Hi Some general comments… I never heard of a RAT with some many questions….we should be sampling….with just barely enough questions to get students ready for what follows If we make RAT’s too long or too hard….the students complaint of….”you are testing before teaching”….actually has some validity I would also be interested in how big your teams are…..if the team is big enough….there is peer pressure during tRAT….to be prepared and contribute….this can take a few RAT cycles to take effect I would also be interested in relative portion of the course grade that is allocated to the RATs…too little…nobody prepares….too much….RATs become high stakes testing We use both 4 and 5 distractor questions….depends on the instructor I use 4 distractor….because my RATs are short a low stakes….I don’t burn up student goodwill before the 4S activities….I actually don’t worry about guessing because tRAT peer pressure often corrects the preparation issues When I get the 4S activities right….students just want to get past the RAT and into all the fun of the 4S activities Typically our iRAT averages are 60-70% and tRATs 90-100% Cheers Jim [cid:0FCCEEB7-A6BD-4047-924B-70E1CA322864] Jim Sibley Director [cid:31A665A0-B81A-48B4-9608-F43FDCDC0025] http://cis.apsc.ubc.ca/ Faculty of Applied Science University of British Columbia CEME 1214-6250 Applied Science Lane Vancouver, BC Canada V6T 1Z4 Phone 604.822.9241 Email: [log in to unmask]<applewebdata:[log in to unmask]> Check out my book Getting Started with Team–Based Learning<http://www.learntbl.ca> Check out my TBL website at www.learntbl.ca<http://www.learntbl.ca> © Copyright 2015, Jim Sibley, All rights reserved The information contained in this e-mail message and any attachments (collectively "message") is intended only for the personal and confidential use of the recipient (or recipients) named above. If the reader of this message is not the intended recipient, you are hereby notified that you have received this message in error and that any review, use, distribution, or copying of this message is strictly prohibited. If you have received this in error, please notify the sender immediately by e-mail, and delete the message. From: "J.A. Vos" <[log in to unmask]<mailto:[log in to unmask]>> Date: Monday, July 18, 2016 at 5:55 AM To: James Sibley <[log in to unmask]<mailto:[log in to unmask]>>, "[log in to unmask]<mailto:[log in to unmask]>" <[log in to unmask]<mailto:[log in to unmask]>> Subject: RE: iRAT and tRAT scores correcting for guessing? Hi, I’m sorry, my question is not clear enough . I’ll clarify it. When a student answers a one-best-answer item with options and he/she knows nothing about the subject, he/she can always guess what the right answer is by putting one of the options right. When an exam consists of one-best-answer items we are used to correct the exam score for guessing. A student normally pass the exam when he answers 55% of the items correct. Each right answer is one point, a wrong answer is no point. Because of the probality of guessing for exams with one-best-answer items a student should answer more items right than just the 55% of the items to pass the exam. Exactly, the score should be the guessing score plus 55% of the max score minus the guessing score. An example: A exam consists of 40 one-best-answer items, all with 4 options. Each right answer gives 1 point. The max score is 40 points. When a student answers the questions only by guessing he can get an exam score of 10 points (= 1Ž4 * 40). To pass the exam the student should answer 26,5 items right (= 10 + 55% * (40-10)). In our TBL-module all the RAT questions are one-best-answer items with 4 options. In the iRAT a student can guess an answer. There is a chance of 25% that the answer is right. Also in the tRAT the team can guess the answer, for the first answer there is a chance of 25% that the answer is right. When the first answer is wrong, a team can try again to give the right answer. For the second effort there are still 3 options left, so there is a chance of 33% that the second answer is right. And so on for the third effort. When the iRAT and the tRAT were exams, we should set a pass score taking into account the guessing score. And now my question: What’s your way of calculating the score to pass (or the grades of) the iRAT/tRAT and what’s your opinion in taking into account the score for guessing? Is there any difference between the iRAT and the tRAT? It would be very helpful when I can gain insight in your practice. I hope this explanation will clarify my question. Kind regards, Jacqueline Van: Team-Based Learning [mailto:[log in to unmask]] Namens Sibley, James Edward Verzonden: vrijdag 15 juli 2016 15:36 Aan: [log in to unmask]<mailto:[log in to unmask]> Onderwerp: Re: iRAT end tRAT correcting for guessing? Hi Can you explain a bit more about "correct scores for guessing" I am not not quite sure what that is.....are you talking about confidence testing where student spread their points across all dis tractors ...or something else Take care Jim Jim Sibley Author of Getting Started with Team-Based Learning Visit my website at learntbl.ca<http://learntbl.ca> Sorry for brief message -sent from my iPad On Jul 15, 2016, at 6:25 AM, J.A. Vos <[log in to unmask]<mailto:[log in to unmask]>> wrote: Dear collegues, I wonder what your practice is in calculating the iRAT and the tRAT grade of a TBL-module. Are you used to correct the scores for guessing? Kind regards, Jacqueline Vos the Netherlands ________________________________ AMC Disclaimer : https://www.amc.nl/disclaimer ________________________________ ________________________________ To unsubscribe from the TEAMLEARNING-L list, please click here.<https://lists.ubc.ca/scripts/wa.exe?SUBED1=TEAMLEARNING-L&A=1> Further information about the UBC Mailing Lists service can be found on the UBC IT website. ________________________________ To unsubscribe from the TEAMLEARNING-L list, please click here.<https://lists.ubc.ca/scripts/wa.exe?SUBED1=TEAMLEARNING-L&A=1> Further information about the UBC Mailing Lists service can be found on the UBC IT website. ######################################################################## To unsubscribe from the TEAMLEARNING-L list, please click the following link: https://lists.ubc.ca/scripts/wa.exe?SUBED1=TEAMLEARNING-L&A=1 Further information about the UBC Mailing Lists service can be found on the UBC IT website.