I believe the Fink method requires that a set number of points is evenly divided among teammates. So if you give some of your peers a "9", then you need to give others an "11". You can't give less than the set number in order to secure yourself a higher score. In my experience, the Michaelsen method is the one teams are most likely to "game", since learners often dislike giving discriminating scores. The Fink method allows you to either give everyone the same score, or give discriminating scores, but it does not allow you to give any less than the set number that every student is required to give.
Ruth
Ruth E. Levine MD
Associate Dean, Student Affairs and Admissions
School of Medicine
Clarence Ross Miller Professor of Psychiatry
University of Texas Medical Branch
Ashbel Smith Building, Suite 1.210
Galveston, Texas 77555-1307
409-772-1442 (p)
[log in to unmask]
-----Original Message-----
From: Team-Based Learning <[log in to unmask]> On Behalf Of Mark Stevens
Sent: Thursday, October 31, 2019 5:11 PM
To: [log in to unmask]
Subject: Potential problem with Fink method for peer evaluation
WARNING: This email originated from outside of UTMB's email system. Do not click links or open attachments unless you recognize the sender and know the content is safe.
Hi everyone -
I've been using the Michaelsen method of peer evaluation for the last several years, but this year I decided to try the Fink method for the first time. I'm looking at the results from my class, and I see that most students gave all of their teammates a full score of 10, which was to be expected because that is usually what happens in my classes. But a few students gave each of their teammates a score of less than 10, which was permissible according to the rules but seems potentially problematic now that I think about it.
In the case of one particular student on a team of 6, they gave each of their teammates a 9, whereas all other member of the team gave everyone a 10. As a result, the student who gave 9s ends up receiving a Fink multiplier equal to 1.017 (because their average individual score is greater than the average team score), whereas the students who gave 10s receive a Fink multiplier score equal to 0.997 (because their average individual score is lesser than the average team score). The difference between the multiplier scores is small, but the fact remains that the student who gave 9s ends up receiving a higher multiplier simply by virtue of downgrading their teammates, which doesn't really seem fair or like a desirable feature of peer evaluation. If a student has reason to believe that their teammates will probably give out full scores of 10, then the student could intentionally "game the system" by giving all
sub-10 scores, thereby securing for themselves a higher multiplier.
Has anyone else seen this as a problem? If so, how have you dealt with it?
Thanks,
Mark
--
Mark Stevens, PhD, MCIP
Chair, Masters of Community & Regional Planning Program University of British Columbia
433-6333 Memorial Road
Vancouver, BC V6T 1Z2, Canada
https://nam03.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.scarp.ubc.ca%2Fpeople%2Fmark-stevens&data=02%7C01%7Crlevine%40UTMB.EDU%7C29a9d71b88a744bc87f408d75e4f4505%7C7bef256d85db4526a72d31aea2546852%7C0%7C1%7C637081566869474934&sdata=JQnSoIZQ34DQzKnN0O3xZDG24xMPMobafW5RaSurwjU%3D&reserved=0
604-822-0657
########################################################################
To unsubscribe from the TEAMLEARNING-L list, please click the following link:
https://nam03.safelinks.protection.outlook.com/?url=https%3A%2F%2Flists.ubc.ca%2Fscripts%2Fwa.exe%3FSUBED1%3DTEAMLEARNING-L%26A%3D1&data=02%7C01%7Crlevine%40UTMB.EDU%7C29a9d71b88a744bc87f408d75e4f4505%7C7bef256d85db4526a72d31aea2546852%7C0%7C1%7C637081566869474934&sdata=bQ9cRGDGsx4bQSCci5HGDRB2pDelDDQZ1eb%2FUl5iVwQ%3D&reserved=0
Further information about the UBC Mailing Lists service can be found on the UBC IT website.
########################################################################
To unsubscribe from the TEAMLEARNING-L list, please click the following link:
https://lists.ubc.ca/scripts/wa.exe?SUBED1=TEAMLEARNING-L&A=1
Further information about the UBC Mailing Lists service can be found on the UBC IT website.
|