John Mark,
I've been working with Tracy Knowles and several of her faculty (an Associate Professor of Chemistry and Environmental Science Technology at Bluegrass Community and Technical College) as an external evaluator on their National Science Foundation CCLI grant (which seeks to systematically integrate TBL into several Chemistry and Biology courses).
The primary dependent measure in the evaluation is the "TOTAL UNSATISFACTORY ACHIEVEMENT (operationalized as withdrawal, failure, or unsatisfactory "D" grades). However, we are measuring eleven additional outcomes (I've provided the names of the scales and cronbach's coefficient alpha associated with the scales (n=198) below).
We are very pleased with the results of year one and plan to present at the Florida TBL conference. We are also working on a manuscript for publication.
We adapted several of the measures we used from:
Abdelkhalek N, Hussein A, Gibbs T, Hamdy H. 2009. Team-based learning prepares students for problem-based learning. Med Teach 32(2): 123–129.
Tracy's contact information is provided below:.
Tracy Knowles, Chemistry Coordinator
Associate Professor of Chemistry and Environmental Science Technology
Bluegrass Community and Technical College
234H Oswald Building
470 Cooper Drive
Lexington, KY 40506
859.246.6460
[log in to unmask]<mailto:[log in to unmask]>
==================================================
SCALES
•Positive Attitudes about Learning (n=7, α=.913, range = 1-7)
•Student Motivation (n=8, α=.885, range = 1-7)
•TBL Attitudes (n=11, α=.940, 1-5)
•Value of Teams (n=12, α=.902, range = 1-5) (Molly Espey's (2008) Scale)
•Self Efficacy (n=5, α=.929, range = 1-5)
•Self-Reported Learning (n=9, α=.782, range = 1-5)
•Teacher Caring (n=6, α=.80, range = 1-7)
•Teacher Classroom Management (n=7, α=.938, range = 1-5)
•Teacher Immediacy (n=8, α=.749, range = 1-5)
SINGLE ITEM MEASURES
•Motivation to Excel in College (range = 1 – 7)
•Overall Quality of Group Experiences During Semester (range = 0 – 100)
We've also created several faculty assessment measures (though the sample is small (n=11) and the psychometric properties for the goal structure measures are not acceptable).
Goal Structures for Students: Goal Mastery (n=7; alpha=.873)
Goal Structures for Students: Goal Performance (n=5; alpha =.579)
Goal Structure for Instruction: Goal Mastery (n=4; alpha =.649)
Goal Structure for Instruction: Goal Performance (n=5, alpha =.629)
Personal Teaching Efficacy (n=4, 1, 3, 5, 6, alpha =.888)
Technology Use (n=3; alpha =.890)
Value of Teams (n=9; 3 was reverse coded; alpha =.959)
Satisfaction with the quality of student learning in current classes
Satisfaction with student attendance in current classes
Familiarity with "Creating Significant Learning Experiences" model
Familiarity with Team-Based Learning (TBL) Pedagogy
Hope this helps!
-Derek
Derek R. Lane, Ph.D.
Associate Professor
H. Lester Reynolds Endowed Professor in Engineering
Department of Communication<http://comm.uky.edu/>
310H LCLI Little Library
University of Kentucky<http://www.uky.edu/>
Lexington, KY 40506-0042
Tel: (859) 257-9538
Fax: (859) 257-4103
Email: [log in to unmask]<mailto:[log in to unmask]>
Faculty website: <http://www.uky.edu/~drlane> http://www.uky.edu/~drlane
PROUD TO BE A GREEN DOT SUPPORTER<http://www.uky.edu/StudentAffairs/VIPCenter/index.html>
People rarely succeed unless they have fun in what they are doing. Dale Carnegie
IMPORTANT DISCLAIMER REGARDING THIS TRANSMISSION:
The contents of this email message and any attachments are confidential and intended solely for the addressee(s). The information may also be confidential and legally privileged. This transmission is sent in trust, for the sole purpose of delivery to the intended recipient(s). If you have received this transmission in error, any use, reproduction, or dissemination of this transmission is strictly prohibited. Neither the transmission of this email message and any attachments nor any error in transmission or misdelivery shall constitute waiver of any applicable legal privilege. If you are not the intended recipient, please immediately notify the sender by reply email and delete this message and any attachments.
On Aug 17, 2011, at 3:24 PM, Jackson, John Mark wrote:
Hi all,
I'm looking for some good surveys to get information from students about their TBL experience. At the TBLC meeting in Vegas, a number of folks presented their results from such surveys. I hoped to find them on the TBLC site but didn't see any there…unless I just missed them.
Would anyone mind sharing their survey instruments or point me to where they are located?
Thanks!
John Mark
---------------------------------
John Mark Jackson, OD, MS, FAAO
Southern College of Optometry
(901) 722-3314
Skype: jacksonsco
|
