Purpose Team-based learning (TBL) is increasingly employed in medical education because of its potential to promote active group learning. In TBL, learners are usually asked to assess the contributions of peers within their group to ensure accountability. The purpose of this study is to assess the validity and reliability of a peer evaluation instrument that was used in TBL classes in a single medical school.
Methods A total of 141 students were divided into 18 groups in 11 TBL classes. The students were asked to evaluate their peers in the group based on evaluation criteria that were provided to them. We analyzed the comments that were written for the highest and lowest achievers to assess the validity of the peer evaluation instrument. The reliability of the instrument was assessed by examining the agreement among peer ratings within each group of students via intraclass correlation coefficient (ICC) analysis.
Results Most of the students provided reasonable and understandable comments for the high and low achievers within their group, and most of those comments were compatible with the evaluation criteria. The average ICC of each group ranged from 0.390 to 0.863, and the overall average was 0.659. There was no significant difference in inter-rater reliability according to the number of members in the group or the timing of the evaluation within the course.
Conclusion The peer evaluation instrument that was used in the TBL classes was valid and reliable. Providing evaluation criteria and rules seemed to improve the validity and reliability of the instrument.
Citations
Citations to this article as recorded by
Peer assessment in collaborative learning: A validated tool to enhance equity and engagement in nursing education Yujing Dong, Fangfang Du, Haiyan Yin, Shizheng Du Teaching and Learning in Nursing.2026; 21(1): e10. CrossRef
Exploring an effective automated grading model with reliability detection for large‐scale online peer assessment Zirou Lin, Hanbing Yan, Li Zhao Journal of Computer Assisted Learning.2024; 40(4): 1535. CrossRef
Improving learning experience through implementing standardized team-based learning process in undergraduate medical education Rebecca Andrews-Dickert, Ranjini Nagaraj, Lilian Zhan, Laura Knittig, Yuan Zhao BMC Medical Education.2024;[Epub] CrossRef
Improving Peer Assessment Validity and Reliability Through a Fuzzy Coherence Measure Mohamed El Alaoui IEEE Transactions on Learning Technologies.2023; 16(6): 892. CrossRef
Preparing first-year engineering students for cooperation in real-world projects Marietjie Havenga, Arthur James Swart European Journal of Engineering Education.2022; 47(4): 558. CrossRef
The impact of asynchronous online anatomy teaching and smaller learning groups in the anatomy laboratory on medical students’ performance during the Covid‐19 pandemic Ming‐Fong Chang, Meng‐Lin Liao, June‐Horng Lue, Chi‐Chuan Yeh Anatomical Sciences Education.2022; 15(3): 476. CrossRef
Reviewing and analyzing peer review Inter-Rater Reliability in a MOOC platform Felix Garcia-Loro, Sergio Martin, José A. Ruipérez-Valiente, Elio Sancristobal, Manuel Castro Computers & Education.2020; 154: 103894. CrossRef
Evaluation of an e‐book assignment using Fink's Taxonomy of Significant Learning among undergraduate dental hygiene students Brian B. Partido, Elizabeth Chartier, Jennifer Jewell Journal of Dental Education.2020; 84(10): 1074. CrossRef
A Novel Grading Strategy for Team‐Based Learning Exercises in a Hands‐on Course in Molecular Biology for Senior Undergraduate Underrepresented Students in Medicine Resulted in Stronger Student Performance Gonzalo A. Carrasco, Kathryn C. Behling, Osvaldo J. Lopez Biochemistry and Molecular Biology Education.2019; 47(2): 115. CrossRef
Effect of problem based learning models on student skills in conducting validity and reliability test of objective question R D Wulaningsih Journal of Physics: Conference Series.2019; 1402(7): 077108. CrossRef
First
Prev
