Purpose This school-level longitudinal study examined 7 years of clinical performance data to determine differences (effects) in students and annual changes within a school and between schools; examine how much their predictors (characteristics) influenced the variation in student performance; and calculate estimates of the schools’ initial status and growth.
Methods A school-level longitudinal model was tested: level 1 (between students), level 2 (annual change within a school), and level 3 (between schools). The study sample comprised students who belonged to the CPX Consortium (n=5,283 for 2005~2008 and n=4,337 for 2009~2011).
Results Despite a difference between evaluation domains, the performance outcomes were related to individual large-effect differences and small-effect school-level differences. Physical examination, clinical courtesy, and patient education were strongly influenced by the school effect, whereas patient-physician interaction was not affected much.
Conclusion Student scores are influenced by the school effect (differences), and the predictors explain the variation in differences, depending on the evaluation domain.
Citations
Citations to this article as recorded by
Purpose of medical education Young Joon Ahn Korean Journal of Medical Education.2015; 27(2): 75. CrossRef
Purpose From 2009, the Korean Medical Licensure Exam implemented a clinical performance examination (CPX) that highlighted the importance of good patient-physician relationships in medical education. This study aimed to examine changes in medical students’ attitudes before and after implementation of the CPX in their medical education curriculum.
Methods In 2006 and 2009, 236 fourth-year medial students of C College of Medicine took the Patient Practitioner Orientation Scale (PPOS) by Krupet et al. (2000), which measures patient-centered attitudes in patient-physician relationships. The data were analyzed by independent t-test and two-way analysis of variance using SPSS 21.0.
Results The PPOS scores of year 2006 students were 3.88±0.25 for males and 3.98±0.38 for females. For year 2009 students, males scored 3.81±0.42 and females scored 4.01±0.48. All students had higher Care scores than Share scores (2006: Share, 3.67±0.47 vs. Care, 4.19±0.51; 2009: Share, 3.56±0.34 vs. Care, 4.18±0.53). There were significant differences in PPOS and Share scores by gender before and after the CPX. With regard to Care scores, female students' scores tended to rise and males' scores declined over time.
Conclusion An educational program is needed for students to foster patient-centered attitudes, but gender differences should be taken into account.
Citations
Citations to this article as recorded by
Clinical Performance and Communication Skills of ChatGPT Versus Physicians in Emergency Medicine: Simulated Patient Study ChulHyoung Park, Min Ho An, Gyubeom Hwang, Rae Woong Park, Juho An JMIR Medical Informatics.2025; 13: e68409. CrossRef
Evaluation of the effect of a communication skills course on medical students’ attitude towards patient-centered care: a prospective study Khalid Gaffer Mohamed, Amer Almarabheh, Asim Mukhideer Almughamsi, Hany Atwa, Mohamed Hany Shehata PeerJ.2024; 12: e18676. CrossRef
Dentists’ attitudes toward patient-centered care and its predictors: a cross-sectional study in South Korea Minjung Lee, Youngha Song, Myoungsoon You, Shin-Young Park, Jungjoon Ihm BMC Oral Health.2023;[Epub] CrossRef
Healthcare students’ attitudes towards patient centred care: a systematic review with meta-analysis Geronimo Bejarano, Ben Csiernik, James J. Young, Kent Stuber, Joshua R. Zadro BMC Medical Education.2022;[Epub] CrossRef
Developing a best practice framework for clinical competency education in the traditional East-Asian medicine curriculum Sang Yun Han, Seung-Hee Lee, Han Chae BMC Medical Education.2022;[Epub] CrossRef
Empathy and attitude toward communication skill learning as a predictor of patient-centered attitude: a cross-sectional study of dental students in Korea Minjung Lee, Jungjoon Ihm BMC Medical Education.2021;[Epub] CrossRef
Attitudes Toward Patient-Centered Care in the Mental Care Services in Isfahan, Iran Mohammadali Akkafi, Haniye Sadat Sajadi, Zainab Sadat Sajadi, Edward Krupat Community Mental Health Journal.2019; 55(3): 548. CrossRef
Association of burnout with doctor–patient relationship and common stressors among postgraduate trainees and house officers in Lahore—a cross-sectional study Waqas Ahmad, Huma Ashraf, Afnan Talat, Aleena Ahmad Khan, Ammad Anwar Baig, Iqra Zia, Zohak Sarfraz, Hifsa Sajid, Marium Tahir, Usman Sadiq, Hira Imtiaz PeerJ.2018; 6: e5519. CrossRef
Medical students’ and patients’ perceptions of patient-centred attitude Yera Hur, A Ra Cho, Chang Jin Choi Korean Journal of Medical Education.2017; 29(1): 33. CrossRef
Restoring force of medical school Eun Kyung Chung Korean Journal of Medical Education.2014; 26(2): 81. CrossRef
PURPOSE To evaluate the clinical performance through the Korean Medical Licensing Examination clinical skills assessment (KMLE CSA) this survey was done.
METHODS A survey of 130 interns and residents (46 applicants and 84 non-applicants for the KMLE CSA) at a university hospital in Seoul was conducted in January and February 2012. The data were gathered using a structured and self-administered questionnaire. For the items that assessed the clinical performance of these subjects, we selected 15 items that are mostly frequently used by Delphi's technique, and difficult procedural skills based on the results of medical students' performance. We also used subcomponents of the clinical problems test of the KMLE CSA.
RESULTS The total score on the KMLE CSA improved by 1.33 points (a perfect score is 10), 1.49 points for procedural skills, and 0.84 points for clinical problems by multiple regression analysis. The variables that influenced clinical skills were sex (females had 0.86 more points than males), experience in military or public services (1.04 points higher than persons without experience), and type of school (graduates of medical school had 1.41 more points than graduates of professional graduate school).
CONCLUSION Implementation of the KMLE CSA improved the clinical performance of medical graduates.
Citations
Citations to this article as recorded by
Developing a best practice framework for clinical competency education in the traditional East-Asian medicine curriculum Sang Yun Han, Seung-Hee Lee, Han Chae BMC Medical Education.2022;[Epub] CrossRef
Study on Employee Performance Evaluation Based on Adaptive Feature Selection Fuzzy Algorithm Yuan Qian, Jiemin Yin, R. Mo Mobile Information Systems.2022; 2022: 1. CrossRef
A one-day surgical-skill training course for medical students’ improved surgical skills and increased interest in surgery as a career Ho Seok Seo, Yong Hwa Eom, Min Ki Kim, Young-Min Kim, Byung Joo Song, Kyo Young Song BMC Medical Education.2017;[Epub] CrossRef
Does medical students' clinical performance affect the actual performance during medical internship? ER Han, EK Chung Singapore Medical Journal.2016; 57(02): 87. CrossRef
Reforms of the Korean Medical Licensing Examination regarding item development and performance evaluation Mi Kyoung Yim Journal of Educational Evaluation for Health Professions.2015; 12: 6. CrossRef
Educational intervention as an effective step for reducing blood culture contamination: a prospective cohort study W.B. Park, S.J. Myung, M.-d. Oh, J. Lee, N.-J. Kim, E.-C. Kim, J.S. Park Journal of Hospital Infection.2015; 91(2): 111. CrossRef
Student Centered Medical Education Sun Kim Korean Journal of Medical Education.2012; 24(4): 279. CrossRef
PURPOSE Most medical schools have held clinical skills training programs recently. Despite these educational endeavors, few studies have attempted to address the effect of clinical skills assessments on clinical performance. This study investigated whether repeated experiences with the examination improved medical students' history-taking, physical exams, and patient-physician interactions (PPIs).
METHODS The subjects of the study were 101 4th-year medical students who participated in the clinical performance examination (CPX) 3 times. They completed their core clerkship before acquiring the first CPX scores; we tracked down the scores of three sets of CPX for 3 subdomains (history taking, physical exam, and patient-physician interaction) and investigated the changes in these scores.
Additionally, we classified the research subjects into 3 groups by total CPX score-higher (upper 30%, n=30), intermediate (medium 40%, n=40), and lower (lower 30%, n=30)-and compared the curves for each group.
RESULTS Significant improvements were made on history taking and physical exam (F=130.786/237.358, p<0.01), while proficiency on the PPI declined (F=17.621, p<0.01).
Additionally, scores in all levels improved continuously on history taking and physical exam, while students of the high and low levels experienced a sharp decline on the PPI (F=11.628, p<0.01).
CONCLUSION Improvement in the history-taking score reflects an accumulation of clinical knowledge and clinical exposure.
Improvement on the physical exam score is affected by repeated practice on similar or identical cases and receipt of feedback. That PPI can deteriorate might be an effect of one's negative experience in a clinical clerkship.
Citations
Citations to this article as recorded by
Developing a best practice framework for clinical competency education in the traditional East-Asian medicine curriculum Sang Yun Han, Seung-Hee Lee, Han Chae BMC Medical Education.2022;[Epub] CrossRef
Effects of Module Development and Role Play Course on Clinical Practice Examination Scores during a 4th Year Clerkship Kyong-Min Park, Kye-Yeung Park, Nam-Eun Kim, Bong-Kyung Seo, Hoon-Ki Park, Hwan-Sik Hwang Korean Journal of Family Medicine.2018; 39(1): 23. CrossRef
Comparison of Patient-Physician Interaction Scores of Clinical Practice Examination between Checklists and Rating Scale Nam Eun Kim, Hoon Ki Park, Kyong Min Park, Bong Kyung Seo, Kye Yeung Park, Hwan Sik Hwang Korean Journal of Family Medicine.2018; 39(2): 96. CrossRef
The Effects of Preclinical Clinical Performance Examination on Nursing Students' Confidence in Nursing Skills and Critical Thinking Competence Jeong Sook Park, Mi Jung Choi, Soon Yang Jang The Journal of Korean Academic Society of Nursing Education.2015; 21(1): 75. CrossRef
Predictors of clinical practice examination scores of fourth year medical students after core clinical clerkships Kye-Yeung Park, Hoon-Ki Park, Jong-Hoon Kim, Hwan-Sik Hwang Korean Journal of Medical Education.2015; 27(4): 275. CrossRef
Changes in medical students' patient-centeredness attitudes by implementation of clinical performance examination Yera Hur, Sun Kim, Joo Hyun Park, A-Ra Cho, Chang Jin Choi Korean Journal of Medical Education.2014; 26(2): 99. CrossRef
Student Satisfaction Study of Clinical Skills Training in Korean Medical Education Sung Bo Sim, Ji Hyeon Kweon, Hyung Woo Kim, Jin Woo Hong, Sang Woo Shin Journal of Korean Medicine.2013; 34(3): 37. CrossRef
Conflict of Interest in Medical Practice and Research Young Hoon Youn, Ilhak Lee The Korean Journal of Gastroenterology.2012; 60(3): 149. CrossRef
Improvement in Clinical Performance of Interns and Residents through Clinical Skills Assessment of the Korean Medical Licensing Examination Su Mi Kim, Incheol Park, Hoo-Sun Chang, Eun-Cheol Park Korean Journal of Medical Education.2012; 24(4): 329. CrossRef
Medical Education - Beyond the Evaluation of Intellectual Competency Sun Kim Korean Journal of Medical Education.2011; 23(3): 157. CrossRef
PURPOSE The patient-physician interaction (PPI) is a critical part of the clinical encounter. Recent studies have emphasized the importance of the emotional intelligence (EI) of physician in the PPI. Despite emphasizing the EI, previous studies offer limited evidence regarding the effect of a student's EI on the PPI. The purpose of this study is to explore the differences in EI depending on the demographics of medical students and the correlation between EI and PPI scores.
METHODS The sample was 85 fourth-grade medical students.
Prior to taking a 12-station clinical performance examination, the students completed questionnaires on their own perception of the EI, which included 5 domains and 50 items. The tool that was used to assess the level of EI was Moon's modified version of the EI test for adults. We investigated differences in EI depending on the demographics of medical students by ANOVA and noted a correlation between EI and PPI scores by stepwise multiple regression analysis.
RESULTS This study found that females or graduate entry students have higher EI scores and that 25 to 30-year-old students have higher EI scores than aged under 25 years. The PPI scores correlated positively with total EI scores (r=0.32) and 2 subdomains (perception and expression of emotion, r=0.26; empathy, r=0.33). Two subdomains were the best predictors of PPI score (R2=0.171).
CONCLUSION EI correlates significantly with PPI score and affects it. We conclude that EI is a key influence of the PPI. Further research is required to explore whether this is a consistent effect.
Citations
Citations to this article as recorded by
Investigation into the correlation between humanistic care ability and emotional intelligence of hospital staff Jingjing Ma, Wentao Peng, Jihong Pan BMC Health Services Research.2022;[Epub] CrossRef
The role of emotional competencies in predicting medical students’ attitudes towards communication skills training Hélène Givron, Martin Desseilles Patient Education and Counseling.2021; 104(10): 2505. CrossRef
Assessing the Validity of the Preclinical Objective Structured Clinical Examination Using Messick’s Validity Framework Hye-Yoon Lee, So-Jung Yune, Sang-Yeoup Lee, Sunju Im Korean Medical Education Review.2021; 23(3): 185. CrossRef
Understanding medical students’ empathy based on Enneagram personality types HyeRin Roh, Kyung Hye Park, Hyo Jeong Ko, Dong Kyu Kim, Han Bin Son, Dong Hyeok Shin, Seung Hyeon Lee, Hee Young Jung, Dong Heo Korean Journal of Medical Education.2019; 31(1): 73. CrossRef
Medical students’ empathy and its effect on the physicianpatient relationship Min Young Chun, Sang Ho Yoo, Hoon-Ki Park Korean Journal of Medical Education.2015; 27(4): 283. CrossRef
Validating relationships among attachment, emotional intelligence and clinical communication M Gemma Cherry, Ian Fletcher, Helen O'Sullivan Medical Education.2014; 48(10): 988. CrossRef
The influence of medical students’ and doctors’ attachment style and emotional intelligence on their patient–provider communication Mary Gemma Cherry, Ian Fletcher, Helen O'Sullivan Patient Education and Counseling.2013; 93(2): 177. CrossRef
Medical Education - Beyond the Evaluation of Intellectual Competency Sun Kim Korean Journal of Medical Education.2011; 23(3): 157. CrossRef
PURPOSE The purpose of this study is to test the reliability of the clinical performance examination (CPX) using Generalizability theory (G-theory). Through G-theory, the effects of not only students and tasks but also the school will be analyzed as primary sources of error, which can affect the interpretation of the reliability of the CPX.
METHODS One thousand three hundred nineteen students from 16 medical schools that participated in the Seoul-Gyeonggi CPX Consortium 2008 were enrolled. In our research design, we suppose that student is nested within school and crossed with task. Data analysis was conducted with urGenova.
RESULTS According to our analysis, the percentage of error variance was 6.2% for school, 14.9% for student nested within school, 14.4% for task, and 3% for interaction between school and task. An effect of school on students was observed, but the interaction between task and school was insignificant. When student is nested within school, the universe score decreased and the g-coefficient was less than the g-coefficient of the p x t (p: studentm, t: task) design.
CONCLUSION The results show that generalizability theory is useful in detecting various error components in the CPX.
Using the generalizability theory to improve the technical quality of performance assessments provides us with greater information compared with traditional test theories.
Citations
Citations to this article as recorded by
Can disclosure of scoring rubric for basic clinical skills improve objective structured clinical examination? Su Jin Chae, Miran Kim, Ki Hong Chang Korean Journal of Medical Education.2016; 28(2): 179. CrossRef
A school-level longitudinal study of clinical performance examination scores Jang Hee Park Korean Journal of Medical Education.2015; 27(2): 107. CrossRef
Experience of clinical skills assessment in the Busan-Gyeongnam Consortium Beesung Kam, Young Rim Oh, Sang Hwa Lee, Hye Rin Roh, Jong Ryeal Hahm, Sun Ju Im Korean Journal of Medical Education.2013; 25(4): 327. CrossRef
Teaching Clinical Performance Examination Using Action Learning Techniques Kyung Hye Park, Woo Jeong Kim Korean Journal of Medical Education.2012; 24(1): 23. CrossRef
Introduction and Administration of the Clinical Skill Test of the Medical Licensing Examination, Republic of Korea (2009) Kun Sang Kim Journal of Educational Evaluation for Health Professions.2010; 7: 4. CrossRef
Current Issues in Medical Education: What Is Important? Sun Kim Korean Journal of Medical Education.2010; 22(3): 167. CrossRef
PURPOSE The objective s of this study were: 1) to analyze Clinical Performance Examination(CPX) items using item response theory(IRT) and classical test theory(CTT) and 2) to discuss how to apply and interpret these results in order to improve the quality of CPX items. In addition, we intended to explore statistical procedures in order to merge examination data from several different medical schools.
METHODS The subject of the study was the 2005 CPX examination data from 10 medical schools located in Seoul and the Kyunggi province. For merging data from ten different medical schools, Levene's test for homogeneity of variances was used. Homogeneous group selection was conducted based on ANOVA or Kruskal-Wallis' test and Tukey's multiple comparisons appropriately. The generalized partial credit model was applied to analyze polytomous items and the 2-parameter logistic model was used to analyze dichotomous items.
RESULTS Data from 8 medical schools were incorporated into the analysis. The result of the discrimination index by IRT was different from that of CTT in both polytomous and dichotomous items. Discrimination index from IRT tended to be lower than that of CTT. Difficulty index of dichotomous items of two models was correlated well with each other.
However, for polytomous items, IRT model provided more information than CCT.
CONCLUSION We discovered that the CPX items were mostly easy in terms of difficulty index, and the result from IRT and CCT model did not correlated well in the discrimination index. IRT may provide more detailed information for polytomous items, but the checklist and criteria of scoring system should be cautiously reviewed.
Citations
Citations to this article as recorded by
Psychometric validation of the Korean Pressure Ulcer Knowledge Assessment Tool Jung Mi Ryu, Myoung Soo Kim, Jung Yoon Kim Journal of Wound Care.2023; 32(3): 172. CrossRef
Development of a high-risk neonatal infection control competency scale Mi Yu, Hyunju Kang, Jisun Park, Miran Yang Journal of Child Health Care.2021; 25(3): 393. CrossRef
The relationship between classical item characteristics and item response time on computer-based testing Yoo-mi Chae, Seok Gun Park, Ilyong Park Korean Journal of Medical Education.2019; 31(1): 1. CrossRef
Effectiveness of Medical Education Assessment Consortium Clinical Knowledge Mock Examination (2011‐2016) Sang Yeoup Lee, Yeli Lee, Mi Kyung Kim Korean Medical Education Review.2018; 20(1): 20. CrossRef
PURPOSE The purpose of this study is to evaluate the accuracy of standardized patients'(SP) rating according to the order of examinees in clinical performance examination.
METHODS In the clinical performance examination which was administered in 2005 at Seoul National University College of Medicine, each SP evaluated 16 students consecutively. For all 16 SPs(2 SPs per station), accuracy of rating was evaluated by comparing the individual records of each SP to the 'recording keys' made by two SPs from reviewing a video recording of performances by examinees.
RESULTS The average number of items incorrectly rated by SP was 3.8(range, 0~12), 2.8 in female SPs and 4.8 in male SPs(p<0.001). No statistical correlation was observed between the number of errors and the order of examinees(p=0.843). Even after stratification by gender or age of the SPs or domains of examination, the number of items incorrectly rated did not differ significantly according to the order of examinees.
CONCLUSION An increase in SP's rating error with time after the start of examinations was not observed within the 16 consecutive encounters in clinical performance examination.
The effect of SP's fatigue on the accuracy of simulation as an examination progresses remains to be studied.
Citations
Citations to this article as recorded by
The Change of CPX Scores according to Repeated CPXs Yoon Hee Lee, Jae Hyun Park, Jin Kyung Ko, Hyo Bin Yoo Korean Journal of Medical Education.2011; 23(3): 193. CrossRef
PURPOSE This study was designed to investigate the effects of information sharing between students on results of clinical performance examination (CPX).
METHODS 143 third-year students, who completed their core clinical clerkship, were randomly assigned to one day of a 3-day, 6 station CPX. Station checklists, scored by the SP(s), consisted of history taking, physical examination, information sharing, clinical courtesy and patient-physician interaction. We compared the CPX station scores, CPX domain scores, self assessment scores and GPA of the three groups tested on different days with ANOVA, and analyzed the differences in CPX scores, after controlling for GPA, with ANCOVA. The correlations among the CPX total and domain scores, self assessment and the GPA of the 3rd year students were calculated. Data regarding information sharing between students and self-assessment were obtained through student questionnaires.
RESULTS CPX total scores, self assessment scores and GPA of 3rd year students from day-2 were significantly higher than scores from day-1 or day-3. Checklist analysis showed that PE, CC and PPI scores were significantly higher on day-2, but Hx and IS scores were not significantly different.
Results from questionnaires showed that 43% of students shared evaluation information. And CPX total scores had little correlation with self assessment scores. GPA of 3rd year students showed a similar pattern with the CPX totalscore.
CONCLUSION There is information sharing occurring between students during clinical performance examinations. Although there are significant differences in CPXscores for the treatment group, it seemed that CPX scores are not affected by information sharing between students. Reliability of information sharing from other students is low. The generalization of this study should be interpreted carefully.
Citations
Citations to this article as recorded by
Necessity of introducing postencounter note describing history and physical examination at clinical performance examination in Korea Jonghoon Kim Korean Journal of Medical Education.2014; 26(2): 107. CrossRef
Comprehension of Patient-Physician Interaction through Analysis of Relationships between Domains in Clinical Performance Examination Jae Jin Han, Myoung Jin Lee, Hyun-jung Im Korean Journal of Medical Education.2010; 22(3): 177. CrossRef
Does sharing information before a clinical skills examination impact student performance? Jong Hoon Kim Medical Teacher.2010; 32(9): 747. CrossRef
Correlations of Information Gathering Scores between Checklists and Interstation Works in a Clinical Performance Examination Jong Hoon Kim Korean Medical Education Review.2010; 12(2): 19. CrossRef
Effects of Case Type and Standardized Patient Gender on Student Performance in a Clinical Performance Examination Jonghoon Kim, Kiyoung Lee, Dongmi Yoo, Eunbae Yang Korean Journal of Medical Education.2007; 19(1): 23. CrossRef
PURPOSE Recently, the clinical performance examination (CPX) using standardized patients has been introduced to several Korean medical schools. The purpose of this paper is to evaluate the correlation of CPX scores with the scores of other clinical clerkship assessments and written examinations. METHODS: We evaluated the correlation of the scores of CPX, which was administered to third-year medical students (n=230) at Seoul National University College of Medicine in January 2005, with the scores of a slide examination in internal medicine, an objective structured clinical examination (OSCE) in pediatrics and obstetrics/gynecology, and the written examinations in internal medicine and general surgery. RESULTS: CPX scores showed a mild correlation with the scores of the slide examination in internal medicine and OSCE in pediatrics and obstetrics/gynecology (r=0.19, 0.28, 0.30). CPX scores were also mildly correlated with written examination scores in internal medicine but not associated with those in general surgery. CONCLUSION: Considering the mild correlation of CPX scores with scores of other clinical clerkship assessments and written examinations, CPX should be affirmatively considered as an examination complementary to previous examinations.
Citations
Citations to this article as recorded by
Effects of Module Development and Role Play Course on Clinical Practice Examination Scores during a 4th Year Clerkship Kyong-Min Park, Kye-Yeung Park, Nam-Eun Kim, Bong-Kyung Seo, Hoon-Ki Park, Hwan-Sik Hwang Korean Journal of Family Medicine.2018; 39(1): 23. CrossRef
Comparative study between an intensive small group teaching and a 1-year clinical practice on OSCE Sinjae Kim, Minhwan Park, Ji-Hyun Seo, Hyang-Ok Woo, Hee-Shang Youn, Jung Je Park, Sea-Yuoug Jeon, Jung Seok Hwa, Patricia Mullan, Larry D. Gruppen Kosin Medical Journal.2018; 33(2): 181. CrossRef
The relationship between problem-based learning and clinical performance evaluations Sun-A Oh, Eun-Kyung Chung, Eui-Ryoung Han Korean Journal of Medical Education.2015; 27(3): 195. CrossRef
Predictors of clinical practice examination scores of fourth year medical students after core clinical clerkships Kye-Yeung Park, Hoon-Ki Park, Jong-Hoon Kim, Hwan-Sik Hwang Korean Journal of Medical Education.2015; 27(4): 275. CrossRef
A Study on the Cognitive Coping Strategies by Job Stress Level of Call Center Workers Jung-Im Kim, Soon-Lae Kim, Jin-Hwa Lee Korean Journal of Occupational Health Nursing.2013; 22(3): 257. CrossRef
Correlation of CPX Scores with the Scores on Written Multiple-Choice Examinations on the Certifying Examination for Family Medicine in 2009 to 2011 Jung Jin Cho, Ji Yong Kim, Hoon Ki Park, In Hong Hwang Korean Journal of Medical Education.2011; 23(4): 315. CrossRef
Relationship between the Content of the Medical Knowledge Written Examination and Clinical Skill Score in Medical Students Jee-Young Hwang, Hwee-Soo Jeong Korean Journal of Medical Education.2011; 23(4): 305. CrossRef
Clinical Performance Examination Utilizing Standardized Patients in Board Examination: Based on the Board Examination of Korean Neurological Association for Three Years Beom Joon Kim, Jung-Joon Sung, Hoon Ki Park, Dae-Won Seo, Chin-Sang Chung, Byung-Woo Yoon Korean Journal of Medical Education.2011; 23(2): 127. CrossRef
Correlations of Communication and Interpersonal Skills between Medical Students and Residents Wan Beom Park, Sae Ra Phyo, Eun Young Jang, Seok Hoon Kang, Sun Jung Myung, Hee Young Shin, Yoon-Seong Lee, Jwa-Seop Shin Korean Journal of Medical Education.2010; 22(4): 269. CrossRef
Correlations of Clinical Assessment Tools with Written Examinations Eun Jeong Choi, Sung Sunwoo Korean Journal of Medical Education.2009; 21(1): 43. CrossRef
Relationship between the Clinical Performance Examination and Associated Variables Kwi Hwa Park, Wook-Jin Chung, Duho Hong, Woon Kee Lee, Eak Kyun Shin Korean Journal of Medical Education.2009; 21(3): 269. CrossRef
Inter-rater Reliability in a Clinical Performance Examination Using Multiple Standardized Patients for the Same Case Jinkyung Ko, Tai-Young Yoon, Jaehyun Park Korean Journal of Medical Education.2008; 20(1): 61. CrossRef
Effects of Case Type and Standardized Patient Gender on Student Performance in a Clinical Performance Examination Jonghoon Kim, Kiyoung Lee, Dongmi Yoo, Eunbae Yang Korean Journal of Medical Education.2007; 19(1): 23. CrossRef
The Correlation between CPX and Written Examination Scores in Medical Students Yera Hur, Sun Kim, Sung-Whan Park Korean Journal of Medical Education.2007; 19(4): 335. CrossRef
The Correlation between the Scores of Written Examination, the Clinical Clerkship Examination, the Clinical Skill Assessment, and the Graduation Examination of the Medical Students Suk Bong Koh, Hye Jin Park Korean Journal of Medical Education.1970; 21(4): 347. CrossRef
PURPOSE To compare the evaluation results of faculties to those of Standardized Patients (SP) participating in a Clinical Performance Examination (CPX) administered at Ewha Womans University College of Medicine. METHODS: The CPX was taken by 77 fourth year medical students. Cases and checklist were developed by the medical school consortium in capital area. Six cases were used and 24 SPs participated and evaluated the students' performances. The whole session was recorded on videotapes so that 6 medical school faculties could analyze and evaluate the students' performances as well. The results were compared and analyzed by SPSS package. RESULTS: The agreement between the faculties and the SPs was relatively good (r=0.79), but not good enough. In every case, SPs gave higher marks than did the faculties. Clear disease entity cases like "hepatitis" and "anemia" showed better agreement than obscure clinical contexts such as "bad news delivery". Better agreement was seen in the items of physical exam category (r=0.91), but the agreement was very poor in the items of doctor-patient (Dr-Pt) relationship category (r=0.54). The construction of checklist and the character of each evaluation item should influence the differences. CONCLUSION: More detailed guidelines and clear/specific evaluating items are necessary to improve the agreement rate. In certain categories like physical exam and brief history taking, the SP' s evaluation can replace the faculties', but for complex contexts like Dr-Pt relationship.
Citations
Citations to this article as recorded by
A study on evaluator factors affecting physician-patient interaction scores in clinical performance examinations: a single medical school experience Young Soon Park, Kyung Hee Chun, Kyeong Soo Lee, Young Hwan Lee Yeungnam University Journal of Medicine.2021; 38(2): 118. CrossRef
Effect of SEGUE-based communication education on nursing simulation practice: a quasi-experimental design Hae Kyoung Son, Dong Hee Kim Contemporary Nurse.2019; 55(4-5): 330. CrossRef
Comparison of Standardized Patient and Faculty Agreement in Evaluating Nursing Students’ Assessment and Communication Skills Young Ju Kim Journal of Korean Academy of Fundamentals of Nursing.2017; 24(3): 189. CrossRef
The Effect of Recorded Video Monitoring on Students’ Self Reflection of Patient‐Physician Interaction Misun Ju, Jiyeong Hwang, Jaemyung Kim, Jeaku Kang Korean Medical Education Review.2017; 19(2): 83. CrossRef
The Effects of Preclinical Clinical Performance Examination on Nursing Students' Confidence in Nursing Skills and Critical Thinking Competence Jeong Sook Park, Mi Jung Choi, Soon Yang Jang The Journal of Korean Academic Society of Nursing Education.2015; 21(1): 75. CrossRef
Clinical Performance Examination Utilizing Standardized Patients in Board Examination: Based on the Board Examination of Korean Neurological Association for Three Years Beom Joon Kim, Jung-Joon Sung, Hoon Ki Park, Dae-Won Seo, Chin-Sang Chung, Byung-Woo Yoon Korean Journal of Medical Education.2011; 23(2): 127. CrossRef
Content Analysis of Standardized-Patients' Descriptive Feedback on Student Performance on the CPX Young Hee Lee, Young-Mee Lee, Byung Soo Kim Korean Journal of Medical Education.2010; 22(4): 291. CrossRef
Faculty Observer and Standardized Patient Accuracy in Recording Examinees' Behaviors Using Checklists in the Clinical Performance Examination Jaehyun Park, Jinkyung Ko, Sunmi Kim, Hyobin Yoo Korean Journal of Medical Education.2009; 21(3): 287. CrossRef
Correlations of Clinical Assessment Tools with Written Examinations Eun Jeong Choi, Sung Sunwoo Korean Journal of Medical Education.2009; 21(1): 43. CrossRef
Inter-rater Reliability in a Clinical Performance Examination Using Multiple Standardized Patients for the Same Case Jinkyung Ko, Tai-Young Yoon, Jaehyun Park Korean Journal of Medical Education.2008; 20(1): 61. CrossRef
The Accuracy of Standardized Patients' Rating according to the Order of Examinees in Clinical Performance Examination Wan Beom Park, Ah Reum Kim, Sung A Lee, Eun A Kim, Sun-young Chang, Yon Su Kim, Suk Wha Kim, Jwa-Seop Shin, Yoon Sung Lee Korean Journal of Medical Education.2007; 19(1): 39. CrossRef
The Correlation between CPX and Written Examination Scores in Medical Students Yera Hur, Sun Kim, Sung-Whan Park Korean Journal of Medical Education.2007; 19(4): 335. CrossRef
PURPOSE The purpose of the study is to analyse the appropriateness of using standardized patients' (SPs) assessment scores of medical students in clinical performance examination (CPX). METHODS: 110 fourth year medical students in year four were divided into two large groups (group A and group B). Each group of students performed four different cases and overall, eight cases were tested. The examination were done by professors and the SPs using the same examination paper. Test scores were analysed per station and per each test domain. The differences between the two examiners were studied using paired t-test.
RESULTS There were significant differences in the scores given out by the professors' and the SP' s in four out of the eight stations. According to the examination results of each domain, four cases showed significant differences in the history taking category, three cases in the physical examination, one case in the information sharing, four cases in clinical courtesy, and two cases in physician-patient relationship category. Cronbach' s alpha scores of all stations were over 0.6, reflecting that the test items were appropriate for the examination. CONCLUSION: From the result of this study and according to many preceding studies, using SPs' evaluation scores in CPX is appropriate. Some limitation of this study and ideas for improvement in using SPs in CPX are suggested.
Citations
Citations to this article as recorded by
Enhancing healthcare communication education: Standardised patient programmes Pooja A. Nawathe, Alaina Herrington Indian Journal of Anaesthesia.2024; 68(1): 65. CrossRef
Pilot application and Comparative Study between inter-raters in Clinical Performance Examination (CPX) of Ankle Sprain Minjeong Kim Journal of Korean Medicine.2024; 45(3): 112. CrossRef
Effects of using Standardized Patients on Nursing Competence, Communication Skills, and Learning Satisfaction in Health Assessment Sun Ju Choi, Mal Suk Kwon, Seon Hwa Kim, Hyeon Mi Kim, Yang Sook Jung, Geum Yi Jo The Journal of Korean Academic Society of Nursing Education.2013; 19(1): 97. CrossRef
Clinical Performance Examination Utilizing Standardized Patients in Board Examination: Based on the Board Examination of Korean Neurological Association for Three Years Beom Joon Kim, Jung-Joon Sung, Hoon Ki Park, Dae-Won Seo, Chin-Sang Chung, Byung-Woo Yoon Korean Journal of Medical Education.2011; 23(2): 127. CrossRef
Content Analysis of Standardized-Patients' Descriptive Feedback on Student Performance on the CPX Young Hee Lee, Young-Mee Lee, Byung Soo Kim Korean Journal of Medical Education.2010; 22(4): 291. CrossRef
Introduction and Administration of the Clinical Skill Test of the Medical Licensing Examination, Republic of Korea (2009) Kun Sang Kim Journal of Educational Evaluation for Health Professions.2010; 7: 4. CrossRef
The School Effect on the Reliability of Clinical Performance Examination in Medical Schools Mi Kyoung Yim, Gue Min Lee Korean Journal of Medical Education.2010; 22(3): 215. CrossRef
Experience of Clinical Performance Examination in Ethical Dilemma Seo-Young Song, Hye Rin Roh Korean Journal of Medical Education.2008; 20(2): 155. CrossRef
Inter-rater Reliability in a Clinical Performance Examination Using Multiple Standardized Patients for the Same Case Jinkyung Ko, Tai-Young Yoon, Jaehyun Park Korean Journal of Medical Education.2008; 20(1): 61. CrossRef
Effects of Case Type and Standardized Patient Gender on Student Performance in a Clinical Performance Examination Jonghoon Kim, Kiyoung Lee, Dongmi Yoo, Eunbae Yang Korean Journal of Medical Education.2007; 19(1): 23. CrossRef
The Accuracy of Standardized Patients' Rating according to the Order of Examinees in Clinical Performance Examination Wan Beom Park, Ah Reum Kim, Sung A Lee, Eun A Kim, Sun-young Chang, Yon Su Kim, Suk Wha Kim, Jwa-Seop Shin, Yoon Sung Lee Korean Journal of Medical Education.2007; 19(1): 39. CrossRef
The Correlation between CPX and Written Examination Scores in Medical Students Yera Hur, Sun Kim, Sung-Whan Park Korean Journal of Medical Education.2007; 19(4): 335. CrossRef
PURPOSE This study aims to abstract the differences of scores between the clinical instructors and standardized patients (SPs) in a clinical performance examination (CPX) using SPs and to correlate the concordance between the evaluation scores and the school records. METHODS: The CPX was administered in 2003 to a total of thirty-six fifth year medical students at Gachon Medical School. The examination consisted of four cases, and four stations were duplicated, each requiring a total of 7.5 minutes per station.
Evaluation of the student' s performances was conducted by both clinical instructors and SPs using a formatted checklist. Results were analysed by t-test, agreement rates, and Pearson correlation. RESULT: The mean scores given out by the clinical instructors and the SPs for the newly developed case were significantly different, while those scores for pre-existing cases were not in the old cases. The correlation coefficients between these two evaluation groups were relatively high. And agreements between the two evaluation groups were 0.37~0.72. The mean scores among clinical instructors were not significantly different, but the correlation coefficients and agreement rates were relatively high. The correlation between the evaluation scores and school records did not correlate significantly.
CONCLUSION It is concluded that the CPX is a useful tool to measure the students' essential competences in areas of knowledge, skills and attitude during the subinternship stage. In conducting a successful CPX, it is crucial to reconsider the recycling of cases and the selection and training of SPs aside from the development of an objective checklist.
Citations
Citations to this article as recorded by
Relationship between the Content of the Medical Knowledge Written Examination and Clinical Skill Score in Medical Students Jee-Young Hwang, Hwee-Soo Jeong Korean Journal of Medical Education.2011; 23(4): 305. CrossRef
Relationship between the Clinical Performance Examination and Associated Variables Kwi Hwa Park, Wook-Jin Chung, Duho Hong, Woon Kee Lee, Eak Kyun Shin Korean Journal of Medical Education.2009; 21(3): 269. CrossRef
PURPOSE Analysis of the evaluation for clinical performance examination (CPX) using standardized patient (SP) in one medical school was done to compare the evaluations between the staffs and SPs, among the staffs, and among the SPs, and to investigate the correlation between the evaluation scores and the school record. METHODS: Clinical performance examination was done to seventy-nine 4th grade medical students. Checklist was modified from the existing reference and added more items. Three SPs who were non-physician volunteers were trained by authors about what is the disease and how to act the patient and how to evaluate the students.
Three staffs and three SPs both filled up the checklist at the same time right after each student's performance.
RESULTS Agreements between the staffs and the SPs were relatively high enough in the items of physical examination and management but low in the history taking related items although they were statistically significant. In the evaluation between the staffs and the SPs, the mean scores in the management and overall attitude were not significantly different, but, mean scores in the history taking, physical examination and overall skill were significantly different. Among the staffs there were no significant differences in history taking, physical examination, overall attitude, and there were significant differences in patient management and overall skill. Among the SPs there were no significant differences in physical exam, patient management and overall skill, and there were significant differences in history taking and overall attitude. The correlation coefficients between the evaluation scores and school records, between the evaluation scores and written report were relatively low respectively. CONCLUSION: To increase the agreement rates between the staffs and SPs, more training for the staffs and SPs are necessary
Citations
Citations to this article as recorded by
A study on evaluator factors affecting physician-patient interaction scores in clinical performance examinations: a single medical school experience Young Soon Park, Kyung Hee Chun, Kyeong Soo Lee, Young Hwan Lee Yeungnam University Journal of Medicine.2021; 38(2): 118. CrossRef
Students’ self-assessment of achievement of terminal competency and 4-year trend of student evaluation on outcome-based education Sanghee Yeo, Bong Hyun Chang Korean Journal of Medical Education.2019; 31(1): 39. CrossRef
Effect of SEGUE-based communication education on nursing simulation practice: a quasi-experimental design Hae Kyoung Son, Dong Hee Kim Contemporary Nurse.2019; 55(4-5): 330. CrossRef
Effects of Module Development and Role Play Course on Clinical Practice Examination Scores during a 4th Year Clerkship Kyong-Min Park, Kye-Yeung Park, Nam-Eun Kim, Bong-Kyung Seo, Hoon-Ki Park, Hwan-Sik Hwang Korean Journal of Family Medicine.2018; 39(1): 23. CrossRef
Holistic rubric vs. analytic rubric for measuring clinical performance levels in medical students So Jung Yune, Sang Yeoup Lee, Sun Ju Im, Bee Sung Kam, Sun Yong Baek BMC Medical Education.2018;[Epub] CrossRef
Comparison of Standardized Patient and Faculty Agreement in Evaluating Nursing Students’ Assessment and Communication Skills Young Ju Kim Journal of Korean Academy of Fundamentals of Nursing.2017; 24(3): 189. CrossRef
Development and Effects of Simulation Program for Fall Management Mi Yu, Jong Kyung Kim, Se Young Kim, Sung Hyun Cho, Myung Ja Kim, GyeongAe Seomun Journal of Korean Academy of Nursing Administration.2017; 23(5): 548. CrossRef
The relationship between problem-based learning and clinical performance evaluations Sun-A Oh, Eun-Kyung Chung, Eui-Ryoung Han Korean Journal of Medical Education.2015; 27(3): 195. CrossRef
Predictors of clinical practice examination scores of fourth year medical students after core clinical clerkships Kye-Yeung Park, Hoon-Ki Park, Jong-Hoon Kim, Hwan-Sik Hwang Korean Journal of Medical Education.2015; 27(4): 275. CrossRef
Improvement in Clinical Performance of Interns and Residents through Clinical Skills Assessment of the Korean Medical Licensing Examination Su Mi Kim, Incheol Park, Hoo-Sun Chang, Eun-Cheol Park Korean Journal of Medical Education.2012; 24(4): 329. CrossRef
Relationship between the Content of the Medical Knowledge Written Examination and Clinical Skill Score in Medical Students Jee-Young Hwang, Hwee-Soo Jeong Korean Journal of Medical Education.2011; 23(4): 305. CrossRef
Correlation of CPX Scores with the Scores on Written Multiple-Choice Examinations on the Certifying Examination for Family Medicine in 2009 to 2011 Jung Jin Cho, Ji Yong Kim, Hoon Ki Park, In Hong Hwang Korean Journal of Medical Education.2011; 23(4): 315. CrossRef
Development of a Multimedia Learning DM Diet Education Program using Standardized Patients and Analysis of Its Effects on Clinical Competency and Learning Satisfaction for Nursing Students Kyung Sun Hyun, Hyun Sook Kang, Won Ock Kim, Sunhee Park, Jia Lee, Sohyune Sok Journal of Korean Academy of Nursing.2009; 39(2): 249. CrossRef
Correlations of Clinical Assessment Tools with Written Examinations Eun Jeong Choi, Sung Sunwoo Korean Journal of Medical Education.2009; 21(1): 43. CrossRef
Introduction of Objective Structured Clinical Examination (OSCE) to Residency Examination Son Hwan Choi, Suk Bong Koh Korean Journal of Medical Education.2008; 20(4): 343. CrossRef
Inter-rater Reliability in a Clinical Performance Examination Using Multiple Standardized Patients for the Same Case Jinkyung Ko, Tai-Young Yoon, Jaehyun Park Korean Journal of Medical Education.2008; 20(1): 61. CrossRef
The Correlation between CPX and Written Examination Scores in Medical Students Yera Hur, Sun Kim, Sung-Whan Park Korean Journal of Medical Education.2007; 19(4): 335. CrossRef
The Correlation between the Scores of Written Examination, the Clinical Clerkship Examination, the Clinical Skill Assessment, and the Graduation Examination of the Medical Students Suk Bong Koh, Hye Jin Park Korean Journal of Medical Education.1970; 21(4): 347. CrossRef
First
Prev
