Comparison of students' performance of objective structured clinical examination during clinical practice

Article information

Korean J Med Educ. 2020;32(3):231-235
Publication date (electronic) : 2020 July 21
doi : https://doi.org/10.3946/kjme.2020.168
1Office of Medical Education, Ajou University School of Medicine, Suwon, Korea
2Ajou Center for Clinical Excellence, Ajou University School of Medicine, Suwon, Korea
Corresponding Author: Janghoon Lee (https://orcid.org/0000-0003-4765-9948) Ajou University School of Medicine, 164 World cup-ro, Yeongtong-gu, Suwon 16499, Korea Tel: +82.31.219.5169 Fax: +82.31.219.5169 email: neopedlee@aumc.ac.kr
Received 2020 March 11; Revised 2020 April 20; Accepted 2020 May 25.

Abstract

Purpose

Clinical practice for medical students aims to improve their clinical competency. Since students gain experience in clinical practice, it is assumed that their capacity for care is strengthened. This study aimed to verify whether there is a change in the competency of medical students after clinical practice.

Methods

We assessed the clinical performance of 120 medical students who were enrolled in the fifth year over the academic years 2016–2018. Objective structured clinical examination (OSCE) was used to measure the clinical competency.

Results

The OSCE scores for November fifth grade improved significantly compared to May fifth grade. The scores in September of sixth grade were slightly lower than those of November of fifth grade, but there was no statistically significant difference.

Conclusion

It was confirmed that the clinical practice of fifth-year students improved their clinical competency, but it did not show any significant shift in the clinical competency of sixth-year students. The results of this study suggest that it is very important to organize the curriculum so that students can continue to experience patient-facing care throughout the entire clinical practice course to produce highly qualified physicians.

Introduction

The clinical practice course in medical education aims to train students to have appropriate medical competency for medical care [1]. In clinical practice, students learn clinical diagnosis, clinical skills, and ways to interact with patients as doctors. Patient encounter is the most important part of clinical practice to improve a student’s clinical competency [2].

Clinical experience during clinical practice varies from student to student. Clinical experience can be defined as the student’s experience in clinical settings, including bedside small-group tutorials, ward round, patient pre-consultation, attendance at operations, seeing or learning special procedures, and clinical or paramedical case conference [3]. The study analyzing the relationship between clinical experience and subsequent performance of the students shows mixed results. Previous studies have shown that a greater amount of clinical experience does not necessarily result in good subsequent clinical performance [3], while experiences with real patients may improve clinical competency [4]. However, the number of patient encounters does not necessarily guarantee clinical competency [5,6].

Clinical competency is based on clinical skill, scientific knowledge, and ethical attributes required in clinical settings [7]. The clinical competency of medical students is important in that it affects clinical performance as a doctor after graduation [8]. Measurement of clinical competency can be done through the assessment of the clinical competency of students who have gone through the clinical practice course.

Therefore, the purpose of this study is to compare the student’s performance of objective structured clinical examination (OSCE) before and after clinical experience.

Methods

1. Data collection

The course curriculum of Ajou University School of Medicine covers a total of 6 years: 2 years of premedical, 2 years of preclinical, and 2 years of clinical training. The structure of the clinical practice process is presented in Table 1. The fifth-year clinical practice consists of internal medicine, general surgery, obstetrics and gynecology, pediatrics, and psychiatry, which runs from mid-February to November. The sixth-year runs from mid-January to the end of July, and has required courses in emergency medicine, traumatology, community medicine, radiology, neurology, family medicine, orthopedics, dermatology, urology, ophthalmology, and otorhinolaryngology, and other elective courses.

Clinical Practice Course

In this study, OSCE scores of 120 students who attended fifth and sixth-year in Ajou University School of Medicine in the years 2016–2017, 2017–2018, 2018–2019 were collected and analyzed. The subject distribution is shown in Table 2. The assessment was conducted at the end of May for fifth-year students (at 1/3rd phase of the practice), at the end of fifth-year, and at the end of sixth-year.

Characteristics of Study Participants

2. Outcome measures

OSCE is highly valid for testing and has become a strong indicator of good performance [9]. The OSCE is known as ‘clinical performance examination (CPX)’ in Korea. The OSCE scenario used in this study was developed by the Seoul-Gyeonggi CPX Consortium. It involved examining three cases in May and six cases in November for fifth-year students, and six cases in September for sixth-year students. Each student was given a total of 16 minutes, consisting of 1 minute of case introduction, 10 minutes of patient treatment, and 5 minutes of high-probability diagnosis and planning. The OSCE score is the combined score of history taking, physical examination, interpersonal interactions with standardized patient scores, and assessment hypotheses and planning.

3. Analysis

Descriptive statistical analysis was conducted to examine the distribution of study subjects. Paired t-tests were conducted to analyze the changes in OSCE scores at 3-time points in clinical practice.

4. Compliance with ethical standards

This study was approved by the Institutional Review Board of Ajou University Hospital (ethics consent no., AJIRB-SBR-SUR-19-442). It proceeded with consent exemption.

Results

Table 3 shows that the OSCE scores for three periods increased during fifth year, but did not show a significant change after the sixth grade. As a result of analysis by sub-factor, history taking did not change during the fifth and sixth grades, and physical examination and patient-physician interaction increased during the fifth grade, but there was no significant change after the sixth grade.

Characteristics of Study Participants

Discussion

An analysis of the OCSE scores of medical students showed that the level of clinical competency of students after fifth year clinical practice increased significantly, but the clinical competency after sixth year clinical practice did not vary significantly, when compared to the end of the fifth year. This is in contrast to previous studies, which showed that as the years increase, the achievement level in clinical performance increases [10]. Although the case is different for each test in OSCE used in this study, it can be inferred that score variation according to the case is not large because the average score of all subjects does not differ significantly from test to test. We found that increasing the amount of clinical practice experience do not necessarily improve clinical competency.

In clinical practice in the fifth year, students conduct pre-consultation, write a patient medical record, and develop a diagnosis and treatment plan by taking the history of the patient and conduct physical examinations of outpatients. And students are assigned to serve as primary care physicians for inpatients and brief them at the case conference. Students also conduct clinical performance for standardized patients. Clinical skill training using simulated patients has a positive effect on improving students’ clinical competency [11].

On the other hand, the sixth-grade practice focuses on mastering the specialized knowledge and skills required in each clinic and developing basic skills to be a physician. Compared to the fifth year, the opportunities for patient encounters are relatively low for the students. Such differences in the composition of the practice may have influenced the students’ ability to perform clinical practice such as physical examination and patient-physician interaction. Meeting a sufficient number of patients is essential for improving clinical competency [2]. Gathering relevant information from patients, considering it comprehensively, establishing a diagnostic hypothesis, and making decisions are very important activities in clinical practice [6]. Clinical practice courses should be structured in such a way as to enable students to fully experience the patient-facing situation, so that they become doctors with clinical competency in primary care settings. Also, the number of OSCE experiences is much less than in the fifth grade. OSCE can be a valuable method to improve students’ clinical performance [12].

The findings of this study have implication in that it has been confirmed that the composition of the clerkship course is important for the continuous development of patient care competency of medical students. This study confirmed that it is important to construct a clerkship course so that students can have a patient encounter experience evenly during the clinical practice period in order to ensure for students to be competent in history taking, physical examination, and interaction with patient.

Nevertheless, this study has a limitation in that it lacks a detailed analysis of the contents of the students’ clinical experience, including patient-facing experience, instructors’ supervision or feedback, and so forth. Subsequent studies will need to explore these details of clinical practice as variables and analyze in detail how these variables affect the clinical performance of medical students.

It is very important to organize the curriculum so that students can continue to experience patient-facing care throughout the entire clinical practice course to produce highly qualified physicians. It is necessary to reflect this in clinical department placement and content composition. If it is practically difficult to provide an opportunity to see a real patient, it will be necessary to provide a variety of educational experiences such as training using standardized patients or simulators.

Acknowledgements

None.

Notes

Funding

None.

Conflicts of interest

No potential conflict of interest relevant to this article was reported.

Author contributions

YJH, LSK, KMR, and LJH conceived the study concept and design; YJH analyzed and interpreted the data, draft the manuscript; KMR reviewed and revised the manuscript; and LJH critically revised the manuscript and supervised the study.

References

1. Kramer AW, Jansen JJ, Zuithoff P, et al. Predictive validity of a written knowledge test of skills for an OSCE in postgraduate training for general practice. Med Educ 2002;36(9):812–819.
2. Snell LM, Battles JB, Bedford JA, Washington ET. Verifying the curriculum of a family medicine clerkship. Med Educ 1998;32(4):370–375.
3. Jolly BC, Jones A, Dacre JE, Elzubeir M, Kopelman P, Hitman G. Relationships between students’ clinical experiences in introductory clinical courses and their performances on an objective structured clinical examination (OSCE). Acad Med 1996;71(8):909–916.
4. Rudaz A, Gut AM, Louis-Simonet M, Perrier A, Vu NV, Nendaz MR. Acquisition of clinical competence: added value of clerkship real-life contextual experience. Med Teach 2013;35(2):e957–e962.
5. Ericsson KA. Deliberate practice and the acquisition and maintenance of expert performance in medicine and related domains. Acad Med 2004;79(10 Suppl):S70–S81.
6. Wimmers PF, Schmidt HG, Splinter TA. Influence of clerkship experiences on clinical competence. Med Educ 2006;40(5):450–458.
7. Epstein RM, Hundert EM. Defining and assessing professional competence. JAMA 2002;287(2):226–235.
8. Wallenstein J, Heron S, Santen S, Shayne P, Ander D. A core competency-based objective structured clinical examination (OSCE) can predict future resident performance. Acad Emerg Med 2010;17 Suppl 2:S67–S71.
9. Jefferies A, Simmons B, Tabak D, et al. Using an objective structured clinical examination (OSCE) to assess multiple physician competencies in postgraduate training. Med Teach 2007;29(2-3):183–191.
10. Remmen R, Scherpbier A, van der Vleuten C, et al. Effectiveness of basic clinical skills training programmes: a cross-sectional comparison of four medical schools. Med Educ 2001;35(2):121–128.
11. Taylor S, Haywood M, Shulruf B. Comparison of effect between simulated patient clinical skill training and student role play on objective structured clinical examination performance outcomes for medical students in Australia. J Educ Eval Health Prof 2019;16:3.
12. Nagoshi Y, Cooper LA, Meyer L, et al. Application of an objective structured clinical examination to evaluate and monitor intern’s proficiency of hand hygiene and personal protective equipment use in the United States. J Educ Eval Health Prof 2019;16:31.

Article information Continued

Table 1.

Clinical Practice Course

Year Course (times of preliminary medical examination trials)/term Objective structured clinical examination
Fifth year Internal medicinea) (10 or more times)/14 weeks Nephrology (two cases)
General surgerya) (1 or more times)/5 weeks Obstetrics and gynaecology (three cases)
Obstetrics & gynaecologya) (1 or more times)/5 weeks Pediatrics (three cases)
Pediatricsa) (5 times)/5 weeks Psychiatry (two cases)
Psychiatry/5 weeks
Sixth year
Required courses Emergency medicine/2weeks Orthopaedics (two cases)
Traumatology/2 weeks
Community medicine/2 weeks
Radiology/2 weeks
Neurologya) (1 time)/2 weeks
Family medicinea) (1 time)/2 weeks
Orthopaedics/2 weeks
Dermatologya) (1 or more times)/2 weeks
Urologya) (1 time)/1 week
Ophthalmologya) (1 or more times)/1 week
Otolaryngology/2 weeks
Electives (six choices) Nuclear medicine/2 weeks
Radiation oncology/2 weeks
Physical medicine and rehabilitation/2 weeks
Occupational and environmental medicine/2 weeks
Neurosurgery/2 weeks
Thoracic and cardiovascular surgery/2 weeks
Plastic surgery/1 week
Anaesthesiology/2 weeks
Clinical pathology/1 week
a)

Practice in preliminary medical examination of the outpatient.

Table 2.

Characteristics of Study Participants

Variable No. (%)
Gender
 Male 76 (63.3)
 Female 44 (36.7)
Period of clinical practice
 2016–2017 43 (35.8)
 2017–2018 40 (33.3)
 2018–2019 37 (30.8)

Table 3.

Characteristics of Study Participants

OSCE (n=120) Assessment time
May/fifth year November/fifth year September/sixth year
Totala) 54.94±6.25 59.69±5.55 59.35±7.06
History-taking 64.24±8.38 65.02±7.34 65.68±9.09
Physical examinationa) 39.71±11.75 49.79±11.26 47.96±11.53
Patient-physician interactiona) 60.87±5.73 64.24±5.41 64.42±6.70

Data are presented as mean±standard deviation.

OSCE: Objective structured clinical examination.

a)

May fifth year versus November fifth year; p<0.001.