Development of a novel observed structured clinical exam to assess clinical ultrasound proficiency in undergraduate medical education
Abstract Objectives A pilot study was performed to develop and test an observed structured clinical exam (OSCE) for clinical ultrasound in second-year medical students. The goal was to assess a longitudinal clinical ultrasound curriculum for medical students and to help determine readiness to perfor...
| Main Authors: | , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
SpringerOpen
2023-09-01
|
| Series: | The Ultrasound Journal |
| Subjects: | |
| Online Access: | https://doi.org/10.1186/s13089-023-00337-2 |
| _version_ | 1797577323995725824 |
|---|---|
| author | Andrew Kamilaris Jeffrey A. Kramer Gwen Baraniecki-Zwil Frances Shofer Christy Moore Nova Panebianco Wilma Chan |
| author_facet | Andrew Kamilaris Jeffrey A. Kramer Gwen Baraniecki-Zwil Frances Shofer Christy Moore Nova Panebianco Wilma Chan |
| author_sort | Andrew Kamilaris |
| collection | DOAJ |
| description | Abstract Objectives A pilot study was performed to develop and test an observed structured clinical exam (OSCE) for clinical ultrasound in second-year medical students. The goal was to assess a longitudinal clinical ultrasound curriculum for medical students and to help determine readiness to perform ultrasound during clinical clerkships. Methods The OSCE contained 40 tasks over 30 min in a one-to-one examiner to examinee environment using standardized patients covering cardiac, pulmonary, and inferior vena cava (IVC) ultrasound exams along with 6 critical diagnoses. Examinees were assessed using a binary checklist approach. A two-way ANOVA analysis was performed to determine if there were differences between the day and session the OSCE was administered. Results are presented as mean ± standard deviation. Results One hundred fifty-two students were tested with an overall mean score of 64.9 ± 17.6%. Scores between the cardiac, IVC, and lung sections varied—67.8% ± 18.8%, 62.4% ± 26.2%, and 57.1% ± 20.6%, respectively. One hundred twenty-six (82.9%) answered at least one critical diagnosis incorrectly. Students in the late session performed better than the early session (1: 60% vs 2: 69%, p = .001). Conclusions Students performed better in later sessions. Additionally, the number of questions left blank at the end of the exam suggests that the length of the OSCE should be evaluated. Incorporating critical diagnoses was challenging for examinees. The proposed OSCE is a valuable assessment tool that could be adapted to assess student’s readiness to use clinical ultrasound prior to clerkships. |
| first_indexed | 2024-03-10T22:07:39Z |
| format | Article |
| id | doaj.art-b173cf1187114a01866ebbb14cd597a9 |
| institution | Directory Open Access Journal |
| issn | 2524-8987 |
| language | English |
| last_indexed | 2024-03-10T22:07:39Z |
| publishDate | 2023-09-01 |
| publisher | SpringerOpen |
| record_format | Article |
| series | The Ultrasound Journal |
| spelling | doaj.art-b173cf1187114a01866ebbb14cd597a92023-11-19T12:46:02ZengSpringerOpenThe Ultrasound Journal2524-89872023-09-011511810.1186/s13089-023-00337-2Development of a novel observed structured clinical exam to assess clinical ultrasound proficiency in undergraduate medical educationAndrew Kamilaris0Jeffrey A. Kramer1Gwen Baraniecki-Zwil2Frances Shofer3Christy Moore4Nova Panebianco5Wilma Chan6Department of Emergency Medicine, Yale UniversityDepartment of Emergency Medicine, University of PennsylvaniaDepartment of Emergency Medicine, University of PennsylvaniaDepartment of Emergency Medicine, University of PennsylvaniaDepartment of Emergency Medicine, University of PennsylvaniaDepartment of Emergency Medicine, University of PennsylvaniaDepartment of Emergency Medicine, University of PennsylvaniaAbstract Objectives A pilot study was performed to develop and test an observed structured clinical exam (OSCE) for clinical ultrasound in second-year medical students. The goal was to assess a longitudinal clinical ultrasound curriculum for medical students and to help determine readiness to perform ultrasound during clinical clerkships. Methods The OSCE contained 40 tasks over 30 min in a one-to-one examiner to examinee environment using standardized patients covering cardiac, pulmonary, and inferior vena cava (IVC) ultrasound exams along with 6 critical diagnoses. Examinees were assessed using a binary checklist approach. A two-way ANOVA analysis was performed to determine if there were differences between the day and session the OSCE was administered. Results are presented as mean ± standard deviation. Results One hundred fifty-two students were tested with an overall mean score of 64.9 ± 17.6%. Scores between the cardiac, IVC, and lung sections varied—67.8% ± 18.8%, 62.4% ± 26.2%, and 57.1% ± 20.6%, respectively. One hundred twenty-six (82.9%) answered at least one critical diagnosis incorrectly. Students in the late session performed better than the early session (1: 60% vs 2: 69%, p = .001). Conclusions Students performed better in later sessions. Additionally, the number of questions left blank at the end of the exam suggests that the length of the OSCE should be evaluated. Incorporating critical diagnoses was challenging for examinees. The proposed OSCE is a valuable assessment tool that could be adapted to assess student’s readiness to use clinical ultrasound prior to clerkships.https://doi.org/10.1186/s13089-023-00337-2Medical educationMedical studentsClinical ultrasoundPoint of care ultrasonographyUndergraduate medical education |
| spellingShingle | Andrew Kamilaris Jeffrey A. Kramer Gwen Baraniecki-Zwil Frances Shofer Christy Moore Nova Panebianco Wilma Chan Development of a novel observed structured clinical exam to assess clinical ultrasound proficiency in undergraduate medical education The Ultrasound Journal Medical education Medical students Clinical ultrasound Point of care ultrasonography Undergraduate medical education |
| title | Development of a novel observed structured clinical exam to assess clinical ultrasound proficiency in undergraduate medical education |
| title_full | Development of a novel observed structured clinical exam to assess clinical ultrasound proficiency in undergraduate medical education |
| title_fullStr | Development of a novel observed structured clinical exam to assess clinical ultrasound proficiency in undergraduate medical education |
| title_full_unstemmed | Development of a novel observed structured clinical exam to assess clinical ultrasound proficiency in undergraduate medical education |
| title_short | Development of a novel observed structured clinical exam to assess clinical ultrasound proficiency in undergraduate medical education |
| title_sort | development of a novel observed structured clinical exam to assess clinical ultrasound proficiency in undergraduate medical education |
| topic | Medical education Medical students Clinical ultrasound Point of care ultrasonography Undergraduate medical education |
| url | https://doi.org/10.1186/s13089-023-00337-2 |
| work_keys_str_mv | AT andrewkamilaris developmentofanovelobservedstructuredclinicalexamtoassessclinicalultrasoundproficiencyinundergraduatemedicaleducation AT jeffreyakramer developmentofanovelobservedstructuredclinicalexamtoassessclinicalultrasoundproficiencyinundergraduatemedicaleducation AT gwenbaranieckizwil developmentofanovelobservedstructuredclinicalexamtoassessclinicalultrasoundproficiencyinundergraduatemedicaleducation AT francesshofer developmentofanovelobservedstructuredclinicalexamtoassessclinicalultrasoundproficiencyinundergraduatemedicaleducation AT christymoore developmentofanovelobservedstructuredclinicalexamtoassessclinicalultrasoundproficiencyinundergraduatemedicaleducation AT novapanebianco developmentofanovelobservedstructuredclinicalexamtoassessclinicalultrasoundproficiencyinundergraduatemedicaleducation AT wilmachan developmentofanovelobservedstructuredclinicalexamtoassessclinicalultrasoundproficiencyinundergraduatemedicaleducation |