Assessment methods and the validity and reliability of measurement tools in online objective structured clinical examinations: a systematic scoping review
The coronavirus disease 2019 (COVID-19) pandemic has required educators to adapt the in-person objective structured clinical examination (OSCE) to online settings in order for it to remain a critical component of the multifaceted assessment of a student’s competency. This systematic scoping review a...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Korea Health Personnel Licensing Examination Institute
2021-06-01
|
| Series: | Journal of Educational Evaluation for Health Professions |
| Subjects: | |
| Online Access: | http://www.jeehp.org/upload/jeehp-18-11.pdf |
| _version_ | 1797760286881480704 |
|---|---|
| author | Jonathan Zachary Felthun Silas Taylor Boaz Shulruf Digby Wigram Allen |
| author_facet | Jonathan Zachary Felthun Silas Taylor Boaz Shulruf Digby Wigram Allen |
| author_sort | Jonathan Zachary Felthun |
| collection | DOAJ |
| description | The coronavirus disease 2019 (COVID-19) pandemic has required educators to adapt the in-person objective structured clinical examination (OSCE) to online settings in order for it to remain a critical component of the multifaceted assessment of a student’s competency. This systematic scoping review aimed to summarize the assessment methods and validity and reliability of the measurement tools used in current online OSCE (hereafter, referred to as teleOSCE) approaches. A comprehensive literature review was undertaken following the Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews guidelines. Articles were eligible if they reported any form of performance assessment, in any field of healthcare, delivered in an online format. Two reviewers independently screened the results and analyzed relevant studies. Eleven articles were included in the analysis. Pre-recorded videos were used in 3 studies, while observations by remote examiners through an online platform were used in 7 studies. Acceptability as perceived by students was reported in 2 studies. This systematic scoping review identified several insights garnered from implementing teleOSCEs, the components transferable from telemedicine, and the need for systemic research to establish the ideal teleOSCE framework. TeleOSCEs may be able to improve the accessibility and reproducibility of clinical assessments and equip students with the requisite skills to effectively practice telemedicine in the future. |
| first_indexed | 2024-03-12T18:56:25Z |
| format | Article |
| id | doaj.art-658b49a25c234d49a30c795ec4e31e3f |
| institution | Directory Open Access Journal |
| issn | 1975-5937 |
| language | English |
| last_indexed | 2024-03-12T18:56:25Z |
| publishDate | 2021-06-01 |
| publisher | Korea Health Personnel Licensing Examination Institute |
| record_format | Article |
| series | Journal of Educational Evaluation for Health Professions |
| spelling | doaj.art-658b49a25c234d49a30c795ec4e31e3f2023-08-02T06:49:05ZengKorea Health Personnel Licensing Examination InstituteJournal of Educational Evaluation for Health Professions1975-59372021-06-011810.3352/jeehp.2021.18.11403Assessment methods and the validity and reliability of measurement tools in online objective structured clinical examinations: a systematic scoping reviewJonathan Zachary Felthun0Silas Taylor1Boaz Shulruf2Digby Wigram Allen3School of Medicine, The University of New South Wales, Kensington, NSW, AustraliaOffice of Medical Education, University of New South Wales, Sydney, NSW, AustraliaOffice of Medical Education, University of New South Wales, Sydney, NSW, AustraliaSchool of Medicine, The University of New South Wales, Kensington, NSW, AustraliaThe coronavirus disease 2019 (COVID-19) pandemic has required educators to adapt the in-person objective structured clinical examination (OSCE) to online settings in order for it to remain a critical component of the multifaceted assessment of a student’s competency. This systematic scoping review aimed to summarize the assessment methods and validity and reliability of the measurement tools used in current online OSCE (hereafter, referred to as teleOSCE) approaches. A comprehensive literature review was undertaken following the Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews guidelines. Articles were eligible if they reported any form of performance assessment, in any field of healthcare, delivered in an online format. Two reviewers independently screened the results and analyzed relevant studies. Eleven articles were included in the analysis. Pre-recorded videos were used in 3 studies, while observations by remote examiners through an online platform were used in 7 studies. Acceptability as perceived by students was reported in 2 studies. This systematic scoping review identified several insights garnered from implementing teleOSCEs, the components transferable from telemedicine, and the need for systemic research to establish the ideal teleOSCE framework. TeleOSCEs may be able to improve the accessibility and reproducibility of clinical assessments and equip students with the requisite skills to effectively practice telemedicine in the future.http://www.jeehp.org/upload/jeehp-18-11.pdfaustraliacovid-19objective structured clinical examinationonline assessmenteducational technology |
| spellingShingle | Jonathan Zachary Felthun Silas Taylor Boaz Shulruf Digby Wigram Allen Assessment methods and the validity and reliability of measurement tools in online objective structured clinical examinations: a systematic scoping review Journal of Educational Evaluation for Health Professions australia covid-19 objective structured clinical examination online assessment educational technology |
| title | Assessment methods and the validity and reliability of measurement tools in online objective structured clinical examinations: a systematic scoping review |
| title_full | Assessment methods and the validity and reliability of measurement tools in online objective structured clinical examinations: a systematic scoping review |
| title_fullStr | Assessment methods and the validity and reliability of measurement tools in online objective structured clinical examinations: a systematic scoping review |
| title_full_unstemmed | Assessment methods and the validity and reliability of measurement tools in online objective structured clinical examinations: a systematic scoping review |
| title_short | Assessment methods and the validity and reliability of measurement tools in online objective structured clinical examinations: a systematic scoping review |
| title_sort | assessment methods and the validity and reliability of measurement tools in online objective structured clinical examinations a systematic scoping review |
| topic | australia covid-19 objective structured clinical examination online assessment educational technology |
| url | http://www.jeehp.org/upload/jeehp-18-11.pdf |
| work_keys_str_mv | AT jonathanzacharyfelthun assessmentmethodsandthevalidityandreliabilityofmeasurementtoolsinonlineobjectivestructuredclinicalexaminationsasystematicscopingreview AT silastaylor assessmentmethodsandthevalidityandreliabilityofmeasurementtoolsinonlineobjectivestructuredclinicalexaminationsasystematicscopingreview AT boazshulruf assessmentmethodsandthevalidityandreliabilityofmeasurementtoolsinonlineobjectivestructuredclinicalexaminationsasystematicscopingreview AT digbywigramallen assessmentmethodsandthevalidityandreliabilityofmeasurementtoolsinonlineobjectivestructuredclinicalexaminationsasystematicscopingreview |