Taking OSCE examiner training on the road: reaching the masses

Background: To ensure the rigour of objective structured clinical examinations (OSCEs) in assessing medical students, medical school educators must educate examiners with a view to standardising examiner assessment behaviour. Delivering OSCE examiner training is a necessary yet challenging part of t...

Full description

Bibliographic Details
Main Authors: Katharine Reid, David Smallwood, Margo Collins, Ruth Sutherland, Agnes Dodds
Format: Article
Language:English
Published: Taylor & Francis Group 2016-09-01
Series:Medical Education Online
Subjects:
Online Access:http://med-ed-online.net/index.php/meo/article/view/32389/48957
_version_ 1819064243002015744
author Katharine Reid
David Smallwood
Margo Collins
Ruth Sutherland
Agnes Dodds
author_facet Katharine Reid
David Smallwood
Margo Collins
Ruth Sutherland
Agnes Dodds
author_sort Katharine Reid
collection DOAJ
description Background: To ensure the rigour of objective structured clinical examinations (OSCEs) in assessing medical students, medical school educators must educate examiners with a view to standardising examiner assessment behaviour. Delivering OSCE examiner training is a necessary yet challenging part of the OSCE process. A novel approach to implementing training for current and potential OSCE examiners was trialled by delivering large-group education sessions at major teaching hospitals. Methods: The ‘OSCE Roadshow’ comprised a short training session delivered in the context of teaching hospital ‘Grand Rounds’ to current and potential OSCE examiners. The training was developed to educate clinicians about OSCE processes, clarify the examiners’ role and required behaviours, and to review marking guides and mark allocation in an effort to standardise OSCE processes and encourage consistency in examiner marking behaviour. A short exercise allowed participants to practise marking a mock OSCE to investigate examiner marking behaviour after the training. Results: OSCE Roadshows at four metropolitan and one rural teaching hospital were well received and well attended by 171 clinicians across six sessions. Unexpectedly, medical students also attended in large numbers (n=220). After training, participants’ average scores for the mock OSCE clustered closely around the ideal score of 28 (out of 40), and the average scores did not differ according to the levels of clinical experience. Conclusion: The OSCE Roadshow demonstrated the potential of brief familiarisation training in reaching large numbers of current and potential OSCE examiners in a time and cost-effective manner to promote standardisation of OSCE processes.
first_indexed 2024-12-21T15:27:28Z
format Article
id doaj.art-6708a6cde64d44de82c39cf3ff22bec8
institution Directory Open Access Journal
issn 1087-2981
language English
last_indexed 2024-12-21T15:27:28Z
publishDate 2016-09-01
publisher Taylor & Francis Group
record_format Article
series Medical Education Online
spelling doaj.art-6708a6cde64d44de82c39cf3ff22bec82022-12-21T18:58:52ZengTaylor & Francis GroupMedical Education Online1087-29812016-09-012101510.3402/meo.v21.3238932389Taking OSCE examiner training on the road: reaching the massesKatharine Reid0David Smallwood1Margo Collins2Ruth Sutherland3Agnes Dodds4Department of Medical Education, Melbourne Medical School, The University of Melbourne, Victoria, Melbourne, AustraliaDepartment of Medical Education, Melbourne Medical School, The University of Melbourne, Victoria, Melbourne, AustraliaDepartment of Medical Education, Melbourne Medical School, The University of Melbourne, Victoria, Melbourne, AustraliaDepartment of Medical Education, Melbourne Medical School, The University of Melbourne, Victoria, Melbourne, AustraliaDepartment of Medical Education, Melbourne Medical School, The University of Melbourne, Victoria, Melbourne, AustraliaBackground: To ensure the rigour of objective structured clinical examinations (OSCEs) in assessing medical students, medical school educators must educate examiners with a view to standardising examiner assessment behaviour. Delivering OSCE examiner training is a necessary yet challenging part of the OSCE process. A novel approach to implementing training for current and potential OSCE examiners was trialled by delivering large-group education sessions at major teaching hospitals. Methods: The ‘OSCE Roadshow’ comprised a short training session delivered in the context of teaching hospital ‘Grand Rounds’ to current and potential OSCE examiners. The training was developed to educate clinicians about OSCE processes, clarify the examiners’ role and required behaviours, and to review marking guides and mark allocation in an effort to standardise OSCE processes and encourage consistency in examiner marking behaviour. A short exercise allowed participants to practise marking a mock OSCE to investigate examiner marking behaviour after the training. Results: OSCE Roadshows at four metropolitan and one rural teaching hospital were well received and well attended by 171 clinicians across six sessions. Unexpectedly, medical students also attended in large numbers (n=220). After training, participants’ average scores for the mock OSCE clustered closely around the ideal score of 28 (out of 40), and the average scores did not differ according to the levels of clinical experience. Conclusion: The OSCE Roadshow demonstrated the potential of brief familiarisation training in reaching large numbers of current and potential OSCE examiners in a time and cost-effective manner to promote standardisation of OSCE processes.http://med-ed-online.net/index.php/meo/article/view/32389/48957objective structured clinical examinationsmedical educationexaminer trainingassessmentreliability
spellingShingle Katharine Reid
David Smallwood
Margo Collins
Ruth Sutherland
Agnes Dodds
Taking OSCE examiner training on the road: reaching the masses
Medical Education Online
objective structured clinical examinations
medical education
examiner training
assessment
reliability
title Taking OSCE examiner training on the road: reaching the masses
title_full Taking OSCE examiner training on the road: reaching the masses
title_fullStr Taking OSCE examiner training on the road: reaching the masses
title_full_unstemmed Taking OSCE examiner training on the road: reaching the masses
title_short Taking OSCE examiner training on the road: reaching the masses
title_sort taking osce examiner training on the road reaching the masses
topic objective structured clinical examinations
medical education
examiner training
assessment
reliability
url http://med-ed-online.net/index.php/meo/article/view/32389/48957
work_keys_str_mv AT katharinereid takingosceexaminertrainingontheroadreachingthemasses
AT davidsmallwood takingosceexaminertrainingontheroadreachingthemasses
AT margocollins takingosceexaminertrainingontheroadreachingthemasses
AT ruthsutherland takingosceexaminertrainingontheroadreachingthemasses
AT agnesdodds takingosceexaminertrainingontheroadreachingthemasses