'Stability' of Assessment: Extending the Utility Equation

The COVID-19 pandemic has brought many challenges to medical education, necessitating a rapid transition to digital delivery. The widespread move to online exams has introduced novel risks, including the risk of catastrophic IT failure. These are not ‘black swan’ events &ndas...

Full description

Bibliographic Details
Main Authors: Tarun Sen Gupta, Eugene Wong, Deepak Doshi, Richard Hays
Format: Article
Language:English
Published: F1000 Research Ltd 2021-06-01
Series:MedEdPublish
Subjects:
Online Access:https://www.mededpublish.org/Manuscripts/4162
_version_ 1818350209586954240
author Tarun Sen Gupta
Eugene Wong
Deepak Doshi
Richard Hays
author_facet Tarun Sen Gupta
Eugene Wong
Deepak Doshi
Richard Hays
author_sort Tarun Sen Gupta
collection DOAJ
description The COVID-19 pandemic has brought many challenges to medical education, necessitating a rapid transition to digital delivery. The widespread move to online exams has introduced novel risks, including the risk of catastrophic IT failure. These are not ‘black swan’ events – something so unexpected and devastating that we could not anticipate them and prepare accordingly. The phrase ‘black elephants’, a cross between a black swan and ‘the elephant in the room’ has been coined to describe these events.   Moving to high-stakes online examinations introduces another element that needs to be considered and managed: the ‘stability’ of the assessment format used. This dimension incorporates notions of ‘platform reliability’ and ‘internal risk management’ and can be caused by both unplanned events eg IT failures, and planned events like security breaches   Developing approaches to mitigate this new risk suggests another dimension to the well-known assessment ‘utility equation’: stability of the platform used. This paper explores the concept of stability from the perspectives of educational institutions and candidates and offers some approaches to achieving stability. The delivery of assessment in the digital age, requires the ‘utility equation’ to be recalibrated and establishment of a new “sweet spot” for each assessment program.  
first_indexed 2024-12-13T18:18:13Z
format Article
id doaj.art-c6724db8e0384a14be812bced83bf0e7
institution Directory Open Access Journal
issn 2312-7996
language English
last_indexed 2024-12-13T18:18:13Z
publishDate 2021-06-01
publisher F1000 Research Ltd
record_format Article
series MedEdPublish
spelling doaj.art-c6724db8e0384a14be812bced83bf0e72022-12-21T23:35:47ZengF1000 Research LtdMedEdPublish2312-79962021-06-01101'Stability' of Assessment: Extending the Utility EquationTarun Sen Gupta0Eugene Wong1Deepak Doshi2Richard Hays3James Cook University and The Australian College of Rural & Remote MedicineThe Australian College of Rural & Remote MedicineThe Australian College of Rural & Remote MedicineJames Cook University The COVID-19 pandemic has brought many challenges to medical education, necessitating a rapid transition to digital delivery. The widespread move to online exams has introduced novel risks, including the risk of catastrophic IT failure. These are not ‘black swan’ events – something so unexpected and devastating that we could not anticipate them and prepare accordingly. The phrase ‘black elephants’, a cross between a black swan and ‘the elephant in the room’ has been coined to describe these events.   Moving to high-stakes online examinations introduces another element that needs to be considered and managed: the ‘stability’ of the assessment format used. This dimension incorporates notions of ‘platform reliability’ and ‘internal risk management’ and can be caused by both unplanned events eg IT failures, and planned events like security breaches   Developing approaches to mitigate this new risk suggests another dimension to the well-known assessment ‘utility equation’: stability of the platform used. This paper explores the concept of stability from the perspectives of educational institutions and candidates and offers some approaches to achieving stability. The delivery of assessment in the digital age, requires the ‘utility equation’ to be recalibrated and establishment of a new “sweet spot” for each assessment program.  https://www.mededpublish.org/Manuscripts/4162assessmentutility equationstability
spellingShingle Tarun Sen Gupta
Eugene Wong
Deepak Doshi
Richard Hays
'Stability' of Assessment: Extending the Utility Equation
MedEdPublish
assessment
utility equation
stability
title 'Stability' of Assessment: Extending the Utility Equation
title_full 'Stability' of Assessment: Extending the Utility Equation
title_fullStr 'Stability' of Assessment: Extending the Utility Equation
title_full_unstemmed 'Stability' of Assessment: Extending the Utility Equation
title_short 'Stability' of Assessment: Extending the Utility Equation
title_sort stability of assessment extending the utility equation
topic assessment
utility equation
stability
url https://www.mededpublish.org/Manuscripts/4162
work_keys_str_mv AT tarunsengupta stabilityofassessmentextendingtheutilityequation
AT eugenewong stabilityofassessmentextendingtheutilityequation
AT deepakdoshi stabilityofassessmentextendingtheutilityequation
AT richardhays stabilityofassessmentextendingtheutilityequation