'Stability' of Assessment: Extending the Utility Equation
The COVID-19 pandemic has brought many challenges to medical education, necessitating a rapid transition to digital delivery. The widespread move to online exams has introduced novel risks, including the risk of catastrophic IT failure. These are not ‘black swan’ events &ndas...
Main Authors: | , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
F1000 Research Ltd
2021-06-01
|
Series: | MedEdPublish |
Subjects: | |
Online Access: | https://www.mededpublish.org/Manuscripts/4162 |
_version_ | 1818350209586954240 |
---|---|
author | Tarun Sen Gupta Eugene Wong Deepak Doshi Richard Hays |
author_facet | Tarun Sen Gupta Eugene Wong Deepak Doshi Richard Hays |
author_sort | Tarun Sen Gupta |
collection | DOAJ |
description | The COVID-19 pandemic has brought many challenges to medical education, necessitating a rapid transition to digital delivery. The widespread move to online exams has introduced novel risks, including the risk of catastrophic IT failure. These are not ‘black swan’ events – something so unexpected and devastating that we could not anticipate them and prepare accordingly. The phrase ‘black elephants’, a cross between a black swan and ‘the elephant in the room’ has been coined to describe these events.
Moving to high-stakes online examinations introduces another element that needs to be considered and managed: the ‘stability’ of the assessment format used. This dimension incorporates notions of ‘platform reliability’ and ‘internal risk management’ and can be caused by both unplanned events eg IT failures, and planned events like security breaches
Developing approaches to mitigate this new risk suggests another dimension to the well-known assessment ‘utility equation’: stability of the platform used. This paper explores the concept of stability from the perspectives of educational institutions and candidates and offers some approaches to achieving stability. The delivery of assessment in the digital age, requires the ‘utility equation’ to be recalibrated and establishment of a new “sweet spot” for each assessment program.
|
first_indexed | 2024-12-13T18:18:13Z |
format | Article |
id | doaj.art-c6724db8e0384a14be812bced83bf0e7 |
institution | Directory Open Access Journal |
issn | 2312-7996 |
language | English |
last_indexed | 2024-12-13T18:18:13Z |
publishDate | 2021-06-01 |
publisher | F1000 Research Ltd |
record_format | Article |
series | MedEdPublish |
spelling | doaj.art-c6724db8e0384a14be812bced83bf0e72022-12-21T23:35:47ZengF1000 Research LtdMedEdPublish2312-79962021-06-01101'Stability' of Assessment: Extending the Utility EquationTarun Sen Gupta0Eugene Wong1Deepak Doshi2Richard Hays3James Cook University and The Australian College of Rural & Remote MedicineThe Australian College of Rural & Remote MedicineThe Australian College of Rural & Remote MedicineJames Cook University The COVID-19 pandemic has brought many challenges to medical education, necessitating a rapid transition to digital delivery. The widespread move to online exams has introduced novel risks, including the risk of catastrophic IT failure. These are not ‘black swan’ events – something so unexpected and devastating that we could not anticipate them and prepare accordingly. The phrase ‘black elephants’, a cross between a black swan and ‘the elephant in the room’ has been coined to describe these events. Moving to high-stakes online examinations introduces another element that needs to be considered and managed: the ‘stability’ of the assessment format used. This dimension incorporates notions of ‘platform reliability’ and ‘internal risk management’ and can be caused by both unplanned events eg IT failures, and planned events like security breaches Developing approaches to mitigate this new risk suggests another dimension to the well-known assessment ‘utility equation’: stability of the platform used. This paper explores the concept of stability from the perspectives of educational institutions and candidates and offers some approaches to achieving stability. The delivery of assessment in the digital age, requires the ‘utility equation’ to be recalibrated and establishment of a new “sweet spot” for each assessment program. https://www.mededpublish.org/Manuscripts/4162assessmentutility equationstability |
spellingShingle | Tarun Sen Gupta Eugene Wong Deepak Doshi Richard Hays 'Stability' of Assessment: Extending the Utility Equation MedEdPublish assessment utility equation stability |
title | 'Stability' of Assessment: Extending the Utility Equation |
title_full | 'Stability' of Assessment: Extending the Utility Equation |
title_fullStr | 'Stability' of Assessment: Extending the Utility Equation |
title_full_unstemmed | 'Stability' of Assessment: Extending the Utility Equation |
title_short | 'Stability' of Assessment: Extending the Utility Equation |
title_sort | stability of assessment extending the utility equation |
topic | assessment utility equation stability |
url | https://www.mededpublish.org/Manuscripts/4162 |
work_keys_str_mv | AT tarunsengupta stabilityofassessmentextendingtheutilityequation AT eugenewong stabilityofassessmentextendingtheutilityequation AT deepakdoshi stabilityofassessmentextendingtheutilityequation AT richardhays stabilityofassessmentextendingtheutilityequation |