Self-efficacy and its miscalibration in cricothyroidotomy training

Introduction: Often, trainers use self-assessed competency, or self-efficacy, as a substitute for objective metrics of ability. However, self-efficacy is subject to several cognitive biases like the Dunning-Kruger effect: the tendency for those unskilled at a task to be unaware of their own incompet...

Full description

Bibliographic Details
Main Authors: Dr. Kent C. Etherton, Dr. James P. Bliss, Ms. Jennifer Winner
Format: Article
Language:English
Published: Elsevier 2024-06-01
Series:Human Factors in Healthcare
Subjects:
Online Access:http://www.sciencedirect.com/science/article/pii/S2772501424000034
_version_ 1797295737718964224
author Dr. Kent C. Etherton
Dr. James P. Bliss
Ms. Jennifer Winner
author_facet Dr. Kent C. Etherton
Dr. James P. Bliss
Ms. Jennifer Winner
author_sort Dr. Kent C. Etherton
collection DOAJ
description Introduction: Often, trainers use self-assessed competency, or self-efficacy, as a substitute for objective metrics of ability. However, self-efficacy is subject to several cognitive biases like the Dunning-Kruger effect: the tendency for those unskilled at a task to be unaware of their own incompetence (Kruger & Dunning, 1999). We investigated factors that affect self-efficacy and its calibration with performance. This included examining the role of task knowledge when estimating self-efficacy, using recently proposed analyses to assess the Dunning-Kruger effect (Gignac & Zajenkowski, 2020), and examining how indices of such effects may be partially affected by the simulator one trains with. Methods: We recruited participants (N = 52) from the local population of a Midwest area in the United States. Using didactic training, a subject matter expert trained participants over a series of trials in a laboratory setting to perform cricothyroidotomy. Results: Results indicated the presence of one, but not both indices of Dunning-Kruger effects (i.e., heteroscedasticity, but not quadratic regression), unique variance in self-efficacy accounted for by task knowledge after controlling for performance, and that the Dunning-Kruger indices were affected by one's training simulator. Conclusions: The current study raised issues relating to the nature of Dunning-Kruger analyses, the importance of task knowledge, and how the analyses conducted in the current study can provide trainers and researchers valuable insights to medical trainees. In sum, our results highlight the value in assessing Dunning-Kruger effects in medical training contexts and provide directions for future research on self-efficacy and its calibration with performance.
first_indexed 2024-03-07T21:52:19Z
format Article
id doaj.art-6680286a63904c68ac5d41462e8f2eea
institution Directory Open Access Journal
issn 2772-5014
language English
last_indexed 2024-03-07T21:52:19Z
publishDate 2024-06-01
publisher Elsevier
record_format Article
series Human Factors in Healthcare
spelling doaj.art-6680286a63904c68ac5d41462e8f2eea2024-02-25T04:36:40ZengElsevierHuman Factors in Healthcare2772-50142024-06-015100066Self-efficacy and its miscalibration in cricothyroidotomy trainingDr. Kent C. Etherton0Dr. James P. Bliss1Ms. Jennifer Winner2Corresponding author.; Air Force Research Laboratory, 711 Human Performance Wing Wright-Patterson Air Force Base, Dayton, Ohio, United StatesAir Force Research Laboratory, 711 Human Performance Wing Wright-Patterson Air Force Base, Dayton, Ohio, United StatesAir Force Research Laboratory, 711 Human Performance Wing Wright-Patterson Air Force Base, Dayton, Ohio, United StatesIntroduction: Often, trainers use self-assessed competency, or self-efficacy, as a substitute for objective metrics of ability. However, self-efficacy is subject to several cognitive biases like the Dunning-Kruger effect: the tendency for those unskilled at a task to be unaware of their own incompetence (Kruger & Dunning, 1999). We investigated factors that affect self-efficacy and its calibration with performance. This included examining the role of task knowledge when estimating self-efficacy, using recently proposed analyses to assess the Dunning-Kruger effect (Gignac & Zajenkowski, 2020), and examining how indices of such effects may be partially affected by the simulator one trains with. Methods: We recruited participants (N = 52) from the local population of a Midwest area in the United States. Using didactic training, a subject matter expert trained participants over a series of trials in a laboratory setting to perform cricothyroidotomy. Results: Results indicated the presence of one, but not both indices of Dunning-Kruger effects (i.e., heteroscedasticity, but not quadratic regression), unique variance in self-efficacy accounted for by task knowledge after controlling for performance, and that the Dunning-Kruger indices were affected by one's training simulator. Conclusions: The current study raised issues relating to the nature of Dunning-Kruger analyses, the importance of task knowledge, and how the analyses conducted in the current study can provide trainers and researchers valuable insights to medical trainees. In sum, our results highlight the value in assessing Dunning-Kruger effects in medical training contexts and provide directions for future research on self-efficacy and its calibration with performance.http://www.sciencedirect.com/science/article/pii/S2772501424000034Self-efficacyDunning-Kruger effectOverconfidencecricothyroidotomy
spellingShingle Dr. Kent C. Etherton
Dr. James P. Bliss
Ms. Jennifer Winner
Self-efficacy and its miscalibration in cricothyroidotomy training
Human Factors in Healthcare
Self-efficacy
Dunning-Kruger effect
Overconfidence
cricothyroidotomy
title Self-efficacy and its miscalibration in cricothyroidotomy training
title_full Self-efficacy and its miscalibration in cricothyroidotomy training
title_fullStr Self-efficacy and its miscalibration in cricothyroidotomy training
title_full_unstemmed Self-efficacy and its miscalibration in cricothyroidotomy training
title_short Self-efficacy and its miscalibration in cricothyroidotomy training
title_sort self efficacy and its miscalibration in cricothyroidotomy training
topic Self-efficacy
Dunning-Kruger effect
Overconfidence
cricothyroidotomy
url http://www.sciencedirect.com/science/article/pii/S2772501424000034
work_keys_str_mv AT drkentcetherton selfefficacyanditsmiscalibrationincricothyroidotomytraining
AT drjamespbliss selfefficacyanditsmiscalibrationincricothyroidotomytraining
AT msjenniferwinner selfefficacyanditsmiscalibrationincricothyroidotomytraining