Performance of a cognitive load inventory during simulated handoffs: Evidence for validity
Background: Advancing patient safety during handoffs remains a public health priority. The application of cognitive load theory offers promise, but is currently limited by the inability to measure cognitive load types. Objective: To develop and collect validity evidence for a revised self-report inv...
| Main Authors: | , , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
SAGE Publishing
2016-12-01
|
| Series: | SAGE Open Medicine |
| Online Access: | https://doi.org/10.1177/2050312116682254 |
| _version_ | 1831834452406304768 |
|---|---|
| author | John Q Young Christy K Boscardin Savannah M van Dijk Ruqayyah Abdullah David M Irby Justin L Sewell Olle Ten Cate Patricia S O’Sullivan |
| author_facet | John Q Young Christy K Boscardin Savannah M van Dijk Ruqayyah Abdullah David M Irby Justin L Sewell Olle Ten Cate Patricia S O’Sullivan |
| author_sort | John Q Young |
| collection | DOAJ |
| description | Background: Advancing patient safety during handoffs remains a public health priority. The application of cognitive load theory offers promise, but is currently limited by the inability to measure cognitive load types. Objective: To develop and collect validity evidence for a revised self-report inventory that measures cognitive load types during a handoff. Methods: Based on prior published work, input from experts in cognitive load theory and handoffs, and a think-aloud exercise with residents, a revised Cognitive Load Inventory for Handoffs was developed. The Cognitive Load Inventory for Handoffs has items for intrinsic, extraneous, and germane load. Students who were second- and sixth-year students recruited from a Dutch medical school participated in four simulated handoffs (two simple and two complex cases). At the end of each handoff, study participants completed the Cognitive Load Inventory for Handoffs, Paas’ Cognitive Load Scale, and one global rating item for intrinsic load, extraneous load, and germane load, respectively. Factor and correlational analyses were performed to collect evidence for validity. Results: Confirmatory factor analysis yielded a single factor that combined intrinsic and germane loads. The extraneous load items performed poorly and were removed from the model. The score from the combined intrinsic and germane load items associated, as predicted by cognitive load theory, with a commonly used measure of overall cognitive load (Pearson’s r = 0.83, p < 0.001), case complexity (beta = 0.74, p < 0.001), level of experience (beta = −0.96, p < 0.001), and handoff accuracy (r = −0.34, p < 0.001). Conclusion: These results offer encouragement that intrinsic load during handoffs may be measured via a self-report measure. Additional work is required to develop an adequate measure of extraneous load. |
| first_indexed | 2024-12-23T04:13:47Z |
| format | Article |
| id | doaj.art-e47c31dcf0a24160aa0e0fe9d6bfbc3a |
| institution | Directory Open Access Journal |
| issn | 2050-3121 |
| language | English |
| last_indexed | 2024-12-23T04:13:47Z |
| publishDate | 2016-12-01 |
| publisher | SAGE Publishing |
| record_format | Article |
| series | SAGE Open Medicine |
| spelling | doaj.art-e47c31dcf0a24160aa0e0fe9d6bfbc3a2022-12-21T18:00:26ZengSAGE PublishingSAGE Open Medicine2050-31212016-12-01410.1177/205031211668225410.1177_2050312116682254Performance of a cognitive load inventory during simulated handoffs: Evidence for validityJohn Q Young0Christy K Boscardin1Savannah M van Dijk2Ruqayyah Abdullah3David M Irby4Justin L Sewell5Olle Ten Cate6Patricia S O’Sullivan7Hofstra Northwell School of Medicine, Zucker Hillside Hospital, Glen Oaks, NY, USAUCSF School of Medicine, University of California–San Francisco, San Francisco, CA, USAUtrecht Medical Center, Utrecht, The NetherlandsHofstra Northwell School of Medicine, Zucker Hillside Hospital, Glen Oaks, NY, USAUCSF School of Medicine, University of California–San Francisco, San Francisco, CA, USAUCSF School of Medicine, University of California–San Francisco, San Francisco, CA, USAUtrecht Medical Center, Utrecht, The NetherlandsUCSF School of Medicine, University of California–San Francisco, San Francisco, CA, USABackground: Advancing patient safety during handoffs remains a public health priority. The application of cognitive load theory offers promise, but is currently limited by the inability to measure cognitive load types. Objective: To develop and collect validity evidence for a revised self-report inventory that measures cognitive load types during a handoff. Methods: Based on prior published work, input from experts in cognitive load theory and handoffs, and a think-aloud exercise with residents, a revised Cognitive Load Inventory for Handoffs was developed. The Cognitive Load Inventory for Handoffs has items for intrinsic, extraneous, and germane load. Students who were second- and sixth-year students recruited from a Dutch medical school participated in four simulated handoffs (two simple and two complex cases). At the end of each handoff, study participants completed the Cognitive Load Inventory for Handoffs, Paas’ Cognitive Load Scale, and one global rating item for intrinsic load, extraneous load, and germane load, respectively. Factor and correlational analyses were performed to collect evidence for validity. Results: Confirmatory factor analysis yielded a single factor that combined intrinsic and germane loads. The extraneous load items performed poorly and were removed from the model. The score from the combined intrinsic and germane load items associated, as predicted by cognitive load theory, with a commonly used measure of overall cognitive load (Pearson’s r = 0.83, p < 0.001), case complexity (beta = 0.74, p < 0.001), level of experience (beta = −0.96, p < 0.001), and handoff accuracy (r = −0.34, p < 0.001). Conclusion: These results offer encouragement that intrinsic load during handoffs may be measured via a self-report measure. Additional work is required to develop an adequate measure of extraneous load.https://doi.org/10.1177/2050312116682254 |
| spellingShingle | John Q Young Christy K Boscardin Savannah M van Dijk Ruqayyah Abdullah David M Irby Justin L Sewell Olle Ten Cate Patricia S O’Sullivan Performance of a cognitive load inventory during simulated handoffs: Evidence for validity SAGE Open Medicine |
| title | Performance of a cognitive load inventory during simulated handoffs: Evidence for validity |
| title_full | Performance of a cognitive load inventory during simulated handoffs: Evidence for validity |
| title_fullStr | Performance of a cognitive load inventory during simulated handoffs: Evidence for validity |
| title_full_unstemmed | Performance of a cognitive load inventory during simulated handoffs: Evidence for validity |
| title_short | Performance of a cognitive load inventory during simulated handoffs: Evidence for validity |
| title_sort | performance of a cognitive load inventory during simulated handoffs evidence for validity |
| url | https://doi.org/10.1177/2050312116682254 |
| work_keys_str_mv | AT johnqyoung performanceofacognitiveloadinventoryduringsimulatedhandoffsevidenceforvalidity AT christykboscardin performanceofacognitiveloadinventoryduringsimulatedhandoffsevidenceforvalidity AT savannahmvandijk performanceofacognitiveloadinventoryduringsimulatedhandoffsevidenceforvalidity AT ruqayyahabdullah performanceofacognitiveloadinventoryduringsimulatedhandoffsevidenceforvalidity AT davidmirby performanceofacognitiveloadinventoryduringsimulatedhandoffsevidenceforvalidity AT justinlsewell performanceofacognitiveloadinventoryduringsimulatedhandoffsevidenceforvalidity AT olletencate performanceofacognitiveloadinventoryduringsimulatedhandoffsevidenceforvalidity AT patriciasosullivan performanceofacognitiveloadinventoryduringsimulatedhandoffsevidenceforvalidity |