Benchtop simulation of the retrosigmoid approach: Validation of a surgical simulator and development of a task-specific outcome measure score

Background: Neurosurgical training is changing globally. Reduced working hours and training opportunities, increased patient safety expectations, and the impact of COVID-19 have reduced operative exposure. Benchtop simulators enable trainees to develop surgical skills in a controlled environment. We...

Full description

Bibliographic Details
Main Authors: Simon C. Williams, Razna Ahmed, Joseph Darlington Davids, Jonathan P. Funnell, John Gerrard Hanrahan, Hugo Layard Horsfall, William Muirhead, Federico Nicolosi, Lewis Thorne, Hani J. Marcus, Patrick Grover
Format: Article
Language:English
Published: Elsevier 2023-10-01
Series:World Neurosurgery: X
Subjects:
Online Access:http://www.sciencedirect.com/science/article/pii/S2590139723000790
_version_ 1827794224486023168
author Simon C. Williams
Razna Ahmed
Joseph Darlington Davids
Jonathan P. Funnell
John Gerrard Hanrahan
Hugo Layard Horsfall
William Muirhead
Federico Nicolosi
Lewis Thorne
Hani J. Marcus
Patrick Grover
author_facet Simon C. Williams
Razna Ahmed
Joseph Darlington Davids
Jonathan P. Funnell
John Gerrard Hanrahan
Hugo Layard Horsfall
William Muirhead
Federico Nicolosi
Lewis Thorne
Hani J. Marcus
Patrick Grover
author_sort Simon C. Williams
collection DOAJ
description Background: Neurosurgical training is changing globally. Reduced working hours and training opportunities, increased patient safety expectations, and the impact of COVID-19 have reduced operative exposure. Benchtop simulators enable trainees to develop surgical skills in a controlled environment. We aim to validate a high-fidelity simulator model (RetrosigmoidBox, UpSurgeOn) for the retrosigmoid approach to the cerebellopontine angle (CPA). Methods: Novice and expert Neurosurgeons and Ear, Nose, and Throat surgeons performed a surgical task using the model – identification of the trigeminal nerve. Experts completed a post-task questionnaire examining face and content validity. Construct validity was assessed through scoring of operative videos employing Objective Structured Assessment of Technical Skills (OSATS) and a novel Task-Specific Outcome Measure score. Results: Fifteen novice and five expert participants were recruited. Forty percent of experts agreed or strongly agreed that the brain tissue looked real. Experts unanimously agreed that the RetrosigmoidBox was appropriate for teaching. Statistically significant differences were noted in task performance between novices and experts, demonstrating construct validity. Median total OSATS score was 14/25 (IQR 10–19) for novices and 22/25 (IQR 20–22) for experts (p < 0.05). Median Task-Specific Outcome Measure score was 10/20 (IQR 7–17) for novices compared to 19/20 (IQR 18.5–19.5) for experts (p < 0.05). Conclusion: The RetrosigmoidBox benchtop simulator has a high degree of content and construct validity and moderate face validity. The changing landscape of neurosurgical training mean that simulators are likely to become increasingly important in the delivery of high-quality education. We demonstrate the validity of a Task-Specific Outcome Measure score for performance assessment of a simulated approach to the CPA.
first_indexed 2024-03-11T18:29:43Z
format Article
id doaj.art-203a5f2d493e413594ef99d47248ddf6
institution Directory Open Access Journal
issn 2590-1397
language English
last_indexed 2024-03-11T18:29:43Z
publishDate 2023-10-01
publisher Elsevier
record_format Article
series World Neurosurgery: X
spelling doaj.art-203a5f2d493e413594ef99d47248ddf62023-10-13T11:05:46ZengElsevierWorld Neurosurgery: X2590-13972023-10-0120100230Benchtop simulation of the retrosigmoid approach: Validation of a surgical simulator and development of a task-specific outcome measure scoreSimon C. Williams0Razna Ahmed1Joseph Darlington Davids2Jonathan P. Funnell3John Gerrard Hanrahan4Hugo Layard Horsfall5William Muirhead6Federico Nicolosi7Lewis Thorne8Hani J. Marcus9Patrick Grover10Department of Neurosurgery, National Hospital for Neurology and Neurosurgery, Queen Square, London, UK; Wellcome/EPSRC Centre for Interventional and Surgical Sciences (WEISS), London, UK; Corresponding author. Department of Neurosurgery, National Hospital for Neurology and Neurosurgery, Queen Square, London, UK.Wellcome/EPSRC Centre for Interventional and Surgical Sciences (WEISS), London, UK; Queen Square Institute of Neurology, University College London, London, UKDepartment of Neurosurgery, National Hospital for Neurology and Neurosurgery, Queen Square, London, UK; Institute of Global Health Innovation and Hamlyn Centre for Robotics Surgery, Imperial College London, London, UKDepartment of Neurosurgery, National Hospital for Neurology and Neurosurgery, Queen Square, London, UK; Wellcome/EPSRC Centre for Interventional and Surgical Sciences (WEISS), London, UKDepartment of Neurosurgery, National Hospital for Neurology and Neurosurgery, Queen Square, London, UK; Wellcome/EPSRC Centre for Interventional and Surgical Sciences (WEISS), London, UKDepartment of Neurosurgery, National Hospital for Neurology and Neurosurgery, Queen Square, London, UK; Wellcome/EPSRC Centre for Interventional and Surgical Sciences (WEISS), London, UKDepartment of Neurosurgery, National Hospital for Neurology and Neurosurgery, Queen Square, London, UK; Wellcome/EPSRC Centre for Interventional and Surgical Sciences (WEISS), London, UKSchool of Medicine and Surgery, University of Milano-Bicocca, Monza, ItalyDepartment of Neurosurgery, National Hospital for Neurology and Neurosurgery, Queen Square, London, UKDepartment of Neurosurgery, National Hospital for Neurology and Neurosurgery, Queen Square, London, UK; Wellcome/EPSRC Centre for Interventional and Surgical Sciences (WEISS), London, UKDepartment of Neurosurgery, National Hospital for Neurology and Neurosurgery, Queen Square, London, UKBackground: Neurosurgical training is changing globally. Reduced working hours and training opportunities, increased patient safety expectations, and the impact of COVID-19 have reduced operative exposure. Benchtop simulators enable trainees to develop surgical skills in a controlled environment. We aim to validate a high-fidelity simulator model (RetrosigmoidBox, UpSurgeOn) for the retrosigmoid approach to the cerebellopontine angle (CPA). Methods: Novice and expert Neurosurgeons and Ear, Nose, and Throat surgeons performed a surgical task using the model – identification of the trigeminal nerve. Experts completed a post-task questionnaire examining face and content validity. Construct validity was assessed through scoring of operative videos employing Objective Structured Assessment of Technical Skills (OSATS) and a novel Task-Specific Outcome Measure score. Results: Fifteen novice and five expert participants were recruited. Forty percent of experts agreed or strongly agreed that the brain tissue looked real. Experts unanimously agreed that the RetrosigmoidBox was appropriate for teaching. Statistically significant differences were noted in task performance between novices and experts, demonstrating construct validity. Median total OSATS score was 14/25 (IQR 10–19) for novices and 22/25 (IQR 20–22) for experts (p < 0.05). Median Task-Specific Outcome Measure score was 10/20 (IQR 7–17) for novices compared to 19/20 (IQR 18.5–19.5) for experts (p < 0.05). Conclusion: The RetrosigmoidBox benchtop simulator has a high degree of content and construct validity and moderate face validity. The changing landscape of neurosurgical training mean that simulators are likely to become increasingly important in the delivery of high-quality education. We demonstrate the validity of a Task-Specific Outcome Measure score for performance assessment of a simulated approach to the CPA.http://www.sciencedirect.com/science/article/pii/S2590139723000790NeurosurgeryEducationModel validationSimulation trainingRetrosigmoid craniotomyMicrovascular decompression
spellingShingle Simon C. Williams
Razna Ahmed
Joseph Darlington Davids
Jonathan P. Funnell
John Gerrard Hanrahan
Hugo Layard Horsfall
William Muirhead
Federico Nicolosi
Lewis Thorne
Hani J. Marcus
Patrick Grover
Benchtop simulation of the retrosigmoid approach: Validation of a surgical simulator and development of a task-specific outcome measure score
World Neurosurgery: X
Neurosurgery
Education
Model validation
Simulation training
Retrosigmoid craniotomy
Microvascular decompression
title Benchtop simulation of the retrosigmoid approach: Validation of a surgical simulator and development of a task-specific outcome measure score
title_full Benchtop simulation of the retrosigmoid approach: Validation of a surgical simulator and development of a task-specific outcome measure score
title_fullStr Benchtop simulation of the retrosigmoid approach: Validation of a surgical simulator and development of a task-specific outcome measure score
title_full_unstemmed Benchtop simulation of the retrosigmoid approach: Validation of a surgical simulator and development of a task-specific outcome measure score
title_short Benchtop simulation of the retrosigmoid approach: Validation of a surgical simulator and development of a task-specific outcome measure score
title_sort benchtop simulation of the retrosigmoid approach validation of a surgical simulator and development of a task specific outcome measure score
topic Neurosurgery
Education
Model validation
Simulation training
Retrosigmoid craniotomy
Microvascular decompression
url http://www.sciencedirect.com/science/article/pii/S2590139723000790
work_keys_str_mv AT simoncwilliams benchtopsimulationoftheretrosigmoidapproachvalidationofasurgicalsimulatoranddevelopmentofataskspecificoutcomemeasurescore
AT raznaahmed benchtopsimulationoftheretrosigmoidapproachvalidationofasurgicalsimulatoranddevelopmentofataskspecificoutcomemeasurescore
AT josephdarlingtondavids benchtopsimulationoftheretrosigmoidapproachvalidationofasurgicalsimulatoranddevelopmentofataskspecificoutcomemeasurescore
AT jonathanpfunnell benchtopsimulationoftheretrosigmoidapproachvalidationofasurgicalsimulatoranddevelopmentofataskspecificoutcomemeasurescore
AT johngerrardhanrahan benchtopsimulationoftheretrosigmoidapproachvalidationofasurgicalsimulatoranddevelopmentofataskspecificoutcomemeasurescore
AT hugolayardhorsfall benchtopsimulationoftheretrosigmoidapproachvalidationofasurgicalsimulatoranddevelopmentofataskspecificoutcomemeasurescore
AT williammuirhead benchtopsimulationoftheretrosigmoidapproachvalidationofasurgicalsimulatoranddevelopmentofataskspecificoutcomemeasurescore
AT federiconicolosi benchtopsimulationoftheretrosigmoidapproachvalidationofasurgicalsimulatoranddevelopmentofataskspecificoutcomemeasurescore
AT lewisthorne benchtopsimulationoftheretrosigmoidapproachvalidationofasurgicalsimulatoranddevelopmentofataskspecificoutcomemeasurescore
AT hanijmarcus benchtopsimulationoftheretrosigmoidapproachvalidationofasurgicalsimulatoranddevelopmentofataskspecificoutcomemeasurescore
AT patrickgrover benchtopsimulationoftheretrosigmoidapproachvalidationofasurgicalsimulatoranddevelopmentofataskspecificoutcomemeasurescore