Educational Effects of Simulation and Non-Simulation Training in Airway Management according to Levels of the Kirkpatrick Model: A Systematic Review and Network Meta-Analysis

There is insufficient validation of the effectiveness of simulation-based training (Sim) or non-simulation-based training (non-Sim) for teaching airway management to healthcare professionals within the literature. We thus conducted a network meta-analysis comparing the effectiveness of Sim, non-Sim,...

Full description

Bibliographic Details
Main Authors: Koichi Ando, Akane Ando, Akihiko Tanaka, Shinji Koba, Hironori Sagara
Format: Article
Language:English
Published: MDPI AG 2022-09-01
Series:Journal of Clinical Medicine
Subjects:
Online Access:https://www.mdpi.com/2077-0383/11/19/5614
_version_ 1797478707313508352
author Koichi Ando
Akane Ando
Akihiko Tanaka
Shinji Koba
Hironori Sagara
author_facet Koichi Ando
Akane Ando
Akihiko Tanaka
Shinji Koba
Hironori Sagara
author_sort Koichi Ando
collection DOAJ
description There is insufficient validation of the effectiveness of simulation-based training (Sim) or non-simulation-based training (non-Sim) for teaching airway management to healthcare professionals within the literature. We thus conducted a network meta-analysis comparing the effectiveness of Sim, non-Sim, and no educational intervention (NI) for airway management. The primary endpoints were knowledge scores (KnS) and behavioral performance scores (BpS) corresponding to assessments at levels 2 and 3 of the Kirkpatrick model, respectively. Effect sizes were expressed as standardized mean differences (Std. MD) and 95% credible intervals (CrIs). Regarding KnS, the educational effects of Sim and non-Sim were significantly improved compared to those of NI (Std. MD [95% CI]: 1.110 [0.903–1.316] and 0.819 [0.209–1.429], respectively); there was no significant difference between Sim and non-Sim. The educational effect of Sim in BpS was significantly improved compared to that of non-Sim and NI (0.850 [0.015–1.691] and 0.660 [0.241–1.076]); there were no differences between non-Sim and NI. Surface under the cumulative rank curve values demonstrated that Sim ranked highest in efficacy for KnS and BpS. This study provides valuable information regarding the educational efficacy of Sim and non-Sim in airway management. Larger randomized controlled trials are needed to confirm these findings.
first_indexed 2024-03-09T21:35:27Z
format Article
id doaj.art-7ca918f632814e99bd87f3545989cadc
institution Directory Open Access Journal
issn 2077-0383
language English
last_indexed 2024-03-09T21:35:27Z
publishDate 2022-09-01
publisher MDPI AG
record_format Article
series Journal of Clinical Medicine
spelling doaj.art-7ca918f632814e99bd87f3545989cadc2023-11-23T20:45:56ZengMDPI AGJournal of Clinical Medicine2077-03832022-09-011119561410.3390/jcm11195614Educational Effects of Simulation and Non-Simulation Training in Airway Management according to Levels of the Kirkpatrick Model: A Systematic Review and Network Meta-AnalysisKoichi Ando0Akane Ando1Akihiko Tanaka2Shinji Koba3Hironori Sagara4Division of Respiratory Medicine and Allergology, Department of Medicine, Showa University School of Medicine, 1-5-8 Hatanodai, Shinagawa-ku, Tokyo 142-8666, JapanDepartment of Anesthesiology, Showa University School of Medicine, 1-5-8 Hatanodai, Shinagawa-ku, Tokyo 142-8666, JapanDivision of Respiratory Medicine and Allergology, Department of Medicine, Showa University School of Medicine, 1-5-8 Hatanodai, Shinagawa-ku, Tokyo 142-8666, JapanDivision of Internal Medicine, Showa University Dental Hospital Medical Clinic, Senzoku Campus, Showa University, 2-1-1 Kita-senzoku, Ohta-ku, Tokyo 145-8515, JapanDivision of Respiratory Medicine and Allergology, Department of Medicine, Showa University School of Medicine, 1-5-8 Hatanodai, Shinagawa-ku, Tokyo 142-8666, JapanThere is insufficient validation of the effectiveness of simulation-based training (Sim) or non-simulation-based training (non-Sim) for teaching airway management to healthcare professionals within the literature. We thus conducted a network meta-analysis comparing the effectiveness of Sim, non-Sim, and no educational intervention (NI) for airway management. The primary endpoints were knowledge scores (KnS) and behavioral performance scores (BpS) corresponding to assessments at levels 2 and 3 of the Kirkpatrick model, respectively. Effect sizes were expressed as standardized mean differences (Std. MD) and 95% credible intervals (CrIs). Regarding KnS, the educational effects of Sim and non-Sim were significantly improved compared to those of NI (Std. MD [95% CI]: 1.110 [0.903–1.316] and 0.819 [0.209–1.429], respectively); there was no significant difference between Sim and non-Sim. The educational effect of Sim in BpS was significantly improved compared to that of non-Sim and NI (0.850 [0.015–1.691] and 0.660 [0.241–1.076]); there were no differences between non-Sim and NI. Surface under the cumulative rank curve values demonstrated that Sim ranked highest in efficacy for KnS and BpS. This study provides valuable information regarding the educational efficacy of Sim and non-Sim in airway management. Larger randomized controlled trials are needed to confirm these findings.https://www.mdpi.com/2077-0383/11/19/5614simulation trainingairway managementsystematic reviewnetwork meta-analysis
spellingShingle Koichi Ando
Akane Ando
Akihiko Tanaka
Shinji Koba
Hironori Sagara
Educational Effects of Simulation and Non-Simulation Training in Airway Management according to Levels of the Kirkpatrick Model: A Systematic Review and Network Meta-Analysis
Journal of Clinical Medicine
simulation training
airway management
systematic review
network meta-analysis
title Educational Effects of Simulation and Non-Simulation Training in Airway Management according to Levels of the Kirkpatrick Model: A Systematic Review and Network Meta-Analysis
title_full Educational Effects of Simulation and Non-Simulation Training in Airway Management according to Levels of the Kirkpatrick Model: A Systematic Review and Network Meta-Analysis
title_fullStr Educational Effects of Simulation and Non-Simulation Training in Airway Management according to Levels of the Kirkpatrick Model: A Systematic Review and Network Meta-Analysis
title_full_unstemmed Educational Effects of Simulation and Non-Simulation Training in Airway Management according to Levels of the Kirkpatrick Model: A Systematic Review and Network Meta-Analysis
title_short Educational Effects of Simulation and Non-Simulation Training in Airway Management according to Levels of the Kirkpatrick Model: A Systematic Review and Network Meta-Analysis
title_sort educational effects of simulation and non simulation training in airway management according to levels of the kirkpatrick model a systematic review and network meta analysis
topic simulation training
airway management
systematic review
network meta-analysis
url https://www.mdpi.com/2077-0383/11/19/5614
work_keys_str_mv AT koichiando educationaleffectsofsimulationandnonsimulationtraininginairwaymanagementaccordingtolevelsofthekirkpatrickmodelasystematicreviewandnetworkmetaanalysis
AT akaneando educationaleffectsofsimulationandnonsimulationtraininginairwaymanagementaccordingtolevelsofthekirkpatrickmodelasystematicreviewandnetworkmetaanalysis
AT akihikotanaka educationaleffectsofsimulationandnonsimulationtraininginairwaymanagementaccordingtolevelsofthekirkpatrickmodelasystematicreviewandnetworkmetaanalysis
AT shinjikoba educationaleffectsofsimulationandnonsimulationtraininginairwaymanagementaccordingtolevelsofthekirkpatrickmodelasystematicreviewandnetworkmetaanalysis
AT hironorisagara educationaleffectsofsimulationandnonsimulationtraininginairwaymanagementaccordingtolevelsofthekirkpatrickmodelasystematicreviewandnetworkmetaanalysis