Assessment of a virtual reality temporal bone surgical simulator: a national face and content validity study
Abstract Background Trainees in Otolaryngology–Head and Neck Surgery must gain proficiency in a variety of challenging temporal bone surgical techniques. Traditional teaching has relied on the use of cadavers; however, this method is resource-intensive and does not allow for repeated practice. Virtu...
| Main Authors: | , , , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
BMC
2020-04-01
|
| Series: | Journal of Otolaryngology - Head and Neck Surgery |
| Subjects: | |
| Online Access: | http://link.springer.com/article/10.1186/s40463-020-00411-y |
| _version_ | 1797964968915632128 |
|---|---|
| author | Evan C. Compton Sumit K. Agrawal Hanif M. Ladak Sonny Chan Monica Hoy Steven C. Nakoneshny Lauren Siegel Joseph C. Dort Justin T. Lui |
| author_facet | Evan C. Compton Sumit K. Agrawal Hanif M. Ladak Sonny Chan Monica Hoy Steven C. Nakoneshny Lauren Siegel Joseph C. Dort Justin T. Lui |
| author_sort | Evan C. Compton |
| collection | DOAJ |
| description | Abstract Background Trainees in Otolaryngology–Head and Neck Surgery must gain proficiency in a variety of challenging temporal bone surgical techniques. Traditional teaching has relied on the use of cadavers; however, this method is resource-intensive and does not allow for repeated practice. Virtual reality surgical training is a growing field that is increasingly being adopted in Otolaryngology. CardinalSim is a virtual reality temporal bone surgical simulator that offers a high-quality, inexpensive adjunct to traditional teaching methods. The objective of this study was to establish the face and content validity of CardinalSim through a national study. Methods Otolaryngologists and resident trainees from across Canada were recruited to evaluate CardinalSim. Ethics approval and informed consent was obtained. A face and content validity questionnaire with questions categorized into 13 domains was distributed to participants following simulator use. Descriptive statistics were used to describe questionnaire results, and either Chi-square or Fishers exact tests were used to compare responses between junior residents, senior residents, and practising surgeons. Results Sixty-two participants from thirteen different Otolaryngology–Head and Neck Surgery programs were included in the study (32 practicing surgeons; 30 resident trainees). Face validity was achieved for 5 out of 7 domains, while content validity was achieved for 5 out of 6 domains. Significant differences between groups (p-value of < 0.05) were found for one face validity domain (realistic ergonomics, p = 0.002) and two content validity domains (teaching drilling technique, p = 0.011 and overall teaching utility, p = 0.006). The assessment scores, global rating scores, and overall attitudes towards CardinalSim, were universally positive. Open-ended questions identified limitations of the simulator. Conclusion CardinalSim met acceptable criteria for face and content validity. This temporal bone virtual reality surgical simulation platform may enhance surgical training and be suitable for patient-specific surgical rehearsal for practicing Otolaryngologists. |
| first_indexed | 2024-04-11T01:52:54Z |
| format | Article |
| id | doaj.art-3f61aa072ae3450285474c203ae36984 |
| institution | Directory Open Access Journal |
| issn | 1916-0216 |
| language | English |
| last_indexed | 2024-04-11T01:52:54Z |
| publishDate | 2020-04-01 |
| publisher | BMC |
| record_format | Article |
| series | Journal of Otolaryngology - Head and Neck Surgery |
| spelling | doaj.art-3f61aa072ae3450285474c203ae369842023-01-03T05:54:51ZengBMCJournal of Otolaryngology - Head and Neck Surgery1916-02162020-04-014911910.1186/s40463-020-00411-yAssessment of a virtual reality temporal bone surgical simulator: a national face and content validity studyEvan C. Compton0Sumit K. Agrawal1Hanif M. Ladak2Sonny Chan3Monica Hoy4Steven C. Nakoneshny5Lauren Siegel6Joseph C. Dort7Justin T. Lui8Section of Otolaryngology–Head and Neck Surgery, Department of Surgery, Cumming School of Medicine, University of CalgaryDepartment of Otolaryngology–Head and Neck Surgery, Western UniversityDepartment of Otolaryngology–Head and Neck Surgery, Western UniversityDepartment of Computer Sciences, University of CalgarySection of Otolaryngology–Head and Neck Surgery, Department of Surgery, Cumming School of Medicine, University of CalgaryOhlson Research Initiative, Arnie Charbonneau Cancer Institute, Cumming School of Medicine, University of CalgaryDepartment of Otolaryngology–Head and Neck Surgery, Western UniversitySection of Otolaryngology–Head and Neck Surgery, Department of Surgery, Cumming School of Medicine, University of CalgaryDepartment of Otolaryngology–Head and Neck Surgery, University of TorontoAbstract Background Trainees in Otolaryngology–Head and Neck Surgery must gain proficiency in a variety of challenging temporal bone surgical techniques. Traditional teaching has relied on the use of cadavers; however, this method is resource-intensive and does not allow for repeated practice. Virtual reality surgical training is a growing field that is increasingly being adopted in Otolaryngology. CardinalSim is a virtual reality temporal bone surgical simulator that offers a high-quality, inexpensive adjunct to traditional teaching methods. The objective of this study was to establish the face and content validity of CardinalSim through a national study. Methods Otolaryngologists and resident trainees from across Canada were recruited to evaluate CardinalSim. Ethics approval and informed consent was obtained. A face and content validity questionnaire with questions categorized into 13 domains was distributed to participants following simulator use. Descriptive statistics were used to describe questionnaire results, and either Chi-square or Fishers exact tests were used to compare responses between junior residents, senior residents, and practising surgeons. Results Sixty-two participants from thirteen different Otolaryngology–Head and Neck Surgery programs were included in the study (32 practicing surgeons; 30 resident trainees). Face validity was achieved for 5 out of 7 domains, while content validity was achieved for 5 out of 6 domains. Significant differences between groups (p-value of < 0.05) were found for one face validity domain (realistic ergonomics, p = 0.002) and two content validity domains (teaching drilling technique, p = 0.011 and overall teaching utility, p = 0.006). The assessment scores, global rating scores, and overall attitudes towards CardinalSim, were universally positive. Open-ended questions identified limitations of the simulator. Conclusion CardinalSim met acceptable criteria for face and content validity. This temporal bone virtual reality surgical simulation platform may enhance surgical training and be suitable for patient-specific surgical rehearsal for practicing Otolaryngologists.http://link.springer.com/article/10.1186/s40463-020-00411-yFace validityContent validityVirtual realityTemporal boneDissectionEducation |
| spellingShingle | Evan C. Compton Sumit K. Agrawal Hanif M. Ladak Sonny Chan Monica Hoy Steven C. Nakoneshny Lauren Siegel Joseph C. Dort Justin T. Lui Assessment of a virtual reality temporal bone surgical simulator: a national face and content validity study Journal of Otolaryngology - Head and Neck Surgery Face validity Content validity Virtual reality Temporal bone Dissection Education |
| title | Assessment of a virtual reality temporal bone surgical simulator: a national face and content validity study |
| title_full | Assessment of a virtual reality temporal bone surgical simulator: a national face and content validity study |
| title_fullStr | Assessment of a virtual reality temporal bone surgical simulator: a national face and content validity study |
| title_full_unstemmed | Assessment of a virtual reality temporal bone surgical simulator: a national face and content validity study |
| title_short | Assessment of a virtual reality temporal bone surgical simulator: a national face and content validity study |
| title_sort | assessment of a virtual reality temporal bone surgical simulator a national face and content validity study |
| topic | Face validity Content validity Virtual reality Temporal bone Dissection Education |
| url | http://link.springer.com/article/10.1186/s40463-020-00411-y |
| work_keys_str_mv | AT evanccompton assessmentofavirtualrealitytemporalbonesurgicalsimulatoranationalfaceandcontentvaliditystudy AT sumitkagrawal assessmentofavirtualrealitytemporalbonesurgicalsimulatoranationalfaceandcontentvaliditystudy AT hanifmladak assessmentofavirtualrealitytemporalbonesurgicalsimulatoranationalfaceandcontentvaliditystudy AT sonnychan assessmentofavirtualrealitytemporalbonesurgicalsimulatoranationalfaceandcontentvaliditystudy AT monicahoy assessmentofavirtualrealitytemporalbonesurgicalsimulatoranationalfaceandcontentvaliditystudy AT stevencnakoneshny assessmentofavirtualrealitytemporalbonesurgicalsimulatoranationalfaceandcontentvaliditystudy AT laurensiegel assessmentofavirtualrealitytemporalbonesurgicalsimulatoranationalfaceandcontentvaliditystudy AT josephcdort assessmentofavirtualrealitytemporalbonesurgicalsimulatoranationalfaceandcontentvaliditystudy AT justintlui assessmentofavirtualrealitytemporalbonesurgicalsimulatoranationalfaceandcontentvaliditystudy |