Towards a Low-Cost Monitor-Based Augmented Reality Training Platform for At-Home Ultrasound Skill Development
Ultrasound education traditionally involves theoretical and practical training on patients or on simulators; however, difficulty accessing training equipment during the COVID-19 pandemic has highlighted the need for home-based training systems. Due to the prohibitive cost of ultrasound probes, few m...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2022-11-01
|
| Series: | Journal of Imaging |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2313-433X/8/11/305 |
| _version_ | 1797467737311674368 |
|---|---|
| author | Marine Y. Shao Tamara Vagg Matthias Seibold Mitchell Doughty |
| author_facet | Marine Y. Shao Tamara Vagg Matthias Seibold Mitchell Doughty |
| author_sort | Marine Y. Shao |
| collection | DOAJ |
| description | Ultrasound education traditionally involves theoretical and practical training on patients or on simulators; however, difficulty accessing training equipment during the COVID-19 pandemic has highlighted the need for home-based training systems. Due to the prohibitive cost of ultrasound probes, few medical students have access to the equipment required for at home training. Our proof of concept study focused on the development and assessment of the technical feasibility and training performance of an at-home training solution to teach the basics of interpreting and generating ultrasound data. The training solution relies on monitor-based augmented reality for displaying virtual content and requires only a marker printed on paper and a computer with webcam. With input webcam video, we performed body pose estimation to track the student’s limbs and used surface tracking of printed fiducials to track the position of a simulated ultrasound probe. The novelty of our work is in its combination of printed markers with marker-free body pose tracking. In a small user study, four ultrasound lecturers evaluated the training quality with a questionnaire and indicated the potential of our system. The strength of our method is that it allows students to learn the manipulation of an ultrasound probe through the simulated probe combined with the tracking system and to learn how to read ultrasounds in B-mode and Doppler mode. |
| first_indexed | 2024-03-09T18:56:57Z |
| format | Article |
| id | doaj.art-b6209d233db64b47b159a05aa910d2f7 |
| institution | Directory Open Access Journal |
| issn | 2313-433X |
| language | English |
| last_indexed | 2024-03-09T18:56:57Z |
| publishDate | 2022-11-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Journal of Imaging |
| spelling | doaj.art-b6209d233db64b47b159a05aa910d2f72023-11-24T05:20:58ZengMDPI AGJournal of Imaging2313-433X2022-11-0181130510.3390/jimaging8110305Towards a Low-Cost Monitor-Based Augmented Reality Training Platform for At-Home Ultrasound Skill DevelopmentMarine Y. Shao0Tamara Vagg1Matthias Seibold2Mitchell Doughty3Centre For Print Research, University of the West of England, Coldharbour Lane, Bristol BS16 1QY, UKCork Centre for Cystic Fibrosis (3CF), Cork University Hospital & HRB Clinical Research Facility Cork, University College Cork & School of Computer Science and Information Technology, University College Cork, T12 XF62 Cork, IrelandComputer Aided Medical Procedures (CAMP), Technical University of Munich, 85748 Munich, GermanyDepartment of Medical Biophysics, University of Toronto, Toronto, ON M5S 1A1, CanadaUltrasound education traditionally involves theoretical and practical training on patients or on simulators; however, difficulty accessing training equipment during the COVID-19 pandemic has highlighted the need for home-based training systems. Due to the prohibitive cost of ultrasound probes, few medical students have access to the equipment required for at home training. Our proof of concept study focused on the development and assessment of the technical feasibility and training performance of an at-home training solution to teach the basics of interpreting and generating ultrasound data. The training solution relies on monitor-based augmented reality for displaying virtual content and requires only a marker printed on paper and a computer with webcam. With input webcam video, we performed body pose estimation to track the student’s limbs and used surface tracking of printed fiducials to track the position of a simulated ultrasound probe. The novelty of our work is in its combination of printed markers with marker-free body pose tracking. In a small user study, four ultrasound lecturers evaluated the training quality with a questionnaire and indicated the potential of our system. The strength of our method is that it allows students to learn the manipulation of an ultrasound probe through the simulated probe combined with the tracking system and to learn how to read ultrasounds in B-mode and Doppler mode.https://www.mdpi.com/2313-433X/8/11/305augmented realitycross-sectional anatomymedical ultrasoundultrasound education |
| spellingShingle | Marine Y. Shao Tamara Vagg Matthias Seibold Mitchell Doughty Towards a Low-Cost Monitor-Based Augmented Reality Training Platform for At-Home Ultrasound Skill Development Journal of Imaging augmented reality cross-sectional anatomy medical ultrasound ultrasound education |
| title | Towards a Low-Cost Monitor-Based Augmented Reality Training Platform for At-Home Ultrasound Skill Development |
| title_full | Towards a Low-Cost Monitor-Based Augmented Reality Training Platform for At-Home Ultrasound Skill Development |
| title_fullStr | Towards a Low-Cost Monitor-Based Augmented Reality Training Platform for At-Home Ultrasound Skill Development |
| title_full_unstemmed | Towards a Low-Cost Monitor-Based Augmented Reality Training Platform for At-Home Ultrasound Skill Development |
| title_short | Towards a Low-Cost Monitor-Based Augmented Reality Training Platform for At-Home Ultrasound Skill Development |
| title_sort | towards a low cost monitor based augmented reality training platform for at home ultrasound skill development |
| topic | augmented reality cross-sectional anatomy medical ultrasound ultrasound education |
| url | https://www.mdpi.com/2313-433X/8/11/305 |
| work_keys_str_mv | AT marineyshao towardsalowcostmonitorbasedaugmentedrealitytrainingplatformforathomeultrasoundskilldevelopment AT tamaravagg towardsalowcostmonitorbasedaugmentedrealitytrainingplatformforathomeultrasoundskilldevelopment AT matthiasseibold towardsalowcostmonitorbasedaugmentedrealitytrainingplatformforathomeultrasoundskilldevelopment AT mitchelldoughty towardsalowcostmonitorbasedaugmentedrealitytrainingplatformforathomeultrasoundskilldevelopment |