Health-5G: A Mixed Reality-Based System for Remote Medical Assistance in Emergency Situations
Mixed reality is the combination of virtual and augmented reality to interactively and believably merge physical and computer-generated environments. This paper discusses the design of Health-5G, a scalable mixed reality-based system that facilitates and supports emergency response by medical emerge...
| Main Authors: | , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2023-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/10149357/ |
| _version_ | 1797799284813332480 |
|---|---|
| author | Francisco M. Garcia Ruben Moraleda Santiago Schez-Sobrino Dorothy N. Monekosso David Vallejo Carlos Glez-Morcillo |
| author_facet | Francisco M. Garcia Ruben Moraleda Santiago Schez-Sobrino Dorothy N. Monekosso David Vallejo Carlos Glez-Morcillo |
| author_sort | Francisco M. Garcia |
| collection | DOAJ |
| description | Mixed reality is the combination of virtual and augmented reality to interactively and believably merge physical and computer-generated environments. This paper discusses the design of Health-5G, a scalable mixed reality-based system that facilitates and supports emergency response by medical emergency teams. Health-5G is supported by a distributed architecture divided into four interrelated applications responsible for advanced computer-human interaction, effective real-time videoconference, medical device integration, and communication infrastructure, respectively. The mixed reality layer is provided by the headset Microsoft Hololens 2<sup>™</sup>. Health-5G is based on scenarios in which emergency personnel wear mixed reality glasses that can transmit audio, video, and data streams bidirectionally over a 5G network to medical specialists stationed in a hospital at any distance. Thanks to Health-5G, the specialist will be able to access the emergency team’s point of view at any time and provide verbal and visual instructions, including gestures and positioning of graphical markers in 3D space. In this way, emergency personnel can provide the best possible care to the patient without having to wait for them to arrive at the hospital, saving a lot of time in scenarios where every second can make a difference. Health-5G also addresses the integration of medical devices and the collection of the patient’s medical data in a scalable way through optical character recognition. A case study is discussed where Health-5G is used to attend a patient in the street suffering from syncope due to third-degree atrioventricular block. Latency and performance tests over a 5G network are also discussed. To the best of our knowledge, there is no comprehensive solution in the literature that provides all the capabilities offered by Health-5G in terms of functionality and advanced interaction mechanisms within the context of remote, immersive support in emergency situations. |
| first_indexed | 2024-03-13T04:17:39Z |
| format | Article |
| id | doaj.art-57be83c3257c42818cb5e68a42c0562d |
| institution | Directory Open Access Journal |
| issn | 2169-3536 |
| language | English |
| last_indexed | 2024-03-13T04:17:39Z |
| publishDate | 2023-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj.art-57be83c3257c42818cb5e68a42c0562d2023-06-20T23:00:31ZengIEEEIEEE Access2169-35362023-01-0111590165903210.1109/ACCESS.2023.328542010149357Health-5G: A Mixed Reality-Based System for Remote Medical Assistance in Emergency SituationsFrancisco M. Garcia0https://orcid.org/0009-0005-7224-0315Ruben Moraleda1https://orcid.org/0009-0008-0048-6625Santiago Schez-Sobrino2https://orcid.org/0000-0001-6620-1719Dorothy N. Monekosso3David Vallejo4https://orcid.org/0000-0002-6001-7192Carlos Glez-Morcillo5https://orcid.org/0000-0002-8568-9542Department of Information Technologies and Systems, University of Castilla-La Mancha, Ciudad Real, SpainDepartment of Information Technologies and Systems, University of Castilla-La Mancha, Ciudad Real, SpainDepartment of Information Technologies and Systems, University of Castilla-La Mancha, Ciudad Real, SpainDepartment of Computer Science, Durham University, Durham, U.KDepartment of Information Technologies and Systems, University of Castilla-La Mancha, Ciudad Real, SpainDepartment of Information Technologies and Systems, University of Castilla-La Mancha, Ciudad Real, SpainMixed reality is the combination of virtual and augmented reality to interactively and believably merge physical and computer-generated environments. This paper discusses the design of Health-5G, a scalable mixed reality-based system that facilitates and supports emergency response by medical emergency teams. Health-5G is supported by a distributed architecture divided into four interrelated applications responsible for advanced computer-human interaction, effective real-time videoconference, medical device integration, and communication infrastructure, respectively. The mixed reality layer is provided by the headset Microsoft Hololens 2<sup>™</sup>. Health-5G is based on scenarios in which emergency personnel wear mixed reality glasses that can transmit audio, video, and data streams bidirectionally over a 5G network to medical specialists stationed in a hospital at any distance. Thanks to Health-5G, the specialist will be able to access the emergency team’s point of view at any time and provide verbal and visual instructions, including gestures and positioning of graphical markers in 3D space. In this way, emergency personnel can provide the best possible care to the patient without having to wait for them to arrive at the hospital, saving a lot of time in scenarios where every second can make a difference. Health-5G also addresses the integration of medical devices and the collection of the patient’s medical data in a scalable way through optical character recognition. A case study is discussed where Health-5G is used to attend a patient in the street suffering from syncope due to third-degree atrioventricular block. Latency and performance tests over a 5G network are also discussed. To the best of our knowledge, there is no comprehensive solution in the literature that provides all the capabilities offered by Health-5G in terms of functionality and advanced interaction mechanisms within the context of remote, immersive support in emergency situations.https://ieeexplore.ieee.org/document/10149357/Mixed realityteleassistance5Gvisualization |
| spellingShingle | Francisco M. Garcia Ruben Moraleda Santiago Schez-Sobrino Dorothy N. Monekosso David Vallejo Carlos Glez-Morcillo Health-5G: A Mixed Reality-Based System for Remote Medical Assistance in Emergency Situations IEEE Access Mixed reality teleassistance 5G visualization |
| title | Health-5G: A Mixed Reality-Based System for Remote Medical Assistance in Emergency Situations |
| title_full | Health-5G: A Mixed Reality-Based System for Remote Medical Assistance in Emergency Situations |
| title_fullStr | Health-5G: A Mixed Reality-Based System for Remote Medical Assistance in Emergency Situations |
| title_full_unstemmed | Health-5G: A Mixed Reality-Based System for Remote Medical Assistance in Emergency Situations |
| title_short | Health-5G: A Mixed Reality-Based System for Remote Medical Assistance in Emergency Situations |
| title_sort | health 5g a mixed reality based system for remote medical assistance in emergency situations |
| topic | Mixed reality teleassistance 5G visualization |
| url | https://ieeexplore.ieee.org/document/10149357/ |
| work_keys_str_mv | AT franciscomgarcia health5gamixedrealitybasedsystemforremotemedicalassistanceinemergencysituations AT rubenmoraleda health5gamixedrealitybasedsystemforremotemedicalassistanceinemergencysituations AT santiagoschezsobrino health5gamixedrealitybasedsystemforremotemedicalassistanceinemergencysituations AT dorothynmonekosso health5gamixedrealitybasedsystemforremotemedicalassistanceinemergencysituations AT davidvallejo health5gamixedrealitybasedsystemforremotemedicalassistanceinemergencysituations AT carlosglezmorcillo health5gamixedrealitybasedsystemforremotemedicalassistanceinemergencysituations |