Augmenting Image-Guided Procedures through In Situ Visualization of 3D Ultrasound via a Head-Mounted Display
Medical ultrasound (US) is a commonly used modality for image-guided procedures. Recent research systems providing an in situ visualization of 2D US images via an augmented reality (AR) head-mounted display (HMD) were shown to be advantageous over conventional imaging through reduced task completion...
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2023-02-01
|
| Series: | Sensors |
| Subjects: | |
| Online Access: | https://www.mdpi.com/1424-8220/23/4/2168 |
| _version_ | 1797618197660172288 |
|---|---|
| author | Felix von Haxthausen Christoph Rüger Malte Maria Sieren Roman Kloeckner Floris Ernst |
| author_facet | Felix von Haxthausen Christoph Rüger Malte Maria Sieren Roman Kloeckner Floris Ernst |
| author_sort | Felix von Haxthausen |
| collection | DOAJ |
| description | Medical ultrasound (US) is a commonly used modality for image-guided procedures. Recent research systems providing an in situ visualization of 2D US images via an augmented reality (AR) head-mounted display (HMD) were shown to be advantageous over conventional imaging through reduced task completion times and improved accuracy. In this work, we continue in the direction of recent developments by describing the first AR HMD application visualizing real-time volumetric (3D) US in situ for guiding vascular punctures. We evaluated the application on a technical level as well as in a mixed-methods user study with a qualitative prestudy and a quantitative main study, simulating a vascular puncture. Participants completed the puncture task significantly faster when using 3D US AR mode compared to 2D US AR, with a decrease of 28.4% in time. However, no significant differences were observed regarding the success rate of vascular puncture (2D US AR—50% vs. 3D US AR—72%). On the technical side, the system offers a low latency of 49.90 ± 12.92 ms and a satisfactory frame rate of 60 Hz. Our work shows the feasibility of a system that visualizes real-time 3D US data via an AR HMD, and our experiments show, furthermore, that this may offer additional benefits in US-guided tasks (i.e., reduced task completion time) over 2D US images viewed in AR by offering a vividly volumetric visualization. |
| first_indexed | 2024-03-11T08:10:41Z |
| format | Article |
| id | doaj.art-4ab4efa816bc44ab8c08bc2ac0e0e030 |
| institution | Directory Open Access Journal |
| issn | 1424-8220 |
| language | English |
| last_indexed | 2024-03-11T08:10:41Z |
| publishDate | 2023-02-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Sensors |
| spelling | doaj.art-4ab4efa816bc44ab8c08bc2ac0e0e0302023-11-16T23:11:14ZengMDPI AGSensors1424-82202023-02-01234216810.3390/s23042168Augmenting Image-Guided Procedures through In Situ Visualization of 3D Ultrasound via a Head-Mounted DisplayFelix von Haxthausen0Christoph Rüger1Malte Maria Sieren2Roman Kloeckner3Floris Ernst4Institute for Robotics and Cognitive Systems, University of Lübeck, 23562 Lübeck, GermanyDepartment of Surgery, Campus Charité Mitte, Campus Virchow-Klinikum, Experimental Surgery, Charité–Universitätsmedizin Berlin, Corporate Member of Freie Universität Berlin, Humboldt-Universität zu Berlin, Berlin Institute of Health, 10117 Berlin, GermanyDepartment of Radiology and Nuclear Medicine, University Hospital Schleswig-Holstein Campus Lübeck, 23569 Lübeck, GermanyInstitute of Interventional Radiology, University Hospital Schleswig-Holstein Campus Lübeck, 23569 Lübeck, GermanyInstitute for Robotics and Cognitive Systems, University of Lübeck, 23562 Lübeck, GermanyMedical ultrasound (US) is a commonly used modality for image-guided procedures. Recent research systems providing an in situ visualization of 2D US images via an augmented reality (AR) head-mounted display (HMD) were shown to be advantageous over conventional imaging through reduced task completion times and improved accuracy. In this work, we continue in the direction of recent developments by describing the first AR HMD application visualizing real-time volumetric (3D) US in situ for guiding vascular punctures. We evaluated the application on a technical level as well as in a mixed-methods user study with a qualitative prestudy and a quantitative main study, simulating a vascular puncture. Participants completed the puncture task significantly faster when using 3D US AR mode compared to 2D US AR, with a decrease of 28.4% in time. However, no significant differences were observed regarding the success rate of vascular puncture (2D US AR—50% vs. 3D US AR—72%). On the technical side, the system offers a low latency of 49.90 ± 12.92 ms and a satisfactory frame rate of 60 Hz. Our work shows the feasibility of a system that visualizes real-time 3D US data via an AR HMD, and our experiments show, furthermore, that this may offer additional benefits in US-guided tasks (i.e., reduced task completion time) over 2D US images viewed in AR by offering a vividly volumetric visualization.https://www.mdpi.com/1424-8220/23/4/2168augmented realityHoloLens 2volume renderingultrasound phantommixed reality |
| spellingShingle | Felix von Haxthausen Christoph Rüger Malte Maria Sieren Roman Kloeckner Floris Ernst Augmenting Image-Guided Procedures through In Situ Visualization of 3D Ultrasound via a Head-Mounted Display Sensors augmented reality HoloLens 2 volume rendering ultrasound phantom mixed reality |
| title | Augmenting Image-Guided Procedures through In Situ Visualization of 3D Ultrasound via a Head-Mounted Display |
| title_full | Augmenting Image-Guided Procedures through In Situ Visualization of 3D Ultrasound via a Head-Mounted Display |
| title_fullStr | Augmenting Image-Guided Procedures through In Situ Visualization of 3D Ultrasound via a Head-Mounted Display |
| title_full_unstemmed | Augmenting Image-Guided Procedures through In Situ Visualization of 3D Ultrasound via a Head-Mounted Display |
| title_short | Augmenting Image-Guided Procedures through In Situ Visualization of 3D Ultrasound via a Head-Mounted Display |
| title_sort | augmenting image guided procedures through in situ visualization of 3d ultrasound via a head mounted display |
| topic | augmented reality HoloLens 2 volume rendering ultrasound phantom mixed reality |
| url | https://www.mdpi.com/1424-8220/23/4/2168 |
| work_keys_str_mv | AT felixvonhaxthausen augmentingimageguidedproceduresthroughinsituvisualizationof3dultrasoundviaaheadmounteddisplay AT christophruger augmentingimageguidedproceduresthroughinsituvisualizationof3dultrasoundviaaheadmounteddisplay AT maltemariasieren augmentingimageguidedproceduresthroughinsituvisualizationof3dultrasoundviaaheadmounteddisplay AT romankloeckner augmentingimageguidedproceduresthroughinsituvisualizationof3dultrasoundviaaheadmounteddisplay AT florisernst augmentingimageguidedproceduresthroughinsituvisualizationof3dultrasoundviaaheadmounteddisplay |