Feasibility and accuracy of a real-time depth-based markerless navigation method for hologram-guided surgery
Abstract Background Two-dimensional (2D) medical visualization techniques are often insufficient for displaying complex, three-dimensional (3D) anatomical structures. Moreover, the visualization of medical data on a 2D screen during surgery is undesirable, because it requires a surgeon to continuous...
| Main Authors: | , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
BMC
2024-03-01
|
| Series: | BMC Digital Health |
| Subjects: | |
| Online Access: | https://doi.org/10.1186/s44247-024-00067-y |
| _version_ | 1797258984570224640 |
|---|---|
| author | Annabel Groenenberg Lars Brouwers Mike Bemelman Thomas J. J. Maal Jan M. M. Heyligers Max M. Louwerse |
| author_facet | Annabel Groenenberg Lars Brouwers Mike Bemelman Thomas J. J. Maal Jan M. M. Heyligers Max M. Louwerse |
| author_sort | Annabel Groenenberg |
| collection | DOAJ |
| description | Abstract Background Two-dimensional (2D) medical visualization techniques are often insufficient for displaying complex, three-dimensional (3D) anatomical structures. Moreover, the visualization of medical data on a 2D screen during surgery is undesirable, because it requires a surgeon to continuously switch focus. This switching focus problem also results in extensive use of intraoperative radiation to gain additional insights for a 3D configuration. The use of augmented reality (AR) has the potential to overcome these problems, for instance by using markers on target points that are aligned with the AR solution. However, placing markers for a precise virtual overlay are time-costly, always have to be visible within the field of view and disrupt the surgical workflow. In this study, we developed ARCUS, a depth-based, markerless AR navigation system, which overlays 3D virtual elements onto target body parts to overcome the limitations of 2D medical visualization techniques. Methods and results In a phantom study, our markerless ARCUS system was evaluated for accuracy and precision by comparing it to a Quick Response (QR) code-based AR registration method. The evaluation involved measuring the Euclidean distance between target points on a 3D-printed face and their corresponding points on the virtual overlay using a robotic arm for precise measurements. Correlations between the measuring points provided by our markerless system and the actual measuring points on the 3D-print were high, with promising consistent Euclidean distances between the 3D points and the virtual points generated by both our markerless system and the Vuforia QR Code system. We also show two clinical examples of ex vivo case studies on cadaveric human specimens where our markerless ARCUS system could be applicable to. Conclusion The markerless AR navigation system holds strong potential as a 3D visualization method in clinical settings. While both ARCUS and the Vuforia QR code-based method fell short of meeting the surgical threshold of a 2 mm offset, our markerless system demonstrated promising features such as instant registration, markerless operation, and potential compatibility with non-rigid structures. Its automated virtual overlay onto target body parts offers significant advantages, paving the way for investigations into future clinical use. |
| first_indexed | 2024-04-24T23:02:13Z |
| format | Article |
| id | doaj.art-0efac23e42004952996e5dd29621164c |
| institution | Directory Open Access Journal |
| issn | 2731-684X |
| language | English |
| last_indexed | 2024-04-24T23:02:13Z |
| publishDate | 2024-03-01 |
| publisher | BMC |
| record_format | Article |
| series | BMC Digital Health |
| spelling | doaj.art-0efac23e42004952996e5dd29621164c2024-03-17T12:39:01ZengBMCBMC Digital Health2731-684X2024-03-012111110.1186/s44247-024-00067-yFeasibility and accuracy of a real-time depth-based markerless navigation method for hologram-guided surgeryAnnabel Groenenberg0Lars Brouwers1Mike Bemelman2Thomas J. J. Maal3Jan M. M. Heyligers4Max M. Louwerse5Surgery Department, Elisabeth-Tweesteden HospitalSurgery Department, Elisabeth-Tweesteden HospitalSurgery Department, Elisabeth-Tweesteden Hospital3D Lab Maxillofacial Surgery, Radboud University Medical CenterSurgery Department, Elisabeth-Tweesteden HospitalDepartment of Cognitive Science and Artificial Intelligence, Tilburg UniversityAbstract Background Two-dimensional (2D) medical visualization techniques are often insufficient for displaying complex, three-dimensional (3D) anatomical structures. Moreover, the visualization of medical data on a 2D screen during surgery is undesirable, because it requires a surgeon to continuously switch focus. This switching focus problem also results in extensive use of intraoperative radiation to gain additional insights for a 3D configuration. The use of augmented reality (AR) has the potential to overcome these problems, for instance by using markers on target points that are aligned with the AR solution. However, placing markers for a precise virtual overlay are time-costly, always have to be visible within the field of view and disrupt the surgical workflow. In this study, we developed ARCUS, a depth-based, markerless AR navigation system, which overlays 3D virtual elements onto target body parts to overcome the limitations of 2D medical visualization techniques. Methods and results In a phantom study, our markerless ARCUS system was evaluated for accuracy and precision by comparing it to a Quick Response (QR) code-based AR registration method. The evaluation involved measuring the Euclidean distance between target points on a 3D-printed face and their corresponding points on the virtual overlay using a robotic arm for precise measurements. Correlations between the measuring points provided by our markerless system and the actual measuring points on the 3D-print were high, with promising consistent Euclidean distances between the 3D points and the virtual points generated by both our markerless system and the Vuforia QR Code system. We also show two clinical examples of ex vivo case studies on cadaveric human specimens where our markerless ARCUS system could be applicable to. Conclusion The markerless AR navigation system holds strong potential as a 3D visualization method in clinical settings. While both ARCUS and the Vuforia QR code-based method fell short of meeting the surgical threshold of a 2 mm offset, our markerless system demonstrated promising features such as instant registration, markerless operation, and potential compatibility with non-rigid structures. Its automated virtual overlay onto target body parts offers significant advantages, paving the way for investigations into future clinical use.https://doi.org/10.1186/s44247-024-00067-y3D medical visualizationAugmented realityHolographic visualizationMarkerless navigation, hologram-guided surgery, mixed realityImage-guided surgeryComputer vision |
| spellingShingle | Annabel Groenenberg Lars Brouwers Mike Bemelman Thomas J. J. Maal Jan M. M. Heyligers Max M. Louwerse Feasibility and accuracy of a real-time depth-based markerless navigation method for hologram-guided surgery BMC Digital Health 3D medical visualization Augmented reality Holographic visualization Markerless navigation, hologram-guided surgery, mixed reality Image-guided surgery Computer vision |
| title | Feasibility and accuracy of a real-time depth-based markerless navigation method for hologram-guided surgery |
| title_full | Feasibility and accuracy of a real-time depth-based markerless navigation method for hologram-guided surgery |
| title_fullStr | Feasibility and accuracy of a real-time depth-based markerless navigation method for hologram-guided surgery |
| title_full_unstemmed | Feasibility and accuracy of a real-time depth-based markerless navigation method for hologram-guided surgery |
| title_short | Feasibility and accuracy of a real-time depth-based markerless navigation method for hologram-guided surgery |
| title_sort | feasibility and accuracy of a real time depth based markerless navigation method for hologram guided surgery |
| topic | 3D medical visualization Augmented reality Holographic visualization Markerless navigation, hologram-guided surgery, mixed reality Image-guided surgery Computer vision |
| url | https://doi.org/10.1186/s44247-024-00067-y |
| work_keys_str_mv | AT annabelgroenenberg feasibilityandaccuracyofarealtimedepthbasedmarkerlessnavigationmethodforhologramguidedsurgery AT larsbrouwers feasibilityandaccuracyofarealtimedepthbasedmarkerlessnavigationmethodforhologramguidedsurgery AT mikebemelman feasibilityandaccuracyofarealtimedepthbasedmarkerlessnavigationmethodforhologramguidedsurgery AT thomasjjmaal feasibilityandaccuracyofarealtimedepthbasedmarkerlessnavigationmethodforhologramguidedsurgery AT janmmheyligers feasibilityandaccuracyofarealtimedepthbasedmarkerlessnavigationmethodforhologramguidedsurgery AT maxmlouwerse feasibilityandaccuracyofarealtimedepthbasedmarkerlessnavigationmethodforhologramguidedsurgery |