Registration Sanity Check for AR-guided Surgical Interventions: Experience From Head and Face Surgery
Achieving and maintaining proper image registration accuracy is an open challenge of image-guided surgery. This work explores and assesses the efficacy of a registration sanity check method for augmented reality-guided navigation (AR-RSC), based on the visual inspection of virtual 3D models of landm...
| Main Authors: | , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2024-01-01
|
| Series: | IEEE Journal of Translational Engineering in Health and Medicine |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/10315237/ |
| _version_ | 1826533855493881856 |
|---|---|
| author | Sara Condino Fabrizio Cutolo Marina Carbone Laura Cercenelli Giovanni Badiali Nicola Montemurro Vincenzo Ferrari |
| author_facet | Sara Condino Fabrizio Cutolo Marina Carbone Laura Cercenelli Giovanni Badiali Nicola Montemurro Vincenzo Ferrari |
| author_sort | Sara Condino |
| collection | DOAJ |
| description | Achieving and maintaining proper image registration accuracy is an open challenge of image-guided surgery. This work explores and assesses the efficacy of a registration sanity check method for augmented reality-guided navigation (AR-RSC), based on the visual inspection of virtual 3D models of landmarks. We analyze the AR-RSC sensitivity and specificity by recruiting 36 subjects to assess the registration accuracy of a set of 114 AR images generated from camera images acquired during an AR-guided orthognathic intervention. Translational or rotational errors of known magnitude up to ±1.5 mm/±15.5°, were artificially added to the image set in order to simulate different registration errors. This study analyses the performance of AR-RSC when varying (1) the virtual models selected for misalignment evaluation (e. g., the model of brackets, incisor teeth, and gingival margins in our experiment), (2) the type (translation/rotation) of registration error, and (3) the level of user experience in using AR technologies. Results show that: 1) the sensitivity and specificity of the AR-RSC depends on the virtual models (globally, a median true positive rate of up to 79.2% was reached with brackets, and a median true negative rate of up to 64.3% with incisor teeth), 2) there are error components that are more difficult to identify visually, 3) the level of user experience does not affect the method. In conclusion, the proposed AR-RSC, tested also in the operating room, could represent an efficient method to monitor and optimize the registration accuracy during the intervention, but special attention should be paid to the selection of the AR data chosen for the visual inspection of the registration accuracy. |
| first_indexed | 2024-03-07T21:30:16Z |
| format | Article |
| id | doaj.art-ea07725c93f84436a10ebbbcc21c06c5 |
| institution | Directory Open Access Journal |
| issn | 2168-2372 |
| language | English |
| last_indexed | 2025-03-14T02:13:46Z |
| publishDate | 2024-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Journal of Translational Engineering in Health and Medicine |
| spelling | doaj.art-ea07725c93f84436a10ebbbcc21c06c52025-03-11T23:00:15ZengIEEEIEEE Journal of Translational Engineering in Health and Medicine2168-23722024-01-011225826710.1109/JTEHM.2023.333208810315237Registration Sanity Check for AR-guided Surgical Interventions: Experience From Head and Face SurgerySara Condino0https://orcid.org/0000-0001-5235-0414Fabrizio Cutolo1https://orcid.org/0000-0001-6773-3741Marina Carbone2Laura Cercenelli3https://orcid.org/0000-0001-7818-1356Giovanni Badiali4https://orcid.org/0000-0001-9833-9800Nicola Montemurro5https://orcid.org/0000-0002-3686-8907Vincenzo Ferrari6https://orcid.org/0000-0001-9294-2828Department of Information Engineering, University of Pisa, Pisa, ItalyDepartment of Information Engineering, University of Pisa, Pisa, ItalyDepartment of Information Engineering, University of Pisa, Pisa, ItalyDepartment of Experimental, Diagnostic and Specialty Medicine, EDIMES Laboratory of Bioengineering, University of Bologna, Bologna, ItalyDepartment of Information Engineering, University of Pisa, Pisa, ItalyDepartment of Neurosurgery, Azienda Ospedaliera Universitaria Pisana (AOUP), Pisa, ItalyDepartment of Information Engineering, University of Pisa, Pisa, ItalyAchieving and maintaining proper image registration accuracy is an open challenge of image-guided surgery. This work explores and assesses the efficacy of a registration sanity check method for augmented reality-guided navigation (AR-RSC), based on the visual inspection of virtual 3D models of landmarks. We analyze the AR-RSC sensitivity and specificity by recruiting 36 subjects to assess the registration accuracy of a set of 114 AR images generated from camera images acquired during an AR-guided orthognathic intervention. Translational or rotational errors of known magnitude up to ±1.5 mm/±15.5°, were artificially added to the image set in order to simulate different registration errors. This study analyses the performance of AR-RSC when varying (1) the virtual models selected for misalignment evaluation (e. g., the model of brackets, incisor teeth, and gingival margins in our experiment), (2) the type (translation/rotation) of registration error, and (3) the level of user experience in using AR technologies. Results show that: 1) the sensitivity and specificity of the AR-RSC depends on the virtual models (globally, a median true positive rate of up to 79.2% was reached with brackets, and a median true negative rate of up to 64.3% with incisor teeth), 2) there are error components that are more difficult to identify visually, 3) the level of user experience does not affect the method. In conclusion, the proposed AR-RSC, tested also in the operating room, could represent an efficient method to monitor and optimize the registration accuracy during the intervention, but special attention should be paid to the selection of the AR data chosen for the visual inspection of the registration accuracy.https://ieeexplore.ieee.org/document/10315237/Augmented realitycomputer-assisted surgeryimage-to-patient registrationsanity check |
| spellingShingle | Sara Condino Fabrizio Cutolo Marina Carbone Laura Cercenelli Giovanni Badiali Nicola Montemurro Vincenzo Ferrari Registration Sanity Check for AR-guided Surgical Interventions: Experience From Head and Face Surgery IEEE Journal of Translational Engineering in Health and Medicine Augmented reality computer-assisted surgery image-to-patient registration sanity check |
| title | Registration Sanity Check for AR-guided Surgical Interventions: Experience From Head and Face Surgery |
| title_full | Registration Sanity Check for AR-guided Surgical Interventions: Experience From Head and Face Surgery |
| title_fullStr | Registration Sanity Check for AR-guided Surgical Interventions: Experience From Head and Face Surgery |
| title_full_unstemmed | Registration Sanity Check for AR-guided Surgical Interventions: Experience From Head and Face Surgery |
| title_short | Registration Sanity Check for AR-guided Surgical Interventions: Experience From Head and Face Surgery |
| title_sort | registration sanity check for ar guided surgical interventions experience from head and face surgery |
| topic | Augmented reality computer-assisted surgery image-to-patient registration sanity check |
| url | https://ieeexplore.ieee.org/document/10315237/ |
| work_keys_str_mv | AT saracondino registrationsanitycheckforarguidedsurgicalinterventionsexperiencefromheadandfacesurgery AT fabriziocutolo registrationsanitycheckforarguidedsurgicalinterventionsexperiencefromheadandfacesurgery AT marinacarbone registrationsanitycheckforarguidedsurgicalinterventionsexperiencefromheadandfacesurgery AT lauracercenelli registrationsanitycheckforarguidedsurgicalinterventionsexperiencefromheadandfacesurgery AT giovannibadiali registrationsanitycheckforarguidedsurgicalinterventionsexperiencefromheadandfacesurgery AT nicolamontemurro registrationsanitycheckforarguidedsurgicalinterventionsexperiencefromheadandfacesurgery AT vincenzoferrari registrationsanitycheckforarguidedsurgicalinterventionsexperiencefromheadandfacesurgery |