Practical Application of Augmented/Mixed Reality Technologies in Surgery of Abdominal Cancer Patients
The technology of augmented and mixed reality (AR/MR) is useful in various areas of modern surgery. We considered the use of augmented and mixed reality technologies as a method of preoperative planning and intraoperative navigation in abdominal cancer patients. Practical use of AM/MR raises a range...
| Main Authors: | , , , , , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2022-06-01
|
| Series: | Journal of Imaging |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2313-433X/8/7/183 |
| _version_ | 1827596918806544384 |
|---|---|
| author | Vladimir M. Ivanov Anton M. Krivtsov Sergey V. Strelkov Anton Yu. Smirnov Roman Yu. Shipov Vladimir G. Grebenkov Valery N. Rumyantsev Igor S. Gheleznyak Dmitry A. Surov Michail S. Korzhuk Valery S. Koskin |
| author_facet | Vladimir M. Ivanov Anton M. Krivtsov Sergey V. Strelkov Anton Yu. Smirnov Roman Yu. Shipov Vladimir G. Grebenkov Valery N. Rumyantsev Igor S. Gheleznyak Dmitry A. Surov Michail S. Korzhuk Valery S. Koskin |
| author_sort | Vladimir M. Ivanov |
| collection | DOAJ |
| description | The technology of augmented and mixed reality (AR/MR) is useful in various areas of modern surgery. We considered the use of augmented and mixed reality technologies as a method of preoperative planning and intraoperative navigation in abdominal cancer patients. Practical use of AM/MR raises a range questions, which demand suitable solutions. The difficulties and obstacles we encountered in the practical use of AR/MR are presented, along with the ways we chose to overcome them. The most demonstrative case is covered in detail. The three-dimensional anatomical model obtained from the CT scan needed to be rigidly attached to the patient’s body, and therefore an invasive approach was developed, using an orthopedic pin fixed to the pelvic bones. The pin is used both similarly to an X-ray contrast marker and as a marker for augmented reality. This solution made it possible, not only to visualize the anatomical structures of the patient and the border zone of the tumor, but also to change the position of the patient during the operation. In addition, a noninvasive (skin-based) marking method was developed that allows the application of mixed and augmented reality during operation. Both techniques were used (8 clinical cases) for preoperative planning and intraoperative navigation, which allowed surgeons to verify the radicality of the operation, to have visual control of all anatomical structures near the zone of interest, and to reduce the time of surgical intervention, thereby reducing the complication rate and improving the rehabilitation period. |
| first_indexed | 2024-03-09T03:19:16Z |
| format | Article |
| id | doaj.art-ce18c7161fe24877b15e7d298c6fc203 |
| institution | Directory Open Access Journal |
| issn | 2313-433X |
| language | English |
| last_indexed | 2024-03-09T03:19:16Z |
| publishDate | 2022-06-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Journal of Imaging |
| spelling | doaj.art-ce18c7161fe24877b15e7d298c6fc2032023-12-03T15:14:22ZengMDPI AGJournal of Imaging2313-433X2022-06-018718310.3390/jimaging8070183Practical Application of Augmented/Mixed Reality Technologies in Surgery of Abdominal Cancer PatientsVladimir M. Ivanov0Anton M. Krivtsov1Sergey V. Strelkov2Anton Yu. Smirnov3Roman Yu. Shipov4Vladimir G. Grebenkov5Valery N. Rumyantsev6Igor S. Gheleznyak7Dmitry A. Surov8Michail S. Korzhuk9Valery S. Koskin10Higher School of Theoretical Mechanics and Mathematical Physics, Peter the Great Saint Petersburg Polytechnic University, 195251 St. Petersburg, RussiaHigher School of Theoretical Mechanics and Mathematical Physics, Peter the Great Saint Petersburg Polytechnic University, 195251 St. Petersburg, RussiaHigher School of Theoretical Mechanics and Mathematical Physics, Peter the Great Saint Petersburg Polytechnic University, 195251 St. Petersburg, RussiaHigher School of Theoretical Mechanics and Mathematical Physics, Peter the Great Saint Petersburg Polytechnic University, 195251 St. Petersburg, RussiaHigher School of Theoretical Mechanics and Mathematical Physics, Peter the Great Saint Petersburg Polytechnic University, 195251 St. Petersburg, RussiaDepartment & Clinic of Naval Surgery, Military Medical Academy Named after S. M. Kirov, Academic Lebedev Street 6, 194044 St. Petersburg, RussiaDepartment & Clinic of Naval Surgery, Military Medical Academy Named after S. M. Kirov, Academic Lebedev Street 6, 194044 St. Petersburg, RussiaDepartment & Clinic of Roentgenology & Radiology, Military Medical Academy Named after S. M. Kirov, Academic Lebedev Street 6, 194044 St. Petersburg, RussiaDepartment & Clinic of Naval Surgery, Military Medical Academy Named after S. M. Kirov, Academic Lebedev Street 6, 194044 St. Petersburg, RussiaDepartment & Clinic of Naval Surgery, Military Medical Academy Named after S. M. Kirov, Academic Lebedev Street 6, 194044 St. Petersburg, RussiaDepartment & Clinic of Military Field Surgery, Military Medical Academy Named after S. M. Kirov, Academic Lebedev Street 6, 194044 St. Petersburg, RussiaThe technology of augmented and mixed reality (AR/MR) is useful in various areas of modern surgery. We considered the use of augmented and mixed reality technologies as a method of preoperative planning and intraoperative navigation in abdominal cancer patients. Practical use of AM/MR raises a range questions, which demand suitable solutions. The difficulties and obstacles we encountered in the practical use of AR/MR are presented, along with the ways we chose to overcome them. The most demonstrative case is covered in detail. The three-dimensional anatomical model obtained from the CT scan needed to be rigidly attached to the patient’s body, and therefore an invasive approach was developed, using an orthopedic pin fixed to the pelvic bones. The pin is used both similarly to an X-ray contrast marker and as a marker for augmented reality. This solution made it possible, not only to visualize the anatomical structures of the patient and the border zone of the tumor, but also to change the position of the patient during the operation. In addition, a noninvasive (skin-based) marking method was developed that allows the application of mixed and augmented reality during operation. Both techniques were used (8 clinical cases) for preoperative planning and intraoperative navigation, which allowed surgeons to verify the radicality of the operation, to have visual control of all anatomical structures near the zone of interest, and to reduce the time of surgical intervention, thereby reducing the complication rate and improving the rehabilitation period.https://www.mdpi.com/2313-433X/8/7/183mixed realityaugmented realitycancersurgeryHololensCT scan |
| spellingShingle | Vladimir M. Ivanov Anton M. Krivtsov Sergey V. Strelkov Anton Yu. Smirnov Roman Yu. Shipov Vladimir G. Grebenkov Valery N. Rumyantsev Igor S. Gheleznyak Dmitry A. Surov Michail S. Korzhuk Valery S. Koskin Practical Application of Augmented/Mixed Reality Technologies in Surgery of Abdominal Cancer Patients Journal of Imaging mixed reality augmented reality cancer surgery Hololens CT scan |
| title | Practical Application of Augmented/Mixed Reality Technologies in Surgery of Abdominal Cancer Patients |
| title_full | Practical Application of Augmented/Mixed Reality Technologies in Surgery of Abdominal Cancer Patients |
| title_fullStr | Practical Application of Augmented/Mixed Reality Technologies in Surgery of Abdominal Cancer Patients |
| title_full_unstemmed | Practical Application of Augmented/Mixed Reality Technologies in Surgery of Abdominal Cancer Patients |
| title_short | Practical Application of Augmented/Mixed Reality Technologies in Surgery of Abdominal Cancer Patients |
| title_sort | practical application of augmented mixed reality technologies in surgery of abdominal cancer patients |
| topic | mixed reality augmented reality cancer surgery Hololens CT scan |
| url | https://www.mdpi.com/2313-433X/8/7/183 |
| work_keys_str_mv | AT vladimirmivanov practicalapplicationofaugmentedmixedrealitytechnologiesinsurgeryofabdominalcancerpatients AT antonmkrivtsov practicalapplicationofaugmentedmixedrealitytechnologiesinsurgeryofabdominalcancerpatients AT sergeyvstrelkov practicalapplicationofaugmentedmixedrealitytechnologiesinsurgeryofabdominalcancerpatients AT antonyusmirnov practicalapplicationofaugmentedmixedrealitytechnologiesinsurgeryofabdominalcancerpatients AT romanyushipov practicalapplicationofaugmentedmixedrealitytechnologiesinsurgeryofabdominalcancerpatients AT vladimirggrebenkov practicalapplicationofaugmentedmixedrealitytechnologiesinsurgeryofabdominalcancerpatients AT valerynrumyantsev practicalapplicationofaugmentedmixedrealitytechnologiesinsurgeryofabdominalcancerpatients AT igorsgheleznyak practicalapplicationofaugmentedmixedrealitytechnologiesinsurgeryofabdominalcancerpatients AT dmitryasurov practicalapplicationofaugmentedmixedrealitytechnologiesinsurgeryofabdominalcancerpatients AT michailskorzhuk practicalapplicationofaugmentedmixedrealitytechnologiesinsurgeryofabdominalcancerpatients AT valeryskoskin practicalapplicationofaugmentedmixedrealitytechnologiesinsurgeryofabdominalcancerpatients |