Mixed reality navigation training system for liver surgery based on a high‐definition human cross‐sectional anatomy data set
Abstract Objectives This study aims to use the three‐dimensional (3D) mixed‐reality model of liver, entailing complex intrahepatic systems and to deeply study the anatomical structures and to promote the training, diagnosis and treatment of liver diseases. Methods Vascular perfusion human specimens...
Main Authors: | , , , , , , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
Wiley
2023-04-01
|
Series: | Cancer Medicine |
Subjects: | |
Online Access: | https://doi.org/10.1002/cam4.5583 |
_version_ | 1827958699168104448 |
---|---|
author | Muhammad Shahbaz Huachun Miao Zeeshan Farhaj Xin Gong Sun Weikai Wenqing Dong Niu Jun Liu Shuwei Dexin Yu |
author_facet | Muhammad Shahbaz Huachun Miao Zeeshan Farhaj Xin Gong Sun Weikai Wenqing Dong Niu Jun Liu Shuwei Dexin Yu |
author_sort | Muhammad Shahbaz |
collection | DOAJ |
description | Abstract Objectives This study aims to use the three‐dimensional (3D) mixed‐reality model of liver, entailing complex intrahepatic systems and to deeply study the anatomical structures and to promote the training, diagnosis and treatment of liver diseases. Methods Vascular perfusion human specimens were used for thin‐layer frozen milling to obtain liver cross‐sections. The 104‐megapixel‐high‐definition cross sectional data set was established and registered to achieve structure identification and manual segmentation. The digital model was reconstructed and data was used to print a 3D hepatic model. The model was combined with HoloLens mixed reality technology to reflect the complex relationships of intrahepatic systems. We simulated 3D patient specific anatomy for identification and preoperative planning, conducted a questionnaire survey, and evaluated the results. Results The 3D digital model and 1:1 transparent and colored model of liver established truly reflected intrahepatic vessels and their complex relationships. The reconstructed model imported into HoloLens could be accurately matched with the 3D model. Only 7.7% participants could identify accessory hepatic veins. The depth and spatial‐relationship of intrahepatic structures were better understandable for 92%. The 100%, 84.6%, 69% and 84% believed the 3D models were useful in planning, safer surgical paths, reducing intraoperative complications and training of young surgeons respectively. Conclusions A detailed 3D model can be reconstructed using the higher quality cross‐sectional anatomical data set. When combined with 3D printing and HoloLens technology, a novel hybrid‐reality navigation‐training system for liver surgery is created. Mixed Reality training is a worthy alternative to provide 3D information to clinicians and its possible application in surgery. This conclusion was obtained based on a questionnaire and evaluation. Surgeons with extensive experience in surgical operations perceived in the questionnaire that this technology might be useful in liver surgery, would help in precise preoperative planning, accurate intraoperative identification, and reduction of hepatic injury. |
first_indexed | 2024-04-09T15:40:28Z |
format | Article |
id | doaj.art-0602cf328d6a46c49142617e06e323ea |
institution | Directory Open Access Journal |
issn | 2045-7634 |
language | English |
last_indexed | 2024-04-09T15:40:28Z |
publishDate | 2023-04-01 |
publisher | Wiley |
record_format | Article |
series | Cancer Medicine |
spelling | doaj.art-0602cf328d6a46c49142617e06e323ea2023-04-27T10:12:43ZengWileyCancer Medicine2045-76342023-04-011277992800410.1002/cam4.5583Mixed reality navigation training system for liver surgery based on a high‐definition human cross‐sectional anatomy data setMuhammad Shahbaz0Huachun Miao1Zeeshan Farhaj2Xin Gong3Sun Weikai4Wenqing Dong5Niu Jun6Liu Shuwei7Dexin Yu8Department of Radiology, Qilu Hospital of Shandong University Jinan Shandong ChinaDepartment of Anatomy, Wannan Medical College Wuhu Anhui ChinaDepartment of Cardiovascular Surgery, Shandong Qianfoshan Hospital, Cheeloo College of Medicine Shandong University Jinan Shandong ChinaDepartment of Anatomy, Wannan Medical College Wuhu Anhui ChinaDepartment of Radiology, Qilu Hospital of Shandong University Jinan Shandong ChinaDepartment of Anatomy, Wannan Medical College Wuhu Anhui ChinaDepartment of General Surgery Qilu Hospital of Shandong University Jinan Shandong ChinaResearch Center for Sectional and Imaging Anatomy Digital Human Institute, School of Basic Medical Science, Shandong University Jinan Shandong ChinaDepartment of Radiology, Qilu Hospital of Shandong University Jinan Shandong ChinaAbstract Objectives This study aims to use the three‐dimensional (3D) mixed‐reality model of liver, entailing complex intrahepatic systems and to deeply study the anatomical structures and to promote the training, diagnosis and treatment of liver diseases. Methods Vascular perfusion human specimens were used for thin‐layer frozen milling to obtain liver cross‐sections. The 104‐megapixel‐high‐definition cross sectional data set was established and registered to achieve structure identification and manual segmentation. The digital model was reconstructed and data was used to print a 3D hepatic model. The model was combined with HoloLens mixed reality technology to reflect the complex relationships of intrahepatic systems. We simulated 3D patient specific anatomy for identification and preoperative planning, conducted a questionnaire survey, and evaluated the results. Results The 3D digital model and 1:1 transparent and colored model of liver established truly reflected intrahepatic vessels and their complex relationships. The reconstructed model imported into HoloLens could be accurately matched with the 3D model. Only 7.7% participants could identify accessory hepatic veins. The depth and spatial‐relationship of intrahepatic structures were better understandable for 92%. The 100%, 84.6%, 69% and 84% believed the 3D models were useful in planning, safer surgical paths, reducing intraoperative complications and training of young surgeons respectively. Conclusions A detailed 3D model can be reconstructed using the higher quality cross‐sectional anatomical data set. When combined with 3D printing and HoloLens technology, a novel hybrid‐reality navigation‐training system for liver surgery is created. Mixed Reality training is a worthy alternative to provide 3D information to clinicians and its possible application in surgery. This conclusion was obtained based on a questionnaire and evaluation. Surgeons with extensive experience in surgical operations perceived in the questionnaire that this technology might be useful in liver surgery, would help in precise preoperative planning, accurate intraoperative identification, and reduction of hepatic injury.https://doi.org/10.1002/cam4.5583intrahepatic duct systemslivermixed reality modelthree‐dimensional visualizationtraining and teaching system |
spellingShingle | Muhammad Shahbaz Huachun Miao Zeeshan Farhaj Xin Gong Sun Weikai Wenqing Dong Niu Jun Liu Shuwei Dexin Yu Mixed reality navigation training system for liver surgery based on a high‐definition human cross‐sectional anatomy data set Cancer Medicine intrahepatic duct systems liver mixed reality model three‐dimensional visualization training and teaching system |
title | Mixed reality navigation training system for liver surgery based on a high‐definition human cross‐sectional anatomy data set |
title_full | Mixed reality navigation training system for liver surgery based on a high‐definition human cross‐sectional anatomy data set |
title_fullStr | Mixed reality navigation training system for liver surgery based on a high‐definition human cross‐sectional anatomy data set |
title_full_unstemmed | Mixed reality navigation training system for liver surgery based on a high‐definition human cross‐sectional anatomy data set |
title_short | Mixed reality navigation training system for liver surgery based on a high‐definition human cross‐sectional anatomy data set |
title_sort | mixed reality navigation training system for liver surgery based on a high definition human cross sectional anatomy data set |
topic | intrahepatic duct systems liver mixed reality model three‐dimensional visualization training and teaching system |
url | https://doi.org/10.1002/cam4.5583 |
work_keys_str_mv | AT muhammadshahbaz mixedrealitynavigationtrainingsystemforliversurgerybasedonahighdefinitionhumancrosssectionalanatomydataset AT huachunmiao mixedrealitynavigationtrainingsystemforliversurgerybasedonahighdefinitionhumancrosssectionalanatomydataset AT zeeshanfarhaj mixedrealitynavigationtrainingsystemforliversurgerybasedonahighdefinitionhumancrosssectionalanatomydataset AT xingong mixedrealitynavigationtrainingsystemforliversurgerybasedonahighdefinitionhumancrosssectionalanatomydataset AT sunweikai mixedrealitynavigationtrainingsystemforliversurgerybasedonahighdefinitionhumancrosssectionalanatomydataset AT wenqingdong mixedrealitynavigationtrainingsystemforliversurgerybasedonahighdefinitionhumancrosssectionalanatomydataset AT niujun mixedrealitynavigationtrainingsystemforliversurgerybasedonahighdefinitionhumancrosssectionalanatomydataset AT liushuwei mixedrealitynavigationtrainingsystemforliversurgerybasedonahighdefinitionhumancrosssectionalanatomydataset AT dexinyu mixedrealitynavigationtrainingsystemforliversurgerybasedonahighdefinitionhumancrosssectionalanatomydataset |