Mixed reality navigation training system for liver surgery based on a high‐definition human cross‐sectional anatomy data set

Abstract Objectives This study aims to use the three‐dimensional (3D) mixed‐reality model of liver, entailing complex intrahepatic systems and to deeply study the anatomical structures and to promote the training, diagnosis and treatment of liver diseases. Methods Vascular perfusion human specimens...

Full description

Bibliographic Details
Main Authors: Muhammad Shahbaz, Huachun Miao, Zeeshan Farhaj, Xin Gong, Sun Weikai, Wenqing Dong, Niu Jun, Liu Shuwei, Dexin Yu
Format: Article
Language:English
Published: Wiley 2023-04-01
Series:Cancer Medicine
Subjects:
Online Access:https://doi.org/10.1002/cam4.5583
_version_ 1827958699168104448
author Muhammad Shahbaz
Huachun Miao
Zeeshan Farhaj
Xin Gong
Sun Weikai
Wenqing Dong
Niu Jun
Liu Shuwei
Dexin Yu
author_facet Muhammad Shahbaz
Huachun Miao
Zeeshan Farhaj
Xin Gong
Sun Weikai
Wenqing Dong
Niu Jun
Liu Shuwei
Dexin Yu
author_sort Muhammad Shahbaz
collection DOAJ
description Abstract Objectives This study aims to use the three‐dimensional (3D) mixed‐reality model of liver, entailing complex intrahepatic systems and to deeply study the anatomical structures and to promote the training, diagnosis and treatment of liver diseases. Methods Vascular perfusion human specimens were used for thin‐layer frozen milling to obtain liver cross‐sections. The 104‐megapixel‐high‐definition cross sectional data set was established and registered to achieve structure identification and manual segmentation. The digital model was reconstructed and data was used to print a 3D hepatic model. The model was combined with HoloLens mixed reality technology to reflect the complex relationships of intrahepatic systems. We simulated 3D patient specific anatomy for identification and preoperative planning, conducted a questionnaire survey, and evaluated the results. Results The 3D digital model and 1:1 transparent and colored model of liver established truly reflected intrahepatic vessels and their complex relationships. The reconstructed model imported into HoloLens could be accurately matched with the 3D model. Only 7.7% participants could identify accessory hepatic veins. The depth and spatial‐relationship of intrahepatic structures were better understandable for 92%. The 100%, 84.6%, 69% and 84% believed the 3D models were useful in planning, safer surgical paths, reducing intraoperative complications and training of young surgeons respectively. Conclusions A detailed 3D model can be reconstructed using the higher quality cross‐sectional anatomical data set. When combined with 3D printing and HoloLens technology, a novel hybrid‐reality navigation‐training system for liver surgery is created. Mixed Reality training is a worthy alternative to provide 3D information to clinicians and its possible application in surgery. This conclusion was obtained based on a questionnaire and evaluation. Surgeons with extensive experience in surgical operations perceived in the questionnaire that this technology might be useful in liver surgery, would help in precise preoperative planning, accurate intraoperative identification, and reduction of hepatic injury.
first_indexed 2024-04-09T15:40:28Z
format Article
id doaj.art-0602cf328d6a46c49142617e06e323ea
institution Directory Open Access Journal
issn 2045-7634
language English
last_indexed 2024-04-09T15:40:28Z
publishDate 2023-04-01
publisher Wiley
record_format Article
series Cancer Medicine
spelling doaj.art-0602cf328d6a46c49142617e06e323ea2023-04-27T10:12:43ZengWileyCancer Medicine2045-76342023-04-011277992800410.1002/cam4.5583Mixed reality navigation training system for liver surgery based on a high‐definition human cross‐sectional anatomy data setMuhammad Shahbaz0Huachun Miao1Zeeshan Farhaj2Xin Gong3Sun Weikai4Wenqing Dong5Niu Jun6Liu Shuwei7Dexin Yu8Department of Radiology, Qilu Hospital of Shandong University Jinan Shandong ChinaDepartment of Anatomy, Wannan Medical College Wuhu Anhui ChinaDepartment of Cardiovascular Surgery, Shandong Qianfoshan Hospital, Cheeloo College of Medicine Shandong University Jinan Shandong ChinaDepartment of Anatomy, Wannan Medical College Wuhu Anhui ChinaDepartment of Radiology, Qilu Hospital of Shandong University Jinan Shandong ChinaDepartment of Anatomy, Wannan Medical College Wuhu Anhui ChinaDepartment of General Surgery Qilu Hospital of Shandong University Jinan Shandong ChinaResearch Center for Sectional and Imaging Anatomy Digital Human Institute, School of Basic Medical Science, Shandong University Jinan Shandong ChinaDepartment of Radiology, Qilu Hospital of Shandong University Jinan Shandong ChinaAbstract Objectives This study aims to use the three‐dimensional (3D) mixed‐reality model of liver, entailing complex intrahepatic systems and to deeply study the anatomical structures and to promote the training, diagnosis and treatment of liver diseases. Methods Vascular perfusion human specimens were used for thin‐layer frozen milling to obtain liver cross‐sections. The 104‐megapixel‐high‐definition cross sectional data set was established and registered to achieve structure identification and manual segmentation. The digital model was reconstructed and data was used to print a 3D hepatic model. The model was combined with HoloLens mixed reality technology to reflect the complex relationships of intrahepatic systems. We simulated 3D patient specific anatomy for identification and preoperative planning, conducted a questionnaire survey, and evaluated the results. Results The 3D digital model and 1:1 transparent and colored model of liver established truly reflected intrahepatic vessels and their complex relationships. The reconstructed model imported into HoloLens could be accurately matched with the 3D model. Only 7.7% participants could identify accessory hepatic veins. The depth and spatial‐relationship of intrahepatic structures were better understandable for 92%. The 100%, 84.6%, 69% and 84% believed the 3D models were useful in planning, safer surgical paths, reducing intraoperative complications and training of young surgeons respectively. Conclusions A detailed 3D model can be reconstructed using the higher quality cross‐sectional anatomical data set. When combined with 3D printing and HoloLens technology, a novel hybrid‐reality navigation‐training system for liver surgery is created. Mixed Reality training is a worthy alternative to provide 3D information to clinicians and its possible application in surgery. This conclusion was obtained based on a questionnaire and evaluation. Surgeons with extensive experience in surgical operations perceived in the questionnaire that this technology might be useful in liver surgery, would help in precise preoperative planning, accurate intraoperative identification, and reduction of hepatic injury.https://doi.org/10.1002/cam4.5583intrahepatic duct systemslivermixed reality modelthree‐dimensional visualizationtraining and teaching system
spellingShingle Muhammad Shahbaz
Huachun Miao
Zeeshan Farhaj
Xin Gong
Sun Weikai
Wenqing Dong
Niu Jun
Liu Shuwei
Dexin Yu
Mixed reality navigation training system for liver surgery based on a high‐definition human cross‐sectional anatomy data set
Cancer Medicine
intrahepatic duct systems
liver
mixed reality model
three‐dimensional visualization
training and teaching system
title Mixed reality navigation training system for liver surgery based on a high‐definition human cross‐sectional anatomy data set
title_full Mixed reality navigation training system for liver surgery based on a high‐definition human cross‐sectional anatomy data set
title_fullStr Mixed reality navigation training system for liver surgery based on a high‐definition human cross‐sectional anatomy data set
title_full_unstemmed Mixed reality navigation training system for liver surgery based on a high‐definition human cross‐sectional anatomy data set
title_short Mixed reality navigation training system for liver surgery based on a high‐definition human cross‐sectional anatomy data set
title_sort mixed reality navigation training system for liver surgery based on a high definition human cross sectional anatomy data set
topic intrahepatic duct systems
liver
mixed reality model
three‐dimensional visualization
training and teaching system
url https://doi.org/10.1002/cam4.5583
work_keys_str_mv AT muhammadshahbaz mixedrealitynavigationtrainingsystemforliversurgerybasedonahighdefinitionhumancrosssectionalanatomydataset
AT huachunmiao mixedrealitynavigationtrainingsystemforliversurgerybasedonahighdefinitionhumancrosssectionalanatomydataset
AT zeeshanfarhaj mixedrealitynavigationtrainingsystemforliversurgerybasedonahighdefinitionhumancrosssectionalanatomydataset
AT xingong mixedrealitynavigationtrainingsystemforliversurgerybasedonahighdefinitionhumancrosssectionalanatomydataset
AT sunweikai mixedrealitynavigationtrainingsystemforliversurgerybasedonahighdefinitionhumancrosssectionalanatomydataset
AT wenqingdong mixedrealitynavigationtrainingsystemforliversurgerybasedonahighdefinitionhumancrosssectionalanatomydataset
AT niujun mixedrealitynavigationtrainingsystemforliversurgerybasedonahighdefinitionhumancrosssectionalanatomydataset
AT liushuwei mixedrealitynavigationtrainingsystemforliversurgerybasedonahighdefinitionhumancrosssectionalanatomydataset
AT dexinyu mixedrealitynavigationtrainingsystemforliversurgerybasedonahighdefinitionhumancrosssectionalanatomydataset