Surgical Guidance for Removal of Cholesteatoma Using a Multispectral 3D-Endoscope

We develop a stereo-multispectral endoscopic prototype in which a filter-wheel is used for surgical guidance to remove cholesteatoma tissue in the middle ear. Cholesteatoma is a destructive proliferating tissue. The only treatment for this disease is surgery. Removal is a very demanding task, even f...

Full description

Bibliographic Details
Main Authors: Eric L. Wisotzky, Jean-Claude Rosenthal, Ulla Wege, Anna Hilsmann, Peter Eisert, Florian C. Uecker
Format: Article
Language:English
Published: MDPI AG 2020-09-01
Series:Sensors
Subjects:
Online Access:https://www.mdpi.com/1424-8220/20/18/5334
_version_ 1797553392919248896
author Eric L. Wisotzky
Jean-Claude Rosenthal
Ulla Wege
Anna Hilsmann
Peter Eisert
Florian C. Uecker
author_facet Eric L. Wisotzky
Jean-Claude Rosenthal
Ulla Wege
Anna Hilsmann
Peter Eisert
Florian C. Uecker
author_sort Eric L. Wisotzky
collection DOAJ
description We develop a stereo-multispectral endoscopic prototype in which a filter-wheel is used for surgical guidance to remove cholesteatoma tissue in the middle ear. Cholesteatoma is a destructive proliferating tissue. The only treatment for this disease is surgery. Removal is a very demanding task, even for experienced surgeons. It is very difficult to distinguish between bone and cholesteatoma. In addition, it can even reoccur if not all tissue particles of the cholesteatoma are removed, which leads to undesirable follow-up operations. Therefore, we propose an image-based method that combines multispectral tissue classification and 3D reconstruction to identify all parts of the removed tissue and determine their metric dimensions intraoperatively. The designed multispectral filter-wheel 3D-endoscope prototype can switch between narrow-band spectral and broad-band white illumination, which is technically evaluated in terms of optical system properties. Further, it is tested and evaluated on three patients. The wavelengths 400 nm and 420 nm are identified as most suitable for the differentiation task. The stereoscopic image acquisition allows accurate 3D surface reconstruction of the enhanced image information. The first results are promising, as the cholesteatoma can be easily highlighted, correctly identified, and visualized as a true-to-scale 3D model showing the patient-specific anatomy.
first_indexed 2024-03-10T16:15:49Z
format Article
id doaj.art-9b0bdb25ef7145579f5f671a73067ebf
institution Directory Open Access Journal
issn 1424-8220
language English
last_indexed 2024-03-10T16:15:49Z
publishDate 2020-09-01
publisher MDPI AG
record_format Article
series Sensors
spelling doaj.art-9b0bdb25ef7145579f5f671a73067ebf2023-11-20T14:07:12ZengMDPI AGSensors1424-82202020-09-012018533410.3390/s20185334Surgical Guidance for Removal of Cholesteatoma Using a Multispectral 3D-EndoscopeEric L. Wisotzky0Jean-Claude Rosenthal1Ulla Wege2Anna Hilsmann3Peter Eisert4Florian C. Uecker5Department of Computer Vision and Graphics, Fraunhofer Heinrich-Hertz-Institute, 10587 Berlin, GermanyDepartment of Computer Vision and Graphics, Fraunhofer Heinrich-Hertz-Institute, 10587 Berlin, GermanyDepartment of Computer Vision and Graphics, Fraunhofer Heinrich-Hertz-Institute, 10587 Berlin, GermanyDepartment of Computer Vision and Graphics, Fraunhofer Heinrich-Hertz-Institute, 10587 Berlin, GermanyDepartment of Computer Vision and Graphics, Fraunhofer Heinrich-Hertz-Institute, 10587 Berlin, GermanyDepartment of Otorhinolaryngology, Charité-Universitätsmedizin Berlin, 10117 Berlin, GermanyWe develop a stereo-multispectral endoscopic prototype in which a filter-wheel is used for surgical guidance to remove cholesteatoma tissue in the middle ear. Cholesteatoma is a destructive proliferating tissue. The only treatment for this disease is surgery. Removal is a very demanding task, even for experienced surgeons. It is very difficult to distinguish between bone and cholesteatoma. In addition, it can even reoccur if not all tissue particles of the cholesteatoma are removed, which leads to undesirable follow-up operations. Therefore, we propose an image-based method that combines multispectral tissue classification and 3D reconstruction to identify all parts of the removed tissue and determine their metric dimensions intraoperatively. The designed multispectral filter-wheel 3D-endoscope prototype can switch between narrow-band spectral and broad-band white illumination, which is technically evaluated in terms of optical system properties. Further, it is tested and evaluated on three patients. The wavelengths 400 nm and 420 nm are identified as most suitable for the differentiation task. The stereoscopic image acquisition allows accurate 3D surface reconstruction of the enhanced image information. The first results are promising, as the cholesteatoma can be easily highlighted, correctly identified, and visualized as a true-to-scale 3D model showing the patient-specific anatomy.https://www.mdpi.com/1424-8220/20/18/5334stereoscopic imagingmultispectral imagingimage-guided surgerysurgical guidanceclinical decision support
spellingShingle Eric L. Wisotzky
Jean-Claude Rosenthal
Ulla Wege
Anna Hilsmann
Peter Eisert
Florian C. Uecker
Surgical Guidance for Removal of Cholesteatoma Using a Multispectral 3D-Endoscope
Sensors
stereoscopic imaging
multispectral imaging
image-guided surgery
surgical guidance
clinical decision support
title Surgical Guidance for Removal of Cholesteatoma Using a Multispectral 3D-Endoscope
title_full Surgical Guidance for Removal of Cholesteatoma Using a Multispectral 3D-Endoscope
title_fullStr Surgical Guidance for Removal of Cholesteatoma Using a Multispectral 3D-Endoscope
title_full_unstemmed Surgical Guidance for Removal of Cholesteatoma Using a Multispectral 3D-Endoscope
title_short Surgical Guidance for Removal of Cholesteatoma Using a Multispectral 3D-Endoscope
title_sort surgical guidance for removal of cholesteatoma using a multispectral 3d endoscope
topic stereoscopic imaging
multispectral imaging
image-guided surgery
surgical guidance
clinical decision support
url https://www.mdpi.com/1424-8220/20/18/5334
work_keys_str_mv AT ericlwisotzky surgicalguidanceforremovalofcholesteatomausingamultispectral3dendoscope
AT jeanclauderosenthal surgicalguidanceforremovalofcholesteatomausingamultispectral3dendoscope
AT ullawege surgicalguidanceforremovalofcholesteatomausingamultispectral3dendoscope
AT annahilsmann surgicalguidanceforremovalofcholesteatomausingamultispectral3dendoscope
AT petereisert surgicalguidanceforremovalofcholesteatomausingamultispectral3dendoscope
AT floriancuecker surgicalguidanceforremovalofcholesteatomausingamultispectral3dendoscope