Computer-Aided Diagnosis System for Lung Fibrosis: From the Effect of Radiomic Features and Multi-Layer-Perceptron Mixers to Pre-Clinical Evaluation

Medical image segmentation is a crucial element of computer-aided diagnosis (CAD) systems. Segmentation maps are used to calculate imaging features, such as quantitative disease distribution and radiomic features. Since their introduction in 2015, UNets have become the state-of-the-art segmentation...

Full description

Bibliographic Details
Main Authors: M. Fontanellaz, A. Christe, S. Christodoulidis, E. Dack, J. Roos, D. Drakopoulos, D. Sieron, A. Peters, T. Geiser, M. Funke-Chambour, J. Heverhagen, H. Hoppe, A. K. Exadaktylos, L. Ebner, S. Mougiakakou
Format: Article
Language:English
Published: IEEE 2024-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/10381702/
_version_ 1797296354308915200
author M. Fontanellaz
A. Christe
S. Christodoulidis
E. Dack
J. Roos
D. Drakopoulos
D. Sieron
A. Peters
T. Geiser
M. Funke-Chambour
J. Heverhagen
H. Hoppe
A. K. Exadaktylos
L. Ebner
S. Mougiakakou
author_facet M. Fontanellaz
A. Christe
S. Christodoulidis
E. Dack
J. Roos
D. Drakopoulos
D. Sieron
A. Peters
T. Geiser
M. Funke-Chambour
J. Heverhagen
H. Hoppe
A. K. Exadaktylos
L. Ebner
S. Mougiakakou
author_sort M. Fontanellaz
collection DOAJ
description Medical image segmentation is a crucial element of computer-aided diagnosis (CAD) systems. Segmentation maps are used to calculate imaging features, such as quantitative disease distribution and radiomic features. Since their introduction in 2015, UNets have become the state-of-the-art segmentation tools. However, since that time, many new methods for image processing have been introduced, such as vision transformers and multi-layer-perceptron-mixers (MLP-Mixers). Alongside baseline UNets, we have now investigated the application of such MLP-Mixers for medical image segmentation, as part of a CAD system for the diagnosis of interstitial lung diseases (ILDs). Furthermore, we have investigated the effect of 2D and 3D data representations on segmentation and the final CAD results. We have evaluated the performance of the baseline segmentation methods and the MLP-Mixer primary on the overall diagnostic performance of the CAD system - as well as on the accuracy of segmentation as an intermediate step. In addition to network and data representation variations, we have investigated two different techniques for selecting features, an agnostic method and an alternative approach which selects features tailored to a specific segmentation map and diagnosis task. Finally, the CAD’s performance was compared with that of four independent specialists in chest radiology. Among the 105 test cases, the diagnostic accuracy was 77.2±1.6% for the AI-approaches and 79.0±6.9% for the radiologists, indicating that the proposed systems perform comparably well to human readers in most of the cases. For the task of ILD pattern segmentation, similar results were obtained with 3D data and 2D tomography slices.
first_indexed 2024-03-07T22:03:26Z
format Article
id doaj.art-a0f65a8d8101414780b1d2a877e3e9c0
institution Directory Open Access Journal
issn 2169-3536
language English
last_indexed 2024-03-07T22:03:26Z
publishDate 2024-01-01
publisher IEEE
record_format Article
series IEEE Access
spelling doaj.art-a0f65a8d8101414780b1d2a877e3e9c02024-02-24T00:00:44ZengIEEEIEEE Access2169-35362024-01-0112256422565610.1109/ACCESS.2024.335043010381702Computer-Aided Diagnosis System for Lung Fibrosis: From the Effect of Radiomic Features and Multi-Layer-Perceptron Mixers to Pre-Clinical EvaluationM. Fontanellaz0https://orcid.org/0000-0001-9347-4851A. Christe1https://orcid.org/0000-0002-2355-2591S. Christodoulidis2E. Dack3J. Roos4https://orcid.org/0000-0003-3122-6611D. Drakopoulos5D. Sieron6A. Peters7https://orcid.org/0000-0002-9864-6381T. Geiser8M. Funke-Chambour9https://orcid.org/0000-0003-3417-5872J. Heverhagen10H. Hoppe11A. K. Exadaktylos12L. Ebner13S. Mougiakakou14https://orcid.org/0000-0002-6355-9982AI in Health and Nutrition, ARTORG Center for Biomedical Engineering Research, University of Bern, Bern, SwitzerlandDepartment of Diagnostic, Interventional, and Pediatric Radiology, Inselspital, Bern University Hospital, University of Bern, Bern, SwitzerlandLaboratory of Mathematics and Informatics (MICS), CentraleSupélec, Université Paris Saclay, Gif-sur-Yvette, FranceAI in Health and Nutrition, ARTORG Center for Biomedical Engineering Research, University of Bern, Bern, SwitzerlandInstitute of Radiology and Nuclear Medicine, Luzerner Kantonsspital, Lucerne, Canton of Lucerne, SwitzerlandDepartment of Diagnostic, Interventional, and Pediatric Radiology, Inselspital, Bern University Hospital, University of Bern, Bern, SwitzerlandDivision of Magnetic Resonance Imaging, Silesian Center for Heart Diseases, Zabrze, PolandDepartment of Diagnostic, Interventional, and Pediatric Radiology, Inselspital, Bern University Hospital, University of Bern, Bern, SwitzerlandDepartment of Pulmonary Medicine, Inselspital, Bern University Hospital, University of Bern, Bern, SwitzerlandDepartment of Pulmonary Medicine, Inselspital, Bern University Hospital, University of Bern, Bern, SwitzerlandDepartment of Diagnostic, Interventional, and Pediatric Radiology, Inselspital, Bern University Hospital, University of Bern, Bern, SwitzerlandDepartment of Radiology, Lindenhofspital, Bern, SwitzerlandDepartment of Emergency Medicine, Inselspital, University Hospital Bern, University of Bern, Bern, SwitzerlandDepartment of Diagnostic, Interventional, and Pediatric Radiology, Inselspital, Bern University Hospital, University of Bern, Bern, SwitzerlandAI in Health and Nutrition, ARTORG Center for Biomedical Engineering Research, University of Bern, Bern, SwitzerlandMedical image segmentation is a crucial element of computer-aided diagnosis (CAD) systems. Segmentation maps are used to calculate imaging features, such as quantitative disease distribution and radiomic features. Since their introduction in 2015, UNets have become the state-of-the-art segmentation tools. However, since that time, many new methods for image processing have been introduced, such as vision transformers and multi-layer-perceptron-mixers (MLP-Mixers). Alongside baseline UNets, we have now investigated the application of such MLP-Mixers for medical image segmentation, as part of a CAD system for the diagnosis of interstitial lung diseases (ILDs). Furthermore, we have investigated the effect of 2D and 3D data representations on segmentation and the final CAD results. We have evaluated the performance of the baseline segmentation methods and the MLP-Mixer primary on the overall diagnostic performance of the CAD system - as well as on the accuracy of segmentation as an intermediate step. In addition to network and data representation variations, we have investigated two different techniques for selecting features, an agnostic method and an alternative approach which selects features tailored to a specific segmentation map and diagnosis task. Finally, the CAD’s performance was compared with that of four independent specialists in chest radiology. Among the 105 test cases, the diagnostic accuracy was 77.2±1.6% for the AI-approaches and 79.0±6.9% for the radiologists, indicating that the proposed systems perform comparably well to human readers in most of the cases. For the task of ILD pattern segmentation, similar results were obtained with 3D data and 2D tomography slices.https://ieeexplore.ieee.org/document/10381702/Chest X-raychest computed tomographyinterstitial lung diseasesradiomicscomputer-aided diagnosissegmentation
spellingShingle M. Fontanellaz
A. Christe
S. Christodoulidis
E. Dack
J. Roos
D. Drakopoulos
D. Sieron
A. Peters
T. Geiser
M. Funke-Chambour
J. Heverhagen
H. Hoppe
A. K. Exadaktylos
L. Ebner
S. Mougiakakou
Computer-Aided Diagnosis System for Lung Fibrosis: From the Effect of Radiomic Features and Multi-Layer-Perceptron Mixers to Pre-Clinical Evaluation
IEEE Access
Chest X-ray
chest computed tomography
interstitial lung diseases
radiomics
computer-aided diagnosis
segmentation
title Computer-Aided Diagnosis System for Lung Fibrosis: From the Effect of Radiomic Features and Multi-Layer-Perceptron Mixers to Pre-Clinical Evaluation
title_full Computer-Aided Diagnosis System for Lung Fibrosis: From the Effect of Radiomic Features and Multi-Layer-Perceptron Mixers to Pre-Clinical Evaluation
title_fullStr Computer-Aided Diagnosis System for Lung Fibrosis: From the Effect of Radiomic Features and Multi-Layer-Perceptron Mixers to Pre-Clinical Evaluation
title_full_unstemmed Computer-Aided Diagnosis System for Lung Fibrosis: From the Effect of Radiomic Features and Multi-Layer-Perceptron Mixers to Pre-Clinical Evaluation
title_short Computer-Aided Diagnosis System for Lung Fibrosis: From the Effect of Radiomic Features and Multi-Layer-Perceptron Mixers to Pre-Clinical Evaluation
title_sort computer aided diagnosis system for lung fibrosis from the effect of radiomic features and multi layer perceptron mixers to pre clinical evaluation
topic Chest X-ray
chest computed tomography
interstitial lung diseases
radiomics
computer-aided diagnosis
segmentation
url https://ieeexplore.ieee.org/document/10381702/
work_keys_str_mv AT mfontanellaz computeraideddiagnosissystemforlungfibrosisfromtheeffectofradiomicfeaturesandmultilayerperceptronmixerstopreclinicalevaluation
AT achriste computeraideddiagnosissystemforlungfibrosisfromtheeffectofradiomicfeaturesandmultilayerperceptronmixerstopreclinicalevaluation
AT schristodoulidis computeraideddiagnosissystemforlungfibrosisfromtheeffectofradiomicfeaturesandmultilayerperceptronmixerstopreclinicalevaluation
AT edack computeraideddiagnosissystemforlungfibrosisfromtheeffectofradiomicfeaturesandmultilayerperceptronmixerstopreclinicalevaluation
AT jroos computeraideddiagnosissystemforlungfibrosisfromtheeffectofradiomicfeaturesandmultilayerperceptronmixerstopreclinicalevaluation
AT ddrakopoulos computeraideddiagnosissystemforlungfibrosisfromtheeffectofradiomicfeaturesandmultilayerperceptronmixerstopreclinicalevaluation
AT dsieron computeraideddiagnosissystemforlungfibrosisfromtheeffectofradiomicfeaturesandmultilayerperceptronmixerstopreclinicalevaluation
AT apeters computeraideddiagnosissystemforlungfibrosisfromtheeffectofradiomicfeaturesandmultilayerperceptronmixerstopreclinicalevaluation
AT tgeiser computeraideddiagnosissystemforlungfibrosisfromtheeffectofradiomicfeaturesandmultilayerperceptronmixerstopreclinicalevaluation
AT mfunkechambour computeraideddiagnosissystemforlungfibrosisfromtheeffectofradiomicfeaturesandmultilayerperceptronmixerstopreclinicalevaluation
AT jheverhagen computeraideddiagnosissystemforlungfibrosisfromtheeffectofradiomicfeaturesandmultilayerperceptronmixerstopreclinicalevaluation
AT hhoppe computeraideddiagnosissystemforlungfibrosisfromtheeffectofradiomicfeaturesandmultilayerperceptronmixerstopreclinicalevaluation
AT akexadaktylos computeraideddiagnosissystemforlungfibrosisfromtheeffectofradiomicfeaturesandmultilayerperceptronmixerstopreclinicalevaluation
AT lebner computeraideddiagnosissystemforlungfibrosisfromtheeffectofradiomicfeaturesandmultilayerperceptronmixerstopreclinicalevaluation
AT smougiakakou computeraideddiagnosissystemforlungfibrosisfromtheeffectofradiomicfeaturesandmultilayerperceptronmixerstopreclinicalevaluation