Refactoring and performance analysis of the main CNN architectures: using false negative rate minimization to solve the clinical images melanoma detection problem
Abstract Background Melanoma is one of the deadliest tumors in the world. Early detection is critical for first-line therapy in this tumor pathology and it remains challenging due to the need for histological analysis to ensure correctness in diagnosis. Therefore, multiple computer-aided diagnosis (...
| Main Authors: | , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
BMC
2023-10-01
|
| Series: | BMC Bioinformatics |
| Subjects: | |
| Online Access: | https://doi.org/10.1186/s12859-023-05516-5 |
| _version_ | 1797556076422365184 |
|---|---|
| author | Luigi Di Biasi Fabiola De Marco Alessia Auriemma Citarella Modesto Castrillón-Santana Paola Barra Genoveffa Tortora |
| author_facet | Luigi Di Biasi Fabiola De Marco Alessia Auriemma Citarella Modesto Castrillón-Santana Paola Barra Genoveffa Tortora |
| author_sort | Luigi Di Biasi |
| collection | DOAJ |
| description | Abstract Background Melanoma is one of the deadliest tumors in the world. Early detection is critical for first-line therapy in this tumor pathology and it remains challenging due to the need for histological analysis to ensure correctness in diagnosis. Therefore, multiple computer-aided diagnosis (CAD) systems working on melanoma images were proposed to mitigate the need of a biopsy. However, although the high global accuracy is declared in literature results, the CAD systems for the health fields must focus on the lowest false negative rate (FNR) possible to qualify as a diagnosis support system. The final goal must be to avoid classification type 2 errors to prevent life-threatening situations. Another goal could be to create an easy-to-use system for both physicians and patients. Results To achieve the minimization of type 2 error, we performed a wide exploratory analysis of the principal convolutional neural network (CNN) architectures published for the multiple image classification problem; we adapted these networks to the melanoma clinical image binary classification problem (MCIBCP). We collected and analyzed performance data to identify the best CNN architecture, in terms of FNR, usable for solving the MCIBCP problem. Then, to provide a starting point for an easy-to-use CAD system, we used a clinical image dataset (MED-NODE) because clinical images are easier to access: they can be taken by a smartphone or other hand-size devices. Despite the lower resolution than dermoscopic images, the results in the literature would suggest that it would be possible to achieve high classification performance by using clinical images. In this work, we used MED-NODE, which consists of 170 clinical images (70 images of melanoma and 100 images of naevi). We optimized the following CNNs for the MCIBCP problem: Alexnet, DenseNet, GoogleNet Inception V3, GoogleNet, MobileNet, ShuffleNet, SqueezeNet, and VGG16. Conclusions The results suggest that a CNN built on the VGG or AlexNet structure can ensure the lowest FNR (0.07) and (0.13), respectively. In both cases, discrete global performance is ensured: 73% (accuracy), 82% (sensitivity) and 59% (specificity) for VGG; 89% (accuracy), 87% (sensitivity) and 90% (specificity) for AlexNet. |
| first_indexed | 2024-03-10T16:56:36Z |
| format | Article |
| id | doaj.art-2459790dba4145a2a18e172c41105447 |
| institution | Directory Open Access Journal |
| issn | 1471-2105 |
| language | English |
| last_indexed | 2024-03-10T16:56:36Z |
| publishDate | 2023-10-01 |
| publisher | BMC |
| record_format | Article |
| series | BMC Bioinformatics |
| spelling | doaj.art-2459790dba4145a2a18e172c411054472023-11-20T11:06:19ZengBMCBMC Bioinformatics1471-21052023-10-0124111910.1186/s12859-023-05516-5Refactoring and performance analysis of the main CNN architectures: using false negative rate minimization to solve the clinical images melanoma detection problemLuigi Di Biasi0Fabiola De Marco1Alessia Auriemma Citarella2Modesto Castrillón-Santana3Paola Barra4Genoveffa Tortora5Department of Computer Science, University of SalernoDepartment of Computer Science, University of SalernoDepartment of Computer Science, University of SalernoDepartment of Computer Science, Universidad de Las Palmas de Gran CanariaDepartment of Science and Technology, Parthenope University of NaplesDepartment of Computer Science, University of SalernoAbstract Background Melanoma is one of the deadliest tumors in the world. Early detection is critical for first-line therapy in this tumor pathology and it remains challenging due to the need for histological analysis to ensure correctness in diagnosis. Therefore, multiple computer-aided diagnosis (CAD) systems working on melanoma images were proposed to mitigate the need of a biopsy. However, although the high global accuracy is declared in literature results, the CAD systems for the health fields must focus on the lowest false negative rate (FNR) possible to qualify as a diagnosis support system. The final goal must be to avoid classification type 2 errors to prevent life-threatening situations. Another goal could be to create an easy-to-use system for both physicians and patients. Results To achieve the minimization of type 2 error, we performed a wide exploratory analysis of the principal convolutional neural network (CNN) architectures published for the multiple image classification problem; we adapted these networks to the melanoma clinical image binary classification problem (MCIBCP). We collected and analyzed performance data to identify the best CNN architecture, in terms of FNR, usable for solving the MCIBCP problem. Then, to provide a starting point for an easy-to-use CAD system, we used a clinical image dataset (MED-NODE) because clinical images are easier to access: they can be taken by a smartphone or other hand-size devices. Despite the lower resolution than dermoscopic images, the results in the literature would suggest that it would be possible to achieve high classification performance by using clinical images. In this work, we used MED-NODE, which consists of 170 clinical images (70 images of melanoma and 100 images of naevi). We optimized the following CNNs for the MCIBCP problem: Alexnet, DenseNet, GoogleNet Inception V3, GoogleNet, MobileNet, ShuffleNet, SqueezeNet, and VGG16. Conclusions The results suggest that a CNN built on the VGG or AlexNet structure can ensure the lowest FNR (0.07) and (0.13), respectively. In both cases, discrete global performance is ensured: 73% (accuracy), 82% (sensitivity) and 59% (specificity) for VGG; 89% (accuracy), 87% (sensitivity) and 90% (specificity) for AlexNet.https://doi.org/10.1186/s12859-023-05516-5MelanomaSkin cancerDeep leaningIoMT |
| spellingShingle | Luigi Di Biasi Fabiola De Marco Alessia Auriemma Citarella Modesto Castrillón-Santana Paola Barra Genoveffa Tortora Refactoring and performance analysis of the main CNN architectures: using false negative rate minimization to solve the clinical images melanoma detection problem BMC Bioinformatics Melanoma Skin cancer Deep leaning IoMT |
| title | Refactoring and performance analysis of the main CNN architectures: using false negative rate minimization to solve the clinical images melanoma detection problem |
| title_full | Refactoring and performance analysis of the main CNN architectures: using false negative rate minimization to solve the clinical images melanoma detection problem |
| title_fullStr | Refactoring and performance analysis of the main CNN architectures: using false negative rate minimization to solve the clinical images melanoma detection problem |
| title_full_unstemmed | Refactoring and performance analysis of the main CNN architectures: using false negative rate minimization to solve the clinical images melanoma detection problem |
| title_short | Refactoring and performance analysis of the main CNN architectures: using false negative rate minimization to solve the clinical images melanoma detection problem |
| title_sort | refactoring and performance analysis of the main cnn architectures using false negative rate minimization to solve the clinical images melanoma detection problem |
| topic | Melanoma Skin cancer Deep leaning IoMT |
| url | https://doi.org/10.1186/s12859-023-05516-5 |
| work_keys_str_mv | AT luigidibiasi refactoringandperformanceanalysisofthemaincnnarchitecturesusingfalsenegativerateminimizationtosolvetheclinicalimagesmelanomadetectionproblem AT fabiolademarco refactoringandperformanceanalysisofthemaincnnarchitecturesusingfalsenegativerateminimizationtosolvetheclinicalimagesmelanomadetectionproblem AT alessiaauriemmacitarella refactoringandperformanceanalysisofthemaincnnarchitecturesusingfalsenegativerateminimizationtosolvetheclinicalimagesmelanomadetectionproblem AT modestocastrillonsantana refactoringandperformanceanalysisofthemaincnnarchitecturesusingfalsenegativerateminimizationtosolvetheclinicalimagesmelanomadetectionproblem AT paolabarra refactoringandperformanceanalysisofthemaincnnarchitecturesusingfalsenegativerateminimizationtosolvetheclinicalimagesmelanomadetectionproblem AT genoveffatortora refactoringandperformanceanalysisofthemaincnnarchitecturesusingfalsenegativerateminimizationtosolvetheclinicalimagesmelanomadetectionproblem |