Deep Learning Classification of Colorectal Lesions Based on Whole Slide Images
Microscopic tissue analysis is the key diagnostic method needed for disease identification and choosing the best treatment regimen. According to the Global Cancer Observatory, approximately two million people are diagnosed with colorectal cancer each year, and an accurate diagnosis requires a signif...
Main Authors: | , , , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
MDPI AG
2022-10-01
|
Series: | Algorithms |
Subjects: | |
Online Access: | https://www.mdpi.com/1999-4893/15/11/398 |
_version_ | 1827647560583479296 |
---|---|
author | Sergey A. Soldatov Danil M. Pashkov Sergey A. Guda Nikolay S. Karnaukhov Alexander A. Guda Alexander V. Soldatov |
author_facet | Sergey A. Soldatov Danil M. Pashkov Sergey A. Guda Nikolay S. Karnaukhov Alexander A. Guda Alexander V. Soldatov |
author_sort | Sergey A. Soldatov |
collection | DOAJ |
description | Microscopic tissue analysis is the key diagnostic method needed for disease identification and choosing the best treatment regimen. According to the Global Cancer Observatory, approximately two million people are diagnosed with colorectal cancer each year, and an accurate diagnosis requires a significant amount of time and a highly qualified pathologist to decrease the high mortality rate. Recent development of artificial intelligence technologies and scanning microscopy introduced digital pathology into the field of cancer diagnosis by means of the whole-slide image (WSI). In this work, we applied deep learning methods to diagnose six types of colon mucosal lesions using convolutional neural networks (CNNs). As a result, an algorithm for the automatic segmentation of WSIs of colon biopsies was developed, implementing pre-trained, deep convolutional neural networks of the ResNet and EfficientNet architectures. We compared the classical method and one-cycle policy for CNN training and applied both multi-class and multi-label approaches to solve the classification problem. The multi-label approach was superior because some WSI patches may belong to several classes at once or to none of them. Using the standard one-vs-rest approach, we trained multiple binary classifiers. They achieved the receiver operator curve AUC in the range of 0.80–0.96. Other metrics were also calculated, such as accuracy, precision, sensitivity, specificity, negative predictive value, and F1-score. Obtained CNNs can support human pathologists in the diagnostic process and can be extended to other cancers after adding a sufficient amount of labeled data. |
first_indexed | 2024-03-09T19:20:44Z |
format | Article |
id | doaj.art-1f2188b4b0b8455a95fc04a555b7bfbe |
institution | Directory Open Access Journal |
issn | 1999-4893 |
language | English |
last_indexed | 2024-03-09T19:20:44Z |
publishDate | 2022-10-01 |
publisher | MDPI AG |
record_format | Article |
series | Algorithms |
spelling | doaj.art-1f2188b4b0b8455a95fc04a555b7bfbe2023-11-24T03:22:51ZengMDPI AGAlgorithms1999-48932022-10-01151139810.3390/a15110398Deep Learning Classification of Colorectal Lesions Based on Whole Slide ImagesSergey A. Soldatov0Danil M. Pashkov1Sergey A. Guda2Nikolay S. Karnaukhov3Alexander A. Guda4Alexander V. Soldatov5The Smart Materials Research Institute, Southern Federal University, 344090 Rostov-on-Don, RussiaThe Smart Materials Research Institute, Southern Federal University, 344090 Rostov-on-Don, RussiaThe Smart Materials Research Institute, Southern Federal University, 344090 Rostov-on-Don, RussiaMoscow Clinical Scientific Center n.a. A.S. Loginov, 111123 Moscow, RussiaThe Smart Materials Research Institute, Southern Federal University, 344090 Rostov-on-Don, RussiaThe Smart Materials Research Institute, Southern Federal University, 344090 Rostov-on-Don, RussiaMicroscopic tissue analysis is the key diagnostic method needed for disease identification and choosing the best treatment regimen. According to the Global Cancer Observatory, approximately two million people are diagnosed with colorectal cancer each year, and an accurate diagnosis requires a significant amount of time and a highly qualified pathologist to decrease the high mortality rate. Recent development of artificial intelligence technologies and scanning microscopy introduced digital pathology into the field of cancer diagnosis by means of the whole-slide image (WSI). In this work, we applied deep learning methods to diagnose six types of colon mucosal lesions using convolutional neural networks (CNNs). As a result, an algorithm for the automatic segmentation of WSIs of colon biopsies was developed, implementing pre-trained, deep convolutional neural networks of the ResNet and EfficientNet architectures. We compared the classical method and one-cycle policy for CNN training and applied both multi-class and multi-label approaches to solve the classification problem. The multi-label approach was superior because some WSI patches may belong to several classes at once or to none of them. Using the standard one-vs-rest approach, we trained multiple binary classifiers. They achieved the receiver operator curve AUC in the range of 0.80–0.96. Other metrics were also calculated, such as accuracy, precision, sensitivity, specificity, negative predictive value, and F1-score. Obtained CNNs can support human pathologists in the diagnostic process and can be extended to other cancers after adding a sufficient amount of labeled data.https://www.mdpi.com/1999-4893/15/11/398deep learningconvolutional neural networkswhole-slide imagedigital pathologycolon cancer |
spellingShingle | Sergey A. Soldatov Danil M. Pashkov Sergey A. Guda Nikolay S. Karnaukhov Alexander A. Guda Alexander V. Soldatov Deep Learning Classification of Colorectal Lesions Based on Whole Slide Images Algorithms deep learning convolutional neural networks whole-slide image digital pathology colon cancer |
title | Deep Learning Classification of Colorectal Lesions Based on Whole Slide Images |
title_full | Deep Learning Classification of Colorectal Lesions Based on Whole Slide Images |
title_fullStr | Deep Learning Classification of Colorectal Lesions Based on Whole Slide Images |
title_full_unstemmed | Deep Learning Classification of Colorectal Lesions Based on Whole Slide Images |
title_short | Deep Learning Classification of Colorectal Lesions Based on Whole Slide Images |
title_sort | deep learning classification of colorectal lesions based on whole slide images |
topic | deep learning convolutional neural networks whole-slide image digital pathology colon cancer |
url | https://www.mdpi.com/1999-4893/15/11/398 |
work_keys_str_mv | AT sergeyasoldatov deeplearningclassificationofcolorectallesionsbasedonwholeslideimages AT danilmpashkov deeplearningclassificationofcolorectallesionsbasedonwholeslideimages AT sergeyaguda deeplearningclassificationofcolorectallesionsbasedonwholeslideimages AT nikolayskarnaukhov deeplearningclassificationofcolorectallesionsbasedonwholeslideimages AT alexanderaguda deeplearningclassificationofcolorectallesionsbasedonwholeslideimages AT alexandervsoldatov deeplearningclassificationofcolorectallesionsbasedonwholeslideimages |