Deep Learning Classification of Systemic Sclerosis Skin Using the MobileNetV2 Model
<italic>Goal:</italic> Systemic sclerosis (SSc) is a rare autoimmune, systemic disease with prominent fibrosis of skin and internal organs. Early diagnosis of the disease is crucial for designing effective therapy and management plans. Machine learning algorithms, especially deep learnin...
| Main Authors: | , , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2021-01-01
|
| Series: | IEEE Open Journal of Engineering in Medicine and Biology |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/9380371/ |
| _version_ | 1818970805758853120 |
|---|---|
| author | Metin Akay Yong Du Cheryl L. Sershen Minghua Wu Ting Y. Chen Shervin Assassi Chandra Mohan Yasemin M. Akay |
| author_facet | Metin Akay Yong Du Cheryl L. Sershen Minghua Wu Ting Y. Chen Shervin Assassi Chandra Mohan Yasemin M. Akay |
| author_sort | Metin Akay |
| collection | DOAJ |
| description | <italic>Goal:</italic> Systemic sclerosis (SSc) is a rare autoimmune, systemic disease with prominent fibrosis of skin and internal organs. Early diagnosis of the disease is crucial for designing effective therapy and management plans. Machine learning algorithms, especially deep learning, have been found to be greatly useful in biology, medicine, healthcare, and biomedical applications, in the areas of medical image processing and speech recognition. However, the need for a large training data set and the requirement for a graphics processing unit (GPU) have hindered the wide application of machine learning algorithms as a diagnostic tool in resource-constrained environments (e.g., clinics). <italic>Methods:</italic> In this paper, we propose a novel mobile deep learning network for the characterization of SSc skin. The proposed network architecture consists of the UNet, a dense connectivity convolutional neural network (CNN) with added classifier layers that when combined with limited training data, yields better image segmentation and more accurate classification, and a mobile training module. In addition, to improve the computational efficiency and diagnostic accuracy, the highly efficient training model called “MobileNetV2,” which is designed for mobile and embedded applications, was used to train the network. <italic>Results:</italic> The proposed network was implemented using a standard laptop (2.5 GHz Intel Core i7). After fine tuning, our results showed the proposed network reached 100% accuracy on the training image set, 96.8% accuracy on the validation image set, and 95.2% on the testing image set. The training time was less than 5 hours. We also analyzed the same normal vs SSc skin image sets using the CNN using the same laptop. The CNN reached 100% accuracy on the training image set, 87.7% accuracy on the validation image set, and 82.9% on the testing image set. Additionally, it took more than 14 hours to train the CNN architecture. We also utilized the MobileNetV2 model to analyze an additional dataset of images and classified them as normal, early (mid and moderate) SSc or late (severe) SSc skin images. The network reached 100% accuracy on the training image set, 97.2% on the validation set, and 94.8% on the testing image set. Using the same normal, early and late phase SSc skin images, the CNN reached 100% accuracy on the training image set, 87.7% accuracy on the validation image set, and 82.9% on the testing image set. These results indicated that the MobileNetV2 architecture is more accurate and efficient compared to the CNN to classify normal, early and late phase SSc skin images. <italic>Conclusions:</italic> Our preliminary study, intended to show the efficacy of the proposed network architecture, holds promise in the characterization of SSc. We believe that the proposed network architecture could easily be implemented in a clinical setting, providing a simple, inexpensive, and accurate screening tool for SSc. |
| first_indexed | 2024-12-20T14:42:19Z |
| format | Article |
| id | doaj.art-7bd60bd0e0e0465a8d1484c4b7211077 |
| institution | Directory Open Access Journal |
| issn | 2644-1276 |
| language | English |
| last_indexed | 2024-12-20T14:42:19Z |
| publishDate | 2021-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Open Journal of Engineering in Medicine and Biology |
| spelling | doaj.art-7bd60bd0e0e0465a8d1484c4b72110772022-12-21T19:37:14ZengIEEEIEEE Open Journal of Engineering in Medicine and Biology2644-12762021-01-01210411010.1109/OJEMB.2021.30660979380371Deep Learning Classification of Systemic Sclerosis Skin Using the MobileNetV2 ModelMetin Akay0https://orcid.org/0000-0002-2988-4669Yong Du1Cheryl L. Sershen2Minghua Wu3Ting Y. Chen4Shervin Assassi5Chandra Mohan6Yasemin M. Akay7Biomedical Engineering Department, University of Houston, Houston, TX, USABiomedical Engineering Department, University of Houston, Houston, TX, USABiomedical Engineering Department, University of Houston, Houston, TX, USADivision of Rheumatology and Clinical Immunogenetics, Department of Internal Medicine UTHealth, Houston, TX, USABiomedical Engineering Department, University of Houston, Houston, TX, USADivision of Rheumatology and Clinical Immunogenetics, Department of Internal Medicine UTHealth, Houston, TX, USABiomedical Engineering Department, University of Houston, Houston, TX, USABiomedical Engineering Department, University of Houston, Houston, TX, USA<italic>Goal:</italic> Systemic sclerosis (SSc) is a rare autoimmune, systemic disease with prominent fibrosis of skin and internal organs. Early diagnosis of the disease is crucial for designing effective therapy and management plans. Machine learning algorithms, especially deep learning, have been found to be greatly useful in biology, medicine, healthcare, and biomedical applications, in the areas of medical image processing and speech recognition. However, the need for a large training data set and the requirement for a graphics processing unit (GPU) have hindered the wide application of machine learning algorithms as a diagnostic tool in resource-constrained environments (e.g., clinics). <italic>Methods:</italic> In this paper, we propose a novel mobile deep learning network for the characterization of SSc skin. The proposed network architecture consists of the UNet, a dense connectivity convolutional neural network (CNN) with added classifier layers that when combined with limited training data, yields better image segmentation and more accurate classification, and a mobile training module. In addition, to improve the computational efficiency and diagnostic accuracy, the highly efficient training model called “MobileNetV2,” which is designed for mobile and embedded applications, was used to train the network. <italic>Results:</italic> The proposed network was implemented using a standard laptop (2.5 GHz Intel Core i7). After fine tuning, our results showed the proposed network reached 100% accuracy on the training image set, 96.8% accuracy on the validation image set, and 95.2% on the testing image set. The training time was less than 5 hours. We also analyzed the same normal vs SSc skin image sets using the CNN using the same laptop. The CNN reached 100% accuracy on the training image set, 87.7% accuracy on the validation image set, and 82.9% on the testing image set. Additionally, it took more than 14 hours to train the CNN architecture. We also utilized the MobileNetV2 model to analyze an additional dataset of images and classified them as normal, early (mid and moderate) SSc or late (severe) SSc skin images. The network reached 100% accuracy on the training image set, 97.2% on the validation set, and 94.8% on the testing image set. Using the same normal, early and late phase SSc skin images, the CNN reached 100% accuracy on the training image set, 87.7% accuracy on the validation image set, and 82.9% on the testing image set. These results indicated that the MobileNetV2 architecture is more accurate and efficient compared to the CNN to classify normal, early and late phase SSc skin images. <italic>Conclusions:</italic> Our preliminary study, intended to show the efficacy of the proposed network architecture, holds promise in the characterization of SSc. We believe that the proposed network architecture could easily be implemented in a clinical setting, providing a simple, inexpensive, and accurate screening tool for SSc.https://ieeexplore.ieee.org/document/9380371/Autoimmunedeep learningmobilenetSSc skinunet |
| spellingShingle | Metin Akay Yong Du Cheryl L. Sershen Minghua Wu Ting Y. Chen Shervin Assassi Chandra Mohan Yasemin M. Akay Deep Learning Classification of Systemic Sclerosis Skin Using the MobileNetV2 Model IEEE Open Journal of Engineering in Medicine and Biology Autoimmune deep learning mobilenet SSc skin unet |
| title | Deep Learning Classification of Systemic Sclerosis Skin Using the MobileNetV2 Model |
| title_full | Deep Learning Classification of Systemic Sclerosis Skin Using the MobileNetV2 Model |
| title_fullStr | Deep Learning Classification of Systemic Sclerosis Skin Using the MobileNetV2 Model |
| title_full_unstemmed | Deep Learning Classification of Systemic Sclerosis Skin Using the MobileNetV2 Model |
| title_short | Deep Learning Classification of Systemic Sclerosis Skin Using the MobileNetV2 Model |
| title_sort | deep learning classification of systemic sclerosis skin using the mobilenetv2 model |
| topic | Autoimmune deep learning mobilenet SSc skin unet |
| url | https://ieeexplore.ieee.org/document/9380371/ |
| work_keys_str_mv | AT metinakay deeplearningclassificationofsystemicsclerosisskinusingthemobilenetv2model AT yongdu deeplearningclassificationofsystemicsclerosisskinusingthemobilenetv2model AT cheryllsershen deeplearningclassificationofsystemicsclerosisskinusingthemobilenetv2model AT minghuawu deeplearningclassificationofsystemicsclerosisskinusingthemobilenetv2model AT tingychen deeplearningclassificationofsystemicsclerosisskinusingthemobilenetv2model AT shervinassassi deeplearningclassificationofsystemicsclerosisskinusingthemobilenetv2model AT chandramohan deeplearningclassificationofsystemicsclerosisskinusingthemobilenetv2model AT yaseminmakay deeplearningclassificationofsystemicsclerosisskinusingthemobilenetv2model |