Explainable COVID-19 Detection Based on Chest X-rays Using an End-to-End RegNet Architecture

COVID-19,which is caused by the severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2), is one of the worst pandemics in recent history. The identification of patients suspected to be infected with COVID-19 is becoming crucial to reduce its spread. We aimed to validate and test a deep learning...

Full description

Bibliographic Details
Main Authors: Mohamed Chetoui, Moulay A. Akhloufi, El Mostafa Bouattane, Joseph Abdulnour, Stephane Roux, Chantal D’Aoust Bernard
Format: Article
Language:English
Published: MDPI AG 2023-06-01
Series:Viruses
Subjects:
Online Access:https://www.mdpi.com/1999-4915/15/6/1327
_version_ 1797592344161157120
author Mohamed Chetoui
Moulay A. Akhloufi
El Mostafa Bouattane
Joseph Abdulnour
Stephane Roux
Chantal D’Aoust Bernard
author_facet Mohamed Chetoui
Moulay A. Akhloufi
El Mostafa Bouattane
Joseph Abdulnour
Stephane Roux
Chantal D’Aoust Bernard
author_sort Mohamed Chetoui
collection DOAJ
description COVID-19,which is caused by the severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2), is one of the worst pandemics in recent history. The identification of patients suspected to be infected with COVID-19 is becoming crucial to reduce its spread. We aimed to validate and test a deep learning model to detect COVID-19 based on chest X-rays. The recent deep convolutional neural network (CNN) RegNetX032 was adapted for detecting COVID-19 from chest X-ray (CXR) images using polymerase chain reaction (RT-PCR) as a reference. The model was customized and trained on five datasets containing more than 15,000 CXR images (including 4148COVID-19-positive cases) and then tested on 321 images (150 COVID-19-positive) from Montfort Hospital. Twenty percent of the data from the five datasets were used as validation data for hyperparameter optimization. Each CXR image was processed by the model to detect COVID-19. Multi-binary classifications were proposed, such as: COVID-19 vs. normal, COVID-19 + pneumonia vs. normal, and pneumonia vs. normal. The performance results were based on the area under the curve (AUC), sensitivity, and specificity. In addition, an explainability model was developed that demonstrated the high performance and high generalization degree of the proposed model in detecting and highlighting the signs of the disease. The fine-tuned RegNetX032 model achieved an overall accuracy score of 96.0%, with an AUC score of 99.1%. The model showed a superior sensitivity of 98.0% in detecting signs from CXR images of COVID-19 patients, and a specificity of 93.0% in detecting healthy CXR images. A second scenario compared COVID-19 + pneumonia vs. normal (healthy X-ray) patients. The model achieved an overall score of 99.1% (AUC) with a sensitivity of 96.0% and specificity of 93.0% on the Montfort dataset. For the validation set, the model achieved an average accuracy of 98.6%, an AUC score of 98.0%, a sensitivity of 98.0%, and a specificity of 96.0% for detection (COVID-19 patients vs. healthy patients). The second scenario compared COVID-19 + pneumonia vs. normal patients. The model achieved an overall score of 98.8% (AUC) with a sensitivity of 97.0% and a specificity of 96.0%. This robust deep learning model demonstrated excellent performance in detecting COVID-19 from chest X-rays. This model could be used to automate the detection of COVID-19 and improve decision making for patient triage and isolation in hospital settings. This could also be used as a complementary aid for radiologists or clinicians when differentiating to make smart decisions.
first_indexed 2024-03-11T01:49:49Z
format Article
id doaj.art-28217ca383ea47ce9fdffa27a700a8f6
institution Directory Open Access Journal
issn 1999-4915
language English
last_indexed 2024-03-11T01:49:49Z
publishDate 2023-06-01
publisher MDPI AG
record_format Article
series Viruses
spelling doaj.art-28217ca383ea47ce9fdffa27a700a8f62023-11-18T13:02:15ZengMDPI AGViruses1999-49152023-06-01156132710.3390/v15061327Explainable COVID-19 Detection Based on Chest X-rays Using an End-to-End RegNet ArchitectureMohamed Chetoui0Moulay A. Akhloufi1El Mostafa Bouattane2Joseph Abdulnour3Stephane Roux4Chantal D’Aoust Bernard5Perception, Robotics, and Intelligent Machines (PRIME), Department of Computer Science, Université de Moncton, Moncton, NB E1A 3E9, CanadaPerception, Robotics, and Intelligent Machines (PRIME), Department of Computer Science, Université de Moncton, Moncton, NB E1A 3E9, CanadaMontfort Academic Hospital, Institut du Savoir Montfort, Ottawa, ON 61350, CanadaMontfort Academic Hospital, Institut du Savoir Montfort, Ottawa, ON 61350, CanadaMontfort Academic Hospital, Institut du Savoir Montfort, Ottawa, ON 61350, CanadaMontfort Academic Hospital, Institut du Savoir Montfort, Ottawa, ON 61350, CanadaCOVID-19,which is caused by the severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2), is one of the worst pandemics in recent history. The identification of patients suspected to be infected with COVID-19 is becoming crucial to reduce its spread. We aimed to validate and test a deep learning model to detect COVID-19 based on chest X-rays. The recent deep convolutional neural network (CNN) RegNetX032 was adapted for detecting COVID-19 from chest X-ray (CXR) images using polymerase chain reaction (RT-PCR) as a reference. The model was customized and trained on five datasets containing more than 15,000 CXR images (including 4148COVID-19-positive cases) and then tested on 321 images (150 COVID-19-positive) from Montfort Hospital. Twenty percent of the data from the five datasets were used as validation data for hyperparameter optimization. Each CXR image was processed by the model to detect COVID-19. Multi-binary classifications were proposed, such as: COVID-19 vs. normal, COVID-19 + pneumonia vs. normal, and pneumonia vs. normal. The performance results were based on the area under the curve (AUC), sensitivity, and specificity. In addition, an explainability model was developed that demonstrated the high performance and high generalization degree of the proposed model in detecting and highlighting the signs of the disease. The fine-tuned RegNetX032 model achieved an overall accuracy score of 96.0%, with an AUC score of 99.1%. The model showed a superior sensitivity of 98.0% in detecting signs from CXR images of COVID-19 patients, and a specificity of 93.0% in detecting healthy CXR images. A second scenario compared COVID-19 + pneumonia vs. normal (healthy X-ray) patients. The model achieved an overall score of 99.1% (AUC) with a sensitivity of 96.0% and specificity of 93.0% on the Montfort dataset. For the validation set, the model achieved an average accuracy of 98.6%, an AUC score of 98.0%, a sensitivity of 98.0%, and a specificity of 96.0% for detection (COVID-19 patients vs. healthy patients). The second scenario compared COVID-19 + pneumonia vs. normal patients. The model achieved an overall score of 98.8% (AUC) with a sensitivity of 97.0% and a specificity of 96.0%. This robust deep learning model demonstrated excellent performance in detecting COVID-19 from chest X-rays. This model could be used to automate the detection of COVID-19 and improve decision making for patient triage and isolation in hospital settings. This could also be used as a complementary aid for radiologists or clinicians when differentiating to make smart decisions.https://www.mdpi.com/1999-4915/15/6/1327RegNetconvolutional neural networksCOVID-19deep learning
spellingShingle Mohamed Chetoui
Moulay A. Akhloufi
El Mostafa Bouattane
Joseph Abdulnour
Stephane Roux
Chantal D’Aoust Bernard
Explainable COVID-19 Detection Based on Chest X-rays Using an End-to-End RegNet Architecture
Viruses
RegNet
convolutional neural networks
COVID-19
deep learning
title Explainable COVID-19 Detection Based on Chest X-rays Using an End-to-End RegNet Architecture
title_full Explainable COVID-19 Detection Based on Chest X-rays Using an End-to-End RegNet Architecture
title_fullStr Explainable COVID-19 Detection Based on Chest X-rays Using an End-to-End RegNet Architecture
title_full_unstemmed Explainable COVID-19 Detection Based on Chest X-rays Using an End-to-End RegNet Architecture
title_short Explainable COVID-19 Detection Based on Chest X-rays Using an End-to-End RegNet Architecture
title_sort explainable covid 19 detection based on chest x rays using an end to end regnet architecture
topic RegNet
convolutional neural networks
COVID-19
deep learning
url https://www.mdpi.com/1999-4915/15/6/1327
work_keys_str_mv AT mohamedchetoui explainablecovid19detectionbasedonchestxraysusinganendtoendregnetarchitecture
AT moulayaakhloufi explainablecovid19detectionbasedonchestxraysusinganendtoendregnetarchitecture
AT elmostafabouattane explainablecovid19detectionbasedonchestxraysusinganendtoendregnetarchitecture
AT josephabdulnour explainablecovid19detectionbasedonchestxraysusinganendtoendregnetarchitecture
AT stephaneroux explainablecovid19detectionbasedonchestxraysusinganendtoendregnetarchitecture
AT chantaldaoustbernard explainablecovid19detectionbasedonchestxraysusinganendtoendregnetarchitecture