DenResCov-19: a deep transfer learning network for robust automatic classification of COVID-19, pneumonia, and tuberculosis from X-rays

The global pandemic of coronavirus disease 2019 (COVID-19) is continuing to have a significant effect on the well-being of the global population, thus increasing the demand for rapid testing, diagnosis, and treatment. As COVID-19 can cause severe pneumonia, early diagnosis is essential for correct t...

Full description

Bibliographic Details
Main Authors: Mamalakis, M, Swift, AJ, Vorselaars, B, Ray, S, Weeks, S, Ding, W, Clayton, RH, Mackenzie, LS, Banerjee, A
Format: Journal article
Language:English
Published: Elsevier 2021
_version_ 1797108088153571328
author Mamalakis, M
Swift, AJ
Vorselaars, B
Ray, S
Weeks, S
Ding, W
Clayton, RH
Mackenzie, LS
Banerjee, A
author_facet Mamalakis, M
Swift, AJ
Vorselaars, B
Ray, S
Weeks, S
Ding, W
Clayton, RH
Mackenzie, LS
Banerjee, A
author_sort Mamalakis, M
collection OXFORD
description The global pandemic of coronavirus disease 2019 (COVID-19) is continuing to have a significant effect on the well-being of the global population, thus increasing the demand for rapid testing, diagnosis, and treatment. As COVID-19 can cause severe pneumonia, early diagnosis is essential for correct treatment, as well as to reduce the stress on the healthcare system. Along with COVID-19, other etiologies of pneumonia and Tuberculosis (TB) constitute additional challenges to the medical system. Pneumonia (viral as well as bacterial) kills about 2 million infants every year and is consistently estimated as one of the most important factor of childhood mortality (according to the World Health Organization). Chest X-ray (CXR) and computed tomography (CT) scans are the primary imaging modalities for diagnosing respiratory diseases. Although CT scans are the gold standard, they are more expensive, time consuming, and are associated with a small but significant dose of radiation. Hence, CXR have become more widespread as a first line investigation. In this regard, the objective of this work is to develop a new deep transfer learning pipeline, named DenResCov-19, to diagnose patients with COVID-19, pneumonia, TB or healthy based on CXR images. The pipeline consists of the existing DenseNet-121 and the ResNet-50 networks. Since the DenseNet and ResNet have orthogonal performances in some instances, in the proposed model we have created an extra layer with convolutional neural network (CNN) blocks to join these two models together to establish superior performance as compared to the two individual networks. This strategy can be applied universally in cases where two competing networks are observed. We have tested the performance of our proposed network on two-class (pneumonia and healthy), three-class (COVID-19 positive, healthy, and pneumonia), as well as four-class (COVID-19 positive, healthy, TB, and pneumonia) classification problems. We have validated that our proposed network has been able to successfully classify these lung-diseases on our four datasets and this is one of our novel findings. In particular, the AUC-ROC are 99.60, 96.51, 93.70, 96.40% and the F1 values are 98.21, 87.29, 76.09, 83.17% on our Dataset X-Ray 1, 2, 3, and 4 (DXR1, DXR2, DXR3, DXR4), respectively.
first_indexed 2024-03-07T07:22:47Z
format Journal article
id oxford-uuid:5f18c63f-e9d5-4147-992a-60d196abed1c
institution University of Oxford
language English
last_indexed 2024-03-07T07:22:47Z
publishDate 2021
publisher Elsevier
record_format dspace
spelling oxford-uuid:5f18c63f-e9d5-4147-992a-60d196abed1c2022-11-08T12:44:23ZDenResCov-19: a deep transfer learning network for robust automatic classification of COVID-19, pneumonia, and tuberculosis from X-raysJournal articlehttp://purl.org/coar/resource_type/c_dcae04bcuuid:5f18c63f-e9d5-4147-992a-60d196abed1cEnglishSymplectic ElementsElsevier2021Mamalakis, MSwift, AJVorselaars, BRay, SWeeks, SDing, WClayton, RHMackenzie, LSBanerjee, AThe global pandemic of coronavirus disease 2019 (COVID-19) is continuing to have a significant effect on the well-being of the global population, thus increasing the demand for rapid testing, diagnosis, and treatment. As COVID-19 can cause severe pneumonia, early diagnosis is essential for correct treatment, as well as to reduce the stress on the healthcare system. Along with COVID-19, other etiologies of pneumonia and Tuberculosis (TB) constitute additional challenges to the medical system. Pneumonia (viral as well as bacterial) kills about 2 million infants every year and is consistently estimated as one of the most important factor of childhood mortality (according to the World Health Organization). Chest X-ray (CXR) and computed tomography (CT) scans are the primary imaging modalities for diagnosing respiratory diseases. Although CT scans are the gold standard, they are more expensive, time consuming, and are associated with a small but significant dose of radiation. Hence, CXR have become more widespread as a first line investigation. In this regard, the objective of this work is to develop a new deep transfer learning pipeline, named DenResCov-19, to diagnose patients with COVID-19, pneumonia, TB or healthy based on CXR images. The pipeline consists of the existing DenseNet-121 and the ResNet-50 networks. Since the DenseNet and ResNet have orthogonal performances in some instances, in the proposed model we have created an extra layer with convolutional neural network (CNN) blocks to join these two models together to establish superior performance as compared to the two individual networks. This strategy can be applied universally in cases where two competing networks are observed. We have tested the performance of our proposed network on two-class (pneumonia and healthy), three-class (COVID-19 positive, healthy, and pneumonia), as well as four-class (COVID-19 positive, healthy, TB, and pneumonia) classification problems. We have validated that our proposed network has been able to successfully classify these lung-diseases on our four datasets and this is one of our novel findings. In particular, the AUC-ROC are 99.60, 96.51, 93.70, 96.40% and the F1 values are 98.21, 87.29, 76.09, 83.17% on our Dataset X-Ray 1, 2, 3, and 4 (DXR1, DXR2, DXR3, DXR4), respectively.
spellingShingle Mamalakis, M
Swift, AJ
Vorselaars, B
Ray, S
Weeks, S
Ding, W
Clayton, RH
Mackenzie, LS
Banerjee, A
DenResCov-19: a deep transfer learning network for robust automatic classification of COVID-19, pneumonia, and tuberculosis from X-rays
title DenResCov-19: a deep transfer learning network for robust automatic classification of COVID-19, pneumonia, and tuberculosis from X-rays
title_full DenResCov-19: a deep transfer learning network for robust automatic classification of COVID-19, pneumonia, and tuberculosis from X-rays
title_fullStr DenResCov-19: a deep transfer learning network for robust automatic classification of COVID-19, pneumonia, and tuberculosis from X-rays
title_full_unstemmed DenResCov-19: a deep transfer learning network for robust automatic classification of COVID-19, pneumonia, and tuberculosis from X-rays
title_short DenResCov-19: a deep transfer learning network for robust automatic classification of COVID-19, pneumonia, and tuberculosis from X-rays
title_sort denrescov 19 a deep transfer learning network for robust automatic classification of covid 19 pneumonia and tuberculosis from x rays
work_keys_str_mv AT mamalakism denrescov19adeeptransferlearningnetworkforrobustautomaticclassificationofcovid19pneumoniaandtuberculosisfromxrays
AT swiftaj denrescov19adeeptransferlearningnetworkforrobustautomaticclassificationofcovid19pneumoniaandtuberculosisfromxrays
AT vorselaarsb denrescov19adeeptransferlearningnetworkforrobustautomaticclassificationofcovid19pneumoniaandtuberculosisfromxrays
AT rays denrescov19adeeptransferlearningnetworkforrobustautomaticclassificationofcovid19pneumoniaandtuberculosisfromxrays
AT weekss denrescov19adeeptransferlearningnetworkforrobustautomaticclassificationofcovid19pneumoniaandtuberculosisfromxrays
AT dingw denrescov19adeeptransferlearningnetworkforrobustautomaticclassificationofcovid19pneumoniaandtuberculosisfromxrays
AT claytonrh denrescov19adeeptransferlearningnetworkforrobustautomaticclassificationofcovid19pneumoniaandtuberculosisfromxrays
AT mackenziels denrescov19adeeptransferlearningnetworkforrobustautomaticclassificationofcovid19pneumoniaandtuberculosisfromxrays
AT banerjeea denrescov19adeeptransferlearningnetworkforrobustautomaticclassificationofcovid19pneumoniaandtuberculosisfromxrays