Modality-Specific Deep Learning Model Ensembles Toward Improving TB Detection in Chest Radiographs
The proposed study evaluates the efficacy of knowledge transfer gained through an ensemble of modality-specific deep learning models toward improving the state-of-the-art in Tuberculosis (TB) detection. A custom convolutional neural network (CNN) and selected popular pretrained CNNs are trained to l...
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2020-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/8979446/ |
| _version_ | 1818566785597702144 |
|---|---|
| author | Sivaramakrishnan Rajaraman Sameer K. Antani |
| author_facet | Sivaramakrishnan Rajaraman Sameer K. Antani |
| author_sort | Sivaramakrishnan Rajaraman |
| collection | DOAJ |
| description | The proposed study evaluates the efficacy of knowledge transfer gained through an ensemble of modality-specific deep learning models toward improving the state-of-the-art in Tuberculosis (TB) detection. A custom convolutional neural network (CNN) and selected popular pretrained CNNs are trained to learn modality-specific features from large-scale publicly available chest x-ray (CXR) collections including (i) RSNA dataset (normal = 8851, abnormal = 17833), (ii) Pediatric pneumonia dataset (normal = 1583, abnormal = 4273), and (iii) Indiana dataset (normal = 1726, abnormal = 2378). The knowledge acquired through modality-specific learning is transferred and fine-tuned for TB detection on the publicly available Shenzhen CXR collection (normal = 326, abnormal = 336). The predictions of the best performing models are combined using different ensemble methods to demonstrate improved performance over any individual constituent model in classifying TB-infected and normal CXRs. The models are evaluated through cross-validation (n = 5) at the patient-level with an aim to prevent overfitting, improve robustness and generalization. It is observed that a stacked ensemble of the top-3 retrained models demonstrates promising performance (accuracy: 0.941; 95% confidence interval (CI): [0.899, 0.985], area under the curve (AUC): 0.995; 95% CI: [0.945, 1.00]). One-way ANOVA analyses show there are no statistically significant differences in accuracy (P = .759) and AUC (P = .831) among the ensemble methods. Knowledge transferred through modality-specific learning of relevant features helped improve the classification. The ensemble model resulted in reduced prediction variance and sensitivity to training data fluctuations. Results from their combined use are superior to the state-of-the-art. |
| first_indexed | 2024-12-14T01:58:05Z |
| format | Article |
| id | doaj.art-f1a0a904cced46c49cb59cad7a6b4549 |
| institution | Directory Open Access Journal |
| issn | 2169-3536 |
| language | English |
| last_indexed | 2024-12-14T01:58:05Z |
| publishDate | 2020-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj.art-f1a0a904cced46c49cb59cad7a6b45492022-12-21T23:21:07ZengIEEEIEEE Access2169-35362020-01-018273182732610.1109/ACCESS.2020.29712578979446Modality-Specific Deep Learning Model Ensembles Toward Improving TB Detection in Chest RadiographsSivaramakrishnan Rajaraman0https://orcid.org/0000-0003-0871-8634Sameer K. Antani1Lister Hill National Center for Biomedical Communications, National Library of Medicine, Bethesda, MD, USALister Hill National Center for Biomedical Communications, National Library of Medicine, Bethesda, MD, USAThe proposed study evaluates the efficacy of knowledge transfer gained through an ensemble of modality-specific deep learning models toward improving the state-of-the-art in Tuberculosis (TB) detection. A custom convolutional neural network (CNN) and selected popular pretrained CNNs are trained to learn modality-specific features from large-scale publicly available chest x-ray (CXR) collections including (i) RSNA dataset (normal = 8851, abnormal = 17833), (ii) Pediatric pneumonia dataset (normal = 1583, abnormal = 4273), and (iii) Indiana dataset (normal = 1726, abnormal = 2378). The knowledge acquired through modality-specific learning is transferred and fine-tuned for TB detection on the publicly available Shenzhen CXR collection (normal = 326, abnormal = 336). The predictions of the best performing models are combined using different ensemble methods to demonstrate improved performance over any individual constituent model in classifying TB-infected and normal CXRs. The models are evaluated through cross-validation (n = 5) at the patient-level with an aim to prevent overfitting, improve robustness and generalization. It is observed that a stacked ensemble of the top-3 retrained models demonstrates promising performance (accuracy: 0.941; 95% confidence interval (CI): [0.899, 0.985], area under the curve (AUC): 0.995; 95% CI: [0.945, 1.00]). One-way ANOVA analyses show there are no statistically significant differences in accuracy (P = .759) and AUC (P = .831) among the ensemble methods. Knowledge transferred through modality-specific learning of relevant features helped improve the classification. The ensemble model resulted in reduced prediction variance and sensitivity to training data fluctuations. Results from their combined use are superior to the state-of-the-art.https://ieeexplore.ieee.org/document/8979446/Classificationconfidence intervalconvolutional neural networkdeep learningensembleknowledge transfer |
| spellingShingle | Sivaramakrishnan Rajaraman Sameer K. Antani Modality-Specific Deep Learning Model Ensembles Toward Improving TB Detection in Chest Radiographs IEEE Access Classification confidence interval convolutional neural network deep learning ensemble knowledge transfer |
| title | Modality-Specific Deep Learning Model Ensembles Toward Improving TB Detection in Chest Radiographs |
| title_full | Modality-Specific Deep Learning Model Ensembles Toward Improving TB Detection in Chest Radiographs |
| title_fullStr | Modality-Specific Deep Learning Model Ensembles Toward Improving TB Detection in Chest Radiographs |
| title_full_unstemmed | Modality-Specific Deep Learning Model Ensembles Toward Improving TB Detection in Chest Radiographs |
| title_short | Modality-Specific Deep Learning Model Ensembles Toward Improving TB Detection in Chest Radiographs |
| title_sort | modality specific deep learning model ensembles toward improving tb detection in chest radiographs |
| topic | Classification confidence interval convolutional neural network deep learning ensemble knowledge transfer |
| url | https://ieeexplore.ieee.org/document/8979446/ |
| work_keys_str_mv | AT sivaramakrishnanrajaraman modalityspecificdeeplearningmodelensemblestowardimprovingtbdetectioninchestradiographs AT sameerkantani modalityspecificdeeplearningmodelensemblestowardimprovingtbdetectioninchestradiographs |