Pulmonary Nodule Classification Using Feature and Ensemble Learning-Based Fusion Techniques
The Pulmonary nodule indicates the presence of lung cancer. The deep convolutional neural networks (DCNNs) have been widely used to classify the pulmonary nodule as benign or malignant. However, an individual learner usually performs unsatisfactorily due to limited response space, incorrect selectio...
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2021-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/9507437/ |
| _version_ | 1827375106214592512 |
|---|---|
| author | Muhammad Muzammil Imdad Ali Ihsan Ul Haq Muhammad Amir Suheel Abdullah |
| author_facet | Muhammad Muzammil Imdad Ali Ihsan Ul Haq Muhammad Amir Suheel Abdullah |
| author_sort | Muhammad Muzammil |
| collection | DOAJ |
| description | The Pulmonary nodule indicates the presence of lung cancer. The deep convolutional neural networks (DCNNs) have been widely used to classify the pulmonary nodule as benign or malignant. However, an individual learner usually performs unsatisfactorily due to limited response space, incorrect selection of hypothesis space, or falling into local minimums. To investigate these issues, we propose ensemble learners fusion techniques based on averaging of prediction score and maximum vote score (MAX-VOTE). First, the support vector machine (SVM) and AdaBoostM2 machine learning algorithms are trained on the deep features from DCNNs. The results of both classifiers are fused separately based on averaging of the prediction score. Secondly, the feature fusion technique is developed by fusing the feature of three DCNNs (AlexNet, VGG-16 and VGG-19) through predefined rules. After that, the SVM and AdaBoostM2 are trained on fused features independently to build ensemble learners by fusing the multiple DCNN learners. The predictions of all DCNN learners are fused based on the MAX-VOTE. The results show that the ensemble learners based MAX-VOTE technique yields better performance out of twelve single learners for binary class classification of pulmonary nodules. The proposed fusion techniques are also tested for multi-class classification problem. The SVM based feature fusion technique performs better as compared to all the implemented and the state-of-the-art techniques. The achieved maximum accuracy, AUC and specificity scores are 96.89%±0.25, 99.21%±0.10 and 97.70%±0.21, respectively. |
| first_indexed | 2024-03-08T11:44:58Z |
| format | Article |
| id | doaj.art-e74b37b421c54e798a30fa3730dc983e |
| institution | Directory Open Access Journal |
| issn | 2169-3536 |
| language | English |
| last_indexed | 2024-03-08T11:44:58Z |
| publishDate | 2021-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj.art-e74b37b421c54e798a30fa3730dc983e2024-01-25T00:00:25ZengIEEEIEEE Access2169-35362021-01-01911341511342710.1109/ACCESS.2021.31027079507437Pulmonary Nodule Classification Using Feature and Ensemble Learning-Based Fusion TechniquesMuhammad Muzammil0https://orcid.org/0000-0002-9151-8491Imdad Ali1https://orcid.org/0000-0002-5064-423XIhsan Ul Haq2https://orcid.org/0000-0002-5692-1250Muhammad Amir3https://orcid.org/0000-0003-3238-0434Suheel Abdullah4https://orcid.org/0000-0002-6108-5090Faculty of Engineering and Technology, International Islamic University, Islamabad, PakistanFaculty of Engineering and Technology, International Islamic University, Islamabad, PakistanFaculty of Engineering and Technology, International Islamic University, Islamabad, PakistanFaculty of Engineering and Technology, International Islamic University, Islamabad, PakistanFaculty of Engineering and Technology, International Islamic University, Islamabad, PakistanThe Pulmonary nodule indicates the presence of lung cancer. The deep convolutional neural networks (DCNNs) have been widely used to classify the pulmonary nodule as benign or malignant. However, an individual learner usually performs unsatisfactorily due to limited response space, incorrect selection of hypothesis space, or falling into local minimums. To investigate these issues, we propose ensemble learners fusion techniques based on averaging of prediction score and maximum vote score (MAX-VOTE). First, the support vector machine (SVM) and AdaBoostM2 machine learning algorithms are trained on the deep features from DCNNs. The results of both classifiers are fused separately based on averaging of the prediction score. Secondly, the feature fusion technique is developed by fusing the feature of three DCNNs (AlexNet, VGG-16 and VGG-19) through predefined rules. After that, the SVM and AdaBoostM2 are trained on fused features independently to build ensemble learners by fusing the multiple DCNN learners. The predictions of all DCNN learners are fused based on the MAX-VOTE. The results show that the ensemble learners based MAX-VOTE technique yields better performance out of twelve single learners for binary class classification of pulmonary nodules. The proposed fusion techniques are also tested for multi-class classification problem. The SVM based feature fusion technique performs better as compared to all the implemented and the state-of-the-art techniques. The achieved maximum accuracy, AUC and specificity scores are 96.89%±0.25, 99.21%±0.10 and 97.70%±0.21, respectively.https://ieeexplore.ieee.org/document/9507437/Deep convolutional neural networkcomputer aided diagnosiscomputed tomographypulmonary noduledeep featuresdeep feature fusion |
| spellingShingle | Muhammad Muzammil Imdad Ali Ihsan Ul Haq Muhammad Amir Suheel Abdullah Pulmonary Nodule Classification Using Feature and Ensemble Learning-Based Fusion Techniques IEEE Access Deep convolutional neural network computer aided diagnosis computed tomography pulmonary nodule deep features deep feature fusion |
| title | Pulmonary Nodule Classification Using Feature and Ensemble Learning-Based Fusion Techniques |
| title_full | Pulmonary Nodule Classification Using Feature and Ensemble Learning-Based Fusion Techniques |
| title_fullStr | Pulmonary Nodule Classification Using Feature and Ensemble Learning-Based Fusion Techniques |
| title_full_unstemmed | Pulmonary Nodule Classification Using Feature and Ensemble Learning-Based Fusion Techniques |
| title_short | Pulmonary Nodule Classification Using Feature and Ensemble Learning-Based Fusion Techniques |
| title_sort | pulmonary nodule classification using feature and ensemble learning based fusion techniques |
| topic | Deep convolutional neural network computer aided diagnosis computed tomography pulmonary nodule deep features deep feature fusion |
| url | https://ieeexplore.ieee.org/document/9507437/ |
| work_keys_str_mv | AT muhammadmuzammil pulmonarynoduleclassificationusingfeatureandensemblelearningbasedfusiontechniques AT imdadali pulmonarynoduleclassificationusingfeatureandensemblelearningbasedfusiontechniques AT ihsanulhaq pulmonarynoduleclassificationusingfeatureandensemblelearningbasedfusiontechniques AT muhammadamir pulmonarynoduleclassificationusingfeatureandensemblelearningbasedfusiontechniques AT suheelabdullah pulmonarynoduleclassificationusingfeatureandensemblelearningbasedfusiontechniques |