Comparison of Feature Selection Methods and Machine Learning Classifiers for Radiomics Analysis in Glioma Grading
Radiomics-based researches have shown predictive abilities with machine-learning approaches. However, it is still unknown whether different radiomics strategies affect the prediction performance. The aim of this study was to compare the prediction performance of frequently utilized radiomics feature...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2019-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/8763934/ |
| _version_ | 1818566042879787008 |
|---|---|
| author | Pan Sun Defeng Wang Vincent Ct Mok Lin Shi |
| author_facet | Pan Sun Defeng Wang Vincent Ct Mok Lin Shi |
| author_sort | Pan Sun |
| collection | DOAJ |
| description | Radiomics-based researches have shown predictive abilities with machine-learning approaches. However, it is still unknown whether different radiomics strategies affect the prediction performance. The aim of this study was to compare the prediction performance of frequently utilized radiomics feature selection and classification methods in glioma grading. Quantitative radiomics features were extracted from tumor regions in 210 Glioblastoma (GBM) and 75 low-grade glioma (LGG) MRI subjects. Then, the diagnostic performance of sixteen feature selection and fifteen classification methods were evaluated by using two different test modes: ten-fold cross-validation and percentage split. Balanced accuracy and area under the curve (AUC) of the receiver operating characteristic were used to evaluate prediction performance. In addition, the roles of the number of selected features, feature type, MRI modality, and tumor sub-region were compared to optimize the radiomics-based prediction. The results indicated that the combination of feature selection method L<sup>1</sup>-based linear support vector machine (L<sup>1</sup>-SVM) and classifier multi-layer perceptron (MLPC) achieved the best performance in the differentiation of GBM and LGG in both ten-fold cross validation (balanced accuracy:0.944, AUC:0.986) and percentage split (balanced accuracy:0.953, AUC:0.981). For radiomics feature extraction, the enhancing tumor region (ET) combined with necrotic and non-enhancing tumor (NCR/NET) regions in T1 post-contrast (T1-Gd) modality provided more considerable tumor-related phenotypes than other combinations of tumor region and MRI modality. Our comparative investigation indicated that both feature selection methods and machine learning classifiers affected the predictive performance in glioma grading. Also, the cross-combination strategy for comparison of radiomics feature selection and classification methods provided a way of searching optimal machine learning model for future radiomics-based prediction. |
| first_indexed | 2024-12-14T01:48:40Z |
| format | Article |
| id | doaj.art-747a41cd7bfc440c9d75d71a4a1b2ae6 |
| institution | Directory Open Access Journal |
| issn | 2169-3536 |
| language | English |
| last_indexed | 2024-12-14T01:48:40Z |
| publishDate | 2019-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj.art-747a41cd7bfc440c9d75d71a4a1b2ae62022-12-21T23:21:28ZengIEEEIEEE Access2169-35362019-01-01710201010202010.1109/ACCESS.2019.29289758763934Comparison of Feature Selection Methods and Machine Learning Classifiers for Radiomics Analysis in Glioma GradingPan Sun0Defeng Wang1Vincent Ct Mok2Lin Shi3https://orcid.org/0000-0003-2318-4669Department of Medicine and Therapeutics, The Chinese University of Hong Kong, Hong KongSchool of Instrumentation Science and Opto-electronics Engineering, Beihang University, Beijing, ChinaDepartment of Medicine and Therapeutics, The Chinese University of Hong Kong, Hong KongDepartment of Imaging and Interventional Radiology, The Chinese University of Hong Kong, Hong KongRadiomics-based researches have shown predictive abilities with machine-learning approaches. However, it is still unknown whether different radiomics strategies affect the prediction performance. The aim of this study was to compare the prediction performance of frequently utilized radiomics feature selection and classification methods in glioma grading. Quantitative radiomics features were extracted from tumor regions in 210 Glioblastoma (GBM) and 75 low-grade glioma (LGG) MRI subjects. Then, the diagnostic performance of sixteen feature selection and fifteen classification methods were evaluated by using two different test modes: ten-fold cross-validation and percentage split. Balanced accuracy and area under the curve (AUC) of the receiver operating characteristic were used to evaluate prediction performance. In addition, the roles of the number of selected features, feature type, MRI modality, and tumor sub-region were compared to optimize the radiomics-based prediction. The results indicated that the combination of feature selection method L<sup>1</sup>-based linear support vector machine (L<sup>1</sup>-SVM) and classifier multi-layer perceptron (MLPC) achieved the best performance in the differentiation of GBM and LGG in both ten-fold cross validation (balanced accuracy:0.944, AUC:0.986) and percentage split (balanced accuracy:0.953, AUC:0.981). For radiomics feature extraction, the enhancing tumor region (ET) combined with necrotic and non-enhancing tumor (NCR/NET) regions in T1 post-contrast (T1-Gd) modality provided more considerable tumor-related phenotypes than other combinations of tumor region and MRI modality. Our comparative investigation indicated that both feature selection methods and machine learning classifiers affected the predictive performance in glioma grading. Also, the cross-combination strategy for comparison of radiomics feature selection and classification methods provided a way of searching optimal machine learning model for future radiomics-based prediction.https://ieeexplore.ieee.org/document/8763934/Glioma grademachine learningfeature classificationfeature selectionradiomics |
| spellingShingle | Pan Sun Defeng Wang Vincent Ct Mok Lin Shi Comparison of Feature Selection Methods and Machine Learning Classifiers for Radiomics Analysis in Glioma Grading IEEE Access Glioma grade machine learning feature classification feature selection radiomics |
| title | Comparison of Feature Selection Methods and Machine Learning Classifiers for Radiomics Analysis in Glioma Grading |
| title_full | Comparison of Feature Selection Methods and Machine Learning Classifiers for Radiomics Analysis in Glioma Grading |
| title_fullStr | Comparison of Feature Selection Methods and Machine Learning Classifiers for Radiomics Analysis in Glioma Grading |
| title_full_unstemmed | Comparison of Feature Selection Methods and Machine Learning Classifiers for Radiomics Analysis in Glioma Grading |
| title_short | Comparison of Feature Selection Methods and Machine Learning Classifiers for Radiomics Analysis in Glioma Grading |
| title_sort | comparison of feature selection methods and machine learning classifiers for radiomics analysis in glioma grading |
| topic | Glioma grade machine learning feature classification feature selection radiomics |
| url | https://ieeexplore.ieee.org/document/8763934/ |
| work_keys_str_mv | AT pansun comparisonoffeatureselectionmethodsandmachinelearningclassifiersforradiomicsanalysisingliomagrading AT defengwang comparisonoffeatureselectionmethodsandmachinelearningclassifiersforradiomicsanalysisingliomagrading AT vincentctmok comparisonoffeatureselectionmethodsandmachinelearningclassifiersforradiomicsanalysisingliomagrading AT linshi comparisonoffeatureselectionmethodsandmachinelearningclassifiersforradiomicsanalysisingliomagrading |