MaasPenn Radiomics Reproducibility Score: A Novel Quantitative Measure for Evaluating the Reproducibility of CT-Based Handcrafted Radiomic Features
The reproducibility of handcrafted radiomic features (HRFs) has been reported to be affected by variations in imaging parameters, which significantly affect the generalizability of developed signatures and translation to clinical practice. However, the collective effect of the variations in imaging...
| Main Authors: | , , , , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2022-03-01
|
| Series: | Cancers |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2072-6694/14/7/1599 |
| _version_ | 1797440244506689536 |
|---|---|
| author | Abdalla Ibrahim Bruno Barufaldi Turkey Refaee Telmo M. Silva Filho Raymond J. Acciavatti Zohaib Salahuddin Roland Hustinx Felix M. Mottaghy Andrew D. A. Maidment Philippe Lambin |
| author_facet | Abdalla Ibrahim Bruno Barufaldi Turkey Refaee Telmo M. Silva Filho Raymond J. Acciavatti Zohaib Salahuddin Roland Hustinx Felix M. Mottaghy Andrew D. A. Maidment Philippe Lambin |
| author_sort | Abdalla Ibrahim |
| collection | DOAJ |
| description | The reproducibility of handcrafted radiomic features (HRFs) has been reported to be affected by variations in imaging parameters, which significantly affect the generalizability of developed signatures and translation to clinical practice. However, the collective effect of the variations in imaging parameters on the reproducibility of HRFs remains unclear, with no objective measure to assess it in the absence of reproducibility analysis. We assessed these effects of variations in a large number of scenarios and developed the first quantitative score to assess the reproducibility of CT-based HRFs without the need for phantom or reproducibility studies. We further assessed the potential of image resampling and ComBat harmonization for removing these effects. Our findings suggest a need for radiomics-specific harmonization methods. Our developed score should be considered as a first attempt to introduce comprehensive metrics to quantify the reproducibility of CT-based handcrafted radiomic features. More research is warranted to demonstrate its validity in clinical contexts and to further improve it, possibly by the incorporation of more realistic situations, which better reflect real patients’ situations. |
| first_indexed | 2024-03-09T12:04:23Z |
| format | Article |
| id | doaj.art-179de1ecd49f432998343c8688ee21c1 |
| institution | Directory Open Access Journal |
| issn | 2072-6694 |
| language | English |
| last_indexed | 2024-03-09T12:04:23Z |
| publishDate | 2022-03-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Cancers |
| spelling | doaj.art-179de1ecd49f432998343c8688ee21c12023-11-30T22:59:23ZengMDPI AGCancers2072-66942022-03-01147159910.3390/cancers14071599MaasPenn Radiomics Reproducibility Score: A Novel Quantitative Measure for Evaluating the Reproducibility of CT-Based Handcrafted Radiomic FeaturesAbdalla Ibrahim0Bruno Barufaldi1Turkey Refaee2Telmo M. Silva Filho3Raymond J. Acciavatti4Zohaib Salahuddin5Roland Hustinx6Felix M. Mottaghy7Andrew D. A. Maidment8Philippe Lambin9The D-Lab, Department of Precision Medicine, GROW-School for Oncology, Maastricht University, 6229 ER Maastricht, The NetherlandsDepartment of Radiology, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA 19104, USAThe D-Lab, Department of Precision Medicine, GROW-School for Oncology, Maastricht University, 6229 ER Maastricht, The NetherlandsDepartment of Statistics, Federal University of Paraíba, João Pessoa 58051-900, BrazilDepartment of Radiology, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA 19104, USAThe D-Lab, Department of Precision Medicine, GROW-School for Oncology, Maastricht University, 6229 ER Maastricht, The NetherlandsDivision of Nuclear Medicine and Oncological Imaging, Department of Medical Physics, CHU de Liege, CRC In Vivo Imaging, University of Liège, 4000 Liege, BelgiumDepartment of Radiology and Nuclear Medicine, Maastricht University Medical Center+, 6229 HX Maastricht, The NetherlandsDepartment of Radiology, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA 19104, USAThe D-Lab, Department of Precision Medicine, GROW-School for Oncology, Maastricht University, 6229 ER Maastricht, The NetherlandsThe reproducibility of handcrafted radiomic features (HRFs) has been reported to be affected by variations in imaging parameters, which significantly affect the generalizability of developed signatures and translation to clinical practice. However, the collective effect of the variations in imaging parameters on the reproducibility of HRFs remains unclear, with no objective measure to assess it in the absence of reproducibility analysis. We assessed these effects of variations in a large number of scenarios and developed the first quantitative score to assess the reproducibility of CT-based HRFs without the need for phantom or reproducibility studies. We further assessed the potential of image resampling and ComBat harmonization for removing these effects. Our findings suggest a need for radiomics-specific harmonization methods. Our developed score should be considered as a first attempt to introduce comprehensive metrics to quantify the reproducibility of CT-based handcrafted radiomic features. More research is warranted to demonstrate its validity in clinical contexts and to further improve it, possibly by the incorporation of more realistic situations, which better reflect real patients’ situations.https://www.mdpi.com/2072-6694/14/7/1599radiomics reproducibilityharmonizationComBat |
| spellingShingle | Abdalla Ibrahim Bruno Barufaldi Turkey Refaee Telmo M. Silva Filho Raymond J. Acciavatti Zohaib Salahuddin Roland Hustinx Felix M. Mottaghy Andrew D. A. Maidment Philippe Lambin MaasPenn Radiomics Reproducibility Score: A Novel Quantitative Measure for Evaluating the Reproducibility of CT-Based Handcrafted Radiomic Features Cancers radiomics reproducibility harmonization ComBat |
| title | MaasPenn Radiomics Reproducibility Score: A Novel Quantitative Measure for Evaluating the Reproducibility of CT-Based Handcrafted Radiomic Features |
| title_full | MaasPenn Radiomics Reproducibility Score: A Novel Quantitative Measure for Evaluating the Reproducibility of CT-Based Handcrafted Radiomic Features |
| title_fullStr | MaasPenn Radiomics Reproducibility Score: A Novel Quantitative Measure for Evaluating the Reproducibility of CT-Based Handcrafted Radiomic Features |
| title_full_unstemmed | MaasPenn Radiomics Reproducibility Score: A Novel Quantitative Measure for Evaluating the Reproducibility of CT-Based Handcrafted Radiomic Features |
| title_short | MaasPenn Radiomics Reproducibility Score: A Novel Quantitative Measure for Evaluating the Reproducibility of CT-Based Handcrafted Radiomic Features |
| title_sort | maaspenn radiomics reproducibility score a novel quantitative measure for evaluating the reproducibility of ct based handcrafted radiomic features |
| topic | radiomics reproducibility harmonization ComBat |
| url | https://www.mdpi.com/2072-6694/14/7/1599 |
| work_keys_str_mv | AT abdallaibrahim maaspennradiomicsreproducibilityscoreanovelquantitativemeasureforevaluatingthereproducibilityofctbasedhandcraftedradiomicfeatures AT brunobarufaldi maaspennradiomicsreproducibilityscoreanovelquantitativemeasureforevaluatingthereproducibilityofctbasedhandcraftedradiomicfeatures AT turkeyrefaee maaspennradiomicsreproducibilityscoreanovelquantitativemeasureforevaluatingthereproducibilityofctbasedhandcraftedradiomicfeatures AT telmomsilvafilho maaspennradiomicsreproducibilityscoreanovelquantitativemeasureforevaluatingthereproducibilityofctbasedhandcraftedradiomicfeatures AT raymondjacciavatti maaspennradiomicsreproducibilityscoreanovelquantitativemeasureforevaluatingthereproducibilityofctbasedhandcraftedradiomicfeatures AT zohaibsalahuddin maaspennradiomicsreproducibilityscoreanovelquantitativemeasureforevaluatingthereproducibilityofctbasedhandcraftedradiomicfeatures AT rolandhustinx maaspennradiomicsreproducibilityscoreanovelquantitativemeasureforevaluatingthereproducibilityofctbasedhandcraftedradiomicfeatures AT felixmmottaghy maaspennradiomicsreproducibilityscoreanovelquantitativemeasureforevaluatingthereproducibilityofctbasedhandcraftedradiomicfeatures AT andrewdamaidment maaspennradiomicsreproducibilityscoreanovelquantitativemeasureforevaluatingthereproducibilityofctbasedhandcraftedradiomicfeatures AT philippelambin maaspennradiomicsreproducibilityscoreanovelquantitativemeasureforevaluatingthereproducibilityofctbasedhandcraftedradiomicfeatures |