Experimental phantom evaluation to identify robust positron emission tomography (PET) radiomic features

Abstract Background Radiomics analysis usually involves, especially in multicenter and large hospital studies, different imaging protocols for acquisition, reconstruction, and processing of data. Differences in protocols can lead to differences in the quantification of the biomarker distribution, le...

Full description

Bibliographic Details
Main Authors: Montserrat Carles, Tobias Fechter, Luis Martí-Bonmatí, Dimos Baltas, Michael Mix
Format: Article
Language:English
Published: SpringerOpen 2021-06-01
Series:EJNMMI Physics
Subjects:
Online Access:https://doi.org/10.1186/s40658-021-00390-7
_version_ 1818671037152231424
author Montserrat Carles
Tobias Fechter
Luis Martí-Bonmatí
Dimos Baltas
Michael Mix
author_facet Montserrat Carles
Tobias Fechter
Luis Martí-Bonmatí
Dimos Baltas
Michael Mix
author_sort Montserrat Carles
collection DOAJ
description Abstract Background Radiomics analysis usually involves, especially in multicenter and large hospital studies, different imaging protocols for acquisition, reconstruction, and processing of data. Differences in protocols can lead to differences in the quantification of the biomarker distribution, leading to radiomic feature variability. The aim of our study was to identify those radiomic features robust to the different degrading factors in positron emission tomography (PET) studies. We proposed the use of the standardized measurements of the European Association Research Ltd. (EARL) accreditation to retrospectively identify the radiomic features having low variability to the different systems and reconstruction protocols. In addition, we presented a reproducible procedure to identify PET radiomic features robust to PET/CT imaging metal artifacts. In 27 heterogeneous homemade phantoms for which ground truth was accurately defined by CT segmentation, we evaluated the segmentation accuracy and radiomic feature reliability given by the contrast-oriented algorithm (COA) and the 40% threshold PET segmentation. In the comparison of two data sets, robustness was defined by Wilcoxon rank tests, bias was quantified by Bland–Altman (BA) plot analysis, and strong correlations were identified by Spearman correlation test (r > 0.8 and p satisfied multiple test Bonferroni correction). Results Forty-eight radiomic features were robust to system, 22 to resolution, 102 to metal artifacts, and 42 to different PET segmentation tools. Overall, only 4 radiomic features were simultaneously robust to all degrading factors. Although both segmentation approaches significantly underestimated the volume with respect to the ground truth, with relative deviations of −62 ± 36% for COA and −50 ± 44% for 40%, radiomic features derived from the ground truth were strongly correlated and/or robust to 98 radiomic features derived from COA and to 102 from 40%. Conclusion In multicenter studies, we recommend the analysis of EARL accreditation measurements in order to retrospectively identify the robust PET radiomic features. Furthermore, 4 radiomic features (area under the curve of the cumulative SUV volume histogram, skewness, kurtosis, and gray-level variance derived from GLRLM after application of an equal probability quantization algorithm on the voxels within lesion) were robust to all degrading factors. In addition, the feasibility of 40% and COA segmentations for their use in radiomics analysis has been demonstrated.
first_indexed 2024-12-17T07:17:38Z
format Article
id doaj.art-9a8c37d970174bb4b1b1e1cc6386b482
institution Directory Open Access Journal
issn 2197-7364
language English
last_indexed 2024-12-17T07:17:38Z
publishDate 2021-06-01
publisher SpringerOpen
record_format Article
series EJNMMI Physics
spelling doaj.art-9a8c37d970174bb4b1b1e1cc6386b4822022-12-21T21:58:51ZengSpringerOpenEJNMMI Physics2197-73642021-06-018111710.1186/s40658-021-00390-7Experimental phantom evaluation to identify robust positron emission tomography (PET) radiomic featuresMontserrat Carles0Tobias Fechter1Luis Martí-Bonmatí2Dimos Baltas3Michael Mix4Division of Medical Physics, Department of Radiation Oncology, Medical Center - University of Freiburg, Faculty of Medicine, University of FreiburgDivision of Medical Physics, Department of Radiation Oncology, Medical Center - University of Freiburg, Faculty of Medicine, University of FreiburgBiomedical Imaging Research Group (GIBI230-PREBI) and Imaging La Fe node at Distributed Network for Biomedical Imaging (ReDIB) Unique Scientific and Technical Infrastructures (ICTS), La Fe Health Research InstituteDivision of Medical Physics, Department of Radiation Oncology, Medical Center - University of Freiburg, Faculty of Medicine, University of FreiburgGerman Cancer Consortium (DKTK), German Cancer Research Center (DKFZ), Partner Site Freiburg, German Cancer Research Center (DKFZ)Abstract Background Radiomics analysis usually involves, especially in multicenter and large hospital studies, different imaging protocols for acquisition, reconstruction, and processing of data. Differences in protocols can lead to differences in the quantification of the biomarker distribution, leading to radiomic feature variability. The aim of our study was to identify those radiomic features robust to the different degrading factors in positron emission tomography (PET) studies. We proposed the use of the standardized measurements of the European Association Research Ltd. (EARL) accreditation to retrospectively identify the radiomic features having low variability to the different systems and reconstruction protocols. In addition, we presented a reproducible procedure to identify PET radiomic features robust to PET/CT imaging metal artifacts. In 27 heterogeneous homemade phantoms for which ground truth was accurately defined by CT segmentation, we evaluated the segmentation accuracy and radiomic feature reliability given by the contrast-oriented algorithm (COA) and the 40% threshold PET segmentation. In the comparison of two data sets, robustness was defined by Wilcoxon rank tests, bias was quantified by Bland–Altman (BA) plot analysis, and strong correlations were identified by Spearman correlation test (r > 0.8 and p satisfied multiple test Bonferroni correction). Results Forty-eight radiomic features were robust to system, 22 to resolution, 102 to metal artifacts, and 42 to different PET segmentation tools. Overall, only 4 radiomic features were simultaneously robust to all degrading factors. Although both segmentation approaches significantly underestimated the volume with respect to the ground truth, with relative deviations of −62 ± 36% for COA and −50 ± 44% for 40%, radiomic features derived from the ground truth were strongly correlated and/or robust to 98 radiomic features derived from COA and to 102 from 40%. Conclusion In multicenter studies, we recommend the analysis of EARL accreditation measurements in order to retrospectively identify the robust PET radiomic features. Furthermore, 4 radiomic features (area under the curve of the cumulative SUV volume histogram, skewness, kurtosis, and gray-level variance derived from GLRLM after application of an equal probability quantization algorithm on the voxels within lesion) were robust to all degrading factors. In addition, the feasibility of 40% and COA segmentations for their use in radiomics analysis has been demonstrated.https://doi.org/10.1186/s40658-021-00390-7Radiomic featuresPETRobustnessPhantomsHeterogeneity
spellingShingle Montserrat Carles
Tobias Fechter
Luis Martí-Bonmatí
Dimos Baltas
Michael Mix
Experimental phantom evaluation to identify robust positron emission tomography (PET) radiomic features
EJNMMI Physics
Radiomic features
PET
Robustness
Phantoms
Heterogeneity
title Experimental phantom evaluation to identify robust positron emission tomography (PET) radiomic features
title_full Experimental phantom evaluation to identify robust positron emission tomography (PET) radiomic features
title_fullStr Experimental phantom evaluation to identify robust positron emission tomography (PET) radiomic features
title_full_unstemmed Experimental phantom evaluation to identify robust positron emission tomography (PET) radiomic features
title_short Experimental phantom evaluation to identify robust positron emission tomography (PET) radiomic features
title_sort experimental phantom evaluation to identify robust positron emission tomography pet radiomic features
topic Radiomic features
PET
Robustness
Phantoms
Heterogeneity
url https://doi.org/10.1186/s40658-021-00390-7
work_keys_str_mv AT montserratcarles experimentalphantomevaluationtoidentifyrobustpositronemissiontomographypetradiomicfeatures
AT tobiasfechter experimentalphantomevaluationtoidentifyrobustpositronemissiontomographypetradiomicfeatures
AT luismartibonmati experimentalphantomevaluationtoidentifyrobustpositronemissiontomographypetradiomicfeatures
AT dimosbaltas experimentalphantomevaluationtoidentifyrobustpositronemissiontomographypetradiomicfeatures
AT michaelmix experimentalphantomevaluationtoidentifyrobustpositronemissiontomographypetradiomicfeatures