Classification of Clinically Significant Prostate Cancer on Multi-Parametric MRI: A Validation Study Comparing Deep Learning and Radiomics
The computer-aided analysis of prostate multiparametric MRI (mpMRI) could improve significant-prostate-cancer (PCa) detection. Various deep-learning- and radiomics-based methods for significant-PCa segmentation or classification have been reported in the literature. To be able to assess the generali...
| Main Authors: | , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2021-12-01
|
| Series: | Cancers |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2072-6694/14/1/12 |
| _version_ | 1797499496109703168 |
|---|---|
| author | Jose M. Castillo T. Muhammad Arif Martijn P. A. Starmans Wiro J. Niessen Chris H. Bangma Ivo G. Schoots Jifke F. Veenland |
| author_facet | Jose M. Castillo T. Muhammad Arif Martijn P. A. Starmans Wiro J. Niessen Chris H. Bangma Ivo G. Schoots Jifke F. Veenland |
| author_sort | Jose M. Castillo T. |
| collection | DOAJ |
| description | The computer-aided analysis of prostate multiparametric MRI (mpMRI) could improve significant-prostate-cancer (PCa) detection. Various deep-learning- and radiomics-based methods for significant-PCa segmentation or classification have been reported in the literature. To be able to assess the generalizability of the performance of these methods, using various external data sets is crucial. While both deep-learning and radiomics approaches have been compared based on the same data set of one center, the comparison of the performances of both approaches on various data sets from different centers and different scanners is lacking. The goal of this study was to compare the performance of a deep-learning model with the performance of a radiomics model for the significant-PCa diagnosis of the cohorts of various patients. We included the data from two consecutive patient cohorts from our own center (<i>n</i> = 371 patients), and two external sets of which one was a publicly available patient cohort (<i>n</i> = 195 patients) and the other contained data from patients from two hospitals (<i>n</i> = 79 patients). Using multiparametric MRI (mpMRI), the radiologist tumor delineations and pathology reports were collected for all patients. During training, one of our patient cohorts (<i>n</i> = 271 patients) was used for both the deep-learning- and radiomics-model development, and the three remaining cohorts (<i>n</i> = 374 patients) were kept as unseen test sets. The performances of the models were assessed in terms of their area under the receiver-operating-characteristic curve (AUC). Whereas the internal cross-validation showed a higher AUC for the deep-learning approach, the radiomics model obtained AUCs of 0.88, 0.91 and 0.65 on the independent test sets compared to AUCs of 0.70, 0.73 and 0.44 for the deep-learning model. Our radiomics model that was based on delineated regions resulted in a more accurate tool for significant-PCa classification in the three unseen test sets when compared to a fully automated deep-learning model. |
| first_indexed | 2024-03-10T03:48:12Z |
| format | Article |
| id | doaj.art-52502cfe47ee4154ba5e407619e68228 |
| institution | Directory Open Access Journal |
| issn | 2072-6694 |
| language | English |
| last_indexed | 2024-03-10T03:48:12Z |
| publishDate | 2021-12-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Cancers |
| spelling | doaj.art-52502cfe47ee4154ba5e407619e682282023-11-23T11:14:41ZengMDPI AGCancers2072-66942021-12-011411210.3390/cancers14010012Classification of Clinically Significant Prostate Cancer on Multi-Parametric MRI: A Validation Study Comparing Deep Learning and RadiomicsJose M. Castillo T.0Muhammad Arif1Martijn P. A. Starmans2Wiro J. Niessen3Chris H. Bangma4Ivo G. Schoots5Jifke F. Veenland6Department of Radiology and Nuclear Medicine, Erasmus MC, 3015 GD Rotterdam, The NetherlandsDepartment of Radiology and Nuclear Medicine, Erasmus MC, 3015 GD Rotterdam, The NetherlandsDepartment of Radiology and Nuclear Medicine, Erasmus MC, 3015 GD Rotterdam, The NetherlandsDepartment of Radiology and Nuclear Medicine, Erasmus MC, 3015 GD Rotterdam, The NetherlandsDepartment of Urology, Erasmus MC, 3015 GD Rotterdam, The NetherlandsDepartment of Radiology and Nuclear Medicine, Erasmus MC, 3015 GD Rotterdam, The NetherlandsDepartment of Radiology and Nuclear Medicine, Erasmus MC, 3015 GD Rotterdam, The NetherlandsThe computer-aided analysis of prostate multiparametric MRI (mpMRI) could improve significant-prostate-cancer (PCa) detection. Various deep-learning- and radiomics-based methods for significant-PCa segmentation or classification have been reported in the literature. To be able to assess the generalizability of the performance of these methods, using various external data sets is crucial. While both deep-learning and radiomics approaches have been compared based on the same data set of one center, the comparison of the performances of both approaches on various data sets from different centers and different scanners is lacking. The goal of this study was to compare the performance of a deep-learning model with the performance of a radiomics model for the significant-PCa diagnosis of the cohorts of various patients. We included the data from two consecutive patient cohorts from our own center (<i>n</i> = 371 patients), and two external sets of which one was a publicly available patient cohort (<i>n</i> = 195 patients) and the other contained data from patients from two hospitals (<i>n</i> = 79 patients). Using multiparametric MRI (mpMRI), the radiologist tumor delineations and pathology reports were collected for all patients. During training, one of our patient cohorts (<i>n</i> = 271 patients) was used for both the deep-learning- and radiomics-model development, and the three remaining cohorts (<i>n</i> = 374 patients) were kept as unseen test sets. The performances of the models were assessed in terms of their area under the receiver-operating-characteristic curve (AUC). Whereas the internal cross-validation showed a higher AUC for the deep-learning approach, the radiomics model obtained AUCs of 0.88, 0.91 and 0.65 on the independent test sets compared to AUCs of 0.70, 0.73 and 0.44 for the deep-learning model. Our radiomics model that was based on delineated regions resulted in a more accurate tool for significant-PCa classification in the three unseen test sets when compared to a fully automated deep-learning model.https://www.mdpi.com/2072-6694/14/1/12prostate carcinomaclinically significantradiomicsmachine learningdeep learningcomparison |
| spellingShingle | Jose M. Castillo T. Muhammad Arif Martijn P. A. Starmans Wiro J. Niessen Chris H. Bangma Ivo G. Schoots Jifke F. Veenland Classification of Clinically Significant Prostate Cancer on Multi-Parametric MRI: A Validation Study Comparing Deep Learning and Radiomics Cancers prostate carcinoma clinically significant radiomics machine learning deep learning comparison |
| title | Classification of Clinically Significant Prostate Cancer on Multi-Parametric MRI: A Validation Study Comparing Deep Learning and Radiomics |
| title_full | Classification of Clinically Significant Prostate Cancer on Multi-Parametric MRI: A Validation Study Comparing Deep Learning and Radiomics |
| title_fullStr | Classification of Clinically Significant Prostate Cancer on Multi-Parametric MRI: A Validation Study Comparing Deep Learning and Radiomics |
| title_full_unstemmed | Classification of Clinically Significant Prostate Cancer on Multi-Parametric MRI: A Validation Study Comparing Deep Learning and Radiomics |
| title_short | Classification of Clinically Significant Prostate Cancer on Multi-Parametric MRI: A Validation Study Comparing Deep Learning and Radiomics |
| title_sort | classification of clinically significant prostate cancer on multi parametric mri a validation study comparing deep learning and radiomics |
| topic | prostate carcinoma clinically significant radiomics machine learning deep learning comparison |
| url | https://www.mdpi.com/2072-6694/14/1/12 |
| work_keys_str_mv | AT josemcastillot classificationofclinicallysignificantprostatecanceronmultiparametricmriavalidationstudycomparingdeeplearningandradiomics AT muhammadarif classificationofclinicallysignificantprostatecanceronmultiparametricmriavalidationstudycomparingdeeplearningandradiomics AT martijnpastarmans classificationofclinicallysignificantprostatecanceronmultiparametricmriavalidationstudycomparingdeeplearningandradiomics AT wirojniessen classificationofclinicallysignificantprostatecanceronmultiparametricmriavalidationstudycomparingdeeplearningandradiomics AT chrishbangma classificationofclinicallysignificantprostatecanceronmultiparametricmriavalidationstudycomparingdeeplearningandradiomics AT ivogschoots classificationofclinicallysignificantprostatecanceronmultiparametricmriavalidationstudycomparingdeeplearningandradiomics AT jifkefveenland classificationofclinicallysignificantprostatecanceronmultiparametricmriavalidationstudycomparingdeeplearningandradiomics |