A framework for meta-analysis of prediction model studies with binary and time-to-event outcomes
It is widely recommended that any developed—diagnostic or prognostic—prediction model is externally validated in terms of its predictive performance measured by calibration and discrimination. When multiple validations have been performed, a systematic review followed by a formal meta-analysis helps...
| Príomhchruthaitheoirí: | , , , , , , , |
|---|---|
| Formáid: | Journal article |
| Teanga: | English |
| Foilsithe / Cruthaithe: |
SAGE Publications
2018
|
| _version_ | 1826268255761727488 |
|---|---|
| author | Debray, T Damen, J Riley, R Snell, K Reitsma, J Hooft, L Collins, G Moons, K |
| author_facet | Debray, T Damen, J Riley, R Snell, K Reitsma, J Hooft, L Collins, G Moons, K |
| author_sort | Debray, T |
| collection | OXFORD |
| description | It is widely recommended that any developed—diagnostic or prognostic—prediction model is externally validated in terms of its predictive performance measured by calibration and discrimination. When multiple validations have been performed, a systematic review followed by a formal meta-analysis helps to summarize overall performance across multiple settings, and reveals under which circumstances the model performs suboptimal (alternative poorer) and may need adjustment. We discuss how to undertake meta-analysis of the performance of prediction models with either a binary or a time-to-event outcome. We address how to deal with incomplete availability of study-specific results (performance estimates and their precision), and how to produce summary estimates of the c-statistic, the observed:expected ratio and the calibration slope. Furthermore, we discuss the implementation of frequentist and Bayesian meta-analysis methods, and propose novel empirically-based prior distributions to improve estimation of between-study heterogeneity in small samples. Finally, we illustrate all methods using two examples: meta-analysis of the predictive performance of EuroSCORE II and of the Framingham Risk Score. All examples and meta-analysis models have been implemented in our newly developed R package “metamisc”. |
| first_indexed | 2024-03-06T21:06:52Z |
| format | Journal article |
| id | oxford-uuid:3cc5d25a-964c-4c6a-bde5-a0a812acadf8 |
| institution | University of Oxford |
| language | English |
| last_indexed | 2024-03-06T21:06:52Z |
| publishDate | 2018 |
| publisher | SAGE Publications |
| record_format | dspace |
| spelling | oxford-uuid:3cc5d25a-964c-4c6a-bde5-a0a812acadf82022-03-26T14:15:33ZA framework for meta-analysis of prediction model studies with binary and time-to-event outcomesJournal articlehttp://purl.org/coar/resource_type/c_dcae04bcuuid:3cc5d25a-964c-4c6a-bde5-a0a812acadf8EnglishSymplectic Elements at OxfordSAGE Publications2018Debray, TDamen, JRiley, RSnell, KReitsma, JHooft, LCollins, GMoons, KIt is widely recommended that any developed—diagnostic or prognostic—prediction model is externally validated in terms of its predictive performance measured by calibration and discrimination. When multiple validations have been performed, a systematic review followed by a formal meta-analysis helps to summarize overall performance across multiple settings, and reveals under which circumstances the model performs suboptimal (alternative poorer) and may need adjustment. We discuss how to undertake meta-analysis of the performance of prediction models with either a binary or a time-to-event outcome. We address how to deal with incomplete availability of study-specific results (performance estimates and their precision), and how to produce summary estimates of the c-statistic, the observed:expected ratio and the calibration slope. Furthermore, we discuss the implementation of frequentist and Bayesian meta-analysis methods, and propose novel empirically-based prior distributions to improve estimation of between-study heterogeneity in small samples. Finally, we illustrate all methods using two examples: meta-analysis of the predictive performance of EuroSCORE II and of the Framingham Risk Score. All examples and meta-analysis models have been implemented in our newly developed R package “metamisc”. |
| spellingShingle | Debray, T Damen, J Riley, R Snell, K Reitsma, J Hooft, L Collins, G Moons, K A framework for meta-analysis of prediction model studies with binary and time-to-event outcomes |
| title | A framework for meta-analysis of prediction model studies with binary and time-to-event outcomes |
| title_full | A framework for meta-analysis of prediction model studies with binary and time-to-event outcomes |
| title_fullStr | A framework for meta-analysis of prediction model studies with binary and time-to-event outcomes |
| title_full_unstemmed | A framework for meta-analysis of prediction model studies with binary and time-to-event outcomes |
| title_short | A framework for meta-analysis of prediction model studies with binary and time-to-event outcomes |
| title_sort | framework for meta analysis of prediction model studies with binary and time to event outcomes |
| work_keys_str_mv | AT debrayt aframeworkformetaanalysisofpredictionmodelstudieswithbinaryandtimetoeventoutcomes AT damenj aframeworkformetaanalysisofpredictionmodelstudieswithbinaryandtimetoeventoutcomes AT rileyr aframeworkformetaanalysisofpredictionmodelstudieswithbinaryandtimetoeventoutcomes AT snellk aframeworkformetaanalysisofpredictionmodelstudieswithbinaryandtimetoeventoutcomes AT reitsmaj aframeworkformetaanalysisofpredictionmodelstudieswithbinaryandtimetoeventoutcomes AT hooftl aframeworkformetaanalysisofpredictionmodelstudieswithbinaryandtimetoeventoutcomes AT collinsg aframeworkformetaanalysisofpredictionmodelstudieswithbinaryandtimetoeventoutcomes AT moonsk aframeworkformetaanalysisofpredictionmodelstudieswithbinaryandtimetoeventoutcomes AT debrayt frameworkformetaanalysisofpredictionmodelstudieswithbinaryandtimetoeventoutcomes AT damenj frameworkformetaanalysisofpredictionmodelstudieswithbinaryandtimetoeventoutcomes AT rileyr frameworkformetaanalysisofpredictionmodelstudieswithbinaryandtimetoeventoutcomes AT snellk frameworkformetaanalysisofpredictionmodelstudieswithbinaryandtimetoeventoutcomes AT reitsmaj frameworkformetaanalysisofpredictionmodelstudieswithbinaryandtimetoeventoutcomes AT hooftl frameworkformetaanalysisofpredictionmodelstudieswithbinaryandtimetoeventoutcomes AT collinsg frameworkformetaanalysisofpredictionmodelstudieswithbinaryandtimetoeventoutcomes AT moonsk frameworkformetaanalysisofpredictionmodelstudieswithbinaryandtimetoeventoutcomes |