Prognostic models predicting transition to psychotic disorder using blood-based biomarkers: a systematic review and critical appraisal
Abstract Accumulating evidence suggests individuals with psychotic disorder show abnormalities in metabolic and inflammatory processes. Recently, several studies have employed blood-based predictors in models predicting transition to psychotic disorder in risk-enriched populations. A systematic revi...
Main Authors: | , , , , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
Nature Publishing Group
2023-10-01
|
Series: | Translational Psychiatry |
Online Access: | https://doi.org/10.1038/s41398-023-02623-y |
_version_ | 1797647174943637504 |
---|---|
author | Jonah F. Byrne David Mongan Jennifer Murphy Colm Healy Melanie Fӧcking Mary Cannon David R. Cotter |
author_facet | Jonah F. Byrne David Mongan Jennifer Murphy Colm Healy Melanie Fӧcking Mary Cannon David R. Cotter |
author_sort | Jonah F. Byrne |
collection | DOAJ |
description | Abstract Accumulating evidence suggests individuals with psychotic disorder show abnormalities in metabolic and inflammatory processes. Recently, several studies have employed blood-based predictors in models predicting transition to psychotic disorder in risk-enriched populations. A systematic review of the performance and methodology of prognostic models using blood-based biomarkers in the prediction of psychotic disorder from risk-enriched populations is warranted. Databases (PubMed, EMBASE and PsycINFO) were searched for eligible texts from 1998 to 15/05/2023, which detailed model development or validation studies. The checklist for Critical Appraisal and Data Extraction for Systematic Reviews of Prediction Modelling Studies (CHARMS) was used to guide data extraction from eligible texts and the Prediction Model Risk of Bias Assessment Tool (PROBAST) was used to assess the risk of bias and applicability of the studies. A narrative synthesis of the included studies was performed. Seventeen eligible studies were identified: 16 eligible model development studies and one eligible model validation study. A wide range of biomarkers were assessed, including nucleic acids, proteins, metabolites, and lipids. The range of C-index (area under the curve) estimates reported for the models was 0.67-1.00. No studies assessed model calibration. According to PROBAST criteria, all studies were at high risk of bias in the analysis domain. While a wide range of potentially predictive biomarkers were identified in the included studies, most studies did not account for overfitting in model performance estimates, no studies assessed calibration, and all models were at high risk of bias according to PROBAST criteria. External validation of the models is needed to provide more accurate estimates of their performance. Future studies which follow the latest available methodological and reporting guidelines and adopt strategies to accommodate required sample sizes for model development or validation will clarify the value of including blood-based biomarkers in models predicting psychosis. |
first_indexed | 2024-03-11T15:12:30Z |
format | Article |
id | doaj.art-24f0dac07f8e44a9b715a5ec05bc5702 |
institution | Directory Open Access Journal |
issn | 2158-3188 |
language | English |
last_indexed | 2024-03-11T15:12:30Z |
publishDate | 2023-10-01 |
publisher | Nature Publishing Group |
record_format | Article |
series | Translational Psychiatry |
spelling | doaj.art-24f0dac07f8e44a9b715a5ec05bc57022023-10-29T12:37:14ZengNature Publishing GroupTranslational Psychiatry2158-31882023-10-0113111110.1038/s41398-023-02623-yPrognostic models predicting transition to psychotic disorder using blood-based biomarkers: a systematic review and critical appraisalJonah F. Byrne0David Mongan1Jennifer Murphy2Colm Healy3Melanie Fӧcking4Mary Cannon5David R. Cotter6Department of Psychiatry, Royal College of Surgeons in IrelandDepartment of Psychiatry, Royal College of Surgeons in IrelandDepartment of Psychiatry, Royal College of Surgeons in IrelandDepartment of Psychiatry, Royal College of Surgeons in IrelandDepartment of Psychiatry, Royal College of Surgeons in IrelandDepartment of Psychiatry, Royal College of Surgeons in IrelandDepartment of Psychiatry, Royal College of Surgeons in IrelandAbstract Accumulating evidence suggests individuals with psychotic disorder show abnormalities in metabolic and inflammatory processes. Recently, several studies have employed blood-based predictors in models predicting transition to psychotic disorder in risk-enriched populations. A systematic review of the performance and methodology of prognostic models using blood-based biomarkers in the prediction of psychotic disorder from risk-enriched populations is warranted. Databases (PubMed, EMBASE and PsycINFO) were searched for eligible texts from 1998 to 15/05/2023, which detailed model development or validation studies. The checklist for Critical Appraisal and Data Extraction for Systematic Reviews of Prediction Modelling Studies (CHARMS) was used to guide data extraction from eligible texts and the Prediction Model Risk of Bias Assessment Tool (PROBAST) was used to assess the risk of bias and applicability of the studies. A narrative synthesis of the included studies was performed. Seventeen eligible studies were identified: 16 eligible model development studies and one eligible model validation study. A wide range of biomarkers were assessed, including nucleic acids, proteins, metabolites, and lipids. The range of C-index (area under the curve) estimates reported for the models was 0.67-1.00. No studies assessed model calibration. According to PROBAST criteria, all studies were at high risk of bias in the analysis domain. While a wide range of potentially predictive biomarkers were identified in the included studies, most studies did not account for overfitting in model performance estimates, no studies assessed calibration, and all models were at high risk of bias according to PROBAST criteria. External validation of the models is needed to provide more accurate estimates of their performance. Future studies which follow the latest available methodological and reporting guidelines and adopt strategies to accommodate required sample sizes for model development or validation will clarify the value of including blood-based biomarkers in models predicting psychosis.https://doi.org/10.1038/s41398-023-02623-y |
spellingShingle | Jonah F. Byrne David Mongan Jennifer Murphy Colm Healy Melanie Fӧcking Mary Cannon David R. Cotter Prognostic models predicting transition to psychotic disorder using blood-based biomarkers: a systematic review and critical appraisal Translational Psychiatry |
title | Prognostic models predicting transition to psychotic disorder using blood-based biomarkers: a systematic review and critical appraisal |
title_full | Prognostic models predicting transition to psychotic disorder using blood-based biomarkers: a systematic review and critical appraisal |
title_fullStr | Prognostic models predicting transition to psychotic disorder using blood-based biomarkers: a systematic review and critical appraisal |
title_full_unstemmed | Prognostic models predicting transition to psychotic disorder using blood-based biomarkers: a systematic review and critical appraisal |
title_short | Prognostic models predicting transition to psychotic disorder using blood-based biomarkers: a systematic review and critical appraisal |
title_sort | prognostic models predicting transition to psychotic disorder using blood based biomarkers a systematic review and critical appraisal |
url | https://doi.org/10.1038/s41398-023-02623-y |
work_keys_str_mv | AT jonahfbyrne prognosticmodelspredictingtransitiontopsychoticdisorderusingbloodbasedbiomarkersasystematicreviewandcriticalappraisal AT davidmongan prognosticmodelspredictingtransitiontopsychoticdisorderusingbloodbasedbiomarkersasystematicreviewandcriticalappraisal AT jennifermurphy prognosticmodelspredictingtransitiontopsychoticdisorderusingbloodbasedbiomarkersasystematicreviewandcriticalappraisal AT colmhealy prognosticmodelspredictingtransitiontopsychoticdisorderusingbloodbasedbiomarkersasystematicreviewandcriticalappraisal AT melanieföcking prognosticmodelspredictingtransitiontopsychoticdisorderusingbloodbasedbiomarkersasystematicreviewandcriticalappraisal AT marycannon prognosticmodelspredictingtransitiontopsychoticdisorderusingbloodbasedbiomarkersasystematicreviewandcriticalappraisal AT davidrcotter prognosticmodelspredictingtransitiontopsychoticdisorderusingbloodbasedbiomarkersasystematicreviewandcriticalappraisal |