Artificial Intelligence for the Prediction of In-Hospital Clinical Deterioration: A Systematic Review
OBJECTIVES:. To analyze the available literature on the performance of artificial intelligence-generated clinical models for the prediction of serious life-threatening events in non-ICU adult patients and evaluate their potential clinical usage. DATA SOURCES:. The PubMed database was searched for re...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Wolters Kluwer
2022-09-01
|
| Series: | Critical Care Explorations |
| Online Access: | http://journals.lww.com/10.1097/CCE.0000000000000744 |
| _version_ | 1828373683982303232 |
|---|---|
| author | Lars I. Veldhuis, MD Nicky J. C. Woittiez, MD Prabath W. B. Nanayakkara, MD, PhD Jeroen Ludikhuize, MD, PhD |
| author_facet | Lars I. Veldhuis, MD Nicky J. C. Woittiez, MD Prabath W. B. Nanayakkara, MD, PhD Jeroen Ludikhuize, MD, PhD |
| author_sort | Lars I. Veldhuis, MD |
| collection | DOAJ |
| description | OBJECTIVES:. To analyze the available literature on the performance of artificial intelligence-generated clinical models for the prediction of serious life-threatening events in non-ICU adult patients and evaluate their potential clinical usage.
DATA SOURCES:. The PubMed database was searched for relevant articles in English literature from January 1, 2000, to January 23, 2022. Search terms, including artificial intelligence, machine learning, deep learning, and deterioration, were both controlled terms and free-text terms.
STUDY SELECTION:. We performed a systematic search reporting studies that showed performance of artificial intelligence-based models with outcome mortality and clinical deterioration.
DATA EXTRACTION:. Two review authors independently performed study selection and data extraction. Studies with the same outcome were grouped, namely mortality and various forms of deterioration (including ICU admission, adverse events, and cardiac arrests). Meta-analysis was planned in case sufficient data would be extracted from each study and no considerable heterogeneity between studies was present.
DATA SYNTHESIS:. In total, 45 articles were included for analysis, in which multiple methods of artificial intelligence were used. Twenty-four articles described models for the prediction of mortality and 21 for clinical deterioration. Due to heterogeneity of study characteristics (patient cohort, outcomes, and prediction models), meta-analysis could not be performed. The main reported measure of performance was the area under the receiver operating characteristic (AUROC) (n = 38), of which 33 (87%) had an AUROC greater than 0.8. The highest reported performance in a model predicting mortality had an AUROC of 0.935 and an area under the precision-recall curve of 0.96.
CONCLUSIONS:. Currently, a growing number of studies develop and analyzes artificial intelligence-based prediction models to predict critical illness and deterioration. We show that artificial intelligence-based prediction models have an overall good performance in predicting deterioration of patients. However, external validation of existing models and its performance in a clinical setting is highly recommended. |
| first_indexed | 2024-04-14T07:22:42Z |
| format | Article |
| id | doaj.art-893a73f8ea8a4245bb97fade8545edaa |
| institution | Directory Open Access Journal |
| issn | 2639-8028 |
| language | English |
| last_indexed | 2024-04-14T07:22:42Z |
| publishDate | 2022-09-01 |
| publisher | Wolters Kluwer |
| record_format | Article |
| series | Critical Care Explorations |
| spelling | doaj.art-893a73f8ea8a4245bb97fade8545edaa2022-12-22T02:06:07ZengWolters KluwerCritical Care Explorations2639-80282022-09-0149e074410.1097/CCE.0000000000000744202209000-00001Artificial Intelligence for the Prediction of In-Hospital Clinical Deterioration: A Systematic ReviewLars I. Veldhuis, MD0Nicky J. C. Woittiez, MD1Prabath W. B. Nanayakkara, MD, PhD2Jeroen Ludikhuize, MD, PhD31 Department of Anesthesiology, Amsterdam UMC, Location Academic Medical Center, Amsterdam, The Netherlands.3 Department of Intensive Care, Haga Teaching Hospital, Den Haag, The Netherlands.4 Section General Internal Medicine, Department of Internal Medicine, Amsterdam Public Health Research Institute, Amsterdam UMC, Location VU University Medical Centre, Amsterdam, The Netherlands.3 Department of Intensive Care, Haga Teaching Hospital, Den Haag, The Netherlands.OBJECTIVES:. To analyze the available literature on the performance of artificial intelligence-generated clinical models for the prediction of serious life-threatening events in non-ICU adult patients and evaluate their potential clinical usage. DATA SOURCES:. The PubMed database was searched for relevant articles in English literature from January 1, 2000, to January 23, 2022. Search terms, including artificial intelligence, machine learning, deep learning, and deterioration, were both controlled terms and free-text terms. STUDY SELECTION:. We performed a systematic search reporting studies that showed performance of artificial intelligence-based models with outcome mortality and clinical deterioration. DATA EXTRACTION:. Two review authors independently performed study selection and data extraction. Studies with the same outcome were grouped, namely mortality and various forms of deterioration (including ICU admission, adverse events, and cardiac arrests). Meta-analysis was planned in case sufficient data would be extracted from each study and no considerable heterogeneity between studies was present. DATA SYNTHESIS:. In total, 45 articles were included for analysis, in which multiple methods of artificial intelligence were used. Twenty-four articles described models for the prediction of mortality and 21 for clinical deterioration. Due to heterogeneity of study characteristics (patient cohort, outcomes, and prediction models), meta-analysis could not be performed. The main reported measure of performance was the area under the receiver operating characteristic (AUROC) (n = 38), of which 33 (87%) had an AUROC greater than 0.8. The highest reported performance in a model predicting mortality had an AUROC of 0.935 and an area under the precision-recall curve of 0.96. CONCLUSIONS:. Currently, a growing number of studies develop and analyzes artificial intelligence-based prediction models to predict critical illness and deterioration. We show that artificial intelligence-based prediction models have an overall good performance in predicting deterioration of patients. However, external validation of existing models and its performance in a clinical setting is highly recommended.http://journals.lww.com/10.1097/CCE.0000000000000744 |
| spellingShingle | Lars I. Veldhuis, MD Nicky J. C. Woittiez, MD Prabath W. B. Nanayakkara, MD, PhD Jeroen Ludikhuize, MD, PhD Artificial Intelligence for the Prediction of In-Hospital Clinical Deterioration: A Systematic Review Critical Care Explorations |
| title | Artificial Intelligence for the Prediction of In-Hospital Clinical Deterioration: A Systematic Review |
| title_full | Artificial Intelligence for the Prediction of In-Hospital Clinical Deterioration: A Systematic Review |
| title_fullStr | Artificial Intelligence for the Prediction of In-Hospital Clinical Deterioration: A Systematic Review |
| title_full_unstemmed | Artificial Intelligence for the Prediction of In-Hospital Clinical Deterioration: A Systematic Review |
| title_short | Artificial Intelligence for the Prediction of In-Hospital Clinical Deterioration: A Systematic Review |
| title_sort | artificial intelligence for the prediction of in hospital clinical deterioration a systematic review |
| url | http://journals.lww.com/10.1097/CCE.0000000000000744 |
| work_keys_str_mv | AT larsiveldhuismd artificialintelligenceforthepredictionofinhospitalclinicaldeteriorationasystematicreview AT nickyjcwoittiezmd artificialintelligenceforthepredictionofinhospitalclinicaldeteriorationasystematicreview AT prabathwbnanayakkaramdphd artificialintelligenceforthepredictionofinhospitalclinicaldeteriorationasystematicreview AT jeroenludikhuizemdphd artificialintelligenceforthepredictionofinhospitalclinicaldeteriorationasystematicreview |