Detecting deteriorating patients in hospital: development and validation of a novel scoring system

<p><strong>Rationale:</strong> Late recognition of patient deterioration in hospital is associated with worse outcomes, including higher mortality. Despite the widespread introduction of early warning score systems and electronic health records, deterioration still goes unrecognise...

Täydet tiedot

Bibliografiset tiedot
Päätekijät: Pimentel, MAF, Redfern, OC, Malycha, J, Meredith, P, Prytherch, D, Briggs, J, Young, JD, Clifton, DA, Tarassenko, L, Watkinson, PJ
Aineistotyyppi: Journal article
Kieli:English
Julkaistu: American Thoracic Society 2021
_version_ 1826304901602344960
author Pimentel, MAF
Redfern, OC
Malycha, J
Meredith, P
Prytherch, D
Briggs, J
Young, JD
Clifton, DA
Tarassenko, L
Watkinson, PJ
author_facet Pimentel, MAF
Redfern, OC
Malycha, J
Meredith, P
Prytherch, D
Briggs, J
Young, JD
Clifton, DA
Tarassenko, L
Watkinson, PJ
author_sort Pimentel, MAF
collection OXFORD
description <p><strong>Rationale:</strong> Late recognition of patient deterioration in hospital is associated with worse outcomes, including higher mortality. Despite the widespread introduction of early warning score systems and electronic health records, deterioration still goes unrecognised. </p> <p><strong>Objectives:</strong> To develop and externally validate a Hospital-wide Alerting Via Electronic Noticeboard (HAVEN) system to identify hospitalised patients at risk of reversible deterioration. </p> <p><strong>Methods:</strong> A retrospective cohort study of patients 16 years of age or above admitted to four UK hospitals. The primary outcome was cardiac arrest or unplanned admission to the intensive care unit (ICU). We used patient data (vital signs, laboratory tests, comorbidities, frailty) from one hospital to train a machine learning model (gradient boosting trees). We internally and externally validated the model and compared its performance to existing scoring systems (including NEWS, LAPS-2 and eCART). </p> <p><strong>Measurements and Main Results:</strong> We developed the HAVEN model using 230,415 patient admissions to a single hospital. We validated HAVEN on 266,295 admissions to four hospitals. HAVEN showed substantially higher discrimination (c-statistic 0.901 [95% CI 0.898-0.903]) for the primary outcome within 24 h of each measurement than other published scoring systems (which range from 0.700 [0.696-0.704] to 0.863 [0.860-0.865]). With a precision of 10%, HAVEN was able to identify 42% of cardiac arrests or unplanned ICU admissions with a lead time of up to 48 h in advance, compared to 22% by the next best system. </p> <p><strong>Conclusion:</strong> The HAVEN machine learning algorithm for early identification of in-hospital deterioration significantly outperforms other published scores such as NEWS.</p>
first_indexed 2024-03-07T06:24:44Z
format Journal article
id oxford-uuid:f3e37ee9-c27f-4068-bb12-9026f312f749
institution University of Oxford
language English
last_indexed 2024-03-07T06:24:44Z
publishDate 2021
publisher American Thoracic Society
record_format dspace
spelling oxford-uuid:f3e37ee9-c27f-4068-bb12-9026f312f7492022-03-27T12:15:34ZDetecting deteriorating patients in hospital: development and validation of a novel scoring systemJournal articlehttp://purl.org/coar/resource_type/c_dcae04bcuuid:f3e37ee9-c27f-4068-bb12-9026f312f749EnglishSymplectic ElementsAmerican Thoracic Society2021Pimentel, MAFRedfern, OCMalycha, JMeredith, PPrytherch, DBriggs, JYoung, JDClifton, DATarassenko, LWatkinson, PJ<p><strong>Rationale:</strong> Late recognition of patient deterioration in hospital is associated with worse outcomes, including higher mortality. Despite the widespread introduction of early warning score systems and electronic health records, deterioration still goes unrecognised. </p> <p><strong>Objectives:</strong> To develop and externally validate a Hospital-wide Alerting Via Electronic Noticeboard (HAVEN) system to identify hospitalised patients at risk of reversible deterioration. </p> <p><strong>Methods:</strong> A retrospective cohort study of patients 16 years of age or above admitted to four UK hospitals. The primary outcome was cardiac arrest or unplanned admission to the intensive care unit (ICU). We used patient data (vital signs, laboratory tests, comorbidities, frailty) from one hospital to train a machine learning model (gradient boosting trees). We internally and externally validated the model and compared its performance to existing scoring systems (including NEWS, LAPS-2 and eCART). </p> <p><strong>Measurements and Main Results:</strong> We developed the HAVEN model using 230,415 patient admissions to a single hospital. We validated HAVEN on 266,295 admissions to four hospitals. HAVEN showed substantially higher discrimination (c-statistic 0.901 [95% CI 0.898-0.903]) for the primary outcome within 24 h of each measurement than other published scoring systems (which range from 0.700 [0.696-0.704] to 0.863 [0.860-0.865]). With a precision of 10%, HAVEN was able to identify 42% of cardiac arrests or unplanned ICU admissions with a lead time of up to 48 h in advance, compared to 22% by the next best system. </p> <p><strong>Conclusion:</strong> The HAVEN machine learning algorithm for early identification of in-hospital deterioration significantly outperforms other published scores such as NEWS.</p>
spellingShingle Pimentel, MAF
Redfern, OC
Malycha, J
Meredith, P
Prytherch, D
Briggs, J
Young, JD
Clifton, DA
Tarassenko, L
Watkinson, PJ
Detecting deteriorating patients in hospital: development and validation of a novel scoring system
title Detecting deteriorating patients in hospital: development and validation of a novel scoring system
title_full Detecting deteriorating patients in hospital: development and validation of a novel scoring system
title_fullStr Detecting deteriorating patients in hospital: development and validation of a novel scoring system
title_full_unstemmed Detecting deteriorating patients in hospital: development and validation of a novel scoring system
title_short Detecting deteriorating patients in hospital: development and validation of a novel scoring system
title_sort detecting deteriorating patients in hospital development and validation of a novel scoring system
work_keys_str_mv AT pimentelmaf detectingdeterioratingpatientsinhospitaldevelopmentandvalidationofanovelscoringsystem
AT redfernoc detectingdeterioratingpatientsinhospitaldevelopmentandvalidationofanovelscoringsystem
AT malychaj detectingdeterioratingpatientsinhospitaldevelopmentandvalidationofanovelscoringsystem
AT meredithp detectingdeterioratingpatientsinhospitaldevelopmentandvalidationofanovelscoringsystem
AT prytherchd detectingdeterioratingpatientsinhospitaldevelopmentandvalidationofanovelscoringsystem
AT briggsj detectingdeterioratingpatientsinhospitaldevelopmentandvalidationofanovelscoringsystem
AT youngjd detectingdeterioratingpatientsinhospitaldevelopmentandvalidationofanovelscoringsystem
AT cliftonda detectingdeterioratingpatientsinhospitaldevelopmentandvalidationofanovelscoringsystem
AT tarassenkol detectingdeterioratingpatientsinhospitaldevelopmentandvalidationofanovelscoringsystem
AT watkinsonpj detectingdeterioratingpatientsinhospitaldevelopmentandvalidationofanovelscoringsystem