Development and validation of the ISARIC 4C Deterioration model for adults hospitalised with COVID-19: a prospective cohort study
<p><strong>BACKGROUND:</strong> Prognostic models to predict the risk of clinical deterioration in acute COVID-19 cases are urgently required to inform clinical management decisions.</p> <p><strong>METHODS:</strong> We developed and validated a multivariabl...
| Main Authors: | , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , |
|---|---|
| Format: | Journal article |
| Language: | English |
| Published: |
Elsevier
2021
|
| _version_ | 1826295894062923776 |
|---|---|
| author | Gupta, RK Harrison, EM Ho, A Docherty, AB Knight, SR van Smeden, M Abubakar, I Lipman, M Quartagno, M Pius, R Buchan, I Carson, G Drake, TM Dunning, J Fairfield, CJ Gamble, C Green, CA Halpin, S Hardwick, HE Holden, KA Horby, PW Jackson, C Mclean, KA Merson, L Nguyen-Van-Tam, JS Norman, L Olliaro, PL Pritchard, MG Russell, CD Scott-Brown, J Shaw, CA Sheikh, A Solomon, T Sudlow, C Swann, OV Turtle, L Openshaw, PJM Baillie, JK Semple, MG Noursadeghi, M ISARIC4C Investigators |
| author_facet | Gupta, RK Harrison, EM Ho, A Docherty, AB Knight, SR van Smeden, M Abubakar, I Lipman, M Quartagno, M Pius, R Buchan, I Carson, G Drake, TM Dunning, J Fairfield, CJ Gamble, C Green, CA Halpin, S Hardwick, HE Holden, KA Horby, PW Jackson, C Mclean, KA Merson, L Nguyen-Van-Tam, JS Norman, L Olliaro, PL Pritchard, MG Russell, CD Scott-Brown, J Shaw, CA Sheikh, A Solomon, T Sudlow, C Swann, OV Turtle, L Openshaw, PJM Baillie, JK Semple, MG Noursadeghi, M ISARIC4C Investigators |
| author_sort | Gupta, RK |
| collection | OXFORD |
| description | <p><strong>BACKGROUND:</strong> Prognostic models to predict the risk of clinical deterioration in acute COVID-19 cases are urgently required to inform clinical management decisions.</p>
<p><strong>METHODS:</strong> We developed and validated a multivariable logistic regression model for in-hospital clinical deterioration (defined as any requirement of ventilatory support or critical care, or death) among consecutively hospitalised adults with highly suspected or confirmed COVID-19 who were prospectively recruited to the International Severe Acute Respiratory and Emerging Infections Consortium Coronavirus Clinical Characterisation Consortium (ISARIC4C) study across 260 hospitals in England, Scotland, and Wales. Candidate predictors that were specified a priori were considered for inclusion in the model on the basis of previous prognostic scores and emerging literature describing routinely measured biomarkers associated with COVID-19 prognosis. We used internal-external cross-validation to evaluate discrimination, calibration, and clinical utility across eight National Health Service (NHS) regions in the development cohort. We further validated the final model in held-out data from an additional NHS region (London).</p>
<p><strong>FINDINGS:</strong> 74 944 participants (recruited between Feb 6 and Aug 26, 2020) were included, of whom 31 924 (43·2%) of 73 948 with available outcomes met the composite clinical deterioration outcome. In internal-external cross-validation in the development cohort of 66 705 participants, the selected model (comprising 11 predictors routinely measured at the point of hospital admission) showed consistent discrimination, calibration, and clinical utility across all eight NHS regions. In held-out data from London (n=8239), the model showed a similarly consistent performance (C-statistic 0·77 [95% CI 0·76 to 0·78]; calibration-in-the-large 0·00 [-0·05 to 0·05]); calibration slope 0·96 [0·91 to 1·01]), and greater net benefit than any other reproducible prognostic model.</p>
<p><strong>INTERPRETATION:</strong> The 4C Deterioration model has strong potential for clinical utility and generalisability to predict clinical deterioration and inform decision making among adults hospitalised with COVID-19.</p>
<p><strong>FUNDING:</strong> National Institute for Health Research (NIHR), UK Medical Research Council, Wellcome Trust, Department for International Development, Bill & Melinda Gates Foundation, EU Platform for European Preparedness Against (Re-)emerging Epidemics, NIHR Health Protection Research Unit (HPRU) in Emerging and Zoonotic Infections at University of Liverpool, NIHR HPRU in Respiratory Infections at Imperial College London.</p> |
| first_indexed | 2024-03-07T04:07:58Z |
| format | Journal article |
| id | oxford-uuid:c6de0a2e-4028-41b4-a4f3-2761b2d9fc9d |
| institution | University of Oxford |
| language | English |
| last_indexed | 2024-03-07T04:07:58Z |
| publishDate | 2021 |
| publisher | Elsevier |
| record_format | dspace |
| spelling | oxford-uuid:c6de0a2e-4028-41b4-a4f3-2761b2d9fc9d2022-03-27T06:41:06ZDevelopment and validation of the ISARIC 4C Deterioration model for adults hospitalised with COVID-19: a prospective cohort studyJournal articlehttp://purl.org/coar/resource_type/c_dcae04bcuuid:c6de0a2e-4028-41b4-a4f3-2761b2d9fc9dEnglishSymplectic ElementsElsevier2021Gupta, RKHarrison, EMHo, ADocherty, ABKnight, SRvan Smeden, MAbubakar, ILipman, MQuartagno, MPius, RBuchan, ICarson, GDrake, TMDunning, JFairfield, CJGamble, CGreen, CAHalpin, SHardwick, HEHolden, KAHorby, PWJackson, CMclean, KAMerson, LNguyen-Van-Tam, JSNorman, LOlliaro, PLPritchard, MGRussell, CDScott-Brown, JShaw, CASheikh, ASolomon, TSudlow, CSwann, OVTurtle, LOpenshaw, PJMBaillie, JKSemple, MGNoursadeghi, MISARIC4C Investigators<p><strong>BACKGROUND:</strong> Prognostic models to predict the risk of clinical deterioration in acute COVID-19 cases are urgently required to inform clinical management decisions.</p> <p><strong>METHODS:</strong> We developed and validated a multivariable logistic regression model for in-hospital clinical deterioration (defined as any requirement of ventilatory support or critical care, or death) among consecutively hospitalised adults with highly suspected or confirmed COVID-19 who were prospectively recruited to the International Severe Acute Respiratory and Emerging Infections Consortium Coronavirus Clinical Characterisation Consortium (ISARIC4C) study across 260 hospitals in England, Scotland, and Wales. Candidate predictors that were specified a priori were considered for inclusion in the model on the basis of previous prognostic scores and emerging literature describing routinely measured biomarkers associated with COVID-19 prognosis. We used internal-external cross-validation to evaluate discrimination, calibration, and clinical utility across eight National Health Service (NHS) regions in the development cohort. We further validated the final model in held-out data from an additional NHS region (London).</p> <p><strong>FINDINGS:</strong> 74 944 participants (recruited between Feb 6 and Aug 26, 2020) were included, of whom 31 924 (43·2%) of 73 948 with available outcomes met the composite clinical deterioration outcome. In internal-external cross-validation in the development cohort of 66 705 participants, the selected model (comprising 11 predictors routinely measured at the point of hospital admission) showed consistent discrimination, calibration, and clinical utility across all eight NHS regions. In held-out data from London (n=8239), the model showed a similarly consistent performance (C-statistic 0·77 [95% CI 0·76 to 0·78]; calibration-in-the-large 0·00 [-0·05 to 0·05]); calibration slope 0·96 [0·91 to 1·01]), and greater net benefit than any other reproducible prognostic model.</p> <p><strong>INTERPRETATION:</strong> The 4C Deterioration model has strong potential for clinical utility and generalisability to predict clinical deterioration and inform decision making among adults hospitalised with COVID-19.</p> <p><strong>FUNDING:</strong> National Institute for Health Research (NIHR), UK Medical Research Council, Wellcome Trust, Department for International Development, Bill & Melinda Gates Foundation, EU Platform for European Preparedness Against (Re-)emerging Epidemics, NIHR Health Protection Research Unit (HPRU) in Emerging and Zoonotic Infections at University of Liverpool, NIHR HPRU in Respiratory Infections at Imperial College London.</p> |
| spellingShingle | Gupta, RK Harrison, EM Ho, A Docherty, AB Knight, SR van Smeden, M Abubakar, I Lipman, M Quartagno, M Pius, R Buchan, I Carson, G Drake, TM Dunning, J Fairfield, CJ Gamble, C Green, CA Halpin, S Hardwick, HE Holden, KA Horby, PW Jackson, C Mclean, KA Merson, L Nguyen-Van-Tam, JS Norman, L Olliaro, PL Pritchard, MG Russell, CD Scott-Brown, J Shaw, CA Sheikh, A Solomon, T Sudlow, C Swann, OV Turtle, L Openshaw, PJM Baillie, JK Semple, MG Noursadeghi, M ISARIC4C Investigators Development and validation of the ISARIC 4C Deterioration model for adults hospitalised with COVID-19: a prospective cohort study |
| title | Development and validation of the ISARIC 4C Deterioration model for adults hospitalised with COVID-19: a prospective cohort study |
| title_full | Development and validation of the ISARIC 4C Deterioration model for adults hospitalised with COVID-19: a prospective cohort study |
| title_fullStr | Development and validation of the ISARIC 4C Deterioration model for adults hospitalised with COVID-19: a prospective cohort study |
| title_full_unstemmed | Development and validation of the ISARIC 4C Deterioration model for adults hospitalised with COVID-19: a prospective cohort study |
| title_short | Development and validation of the ISARIC 4C Deterioration model for adults hospitalised with COVID-19: a prospective cohort study |
| title_sort | development and validation of the isaric 4c deterioration model for adults hospitalised with covid 19 a prospective cohort study |
| work_keys_str_mv | AT guptark developmentandvalidationoftheisaric4cdeteriorationmodelforadultshospitalisedwithcovid19aprospectivecohortstudy AT harrisonem developmentandvalidationoftheisaric4cdeteriorationmodelforadultshospitalisedwithcovid19aprospectivecohortstudy AT hoa developmentandvalidationoftheisaric4cdeteriorationmodelforadultshospitalisedwithcovid19aprospectivecohortstudy AT dochertyab developmentandvalidationoftheisaric4cdeteriorationmodelforadultshospitalisedwithcovid19aprospectivecohortstudy AT knightsr developmentandvalidationoftheisaric4cdeteriorationmodelforadultshospitalisedwithcovid19aprospectivecohortstudy AT vansmedenm developmentandvalidationoftheisaric4cdeteriorationmodelforadultshospitalisedwithcovid19aprospectivecohortstudy AT abubakari developmentandvalidationoftheisaric4cdeteriorationmodelforadultshospitalisedwithcovid19aprospectivecohortstudy AT lipmanm developmentandvalidationoftheisaric4cdeteriorationmodelforadultshospitalisedwithcovid19aprospectivecohortstudy AT quartagnom developmentandvalidationoftheisaric4cdeteriorationmodelforadultshospitalisedwithcovid19aprospectivecohortstudy AT piusr developmentandvalidationoftheisaric4cdeteriorationmodelforadultshospitalisedwithcovid19aprospectivecohortstudy AT buchani developmentandvalidationoftheisaric4cdeteriorationmodelforadultshospitalisedwithcovid19aprospectivecohortstudy AT carsong developmentandvalidationoftheisaric4cdeteriorationmodelforadultshospitalisedwithcovid19aprospectivecohortstudy AT draketm developmentandvalidationoftheisaric4cdeteriorationmodelforadultshospitalisedwithcovid19aprospectivecohortstudy AT dunningj developmentandvalidationoftheisaric4cdeteriorationmodelforadultshospitalisedwithcovid19aprospectivecohortstudy AT fairfieldcj developmentandvalidationoftheisaric4cdeteriorationmodelforadultshospitalisedwithcovid19aprospectivecohortstudy AT gamblec developmentandvalidationoftheisaric4cdeteriorationmodelforadultshospitalisedwithcovid19aprospectivecohortstudy AT greenca developmentandvalidationoftheisaric4cdeteriorationmodelforadultshospitalisedwithcovid19aprospectivecohortstudy AT halpins developmentandvalidationoftheisaric4cdeteriorationmodelforadultshospitalisedwithcovid19aprospectivecohortstudy AT hardwickhe developmentandvalidationoftheisaric4cdeteriorationmodelforadultshospitalisedwithcovid19aprospectivecohortstudy AT holdenka developmentandvalidationoftheisaric4cdeteriorationmodelforadultshospitalisedwithcovid19aprospectivecohortstudy AT horbypw developmentandvalidationoftheisaric4cdeteriorationmodelforadultshospitalisedwithcovid19aprospectivecohortstudy AT jacksonc developmentandvalidationoftheisaric4cdeteriorationmodelforadultshospitalisedwithcovid19aprospectivecohortstudy AT mcleanka developmentandvalidationoftheisaric4cdeteriorationmodelforadultshospitalisedwithcovid19aprospectivecohortstudy AT mersonl developmentandvalidationoftheisaric4cdeteriorationmodelforadultshospitalisedwithcovid19aprospectivecohortstudy AT nguyenvantamjs developmentandvalidationoftheisaric4cdeteriorationmodelforadultshospitalisedwithcovid19aprospectivecohortstudy AT normanl developmentandvalidationoftheisaric4cdeteriorationmodelforadultshospitalisedwithcovid19aprospectivecohortstudy AT olliaropl developmentandvalidationoftheisaric4cdeteriorationmodelforadultshospitalisedwithcovid19aprospectivecohortstudy AT pritchardmg developmentandvalidationoftheisaric4cdeteriorationmodelforadultshospitalisedwithcovid19aprospectivecohortstudy AT russellcd developmentandvalidationoftheisaric4cdeteriorationmodelforadultshospitalisedwithcovid19aprospectivecohortstudy AT scottbrownj developmentandvalidationoftheisaric4cdeteriorationmodelforadultshospitalisedwithcovid19aprospectivecohortstudy AT shawca developmentandvalidationoftheisaric4cdeteriorationmodelforadultshospitalisedwithcovid19aprospectivecohortstudy AT sheikha developmentandvalidationoftheisaric4cdeteriorationmodelforadultshospitalisedwithcovid19aprospectivecohortstudy AT solomont developmentandvalidationoftheisaric4cdeteriorationmodelforadultshospitalisedwithcovid19aprospectivecohortstudy AT sudlowc developmentandvalidationoftheisaric4cdeteriorationmodelforadultshospitalisedwithcovid19aprospectivecohortstudy AT swannov developmentandvalidationoftheisaric4cdeteriorationmodelforadultshospitalisedwithcovid19aprospectivecohortstudy AT turtlel developmentandvalidationoftheisaric4cdeteriorationmodelforadultshospitalisedwithcovid19aprospectivecohortstudy AT openshawpjm developmentandvalidationoftheisaric4cdeteriorationmodelforadultshospitalisedwithcovid19aprospectivecohortstudy AT bailliejk developmentandvalidationoftheisaric4cdeteriorationmodelforadultshospitalisedwithcovid19aprospectivecohortstudy AT semplemg developmentandvalidationoftheisaric4cdeteriorationmodelforadultshospitalisedwithcovid19aprospectivecohortstudy AT noursadeghim developmentandvalidationoftheisaric4cdeteriorationmodelforadultshospitalisedwithcovid19aprospectivecohortstudy AT isaric4cinvestigators developmentandvalidationoftheisaric4cdeteriorationmodelforadultshospitalisedwithcovid19aprospectivecohortstudy |