COVID-19 mortality risk assessment: An international multi-center study
Timely identification of COVID-19 patients at high risk of mortality can significantly improve patient management and resource allocation within hospitals. This study seeks to develop and validate a data-driven personalized mortality risk calculator for hospitalized COVID-19 patients. De-identified...
Main Authors: | , , , , , , , , , , , , , , , , , , |
---|---|
Other Authors: | |
Format: | Article |
Published: |
Public Library of Science (PLoS)
2020
|
Online Access: | https://hdl.handle.net/1721.1/128817 |
_version_ | 1826209428470235136 |
---|---|
author | Bertsimas, Dimitris J Lukin, Galit Mingardi, Luca Nohadani, Omid Orfanoudaki, Agni Stellato, Bartolomeo Wiberg, Holly Gonzalez-Garcia, Sara Parra-Calderón, Carlos Luis Robinson, Kenneth Schneider, Michelle Stein, Barry Estirado, Alberto a Beccara, Lia Canino, Rosario Dal Bello, Martina Pezzetti, Federica Pan, Angelo Hellenic COVID-19 Study Group |
author2 | Sloan School of Management |
author_facet | Sloan School of Management Bertsimas, Dimitris J Lukin, Galit Mingardi, Luca Nohadani, Omid Orfanoudaki, Agni Stellato, Bartolomeo Wiberg, Holly Gonzalez-Garcia, Sara Parra-Calderón, Carlos Luis Robinson, Kenneth Schneider, Michelle Stein, Barry Estirado, Alberto a Beccara, Lia Canino, Rosario Dal Bello, Martina Pezzetti, Federica Pan, Angelo Hellenic COVID-19 Study Group |
author_sort | Bertsimas, Dimitris J |
collection | MIT |
description | Timely identification of COVID-19 patients at high risk of mortality can significantly improve patient management and resource allocation within hospitals. This study seeks to develop and validate a data-driven personalized mortality risk calculator for hospitalized COVID-19 patients. De-identified data was obtained for 3,927 COVID-19 positive patients from six independent centers, comprising 33 different hospitals. Demographic, clinical, and laboratory variables were collected at hospital admission. The COVID-19 Mortality Risk (CMR) tool was developed using the XGBoost algorithm to predict mortality. Its discrimination performance was subsequently evaluated on three validation cohorts. The derivation cohort of 3,062 patients has an observed mortality rate of 26.84%. Increased age, decreased oxygen saturation (≤ 93%), elevated levels of C-reactive protein (≥ 130 mg/L), blood urea nitrogen (≥ 18 mg/dL), and blood creatinine (≥ 1.2 mg/dL) were identified as primary risk factors, validating clinical findings. The model obtains out-of-sample AUCs of 0.90 (95% CI, 0.87–0.94) on the derivation cohort. In the validation cohorts, the model obtains AUCs of 0.92 (95% CI, 0.88–0.95) on Seville patients, 0.87 (95% CI, 0.84–0.91) on Hellenic COVID-19 Study Group patients, and 0.81 (95% CI, 0.76–0.85) on Hartford Hospital patients. The CMR tool is available as an online application at https:/www.covidanalytics.io/mortality_calculator and is currently in clinical use. The CMR model leverages machine learning to generate accurate mortality predictions using commonly available clinical features. This is the first risk score trained and validated on a cohort of COVID-19 patients from Europe and the United States. |
first_indexed | 2024-09-23T14:22:21Z |
format | Article |
id | mit-1721.1/128817 |
institution | Massachusetts Institute of Technology |
last_indexed | 2024-09-23T14:22:21Z |
publishDate | 2020 |
publisher | Public Library of Science (PLoS) |
record_format | dspace |
spelling | mit-1721.1/1288172022-10-01T20:54:48Z COVID-19 mortality risk assessment: An international multi-center study Bertsimas, Dimitris J Lukin, Galit Mingardi, Luca Nohadani, Omid Orfanoudaki, Agni Stellato, Bartolomeo Wiberg, Holly Gonzalez-Garcia, Sara Parra-Calderón, Carlos Luis Robinson, Kenneth Schneider, Michelle Stein, Barry Estirado, Alberto a Beccara, Lia Canino, Rosario Dal Bello, Martina Pezzetti, Federica Pan, Angelo Hellenic COVID-19 Study Group Sloan School of Management Timely identification of COVID-19 patients at high risk of mortality can significantly improve patient management and resource allocation within hospitals. This study seeks to develop and validate a data-driven personalized mortality risk calculator for hospitalized COVID-19 patients. De-identified data was obtained for 3,927 COVID-19 positive patients from six independent centers, comprising 33 different hospitals. Demographic, clinical, and laboratory variables were collected at hospital admission. The COVID-19 Mortality Risk (CMR) tool was developed using the XGBoost algorithm to predict mortality. Its discrimination performance was subsequently evaluated on three validation cohorts. The derivation cohort of 3,062 patients has an observed mortality rate of 26.84%. Increased age, decreased oxygen saturation (≤ 93%), elevated levels of C-reactive protein (≥ 130 mg/L), blood urea nitrogen (≥ 18 mg/dL), and blood creatinine (≥ 1.2 mg/dL) were identified as primary risk factors, validating clinical findings. The model obtains out-of-sample AUCs of 0.90 (95% CI, 0.87–0.94) on the derivation cohort. In the validation cohorts, the model obtains AUCs of 0.92 (95% CI, 0.88–0.95) on Seville patients, 0.87 (95% CI, 0.84–0.91) on Hellenic COVID-19 Study Group patients, and 0.81 (95% CI, 0.76–0.85) on Hartford Hospital patients. The CMR tool is available as an online application at https:/www.covidanalytics.io/mortality_calculator and is currently in clinical use. The CMR model leverages machine learning to generate accurate mortality predictions using commonly available clinical features. This is the first risk score trained and validated on a cohort of COVID-19 patients from Europe and the United States. 2020-12-11T19:05:36Z 2020-12-11T19:05:36Z 2020-12 2020-07 Article http://purl.org/eprint/type/JournalArticle 1932-6203 https://hdl.handle.net/1721.1/128817 Bertsimas, Dimitris et al. "COVID-19 mortality risk assessment: An international multi-center study." PLoS One 15, 12: e0243262 © 2020 Bertsimas et al. https://doi.org/10.1371/journal.pone.0243262 PLoS One Creative Commons Attribution 4.0 International license https://creativecommons.org/licenses/by/4.0/ application/pdf Public Library of Science (PLoS) PLoS |
spellingShingle | Bertsimas, Dimitris J Lukin, Galit Mingardi, Luca Nohadani, Omid Orfanoudaki, Agni Stellato, Bartolomeo Wiberg, Holly Gonzalez-Garcia, Sara Parra-Calderón, Carlos Luis Robinson, Kenneth Schneider, Michelle Stein, Barry Estirado, Alberto a Beccara, Lia Canino, Rosario Dal Bello, Martina Pezzetti, Federica Pan, Angelo Hellenic COVID-19 Study Group COVID-19 mortality risk assessment: An international multi-center study |
title | COVID-19 mortality risk assessment: An international multi-center study |
title_full | COVID-19 mortality risk assessment: An international multi-center study |
title_fullStr | COVID-19 mortality risk assessment: An international multi-center study |
title_full_unstemmed | COVID-19 mortality risk assessment: An international multi-center study |
title_short | COVID-19 mortality risk assessment: An international multi-center study |
title_sort | covid 19 mortality risk assessment an international multi center study |
url | https://hdl.handle.net/1721.1/128817 |
work_keys_str_mv | AT bertsimasdimitrisj covid19mortalityriskassessmentaninternationalmulticenterstudy AT lukingalit covid19mortalityriskassessmentaninternationalmulticenterstudy AT mingardiluca covid19mortalityriskassessmentaninternationalmulticenterstudy AT nohadaniomid covid19mortalityriskassessmentaninternationalmulticenterstudy AT orfanoudakiagni covid19mortalityriskassessmentaninternationalmulticenterstudy AT stellatobartolomeo covid19mortalityriskassessmentaninternationalmulticenterstudy AT wibergholly covid19mortalityriskassessmentaninternationalmulticenterstudy AT gonzalezgarciasara covid19mortalityriskassessmentaninternationalmulticenterstudy AT parracalderoncarlosluis covid19mortalityriskassessmentaninternationalmulticenterstudy AT robinsonkenneth covid19mortalityriskassessmentaninternationalmulticenterstudy AT schneidermichelle covid19mortalityriskassessmentaninternationalmulticenterstudy AT steinbarry covid19mortalityriskassessmentaninternationalmulticenterstudy AT estiradoalberto covid19mortalityriskassessmentaninternationalmulticenterstudy AT abeccaralia covid19mortalityriskassessmentaninternationalmulticenterstudy AT caninorosario covid19mortalityriskassessmentaninternationalmulticenterstudy AT dalbellomartina covid19mortalityriskassessmentaninternationalmulticenterstudy AT pezzettifederica covid19mortalityriskassessmentaninternationalmulticenterstudy AT panangelo covid19mortalityriskassessmentaninternationalmulticenterstudy AT helleniccovid19studygroup covid19mortalityriskassessmentaninternationalmulticenterstudy |