COVID-19 mortality risk assessment: An international multi-center study

Timely identification of COVID-19 patients at high risk of mortality can significantly improve patient management and resource allocation within hospitals. This study seeks to develop and validate a data-driven personalized mortality risk calculator for hospitalized COVID-19 patients. De-identified...

Full description

Bibliographic Details
Main Authors: Bertsimas, Dimitris J, Lukin, Galit, Mingardi, Luca, Nohadani, Omid, Orfanoudaki, Agni, Stellato, Bartolomeo, Wiberg, Holly, Gonzalez-Garcia, Sara, Parra-Calderón, Carlos Luis, Robinson, Kenneth, Schneider, Michelle, Stein, Barry, Estirado, Alberto, a Beccara, Lia, Canino, Rosario, Dal Bello, Martina, Pezzetti, Federica, Pan, Angelo, Hellenic COVID-19 Study Group
Other Authors: Sloan School of Management
Format: Article
Published: Public Library of Science (PLoS) 2020
Online Access:https://hdl.handle.net/1721.1/128817
_version_ 1826209428470235136
author Bertsimas, Dimitris J
Lukin, Galit
Mingardi, Luca
Nohadani, Omid
Orfanoudaki, Agni
Stellato, Bartolomeo
Wiberg, Holly
Gonzalez-Garcia, Sara
Parra-Calderón, Carlos Luis
Robinson, Kenneth
Schneider, Michelle
Stein, Barry
Estirado, Alberto
a Beccara, Lia
Canino, Rosario
Dal Bello, Martina
Pezzetti, Federica
Pan, Angelo
Hellenic COVID-19 Study Group
author2 Sloan School of Management
author_facet Sloan School of Management
Bertsimas, Dimitris J
Lukin, Galit
Mingardi, Luca
Nohadani, Omid
Orfanoudaki, Agni
Stellato, Bartolomeo
Wiberg, Holly
Gonzalez-Garcia, Sara
Parra-Calderón, Carlos Luis
Robinson, Kenneth
Schneider, Michelle
Stein, Barry
Estirado, Alberto
a Beccara, Lia
Canino, Rosario
Dal Bello, Martina
Pezzetti, Federica
Pan, Angelo
Hellenic COVID-19 Study Group
author_sort Bertsimas, Dimitris J
collection MIT
description Timely identification of COVID-19 patients at high risk of mortality can significantly improve patient management and resource allocation within hospitals. This study seeks to develop and validate a data-driven personalized mortality risk calculator for hospitalized COVID-19 patients. De-identified data was obtained for 3,927 COVID-19 positive patients from six independent centers, comprising 33 different hospitals. Demographic, clinical, and laboratory variables were collected at hospital admission. The COVID-19 Mortality Risk (CMR) tool was developed using the XGBoost algorithm to predict mortality. Its discrimination performance was subsequently evaluated on three validation cohorts. The derivation cohort of 3,062 patients has an observed mortality rate of 26.84%. Increased age, decreased oxygen saturation (≤ 93%), elevated levels of C-reactive protein (≥ 130 mg/L), blood urea nitrogen (≥ 18 mg/dL), and blood creatinine (≥ 1.2 mg/dL) were identified as primary risk factors, validating clinical findings. The model obtains out-of-sample AUCs of 0.90 (95% CI, 0.87–0.94) on the derivation cohort. In the validation cohorts, the model obtains AUCs of 0.92 (95% CI, 0.88–0.95) on Seville patients, 0.87 (95% CI, 0.84–0.91) on Hellenic COVID-19 Study Group patients, and 0.81 (95% CI, 0.76–0.85) on Hartford Hospital patients. The CMR tool is available as an online application at https:/www.covidanalytics.io/mortality_calculator and is currently in clinical use. The CMR model leverages machine learning to generate accurate mortality predictions using commonly available clinical features. This is the first risk score trained and validated on a cohort of COVID-19 patients from Europe and the United States.
first_indexed 2024-09-23T14:22:21Z
format Article
id mit-1721.1/128817
institution Massachusetts Institute of Technology
last_indexed 2024-09-23T14:22:21Z
publishDate 2020
publisher Public Library of Science (PLoS)
record_format dspace
spelling mit-1721.1/1288172022-10-01T20:54:48Z COVID-19 mortality risk assessment: An international multi-center study Bertsimas, Dimitris J Lukin, Galit Mingardi, Luca Nohadani, Omid Orfanoudaki, Agni Stellato, Bartolomeo Wiberg, Holly Gonzalez-Garcia, Sara Parra-Calderón, Carlos Luis Robinson, Kenneth Schneider, Michelle Stein, Barry Estirado, Alberto a Beccara, Lia Canino, Rosario Dal Bello, Martina Pezzetti, Federica Pan, Angelo Hellenic COVID-19 Study Group Sloan School of Management Timely identification of COVID-19 patients at high risk of mortality can significantly improve patient management and resource allocation within hospitals. This study seeks to develop and validate a data-driven personalized mortality risk calculator for hospitalized COVID-19 patients. De-identified data was obtained for 3,927 COVID-19 positive patients from six independent centers, comprising 33 different hospitals. Demographic, clinical, and laboratory variables were collected at hospital admission. The COVID-19 Mortality Risk (CMR) tool was developed using the XGBoost algorithm to predict mortality. Its discrimination performance was subsequently evaluated on three validation cohorts. The derivation cohort of 3,062 patients has an observed mortality rate of 26.84%. Increased age, decreased oxygen saturation (≤ 93%), elevated levels of C-reactive protein (≥ 130 mg/L), blood urea nitrogen (≥ 18 mg/dL), and blood creatinine (≥ 1.2 mg/dL) were identified as primary risk factors, validating clinical findings. The model obtains out-of-sample AUCs of 0.90 (95% CI, 0.87–0.94) on the derivation cohort. In the validation cohorts, the model obtains AUCs of 0.92 (95% CI, 0.88–0.95) on Seville patients, 0.87 (95% CI, 0.84–0.91) on Hellenic COVID-19 Study Group patients, and 0.81 (95% CI, 0.76–0.85) on Hartford Hospital patients. The CMR tool is available as an online application at https:/www.covidanalytics.io/mortality_calculator and is currently in clinical use. The CMR model leverages machine learning to generate accurate mortality predictions using commonly available clinical features. This is the first risk score trained and validated on a cohort of COVID-19 patients from Europe and the United States. 2020-12-11T19:05:36Z 2020-12-11T19:05:36Z 2020-12 2020-07 Article http://purl.org/eprint/type/JournalArticle 1932-6203 https://hdl.handle.net/1721.1/128817 Bertsimas, Dimitris et al. "COVID-19 mortality risk assessment: An international multi-center study." PLoS One 15, 12: e0243262 © 2020 Bertsimas et al. https://doi.org/10.1371/journal.pone.0243262 PLoS One Creative Commons Attribution 4.0 International license https://creativecommons.org/licenses/by/4.0/ application/pdf Public Library of Science (PLoS) PLoS
spellingShingle Bertsimas, Dimitris J
Lukin, Galit
Mingardi, Luca
Nohadani, Omid
Orfanoudaki, Agni
Stellato, Bartolomeo
Wiberg, Holly
Gonzalez-Garcia, Sara
Parra-Calderón, Carlos Luis
Robinson, Kenneth
Schneider, Michelle
Stein, Barry
Estirado, Alberto
a Beccara, Lia
Canino, Rosario
Dal Bello, Martina
Pezzetti, Federica
Pan, Angelo
Hellenic COVID-19 Study Group
COVID-19 mortality risk assessment: An international multi-center study
title COVID-19 mortality risk assessment: An international multi-center study
title_full COVID-19 mortality risk assessment: An international multi-center study
title_fullStr COVID-19 mortality risk assessment: An international multi-center study
title_full_unstemmed COVID-19 mortality risk assessment: An international multi-center study
title_short COVID-19 mortality risk assessment: An international multi-center study
title_sort covid 19 mortality risk assessment an international multi center study
url https://hdl.handle.net/1721.1/128817
work_keys_str_mv AT bertsimasdimitrisj covid19mortalityriskassessmentaninternationalmulticenterstudy
AT lukingalit covid19mortalityriskassessmentaninternationalmulticenterstudy
AT mingardiluca covid19mortalityriskassessmentaninternationalmulticenterstudy
AT nohadaniomid covid19mortalityriskassessmentaninternationalmulticenterstudy
AT orfanoudakiagni covid19mortalityriskassessmentaninternationalmulticenterstudy
AT stellatobartolomeo covid19mortalityriskassessmentaninternationalmulticenterstudy
AT wibergholly covid19mortalityriskassessmentaninternationalmulticenterstudy
AT gonzalezgarciasara covid19mortalityriskassessmentaninternationalmulticenterstudy
AT parracalderoncarlosluis covid19mortalityriskassessmentaninternationalmulticenterstudy
AT robinsonkenneth covid19mortalityriskassessmentaninternationalmulticenterstudy
AT schneidermichelle covid19mortalityriskassessmentaninternationalmulticenterstudy
AT steinbarry covid19mortalityriskassessmentaninternationalmulticenterstudy
AT estiradoalberto covid19mortalityriskassessmentaninternationalmulticenterstudy
AT abeccaralia covid19mortalityriskassessmentaninternationalmulticenterstudy
AT caninorosario covid19mortalityriskassessmentaninternationalmulticenterstudy
AT dalbellomartina covid19mortalityriskassessmentaninternationalmulticenterstudy
AT pezzettifederica covid19mortalityriskassessmentaninternationalmulticenterstudy
AT panangelo covid19mortalityriskassessmentaninternationalmulticenterstudy
AT helleniccovid19studygroup covid19mortalityriskassessmentaninternationalmulticenterstudy