Updating cut-off values of severity scoring systems for community-acquired pneumonia to orchestrate more predictive accuracy

AbstractBackground: The assessment of severity is crucial in the management of community-acquired pneumonia (CAP). It remains unknown whether updating cut-off values of severity scoring systems orchestrate improvement in predictive accuracy.Methods: 3,212 patients with CAP were recruited to two obse...

Full description

Bibliographic Details
Main Authors: Qi Guo, Hai-yan Li, Wei-dong Song, Ming Li, Xiao-ke Chen, Hui Liu, Hong-lin Peng, Hai-qiong Yu, Nian Liu, Yan-hong Li, Zhong-dong Lü, Li-hua Liang, Qing-zhou Zhao, Mei Jiang
Format: Article
Language:English
Published: Taylor & Francis Group 2023-12-01
Series:Annals of Medicine
Subjects:
Online Access:https://www.tandfonline.com/doi/10.1080/07853890.2023.2202414
_version_ 1797353733987762176
author Qi Guo
Hai-yan Li
Wei-dong Song
Ming Li
Xiao-ke Chen
Hui Liu
Hong-lin Peng
Hai-qiong Yu
Nian Liu
Yan-hong Li
Zhong-dong Lü
Li-hua Liang
Qing-zhou Zhao
Mei Jiang
author_facet Qi Guo
Hai-yan Li
Wei-dong Song
Ming Li
Xiao-ke Chen
Hui Liu
Hong-lin Peng
Hai-qiong Yu
Nian Liu
Yan-hong Li
Zhong-dong Lü
Li-hua Liang
Qing-zhou Zhao
Mei Jiang
author_sort Qi Guo
collection DOAJ
description AbstractBackground: The assessment of severity is crucial in the management of community-acquired pneumonia (CAP). It remains unknown whether updating cut-off values of severity scoring systems orchestrate improvement in predictive accuracy.Methods: 3,212 patients with CAP were recruited to two observational prospective cohort studies. Three bettered scoring systems were derived from the corresponding well-established and extensively used pneumonia-specific severity scoring systems, i.e. pneumonia severity index, minor criteria and CURB-65 (confusion, urea >7 mmol/L, respiratory rate ≥30/min, low blood pressure, and age ≥65 years) score, with the updating cut-off values for tachypnea and low blood pressure. Cronbach α was employed to determine construct validity. Discrimination was valued by calculating the area under the receiver operating characteristic curve (AUROC) and net reclassification improvement (NRI).Results: Respiratory rate ≥22/min and systolic blood pressure ≤100 mm Hg were performed better than respiratory rate ≥30/min and hypotension for predicting mortality in the derivation cohort, respectively (AUROC, 0.823 vs 0.519, 0.688 vs 0.622; NRI, 0.61, 0.13). Bettered scoring systems orchestrated higher convergences, indicated by greater Cronbach α and more decrease in Cronbach α if the updating cut-off values were deleted. The six scoring systems agreed well with one another. Bettered- pneumonia severity index, minor criteria and CURB-65 score showed higher associations with severity and mortality rates and demonstrated greater predictive accuracies for mortality compared with the corresponding original systems (AUROC, 0.939 vs 0.883, 0.909 vs 0.871, 0.913 vs 0.859; NRI, 0.113, 0.076, 0.108; respectively). The validation cohort confirmed a similar pattern.Conclusions: Updating cut-off values of severity scoring systems for CAP orchestrate improvement in predictive accuracy, suggesting that it may facilitate the rationalization of clinical triage decision-making and further reduce mortality. The current studies provide the first known prospective evidence of potential benefit of the updating cut-off values of severity scoring systems for CAP in predictive accuracy.Key messagesUpdating cut-off values were performed better for predicting mortality.Bettered scoring systems orchestrated higher convergences.Bettered scoring systems demonstrated greater predictive accuracies for mortality.
first_indexed 2024-03-08T13:35:20Z
format Article
id doaj.art-5f230c72692e4de39d4c41ba354d82ab
institution Directory Open Access Journal
issn 0785-3890
1365-2060
language English
last_indexed 2024-03-08T13:35:20Z
publishDate 2023-12-01
publisher Taylor & Francis Group
record_format Article
series Annals of Medicine
spelling doaj.art-5f230c72692e4de39d4c41ba354d82ab2024-01-16T19:13:22ZengTaylor & Francis GroupAnnals of Medicine0785-38901365-20602023-12-0155110.1080/07853890.2023.2202414Updating cut-off values of severity scoring systems for community-acquired pneumonia to orchestrate more predictive accuracyQi Guo0Hai-yan Li1Wei-dong Song2Ming Li3Xiao-ke Chen4Hui Liu5Hong-lin Peng6Hai-qiong Yu7Nian Liu8Yan-hong Li9Zhong-dong Lü10Li-hua Liang11Qing-zhou Zhao12Mei Jiang13Department of Pulmonary and Critical Care Medicine, Shenzhen Hospital, Peking University, Shenzhen, Guangdong, P.R. ChinaDepartment of General Medicine, The Eighth Affiliated Hospital, Sun Yat-sen University, Shenzhen, Guangdong, P.R. ChinaDepartment of Pulmonary and Critical Care Medicine, Shenzhen Hospital, Peking University, Shenzhen, Guangdong, P.R. ChinaDepartment of Pulmonary and Critical Care Medicine, The Eighth Affiliated Hospital, Sun Yat-sen University, Shenzhen, Guangdong, P.R. ChinaDepartment of Pulmonary and Critical Care Medicine, The Eighth Affiliated Hospital, Sun Yat-sen University, Shenzhen, Guangdong, P.R. ChinaDepartment of Pulmonary and Critical Care Medicine, The Eighth Affiliated Hospital, Sun Yat-sen University, Shenzhen, Guangdong, P.R. ChinaDepartment of Pulmonary and Critical Care Medicine, The Eighth Affiliated Hospital, Sun Yat-sen University, Shenzhen, Guangdong, P.R. ChinaDepartment of Pulmonary and Critical Care Medicine, The Eighth Affiliated Hospital, Sun Yat-sen University, Shenzhen, Guangdong, P.R. ChinaDepartment of Pulmonary and Critical Care Medicine, The Eighth Affiliated Hospital, Sun Yat-sen University, Shenzhen, Guangdong, P.R. ChinaDepartment of Pulmonary and Critical Care Medicine, Shenzhen Hospital, Peking University, Shenzhen, Guangdong, P.R. ChinaDepartment of Pulmonary and Critical Care Medicine, Shenzhen Hospital, Peking University, Shenzhen, Guangdong, P.R. ChinaDepartment of Radiology, The Eighth Affiliated Hospital, Sun Yat-sen University, Shenzhen, Guangdong, P.R. ChinaDepartment of Radiology, The Eighth Affiliated Hospital, Sun Yat-sen University, Shenzhen, Guangdong, P.R. ChinaState Key Laboratory of Respiratory Disease, National Clinical Research Center for Respiratory Disease, Guangzhou Institute of Respiratory Health, The First Affiliated Hospital, Guangzhou Medical University, Guangzhou, Guangdong, P.R. ChinaAbstractBackground: The assessment of severity is crucial in the management of community-acquired pneumonia (CAP). It remains unknown whether updating cut-off values of severity scoring systems orchestrate improvement in predictive accuracy.Methods: 3,212 patients with CAP were recruited to two observational prospective cohort studies. Three bettered scoring systems were derived from the corresponding well-established and extensively used pneumonia-specific severity scoring systems, i.e. pneumonia severity index, minor criteria and CURB-65 (confusion, urea >7 mmol/L, respiratory rate ≥30/min, low blood pressure, and age ≥65 years) score, with the updating cut-off values for tachypnea and low blood pressure. Cronbach α was employed to determine construct validity. Discrimination was valued by calculating the area under the receiver operating characteristic curve (AUROC) and net reclassification improvement (NRI).Results: Respiratory rate ≥22/min and systolic blood pressure ≤100 mm Hg were performed better than respiratory rate ≥30/min and hypotension for predicting mortality in the derivation cohort, respectively (AUROC, 0.823 vs 0.519, 0.688 vs 0.622; NRI, 0.61, 0.13). Bettered scoring systems orchestrated higher convergences, indicated by greater Cronbach α and more decrease in Cronbach α if the updating cut-off values were deleted. The six scoring systems agreed well with one another. Bettered- pneumonia severity index, minor criteria and CURB-65 score showed higher associations with severity and mortality rates and demonstrated greater predictive accuracies for mortality compared with the corresponding original systems (AUROC, 0.939 vs 0.883, 0.909 vs 0.871, 0.913 vs 0.859; NRI, 0.113, 0.076, 0.108; respectively). The validation cohort confirmed a similar pattern.Conclusions: Updating cut-off values of severity scoring systems for CAP orchestrate improvement in predictive accuracy, suggesting that it may facilitate the rationalization of clinical triage decision-making and further reduce mortality. The current studies provide the first known prospective evidence of potential benefit of the updating cut-off values of severity scoring systems for CAP in predictive accuracy.Key messagesUpdating cut-off values were performed better for predicting mortality.Bettered scoring systems orchestrated higher convergences.Bettered scoring systems demonstrated greater predictive accuracies for mortality.https://www.tandfonline.com/doi/10.1080/07853890.2023.2202414Community-acquired pneumoniaSeverity scoring systemCut-off value updatedMortality
spellingShingle Qi Guo
Hai-yan Li
Wei-dong Song
Ming Li
Xiao-ke Chen
Hui Liu
Hong-lin Peng
Hai-qiong Yu
Nian Liu
Yan-hong Li
Zhong-dong Lü
Li-hua Liang
Qing-zhou Zhao
Mei Jiang
Updating cut-off values of severity scoring systems for community-acquired pneumonia to orchestrate more predictive accuracy
Annals of Medicine
Community-acquired pneumonia
Severity scoring system
Cut-off value updated
Mortality
title Updating cut-off values of severity scoring systems for community-acquired pneumonia to orchestrate more predictive accuracy
title_full Updating cut-off values of severity scoring systems for community-acquired pneumonia to orchestrate more predictive accuracy
title_fullStr Updating cut-off values of severity scoring systems for community-acquired pneumonia to orchestrate more predictive accuracy
title_full_unstemmed Updating cut-off values of severity scoring systems for community-acquired pneumonia to orchestrate more predictive accuracy
title_short Updating cut-off values of severity scoring systems for community-acquired pneumonia to orchestrate more predictive accuracy
title_sort updating cut off values of severity scoring systems for community acquired pneumonia to orchestrate more predictive accuracy
topic Community-acquired pneumonia
Severity scoring system
Cut-off value updated
Mortality
url https://www.tandfonline.com/doi/10.1080/07853890.2023.2202414
work_keys_str_mv AT qiguo updatingcutoffvaluesofseverityscoringsystemsforcommunityacquiredpneumoniatoorchestratemorepredictiveaccuracy
AT haiyanli updatingcutoffvaluesofseverityscoringsystemsforcommunityacquiredpneumoniatoorchestratemorepredictiveaccuracy
AT weidongsong updatingcutoffvaluesofseverityscoringsystemsforcommunityacquiredpneumoniatoorchestratemorepredictiveaccuracy
AT mingli updatingcutoffvaluesofseverityscoringsystemsforcommunityacquiredpneumoniatoorchestratemorepredictiveaccuracy
AT xiaokechen updatingcutoffvaluesofseverityscoringsystemsforcommunityacquiredpneumoniatoorchestratemorepredictiveaccuracy
AT huiliu updatingcutoffvaluesofseverityscoringsystemsforcommunityacquiredpneumoniatoorchestratemorepredictiveaccuracy
AT honglinpeng updatingcutoffvaluesofseverityscoringsystemsforcommunityacquiredpneumoniatoorchestratemorepredictiveaccuracy
AT haiqiongyu updatingcutoffvaluesofseverityscoringsystemsforcommunityacquiredpneumoniatoorchestratemorepredictiveaccuracy
AT nianliu updatingcutoffvaluesofseverityscoringsystemsforcommunityacquiredpneumoniatoorchestratemorepredictiveaccuracy
AT yanhongli updatingcutoffvaluesofseverityscoringsystemsforcommunityacquiredpneumoniatoorchestratemorepredictiveaccuracy
AT zhongdonglu updatingcutoffvaluesofseverityscoringsystemsforcommunityacquiredpneumoniatoorchestratemorepredictiveaccuracy
AT lihualiang updatingcutoffvaluesofseverityscoringsystemsforcommunityacquiredpneumoniatoorchestratemorepredictiveaccuracy
AT qingzhouzhao updatingcutoffvaluesofseverityscoringsystemsforcommunityacquiredpneumoniatoorchestratemorepredictiveaccuracy
AT meijiang updatingcutoffvaluesofseverityscoringsystemsforcommunityacquiredpneumoniatoorchestratemorepredictiveaccuracy