Prediction model of early postoperative delirium risk based on machine learning algorithm in patients undergoing cardiac surgery

Objective To develop an early postoperative delirium (POD) risk prediction model in patients undergoing cardiac surgery based on Extreme Gradient Boosting (XGBoost) and compare its prediction performance with that of a traditional logistic regression (LR) model in order to provide reference for ear...

Full description

Bibliographic Details
Main Authors: ZUO Dukun, WU Zhuoxi, LONG Zonghong, LI Yang, LI Jiaxin
Format: Article
Language:zho
Published: Editorial Office of Journal of Army Medical University 2023-04-01
Series:陆军军医大学学报
Subjects:
Online Access:http://aammt.tmmu.edu.cn/html/202301050.htm
_version_ 1797832788414562304
author ZUO Dukun
WU Zhuoxi
LONG Zonghong
LI Yang
LI Jiaxin
author_facet ZUO Dukun
WU Zhuoxi
LONG Zonghong
LI Yang
LI Jiaxin
author_sort ZUO Dukun
collection DOAJ
description Objective To develop an early postoperative delirium (POD) risk prediction model in patients undergoing cardiac surgery based on Extreme Gradient Boosting (XGBoost) and compare its prediction performance with that of a traditional logistic regression (LR) model in order to provide reference for early identification and timely intervention of the condition. Methods A case-control trial was conducted on 684 patients who underwent elective cardiac surgery under general anesthesia due to heart disease in the Second Affiliated Hospital of Army Medical University from March to July 2022. According to the outcome of their 3-day follow-up after operation, the patients were divided into delirium group (n=38) and non-delirium group (n=646). The patients were randomly divided into a training set (479 patients) and a test set (205 patients) at a ratio of 7∶3. LASSO regression analysis was used to screen out important variables related to POD. LR and XGBoost were employed to construct the prediction models. The area under receiver operating characteristic curve (ROC-AUC) of the prediction models and the sensitivity and specificity under the optimal threshold were calculated and the prediction performance of different models was compared. Results The 3-day postoperative delirium rate of the patients undergoing cardiac surgery was 5.56%. Compared with the non-delirium group, the patients in the delirium group were older (P < 0.05), had a higher proportion of diabetes (P < 0.05), and lower preoperative systolic blood pressure (P < 0.05) and postoperative sleep score (P < 0.05). But there were no statistical differences in other indicators (P>0.05). Then finally, 5 variables, including age, preoperative peripheral oxygen saturation, preoperative regional cerebral oxygen saturation, preoperative systolic blood pressure and postoperative sleep score, were included for modelling. The AUCs of LR and XGBoost models were 0.732 (95%CI: 0.43~1.000) and 0.659 (95%CI: 0.559~0.759), respectively. LR model had a higher AUC value and better predictive performance, but, its sensitivity was 50%, lower than that of XGBoost model (67%), and its specificity was 100%, higher than the other model (98.5%). Conclusion The predictive performance of the prediction model based on XGBoost, an integrated learning algorithm, is not superior to the traditional LR model for postoperative delirium after cardiac surgery. LR model can well predict the occurrence of delirium after cardiac surgery and provide reference for early intervention and treatment. But XGBoost is more sensitive to the diagnosis of postoperative delirium.
first_indexed 2024-04-09T14:14:28Z
format Article
id doaj.art-b5f6e7a9439a4b2987b600d9198e5e99
institution Directory Open Access Journal
issn 2097-0927
language zho
last_indexed 2024-04-09T14:14:28Z
publishDate 2023-04-01
publisher Editorial Office of Journal of Army Medical University
record_format Article
series 陆军军医大学学报
spelling doaj.art-b5f6e7a9439a4b2987b600d9198e5e992023-05-05T23:58:06ZzhoEditorial Office of Journal of Army Medical University陆军军医大学学报2097-09272023-04-0145875375810.16016/j.2097-0927.202301050Prediction model of early postoperative delirium risk based on machine learning algorithm in patients undergoing cardiac surgeryZUO Dukun0WU Zhuoxi1 LONG Zonghong2LI Yang3LI Jiaxin4Department of Anesthesiology, Second Affiliated Hospital, Army Medical University (Third Military Medical University), Chongqing, 400037, ChinaDepartment of Anesthesiology, Second Affiliated Hospital, Army Medical University (Third Military Medical University), Chongqing, 400037, ChinaDepartment of Anesthesiology, Second Affiliated Hospital, Army Medical University (Third Military Medical University), Chongqing, 400037, ChinaDepartment of Anesthesiology, Second Affiliated Hospital, Army Medical University (Third Military Medical University), Chongqing, 400037, ChinaDepartment of Anesthesiology, Second Affiliated Hospital, Army Medical University (Third Military Medical University), Chongqing, 400037, China Objective To develop an early postoperative delirium (POD) risk prediction model in patients undergoing cardiac surgery based on Extreme Gradient Boosting (XGBoost) and compare its prediction performance with that of a traditional logistic regression (LR) model in order to provide reference for early identification and timely intervention of the condition. Methods A case-control trial was conducted on 684 patients who underwent elective cardiac surgery under general anesthesia due to heart disease in the Second Affiliated Hospital of Army Medical University from March to July 2022. According to the outcome of their 3-day follow-up after operation, the patients were divided into delirium group (n=38) and non-delirium group (n=646). The patients were randomly divided into a training set (479 patients) and a test set (205 patients) at a ratio of 7∶3. LASSO regression analysis was used to screen out important variables related to POD. LR and XGBoost were employed to construct the prediction models. The area under receiver operating characteristic curve (ROC-AUC) of the prediction models and the sensitivity and specificity under the optimal threshold were calculated and the prediction performance of different models was compared. Results The 3-day postoperative delirium rate of the patients undergoing cardiac surgery was 5.56%. Compared with the non-delirium group, the patients in the delirium group were older (P < 0.05), had a higher proportion of diabetes (P < 0.05), and lower preoperative systolic blood pressure (P < 0.05) and postoperative sleep score (P < 0.05). But there were no statistical differences in other indicators (P>0.05). Then finally, 5 variables, including age, preoperative peripheral oxygen saturation, preoperative regional cerebral oxygen saturation, preoperative systolic blood pressure and postoperative sleep score, were included for modelling. The AUCs of LR and XGBoost models were 0.732 (95%CI: 0.43~1.000) and 0.659 (95%CI: 0.559~0.759), respectively. LR model had a higher AUC value and better predictive performance, but, its sensitivity was 50%, lower than that of XGBoost model (67%), and its specificity was 100%, higher than the other model (98.5%). Conclusion The predictive performance of the prediction model based on XGBoost, an integrated learning algorithm, is not superior to the traditional LR model for postoperative delirium after cardiac surgery. LR model can well predict the occurrence of delirium after cardiac surgery and provide reference for early intervention and treatment. But XGBoost is more sensitive to the diagnosis of postoperative delirium. http://aammt.tmmu.edu.cn/html/202301050.htmcardiac surgerypostoperative deliriummachine learningprediction model
spellingShingle ZUO Dukun
WU Zhuoxi
LONG Zonghong
LI Yang
LI Jiaxin
Prediction model of early postoperative delirium risk based on machine learning algorithm in patients undergoing cardiac surgery
陆军军医大学学报
cardiac surgery
postoperative delirium
machine learning
prediction model
title Prediction model of early postoperative delirium risk based on machine learning algorithm in patients undergoing cardiac surgery
title_full Prediction model of early postoperative delirium risk based on machine learning algorithm in patients undergoing cardiac surgery
title_fullStr Prediction model of early postoperative delirium risk based on machine learning algorithm in patients undergoing cardiac surgery
title_full_unstemmed Prediction model of early postoperative delirium risk based on machine learning algorithm in patients undergoing cardiac surgery
title_short Prediction model of early postoperative delirium risk based on machine learning algorithm in patients undergoing cardiac surgery
title_sort prediction model of early postoperative delirium risk based on machine learning algorithm in patients undergoing cardiac surgery
topic cardiac surgery
postoperative delirium
machine learning
prediction model
url http://aammt.tmmu.edu.cn/html/202301050.htm
work_keys_str_mv AT zuodukun predictionmodelofearlypostoperativedeliriumriskbasedonmachinelearningalgorithminpatientsundergoingcardiacsurgery
AT wuzhuoxi predictionmodelofearlypostoperativedeliriumriskbasedonmachinelearningalgorithminpatientsundergoingcardiacsurgery
AT longzonghong predictionmodelofearlypostoperativedeliriumriskbasedonmachinelearningalgorithminpatientsundergoingcardiacsurgery
AT liyang predictionmodelofearlypostoperativedeliriumriskbasedonmachinelearningalgorithminpatientsundergoingcardiacsurgery
AT lijiaxin predictionmodelofearlypostoperativedeliriumriskbasedonmachinelearningalgorithminpatientsundergoingcardiacsurgery