Establishment of a gradient boosting prediction model for respiratory failure after non-cardiothoracic surgery based on intraoperative indicators
Objective To develop and validate a machine learning prediction model for postoperative respiratory failure (PRF) in patients after non-cardiothoracic surgery based on intraoperative indicators. Methods A total of 705 patients undergoing non-cardiothoracic surgery in our hospital from January 2014 t...
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | zho |
| Published: |
Editorial Office of Journal of Army Medical University
2023-04-01
|
| Series: | 陆军军医大学学报 |
| Subjects: | |
| Online Access: | http://aammt.tmmu.edu.cn/html/202301053.htm |
| _version_ | 1797832765839769600 |
|---|---|
| author | HUANG Jiahao LI Yujie LIU Xiang YANG Zhiyong SUN Yizhu |
| author_facet | HUANG Jiahao LI Yujie LIU Xiang YANG Zhiyong SUN Yizhu |
| author_sort | HUANG Jiahao |
| collection | DOAJ |
| description | Objective To develop and validate a machine learning prediction model for postoperative respiratory failure (PRF) in patients after non-cardiothoracic surgery based on intraoperative indicators. Methods A total of 705 patients undergoing non-cardiothoracic surgery in our hospital from January 2014 to June 2019 were enrolled, and then 565 patients of them were assigned in the training set (including 128 cases of PRF) and 140 patients into the test set (35 cases of PRF). Another 164 patients undergoing non-cardiothoracic surgery at West China Hospital from May 2019 to January 2020 and Zhongshan Hospital from June 2019 to December 2019 were assigned into the validation set (41 cases of PRF). Nineteen intraoperative indicators were extracted, and 6 machine learning algorithms, such as gradient boosting model (GBM), generalize linear model (GLM), k-nearest neighbor (KNN), naive bayes (NB), neural network (NNET), and support vector machine linear (SVM) were used to develop and test the models and were verified in the validation set. The best model was screened out by comparing the performance of each model, and finally, the web page prediction model was established. Results GBM obtained the best performance, with an accuracy of 76.2%(95%CI: 69.0%~82.5%), an area under the subject curve (AUC) of 0.794 (95%CI: 0.707~0.882), an area under the precision-recall curve (AUPRC) of 0.641, and a Brier score of 0.169. Conclusion The model developed based on GBM algorithm is of higher generalization, accuracy, and clinical utility, and helps avoid overfitting. The developed web page prediction model (http://150.158.55.139) can provide a new dynamic evaluation method for PRF and quantify surgical risk.
|
| first_indexed | 2024-04-09T14:14:06Z |
| format | Article |
| id | doaj.art-6828c39108064300917ee377f9e6a708 |
| institution | Directory Open Access Journal |
| issn | 2097-0927 |
| language | zho |
| last_indexed | 2024-04-09T14:14:06Z |
| publishDate | 2023-04-01 |
| publisher | Editorial Office of Journal of Army Medical University |
| record_format | Article |
| series | 陆军军医大学学报 |
| spelling | doaj.art-6828c39108064300917ee377f9e6a7082023-05-05T23:50:58ZzhoEditorial Office of Journal of Army Medical University陆军军医大学学报2097-09272023-04-0145873974510.16016/j.2097-0927.202301053Establishment of a gradient boosting prediction model for respiratory failure after non-cardiothoracic surgery based on intraoperative indicatorsHUANG Jiahao0LI Yujie1LIU Xiang2YANG Zhiyong3SUN Yizhu4Department of Anesthesiology, First Affiliated Hospital, Army Medical University (Third Military Medical University), Chongqing, 400038, ChinaDepartment of Anesthesiology, First Affiliated Hospital, Army Medical University (Third Military Medical University), Chongqing, 400038, ChinaDepartment of Anesthesiology, First Affiliated Hospital, Army Medical University (Third Military Medical University), Chongqing, 400038, ChinaDepartment of Anesthesiology, First Affiliated Hospital, Army Medical University (Third Military Medical University), Chongqing, 400038, ChinaDepartment of Anesthesiology, First Affiliated Hospital, Army Medical University (Third Military Medical University), Chongqing, 400038, ChinaObjective To develop and validate a machine learning prediction model for postoperative respiratory failure (PRF) in patients after non-cardiothoracic surgery based on intraoperative indicators. Methods A total of 705 patients undergoing non-cardiothoracic surgery in our hospital from January 2014 to June 2019 were enrolled, and then 565 patients of them were assigned in the training set (including 128 cases of PRF) and 140 patients into the test set (35 cases of PRF). Another 164 patients undergoing non-cardiothoracic surgery at West China Hospital from May 2019 to January 2020 and Zhongshan Hospital from June 2019 to December 2019 were assigned into the validation set (41 cases of PRF). Nineteen intraoperative indicators were extracted, and 6 machine learning algorithms, such as gradient boosting model (GBM), generalize linear model (GLM), k-nearest neighbor (KNN), naive bayes (NB), neural network (NNET), and support vector machine linear (SVM) were used to develop and test the models and were verified in the validation set. The best model was screened out by comparing the performance of each model, and finally, the web page prediction model was established. Results GBM obtained the best performance, with an accuracy of 76.2%(95%CI: 69.0%~82.5%), an area under the subject curve (AUC) of 0.794 (95%CI: 0.707~0.882), an area under the precision-recall curve (AUPRC) of 0.641, and a Brier score of 0.169. Conclusion The model developed based on GBM algorithm is of higher generalization, accuracy, and clinical utility, and helps avoid overfitting. The developed web page prediction model (http://150.158.55.139) can provide a new dynamic evaluation method for PRF and quantify surgical risk. http://aammt.tmmu.edu.cn/html/202301053.htmpostoperative respiratory failureprediction modelclinical utilityquantification of surgical risk |
| spellingShingle | HUANG Jiahao LI Yujie LIU Xiang YANG Zhiyong SUN Yizhu Establishment of a gradient boosting prediction model for respiratory failure after non-cardiothoracic surgery based on intraoperative indicators 陆军军医大学学报 postoperative respiratory failure prediction model clinical utility quantification of surgical risk |
| title | Establishment of a gradient boosting prediction model for respiratory failure after non-cardiothoracic surgery based on intraoperative indicators |
| title_full | Establishment of a gradient boosting prediction model for respiratory failure after non-cardiothoracic surgery based on intraoperative indicators |
| title_fullStr | Establishment of a gradient boosting prediction model for respiratory failure after non-cardiothoracic surgery based on intraoperative indicators |
| title_full_unstemmed | Establishment of a gradient boosting prediction model for respiratory failure after non-cardiothoracic surgery based on intraoperative indicators |
| title_short | Establishment of a gradient boosting prediction model for respiratory failure after non-cardiothoracic surgery based on intraoperative indicators |
| title_sort | establishment of a gradient boosting prediction model for respiratory failure after non cardiothoracic surgery based on intraoperative indicators |
| topic | postoperative respiratory failure prediction model clinical utility quantification of surgical risk |
| url | http://aammt.tmmu.edu.cn/html/202301053.htm |
| work_keys_str_mv | AT huangjiahao establishmentofagradientboostingpredictionmodelforrespiratoryfailureafternoncardiothoracicsurgerybasedonintraoperativeindicators AT liyujie establishmentofagradientboostingpredictionmodelforrespiratoryfailureafternoncardiothoracicsurgerybasedonintraoperativeindicators AT liuxiang establishmentofagradientboostingpredictionmodelforrespiratoryfailureafternoncardiothoracicsurgerybasedonintraoperativeindicators AT yangzhiyong establishmentofagradientboostingpredictionmodelforrespiratoryfailureafternoncardiothoracicsurgerybasedonintraoperativeindicators AT sunyizhu establishmentofagradientboostingpredictionmodelforrespiratoryfailureafternoncardiothoracicsurgerybasedonintraoperativeindicators |