Development and Validation of a Machine Learning-Based Model Used for Predicting Hepatocellular Carcinoma Risk in Patients with Hepatitis B-Related Cirrhosis: A Retrospective Study
Yixin Hou,1,* Jianguo Yan,2,* Ke Shi,1,3,* Xiaoli Liu,1 Fangyuan Gao,1 Tong Wu,1 Peipei Meng,1 Min Zhang,2 Yuyong Jiang,1 Xianbo Wang1 1Center of Integrative Medicine, Beijing Ditan Hospital, Capital Medical University, Beijing, 100015, People’s Republic of China; 2People’s L...
| Main Authors: | , , , , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Dove Medical Press
2024-03-01
|
| Series: | OncoTargets and Therapy |
| Subjects: | |
| Online Access: | https://www.dovepress.com/development-and-validation-of-a-machine-learning-based-model-used-for--peer-reviewed-fulltext-article-OTT |
| _version_ | 1797246866625134592 |
|---|---|
| author | Hou Y Yan J Shi K Liu X Gao F Wu T Meng P Zhang M Jiang Y Wang X |
| author_facet | Hou Y Yan J Shi K Liu X Gao F Wu T Meng P Zhang M Jiang Y Wang X |
| author_sort | Hou Y |
| collection | DOAJ |
| description | Yixin Hou,1,* Jianguo Yan,2,* Ke Shi,1,3,* Xiaoli Liu,1 Fangyuan Gao,1 Tong Wu,1 Peipei Meng,1 Min Zhang,2 Yuyong Jiang,1 Xianbo Wang1 1Center of Integrative Medicine, Beijing Ditan Hospital, Capital Medical University, Beijing, 100015, People’s Republic of China; 2People’s Liberation Army Fifth Medical Center, Beijing, 100039, People’s Republic of China; 3Department of Gastroenterology, Dongzhimen Hospital, Beijing University of Chinese Medicine, Beijing, 100700, People’s Republic of China*These authors contributed equally to this workCorrespondence: Xianbo Wang, Center of Integrative Medicine, Beijing Ditan Hospital, Capital Medical University, No. 8 Jing Shun East Street, Beijing, 100015, People’s Republic of China, Email wangxb@ccmu.edu.cn Min Zhang, People’s Liberation Army Fifth Medical Center, Beijing, 100039, People’s Republic of China, Email gcmw2001@163.comObject: Our objective was to estimate the 5-year cumulative risk of HCC in patients with HBC by utilizing an artificial neural network (ANN).Methods: We conducted this study with 1589 patients hospitalized at Beijing Ditan Hospital of Capital Medical University and People’s Liberation Army Fifth Medical Center. The training cohort consisted of 913 subjects from Beijing Ditan Hospital of Capital Medical University, while the validation cohort comprised 676 subjects from People’s Liberation Army Fifth Medical Center. Through univariate analysis, we identified factors that independently influenced the occurrence of HCC, which were then used to develop the ANN model. To evaluate the ANN model, we assessed its predictive accuracy, discriminative ability, and clinical net benefit using metrics such as the area under the receiver operating characteristic curve (AUC), concordance index (C-index), calibration curves.Results: In total, we included nine independent risk factors in the development of the ANN model. Remarkably, the AUC of the ANN model was 0.880, significantly outperforming the AUC values of other existing models including mPAGE-B (0.719) (95% CI 0.670– 0.768), PAGE-B (0. 710) (95% CI 0.660– 0.759), FIB-4 (0.693) (95% CI 0.640– 0.745), and Toronto hepatoma risk index (THRI) (0.705) (95% CI 0.654– 0.756) (p< 0.001 for all). The ANN model effectively stratified patients into low, medium, and high-risk groups based on their 5-year In the training cohort, the positive predictive value (PPV) for low-risk patients was 26.2% (95% CI 25.0– 27.4), and the negative predictive value (NPV) was 98.7% (95% CI 95.2– 99.7). For high-risk patients, the PPV was 54.7% (95% CI 48.6– 60.7), and the NPV was 91.6% (95% CI 89.4– 93.4). These findings were validated in the independent validation cohort.Conclusion: The ANNs model has good individualized prediction performance and may be helpful to evaluate the probability of the 5-year risk of HCC in patients with HBC.Keywords: machine learning-based model, hepatocellular carcinoma, risk, hepatitis B-related cirrhosis |
| first_indexed | 2024-04-24T19:49:36Z |
| format | Article |
| id | doaj.art-81c3e0771bca491db78da6a343de7f5b |
| institution | Directory Open Access Journal |
| issn | 1178-6930 |
| language | English |
| last_indexed | 2024-04-24T19:49:36Z |
| publishDate | 2024-03-01 |
| publisher | Dove Medical Press |
| record_format | Article |
| series | OncoTargets and Therapy |
| spelling | doaj.art-81c3e0771bca491db78da6a343de7f5b2024-03-24T16:49:44ZengDove Medical PressOncoTargets and Therapy1178-69302024-03-01Volume 1721522691493Development and Validation of a Machine Learning-Based Model Used for Predicting Hepatocellular Carcinoma Risk in Patients with Hepatitis B-Related Cirrhosis: A Retrospective StudyHou YYan JShi KLiu XGao FWu TMeng PZhang MJiang YWang XYixin Hou,1,* Jianguo Yan,2,* Ke Shi,1,3,* Xiaoli Liu,1 Fangyuan Gao,1 Tong Wu,1 Peipei Meng,1 Min Zhang,2 Yuyong Jiang,1 Xianbo Wang1 1Center of Integrative Medicine, Beijing Ditan Hospital, Capital Medical University, Beijing, 100015, People’s Republic of China; 2People’s Liberation Army Fifth Medical Center, Beijing, 100039, People’s Republic of China; 3Department of Gastroenterology, Dongzhimen Hospital, Beijing University of Chinese Medicine, Beijing, 100700, People’s Republic of China*These authors contributed equally to this workCorrespondence: Xianbo Wang, Center of Integrative Medicine, Beijing Ditan Hospital, Capital Medical University, No. 8 Jing Shun East Street, Beijing, 100015, People’s Republic of China, Email wangxb@ccmu.edu.cn Min Zhang, People’s Liberation Army Fifth Medical Center, Beijing, 100039, People’s Republic of China, Email gcmw2001@163.comObject: Our objective was to estimate the 5-year cumulative risk of HCC in patients with HBC by utilizing an artificial neural network (ANN).Methods: We conducted this study with 1589 patients hospitalized at Beijing Ditan Hospital of Capital Medical University and People’s Liberation Army Fifth Medical Center. The training cohort consisted of 913 subjects from Beijing Ditan Hospital of Capital Medical University, while the validation cohort comprised 676 subjects from People’s Liberation Army Fifth Medical Center. Through univariate analysis, we identified factors that independently influenced the occurrence of HCC, which were then used to develop the ANN model. To evaluate the ANN model, we assessed its predictive accuracy, discriminative ability, and clinical net benefit using metrics such as the area under the receiver operating characteristic curve (AUC), concordance index (C-index), calibration curves.Results: In total, we included nine independent risk factors in the development of the ANN model. Remarkably, the AUC of the ANN model was 0.880, significantly outperforming the AUC values of other existing models including mPAGE-B (0.719) (95% CI 0.670– 0.768), PAGE-B (0. 710) (95% CI 0.660– 0.759), FIB-4 (0.693) (95% CI 0.640– 0.745), and Toronto hepatoma risk index (THRI) (0.705) (95% CI 0.654– 0.756) (p< 0.001 for all). The ANN model effectively stratified patients into low, medium, and high-risk groups based on their 5-year In the training cohort, the positive predictive value (PPV) for low-risk patients was 26.2% (95% CI 25.0– 27.4), and the negative predictive value (NPV) was 98.7% (95% CI 95.2– 99.7). For high-risk patients, the PPV was 54.7% (95% CI 48.6– 60.7), and the NPV was 91.6% (95% CI 89.4– 93.4). These findings were validated in the independent validation cohort.Conclusion: The ANNs model has good individualized prediction performance and may be helpful to evaluate the probability of the 5-year risk of HCC in patients with HBC.Keywords: machine learning-based model, hepatocellular carcinoma, risk, hepatitis B-related cirrhosishttps://www.dovepress.com/development-and-validation-of-a-machine-learning-based-model-used-for--peer-reviewed-fulltext-article-OTTmachine learning-based modelhepatocellular carcinomariskhepatitis b-related cirrhosis |
| spellingShingle | Hou Y Yan J Shi K Liu X Gao F Wu T Meng P Zhang M Jiang Y Wang X Development and Validation of a Machine Learning-Based Model Used for Predicting Hepatocellular Carcinoma Risk in Patients with Hepatitis B-Related Cirrhosis: A Retrospective Study OncoTargets and Therapy machine learning-based model hepatocellular carcinoma risk hepatitis b-related cirrhosis |
| title | Development and Validation of a Machine Learning-Based Model Used for Predicting Hepatocellular Carcinoma Risk in Patients with Hepatitis B-Related Cirrhosis: A Retrospective Study |
| title_full | Development and Validation of a Machine Learning-Based Model Used for Predicting Hepatocellular Carcinoma Risk in Patients with Hepatitis B-Related Cirrhosis: A Retrospective Study |
| title_fullStr | Development and Validation of a Machine Learning-Based Model Used for Predicting Hepatocellular Carcinoma Risk in Patients with Hepatitis B-Related Cirrhosis: A Retrospective Study |
| title_full_unstemmed | Development and Validation of a Machine Learning-Based Model Used for Predicting Hepatocellular Carcinoma Risk in Patients with Hepatitis B-Related Cirrhosis: A Retrospective Study |
| title_short | Development and Validation of a Machine Learning-Based Model Used for Predicting Hepatocellular Carcinoma Risk in Patients with Hepatitis B-Related Cirrhosis: A Retrospective Study |
| title_sort | development and validation of a machine learning based model used for predicting hepatocellular carcinoma risk in patients with hepatitis b related cirrhosis a retrospective study |
| topic | machine learning-based model hepatocellular carcinoma risk hepatitis b-related cirrhosis |
| url | https://www.dovepress.com/development-and-validation-of-a-machine-learning-based-model-used-for--peer-reviewed-fulltext-article-OTT |
| work_keys_str_mv | AT houy developmentandvalidationofamachinelearningbasedmodelusedforpredictinghepatocellularcarcinomariskinpatientswithhepatitisbrelatedcirrhosisaretrospectivestudy AT yanj developmentandvalidationofamachinelearningbasedmodelusedforpredictinghepatocellularcarcinomariskinpatientswithhepatitisbrelatedcirrhosisaretrospectivestudy AT shik developmentandvalidationofamachinelearningbasedmodelusedforpredictinghepatocellularcarcinomariskinpatientswithhepatitisbrelatedcirrhosisaretrospectivestudy AT liux developmentandvalidationofamachinelearningbasedmodelusedforpredictinghepatocellularcarcinomariskinpatientswithhepatitisbrelatedcirrhosisaretrospectivestudy AT gaof developmentandvalidationofamachinelearningbasedmodelusedforpredictinghepatocellularcarcinomariskinpatientswithhepatitisbrelatedcirrhosisaretrospectivestudy AT wut developmentandvalidationofamachinelearningbasedmodelusedforpredictinghepatocellularcarcinomariskinpatientswithhepatitisbrelatedcirrhosisaretrospectivestudy AT mengp developmentandvalidationofamachinelearningbasedmodelusedforpredictinghepatocellularcarcinomariskinpatientswithhepatitisbrelatedcirrhosisaretrospectivestudy AT zhangm developmentandvalidationofamachinelearningbasedmodelusedforpredictinghepatocellularcarcinomariskinpatientswithhepatitisbrelatedcirrhosisaretrospectivestudy AT jiangy developmentandvalidationofamachinelearningbasedmodelusedforpredictinghepatocellularcarcinomariskinpatientswithhepatitisbrelatedcirrhosisaretrospectivestudy AT wangx developmentandvalidationofamachinelearningbasedmodelusedforpredictinghepatocellularcarcinomariskinpatientswithhepatitisbrelatedcirrhosisaretrospectivestudy |