Bias and Reporting Quality of Clinical Prognostic Models for Idiopathic Pulmonary Fibrosis: A Cross-Sectional Study
Jiaqi Di,1 Xuanlin Li,1 Jingjing Yang,1 Luguang Li,2 Xueqing Yu2 1Co-Construction Collaborative Innovation Center for Chinese Medicine and Respiratory Diseases by Henan & Education Ministry of P.R, Henna University of Chinese Medicine, Zhengzhou, 450046, People’s Republic of China; 2Department o...
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Dove Medical Press
2022-06-01
|
| Series: | Risk Management and Healthcare Policy |
| Subjects: | |
| Online Access: | https://www.dovepress.com/bias-and-reporting-quality-of-clinical-prognostic-models-for-idiopathi-peer-reviewed-fulltext-article-RMHP |
| _version_ | 1811244832834715648 |
|---|---|
| author | Di J Li X Yang J Li L Yu X |
| author_facet | Di J Li X Yang J Li L Yu X |
| author_sort | Di J |
| collection | DOAJ |
| description | Jiaqi Di,1 Xuanlin Li,1 Jingjing Yang,1 Luguang Li,2 Xueqing Yu2 1Co-Construction Collaborative Innovation Center for Chinese Medicine and Respiratory Diseases by Henan & Education Ministry of P.R, Henna University of Chinese Medicine, Zhengzhou, 450046, People’s Republic of China; 2Department of Respiratory Diseases, The First Affiliated Hospital of Henan University of Chinese Medicine, Zhengzhou, Henan, 450000, People’s Republic of ChinaCorrespondence: Xueqing Yu, Email yxqshi@163.comObjective: This study aims to evaluate the risk of bias (ROB) and reporting quality of idiopathic pulmonary fibrosis (IPF) prediction models by assessing characteristics of these models.Methods: The development and/or validation of IPF prognostic models were identified via an electronic search of PubMed, Embase, and Web of Science (from inception to 12 August, 2021). Two researchers independently assessed the risk of bias (ROB) and reporting quality of IPF prediction models based on the Prediction model Risk Of Bias Assessment Tool (PROBAST) and Transparent Reporting of a multivariable prognostic model for Individual Prognosis or Diagnosis (TRIPOD) checklist.Results: Twenty prognostic model studies for IPF were included, including 7 (35%) model development and external validation studies, 8 (40%) development studies, and 5 (25%) external validation studies. According to PROBAST, all studies were appraised with high ROB, because of deficient reporting in the domains of participants (45.0%) and analysis (67.3%), and at least 55% studies were susceptible to 4 of 20 sources of bias. For the reporting quality, none of them completely adhered to the TRIPOD checklist, with the lowest mean reporting score for the methods and results domains (46.6% and 44.7%). For specific items, eight sub-items had a reporting rate ≥ 80% and adhered to the TRIPOD checklist, and nine sub-items had a very poor reporting rate, less than 30%.Conclusion: Studies adhering to PROBAST and TRIPOD checklists are recommended in the future. The reproducibility and transparency can be improved when studies completely adhere to PROBAST and TRIPOD checklists.Keywords: idiopathic pulmonary fibrosis, PROBAST, reporting quality, risk of bias, TRIPOD |
| first_indexed | 2024-04-12T14:31:41Z |
| format | Article |
| id | doaj.art-9e03c33f46654fd58d3a1eb1868b87bb |
| institution | Directory Open Access Journal |
| issn | 1179-1594 |
| language | English |
| last_indexed | 2024-04-12T14:31:41Z |
| publishDate | 2022-06-01 |
| publisher | Dove Medical Press |
| record_format | Article |
| series | Risk Management and Healthcare Policy |
| spelling | doaj.art-9e03c33f46654fd58d3a1eb1868b87bb2022-12-22T03:29:15ZengDove Medical PressRisk Management and Healthcare Policy1179-15942022-06-01Volume 151189120175807Bias and Reporting Quality of Clinical Prognostic Models for Idiopathic Pulmonary Fibrosis: A Cross-Sectional StudyDi JLi XYang JLi LYu XJiaqi Di,1 Xuanlin Li,1 Jingjing Yang,1 Luguang Li,2 Xueqing Yu2 1Co-Construction Collaborative Innovation Center for Chinese Medicine and Respiratory Diseases by Henan & Education Ministry of P.R, Henna University of Chinese Medicine, Zhengzhou, 450046, People’s Republic of China; 2Department of Respiratory Diseases, The First Affiliated Hospital of Henan University of Chinese Medicine, Zhengzhou, Henan, 450000, People’s Republic of ChinaCorrespondence: Xueqing Yu, Email yxqshi@163.comObjective: This study aims to evaluate the risk of bias (ROB) and reporting quality of idiopathic pulmonary fibrosis (IPF) prediction models by assessing characteristics of these models.Methods: The development and/or validation of IPF prognostic models were identified via an electronic search of PubMed, Embase, and Web of Science (from inception to 12 August, 2021). Two researchers independently assessed the risk of bias (ROB) and reporting quality of IPF prediction models based on the Prediction model Risk Of Bias Assessment Tool (PROBAST) and Transparent Reporting of a multivariable prognostic model for Individual Prognosis or Diagnosis (TRIPOD) checklist.Results: Twenty prognostic model studies for IPF were included, including 7 (35%) model development and external validation studies, 8 (40%) development studies, and 5 (25%) external validation studies. According to PROBAST, all studies were appraised with high ROB, because of deficient reporting in the domains of participants (45.0%) and analysis (67.3%), and at least 55% studies were susceptible to 4 of 20 sources of bias. For the reporting quality, none of them completely adhered to the TRIPOD checklist, with the lowest mean reporting score for the methods and results domains (46.6% and 44.7%). For specific items, eight sub-items had a reporting rate ≥ 80% and adhered to the TRIPOD checklist, and nine sub-items had a very poor reporting rate, less than 30%.Conclusion: Studies adhering to PROBAST and TRIPOD checklists are recommended in the future. The reproducibility and transparency can be improved when studies completely adhere to PROBAST and TRIPOD checklists.Keywords: idiopathic pulmonary fibrosis, PROBAST, reporting quality, risk of bias, TRIPODhttps://www.dovepress.com/bias-and-reporting-quality-of-clinical-prognostic-models-for-idiopathi-peer-reviewed-fulltext-article-RMHPidiopathic pulmonary fibrosisprobastreporting qualityrisk of biastripod |
| spellingShingle | Di J Li X Yang J Li L Yu X Bias and Reporting Quality of Clinical Prognostic Models for Idiopathic Pulmonary Fibrosis: A Cross-Sectional Study Risk Management and Healthcare Policy idiopathic pulmonary fibrosis probast reporting quality risk of bias tripod |
| title | Bias and Reporting Quality of Clinical Prognostic Models for Idiopathic Pulmonary Fibrosis: A Cross-Sectional Study |
| title_full | Bias and Reporting Quality of Clinical Prognostic Models for Idiopathic Pulmonary Fibrosis: A Cross-Sectional Study |
| title_fullStr | Bias and Reporting Quality of Clinical Prognostic Models for Idiopathic Pulmonary Fibrosis: A Cross-Sectional Study |
| title_full_unstemmed | Bias and Reporting Quality of Clinical Prognostic Models for Idiopathic Pulmonary Fibrosis: A Cross-Sectional Study |
| title_short | Bias and Reporting Quality of Clinical Prognostic Models for Idiopathic Pulmonary Fibrosis: A Cross-Sectional Study |
| title_sort | bias and reporting quality of clinical prognostic models for idiopathic pulmonary fibrosis a cross sectional study |
| topic | idiopathic pulmonary fibrosis probast reporting quality risk of bias tripod |
| url | https://www.dovepress.com/bias-and-reporting-quality-of-clinical-prognostic-models-for-idiopathi-peer-reviewed-fulltext-article-RMHP |
| work_keys_str_mv | AT dij biasandreportingqualityofclinicalprognosticmodelsforidiopathicpulmonaryfibrosisacrosssectionalstudy AT lix biasandreportingqualityofclinicalprognosticmodelsforidiopathicpulmonaryfibrosisacrosssectionalstudy AT yangj biasandreportingqualityofclinicalprognosticmodelsforidiopathicpulmonaryfibrosisacrosssectionalstudy AT lil biasandreportingqualityofclinicalprognosticmodelsforidiopathicpulmonaryfibrosisacrosssectionalstudy AT yux biasandreportingqualityofclinicalprognosticmodelsforidiopathicpulmonaryfibrosisacrosssectionalstudy |