Meta-DiSc 2.0: a web application for meta-analysis of diagnostic test accuracy data
Abstract Background Diagnostic evidence of the accuracy of a test for identifying a target condition of interest can be estimated using systematic approaches following standardized methodologies. Statistical methods for the meta-analysis of diagnostic test accuracy (DTA) studies are relatively compl...
| Main Authors: | , , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
BMC
2022-11-01
|
| Series: | BMC Medical Research Methodology |
| Subjects: | |
| Online Access: | https://doi.org/10.1186/s12874-022-01788-2 |
| _version_ | 1797985467943092224 |
|---|---|
| author | Maria N. Plana Ingrid Arevalo-Rodriguez Silvia Fernández-García Javier Soto Martin Fabregate Teresa Pérez Marta Roqué Javier Zamora |
| author_facet | Maria N. Plana Ingrid Arevalo-Rodriguez Silvia Fernández-García Javier Soto Martin Fabregate Teresa Pérez Marta Roqué Javier Zamora |
| author_sort | Maria N. Plana |
| collection | DOAJ |
| description | Abstract Background Diagnostic evidence of the accuracy of a test for identifying a target condition of interest can be estimated using systematic approaches following standardized methodologies. Statistical methods for the meta-analysis of diagnostic test accuracy (DTA) studies are relatively complex, presenting a challenge for reviewers without extensive statistical expertise. In 2006, we developed Meta-DiSc, a free user-friendly software to perform test accuracy meta-analysis. This statistical program is now widely used for performing DTA meta-analyses. We aimed to build a new version of the Meta-DiSc software to include statistical methods based on hierarchical models and an enhanced web-based interface to improve user experience. Results In this article, we present the updated version, Meta-DiSc 2.0, a web-based application developed using the R Shiny package. This new version implements recommended state-of-the-art statistical models to overcome the limitations of the statistical approaches included in the previous version. Meta-DiSc 2.0 performs statistical analyses of DTA reviews using a bivariate random effects model. The application offers a thorough analysis of heterogeneity, calculating logit variance estimates of sensitivity and specificity, the bivariate I-squared, the area of the 95% prediction ellipse, and the median odds ratios for sensitivity and specificity, and facilitating subgroup and meta-regression analyses. Furthermore, univariate random effects models can be applied to meta-analyses with few studies or with non-convergent bivariate models. The application interface has an intuitive design set out in four main menus: file upload; graphical description (forest and ROC plane plots); meta-analysis (pooling of sensitivity and specificity, estimation of likelihood ratios and diagnostic odds ratio, sROC curve); and summary of findings (impact of test through downstream consequences in a hypothetical population with a given prevalence). All computational algorithms have been validated in several real datasets by comparing results obtained with STATA/SAS and MetaDTA packages. Conclusion We have developed and validated an updated version of the Meta-DiSc software that is more accessible and statistically sound. The web application is freely available at www.metadisc.es . |
| first_indexed | 2024-04-11T07:17:36Z |
| format | Article |
| id | doaj.art-4793cb1e948b4ec794f5ebb58e312622 |
| institution | Directory Open Access Journal |
| issn | 1471-2288 |
| language | English |
| last_indexed | 2024-04-11T07:17:36Z |
| publishDate | 2022-11-01 |
| publisher | BMC |
| record_format | Article |
| series | BMC Medical Research Methodology |
| spelling | doaj.art-4793cb1e948b4ec794f5ebb58e3126222022-12-22T04:37:51ZengBMCBMC Medical Research Methodology1471-22882022-11-012211810.1186/s12874-022-01788-2Meta-DiSc 2.0: a web application for meta-analysis of diagnostic test accuracy dataMaria N. Plana0Ingrid Arevalo-Rodriguez1Silvia Fernández-García2Javier Soto3Martin Fabregate4Teresa Pérez5Marta Roqué6Javier Zamora7Health Technology Assessment Unit, Hospital Universitario Ramón Y Cajal, IRYCISCIBER of Epidemiology and Public HealthClinical Biostatistics Unit, Hospital Universitario Ramón Y Cajal, IRYCISRadiology Department, Hospital Universitario Ramón Y Cajal, IRYCIS, UPMInternal Medicine Department, Hospital Universitario Ramón Y Cajal, IRYCISDepartment of Statistics and Data Science, Complutense University of MadridCIBER of Epidemiology and Public HealthCIBER of Epidemiology and Public HealthAbstract Background Diagnostic evidence of the accuracy of a test for identifying a target condition of interest can be estimated using systematic approaches following standardized methodologies. Statistical methods for the meta-analysis of diagnostic test accuracy (DTA) studies are relatively complex, presenting a challenge for reviewers without extensive statistical expertise. In 2006, we developed Meta-DiSc, a free user-friendly software to perform test accuracy meta-analysis. This statistical program is now widely used for performing DTA meta-analyses. We aimed to build a new version of the Meta-DiSc software to include statistical methods based on hierarchical models and an enhanced web-based interface to improve user experience. Results In this article, we present the updated version, Meta-DiSc 2.0, a web-based application developed using the R Shiny package. This new version implements recommended state-of-the-art statistical models to overcome the limitations of the statistical approaches included in the previous version. Meta-DiSc 2.0 performs statistical analyses of DTA reviews using a bivariate random effects model. The application offers a thorough analysis of heterogeneity, calculating logit variance estimates of sensitivity and specificity, the bivariate I-squared, the area of the 95% prediction ellipse, and the median odds ratios for sensitivity and specificity, and facilitating subgroup and meta-regression analyses. Furthermore, univariate random effects models can be applied to meta-analyses with few studies or with non-convergent bivariate models. The application interface has an intuitive design set out in four main menus: file upload; graphical description (forest and ROC plane plots); meta-analysis (pooling of sensitivity and specificity, estimation of likelihood ratios and diagnostic odds ratio, sROC curve); and summary of findings (impact of test through downstream consequences in a hypothetical population with a given prevalence). All computational algorithms have been validated in several real datasets by comparing results obtained with STATA/SAS and MetaDTA packages. Conclusion We have developed and validated an updated version of the Meta-DiSc software that is more accessible and statistically sound. The web application is freely available at www.metadisc.es .https://doi.org/10.1186/s12874-022-01788-2Systematic reviewMeta-analysisSensitivitySpecificityDiagnosisHeterogeneity |
| spellingShingle | Maria N. Plana Ingrid Arevalo-Rodriguez Silvia Fernández-García Javier Soto Martin Fabregate Teresa Pérez Marta Roqué Javier Zamora Meta-DiSc 2.0: a web application for meta-analysis of diagnostic test accuracy data BMC Medical Research Methodology Systematic review Meta-analysis Sensitivity Specificity Diagnosis Heterogeneity |
| title | Meta-DiSc 2.0: a web application for meta-analysis of diagnostic test accuracy data |
| title_full | Meta-DiSc 2.0: a web application for meta-analysis of diagnostic test accuracy data |
| title_fullStr | Meta-DiSc 2.0: a web application for meta-analysis of diagnostic test accuracy data |
| title_full_unstemmed | Meta-DiSc 2.0: a web application for meta-analysis of diagnostic test accuracy data |
| title_short | Meta-DiSc 2.0: a web application for meta-analysis of diagnostic test accuracy data |
| title_sort | meta disc 2 0 a web application for meta analysis of diagnostic test accuracy data |
| topic | Systematic review Meta-analysis Sensitivity Specificity Diagnosis Heterogeneity |
| url | https://doi.org/10.1186/s12874-022-01788-2 |
| work_keys_str_mv | AT marianplana metadisc20awebapplicationformetaanalysisofdiagnostictestaccuracydata AT ingridarevalorodriguez metadisc20awebapplicationformetaanalysisofdiagnostictestaccuracydata AT silviafernandezgarcia metadisc20awebapplicationformetaanalysisofdiagnostictestaccuracydata AT javiersoto metadisc20awebapplicationformetaanalysisofdiagnostictestaccuracydata AT martinfabregate metadisc20awebapplicationformetaanalysisofdiagnostictestaccuracydata AT teresaperez metadisc20awebapplicationformetaanalysisofdiagnostictestaccuracydata AT martaroque metadisc20awebapplicationformetaanalysisofdiagnostictestaccuracydata AT javierzamora metadisc20awebapplicationformetaanalysisofdiagnostictestaccuracydata |