A systematic review of the quality of conduct and reporting of systematic reviews and meta-analyses in paediatric surgery.

Our objective was to evaluate quality of conduct and reporting of published systematic reviews and meta-analyses in paediatric surgery. We also aimed to identify characteristics predictive of review quality.Systematic reviews summarise evidence by combining sources, but are potentially prone to bias...

Full description

Bibliographic Details
Main Authors: Paul Stephen Cullis, Katrin Gudlaugsdottir, James Andrews
Format: Article
Language:English
Published: Public Library of Science (PLoS) 2017-01-01
Series:PLoS ONE
Online Access:http://europepmc.org/articles/PMC5383307?pdf=render
_version_ 1819118298440138752
author Paul Stephen Cullis
Katrin Gudlaugsdottir
James Andrews
author_facet Paul Stephen Cullis
Katrin Gudlaugsdottir
James Andrews
author_sort Paul Stephen Cullis
collection DOAJ
description Our objective was to evaluate quality of conduct and reporting of published systematic reviews and meta-analyses in paediatric surgery. We also aimed to identify characteristics predictive of review quality.Systematic reviews summarise evidence by combining sources, but are potentially prone to bias. To counter this, the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) was published to aid in reporting. Similarly, the Assessing the Methodological Quality of Systematic Reviews (AMSTAR) measurement tool was designed to appraise methodology. The paediatric surgical literature has seen an increasing number of reviews over the past decade, but quality has not been evaluated.Adhering to PRISMA guidelines, we performed a systematic review with a priori design to identify systematic reviews and meta-analyses of interventions in paediatric surgery. From 01/2010 to 06/2016, we searched: MEDLINE, EMBASE, Cochrane, Centre for Reviews and Dissemination, Web of Science, Google Scholar, reference lists and journals. Two reviewers independently selected studies and extracted data. We assessed conduct and reporting using AMSTAR and PRISMA. Scores were calculated as the sum of reported items. We also extracted author, journal and article characteristics, and used them in exploratory analysis to determine which variables predict quality.112 articles fulfilled eligibility criteria (53 systematic reviews; 59 meta-analyses). Overall, 68% AMSTAR and 56.8% PRISMA items were reported adequately. Poorest scores were identified with regards a priori design, inclusion of structured summaries, including the grey literature, citing excluded articles and evaluating bias. 13 reviews were pre-registered and 6 in PRISMA-endorsing journals. The following predicted quality in univariate analysis:, word count, Cochrane review, journal h-index, impact factor, journal endorses PRISMA, PRISMA adherence suggested in author guidance, article mentions PRISMA, review includes comparison of interventions and review registration. The latter three variables were significant in multivariate regression.There are gaps in the conduct and reporting of systematic reviews in paediatric surgery. More endorsement by journals of the PRISMA guideline may improve review quality, and the dissemination of reliable evidence to paediatric clinicians.
first_indexed 2024-12-22T05:46:39Z
format Article
id doaj.art-05020a8ba15f407ab2c1387d1ae6e4f4
institution Directory Open Access Journal
issn 1932-6203
language English
last_indexed 2024-12-22T05:46:39Z
publishDate 2017-01-01
publisher Public Library of Science (PLoS)
record_format Article
series PLoS ONE
spelling doaj.art-05020a8ba15f407ab2c1387d1ae6e4f42022-12-21T18:36:59ZengPublic Library of Science (PLoS)PLoS ONE1932-62032017-01-01124e017521310.1371/journal.pone.0175213A systematic review of the quality of conduct and reporting of systematic reviews and meta-analyses in paediatric surgery.Paul Stephen CullisKatrin GudlaugsdottirJames AndrewsOur objective was to evaluate quality of conduct and reporting of published systematic reviews and meta-analyses in paediatric surgery. We also aimed to identify characteristics predictive of review quality.Systematic reviews summarise evidence by combining sources, but are potentially prone to bias. To counter this, the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) was published to aid in reporting. Similarly, the Assessing the Methodological Quality of Systematic Reviews (AMSTAR) measurement tool was designed to appraise methodology. The paediatric surgical literature has seen an increasing number of reviews over the past decade, but quality has not been evaluated.Adhering to PRISMA guidelines, we performed a systematic review with a priori design to identify systematic reviews and meta-analyses of interventions in paediatric surgery. From 01/2010 to 06/2016, we searched: MEDLINE, EMBASE, Cochrane, Centre for Reviews and Dissemination, Web of Science, Google Scholar, reference lists and journals. Two reviewers independently selected studies and extracted data. We assessed conduct and reporting using AMSTAR and PRISMA. Scores were calculated as the sum of reported items. We also extracted author, journal and article characteristics, and used them in exploratory analysis to determine which variables predict quality.112 articles fulfilled eligibility criteria (53 systematic reviews; 59 meta-analyses). Overall, 68% AMSTAR and 56.8% PRISMA items were reported adequately. Poorest scores were identified with regards a priori design, inclusion of structured summaries, including the grey literature, citing excluded articles and evaluating bias. 13 reviews were pre-registered and 6 in PRISMA-endorsing journals. The following predicted quality in univariate analysis:, word count, Cochrane review, journal h-index, impact factor, journal endorses PRISMA, PRISMA adherence suggested in author guidance, article mentions PRISMA, review includes comparison of interventions and review registration. The latter three variables were significant in multivariate regression.There are gaps in the conduct and reporting of systematic reviews in paediatric surgery. More endorsement by journals of the PRISMA guideline may improve review quality, and the dissemination of reliable evidence to paediatric clinicians.http://europepmc.org/articles/PMC5383307?pdf=render
spellingShingle Paul Stephen Cullis
Katrin Gudlaugsdottir
James Andrews
A systematic review of the quality of conduct and reporting of systematic reviews and meta-analyses in paediatric surgery.
PLoS ONE
title A systematic review of the quality of conduct and reporting of systematic reviews and meta-analyses in paediatric surgery.
title_full A systematic review of the quality of conduct and reporting of systematic reviews and meta-analyses in paediatric surgery.
title_fullStr A systematic review of the quality of conduct and reporting of systematic reviews and meta-analyses in paediatric surgery.
title_full_unstemmed A systematic review of the quality of conduct and reporting of systematic reviews and meta-analyses in paediatric surgery.
title_short A systematic review of the quality of conduct and reporting of systematic reviews and meta-analyses in paediatric surgery.
title_sort systematic review of the quality of conduct and reporting of systematic reviews and meta analyses in paediatric surgery
url http://europepmc.org/articles/PMC5383307?pdf=render
work_keys_str_mv AT paulstephencullis asystematicreviewofthequalityofconductandreportingofsystematicreviewsandmetaanalysesinpaediatricsurgery
AT katringudlaugsdottir asystematicreviewofthequalityofconductandreportingofsystematicreviewsandmetaanalysesinpaediatricsurgery
AT jamesandrews asystematicreviewofthequalityofconductandreportingofsystematicreviewsandmetaanalysesinpaediatricsurgery
AT paulstephencullis systematicreviewofthequalityofconductandreportingofsystematicreviewsandmetaanalysesinpaediatricsurgery
AT katringudlaugsdottir systematicreviewofthequalityofconductandreportingofsystematicreviewsandmetaanalysesinpaediatricsurgery
AT jamesandrews systematicreviewofthequalityofconductandreportingofsystematicreviewsandmetaanalysesinpaediatricsurgery