ROSES RepOrting standards for Systematic Evidence Syntheses: pro forma, flow-diagram and descriptive summary of the plan and conduct of environmental systematic reviews and systematic maps

Abstract Reliable synthesis of the various rapidly expanding bodies of evidence is vital for the process of evidence-informed decision-making in environmental policy, practice and research. With the rise of evidence-base medicine and increasing numbers of published systematic reviews, criteria for a...

Full description

Bibliographic Details
Main Authors: Neal R. Haddaway, Biljana Macura, Paul Whaley, Andrew S. Pullin
Format: Article
Language:English
Published: BMC 2018-03-01
Series:Environmental Evidence
Subjects:
Online Access:http://link.springer.com/article/10.1186/s13750-018-0121-7
_version_ 1818482598269157376
author Neal R. Haddaway
Biljana Macura
Paul Whaley
Andrew S. Pullin
author_facet Neal R. Haddaway
Biljana Macura
Paul Whaley
Andrew S. Pullin
author_sort Neal R. Haddaway
collection DOAJ
description Abstract Reliable synthesis of the various rapidly expanding bodies of evidence is vital for the process of evidence-informed decision-making in environmental policy, practice and research. With the rise of evidence-base medicine and increasing numbers of published systematic reviews, criteria for assessing the quality of reporting have been developed. First QUOROM (Lancet 354:1896–1900, 1999) and then PRISMA (Ann Intern Med 151:264, 2009) were developed as reporting guidelines and standards to ensure medical meta-analyses and systematic reviews are reported to a high level of detail. PRISMA is now widely used by a range of journals as a pre-submission checklist. However, due to its development for systematic reviews in healthcare, PRISMA has limited applicability for reviews in conservation and environmental management. We highlight 12 key problems with the application of PRISMA to this field, including an overemphasis on meta-analysis and no consideration for other synthesis methods. We introduce ROSES (RepOrting standards for Systematic Evidence Syntheses), a pro forma and flow diagram designed specifically for systematic reviews and systematic maps in the field of conservation and environmental management. We describe how ROSES solves the problems with PRISMA. We outline the key benefits of our approach to designing ROSES, in particular the level of detail and inclusion of rich guidance statements. We also introduce the extraction of meta-data that describe key aspects of the conduct of the review. Collated together, this summary record can help to facilitate rapid review and appraisal of the conduct of a systematic review or map, potentially speeding up the peer-review process. We present the results of initial road testing of ROSES with systematic review experts, and propose a plan for future development of ROSES.
first_indexed 2024-12-10T11:49:29Z
format Article
id doaj.art-5dfd9f58a2c445afb74825e9d678b15c
institution Directory Open Access Journal
issn 2047-2382
language English
last_indexed 2024-12-10T11:49:29Z
publishDate 2018-03-01
publisher BMC
record_format Article
series Environmental Evidence
spelling doaj.art-5dfd9f58a2c445afb74825e9d678b15c2022-12-22T01:49:57ZengBMCEnvironmental Evidence2047-23822018-03-01711810.1186/s13750-018-0121-7ROSES RepOrting standards for Systematic Evidence Syntheses: pro forma, flow-diagram and descriptive summary of the plan and conduct of environmental systematic reviews and systematic mapsNeal R. Haddaway0Biljana Macura1Paul Whaley2Andrew S. Pullin3Mistra EviEM, Stockholm Environment InstituteMistra EviEM, Stockholm Environment InstituteLancaster Environment Centre, Lancaster UniversityCentre for Evidence-Based Conservation, School of Environment, Natural Resources and Geography, Bangor UniversityAbstract Reliable synthesis of the various rapidly expanding bodies of evidence is vital for the process of evidence-informed decision-making in environmental policy, practice and research. With the rise of evidence-base medicine and increasing numbers of published systematic reviews, criteria for assessing the quality of reporting have been developed. First QUOROM (Lancet 354:1896–1900, 1999) and then PRISMA (Ann Intern Med 151:264, 2009) were developed as reporting guidelines and standards to ensure medical meta-analyses and systematic reviews are reported to a high level of detail. PRISMA is now widely used by a range of journals as a pre-submission checklist. However, due to its development for systematic reviews in healthcare, PRISMA has limited applicability for reviews in conservation and environmental management. We highlight 12 key problems with the application of PRISMA to this field, including an overemphasis on meta-analysis and no consideration for other synthesis methods. We introduce ROSES (RepOrting standards for Systematic Evidence Syntheses), a pro forma and flow diagram designed specifically for systematic reviews and systematic maps in the field of conservation and environmental management. We describe how ROSES solves the problems with PRISMA. We outline the key benefits of our approach to designing ROSES, in particular the level of detail and inclusion of rich guidance statements. We also introduce the extraction of meta-data that describe key aspects of the conduct of the review. Collated together, this summary record can help to facilitate rapid review and appraisal of the conduct of a systematic review or map, potentially speeding up the peer-review process. We present the results of initial road testing of ROSES with systematic review experts, and propose a plan for future development of ROSES.http://link.springer.com/article/10.1186/s13750-018-0121-7PRISMAQuality appraisalCEESATDARTAMSTARQUORUM
spellingShingle Neal R. Haddaway
Biljana Macura
Paul Whaley
Andrew S. Pullin
ROSES RepOrting standards for Systematic Evidence Syntheses: pro forma, flow-diagram and descriptive summary of the plan and conduct of environmental systematic reviews and systematic maps
Environmental Evidence
PRISMA
Quality appraisal
CEESAT
DART
AMSTAR
QUORUM
title ROSES RepOrting standards for Systematic Evidence Syntheses: pro forma, flow-diagram and descriptive summary of the plan and conduct of environmental systematic reviews and systematic maps
title_full ROSES RepOrting standards for Systematic Evidence Syntheses: pro forma, flow-diagram and descriptive summary of the plan and conduct of environmental systematic reviews and systematic maps
title_fullStr ROSES RepOrting standards for Systematic Evidence Syntheses: pro forma, flow-diagram and descriptive summary of the plan and conduct of environmental systematic reviews and systematic maps
title_full_unstemmed ROSES RepOrting standards for Systematic Evidence Syntheses: pro forma, flow-diagram and descriptive summary of the plan and conduct of environmental systematic reviews and systematic maps
title_short ROSES RepOrting standards for Systematic Evidence Syntheses: pro forma, flow-diagram and descriptive summary of the plan and conduct of environmental systematic reviews and systematic maps
title_sort roses reporting standards for systematic evidence syntheses pro forma flow diagram and descriptive summary of the plan and conduct of environmental systematic reviews and systematic maps
topic PRISMA
Quality appraisal
CEESAT
DART
AMSTAR
QUORUM
url http://link.springer.com/article/10.1186/s13750-018-0121-7
work_keys_str_mv AT nealrhaddaway rosesreportingstandardsforsystematicevidencesynthesesproformaflowdiagramanddescriptivesummaryoftheplanandconductofenvironmentalsystematicreviewsandsystematicmaps
AT biljanamacura rosesreportingstandardsforsystematicevidencesynthesesproformaflowdiagramanddescriptivesummaryoftheplanandconductofenvironmentalsystematicreviewsandsystematicmaps
AT paulwhaley rosesreportingstandardsforsystematicevidencesynthesesproformaflowdiagramanddescriptivesummaryoftheplanandconductofenvironmentalsystematicreviewsandsystematicmaps
AT andrewspullin rosesreportingstandardsforsystematicevidencesynthesesproformaflowdiagramanddescriptivesummaryoftheplanandconductofenvironmentalsystematicreviewsandsystematicmaps