ROSES RepOrting standards for Systematic Evidence Syntheses: pro forma, flow-diagram and descriptive summary of the plan and conduct of environmental systematic reviews and systematic maps
Abstract Reliable synthesis of the various rapidly expanding bodies of evidence is vital for the process of evidence-informed decision-making in environmental policy, practice and research. With the rise of evidence-base medicine and increasing numbers of published systematic reviews, criteria for a...
Main Authors: | , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
BMC
2018-03-01
|
Series: | Environmental Evidence |
Subjects: | |
Online Access: | http://link.springer.com/article/10.1186/s13750-018-0121-7 |
_version_ | 1818482598269157376 |
---|---|
author | Neal R. Haddaway Biljana Macura Paul Whaley Andrew S. Pullin |
author_facet | Neal R. Haddaway Biljana Macura Paul Whaley Andrew S. Pullin |
author_sort | Neal R. Haddaway |
collection | DOAJ |
description | Abstract Reliable synthesis of the various rapidly expanding bodies of evidence is vital for the process of evidence-informed decision-making in environmental policy, practice and research. With the rise of evidence-base medicine and increasing numbers of published systematic reviews, criteria for assessing the quality of reporting have been developed. First QUOROM (Lancet 354:1896–1900, 1999) and then PRISMA (Ann Intern Med 151:264, 2009) were developed as reporting guidelines and standards to ensure medical meta-analyses and systematic reviews are reported to a high level of detail. PRISMA is now widely used by a range of journals as a pre-submission checklist. However, due to its development for systematic reviews in healthcare, PRISMA has limited applicability for reviews in conservation and environmental management. We highlight 12 key problems with the application of PRISMA to this field, including an overemphasis on meta-analysis and no consideration for other synthesis methods. We introduce ROSES (RepOrting standards for Systematic Evidence Syntheses), a pro forma and flow diagram designed specifically for systematic reviews and systematic maps in the field of conservation and environmental management. We describe how ROSES solves the problems with PRISMA. We outline the key benefits of our approach to designing ROSES, in particular the level of detail and inclusion of rich guidance statements. We also introduce the extraction of meta-data that describe key aspects of the conduct of the review. Collated together, this summary record can help to facilitate rapid review and appraisal of the conduct of a systematic review or map, potentially speeding up the peer-review process. We present the results of initial road testing of ROSES with systematic review experts, and propose a plan for future development of ROSES. |
first_indexed | 2024-12-10T11:49:29Z |
format | Article |
id | doaj.art-5dfd9f58a2c445afb74825e9d678b15c |
institution | Directory Open Access Journal |
issn | 2047-2382 |
language | English |
last_indexed | 2024-12-10T11:49:29Z |
publishDate | 2018-03-01 |
publisher | BMC |
record_format | Article |
series | Environmental Evidence |
spelling | doaj.art-5dfd9f58a2c445afb74825e9d678b15c2022-12-22T01:49:57ZengBMCEnvironmental Evidence2047-23822018-03-01711810.1186/s13750-018-0121-7ROSES RepOrting standards for Systematic Evidence Syntheses: pro forma, flow-diagram and descriptive summary of the plan and conduct of environmental systematic reviews and systematic mapsNeal R. Haddaway0Biljana Macura1Paul Whaley2Andrew S. Pullin3Mistra EviEM, Stockholm Environment InstituteMistra EviEM, Stockholm Environment InstituteLancaster Environment Centre, Lancaster UniversityCentre for Evidence-Based Conservation, School of Environment, Natural Resources and Geography, Bangor UniversityAbstract Reliable synthesis of the various rapidly expanding bodies of evidence is vital for the process of evidence-informed decision-making in environmental policy, practice and research. With the rise of evidence-base medicine and increasing numbers of published systematic reviews, criteria for assessing the quality of reporting have been developed. First QUOROM (Lancet 354:1896–1900, 1999) and then PRISMA (Ann Intern Med 151:264, 2009) were developed as reporting guidelines and standards to ensure medical meta-analyses and systematic reviews are reported to a high level of detail. PRISMA is now widely used by a range of journals as a pre-submission checklist. However, due to its development for systematic reviews in healthcare, PRISMA has limited applicability for reviews in conservation and environmental management. We highlight 12 key problems with the application of PRISMA to this field, including an overemphasis on meta-analysis and no consideration for other synthesis methods. We introduce ROSES (RepOrting standards for Systematic Evidence Syntheses), a pro forma and flow diagram designed specifically for systematic reviews and systematic maps in the field of conservation and environmental management. We describe how ROSES solves the problems with PRISMA. We outline the key benefits of our approach to designing ROSES, in particular the level of detail and inclusion of rich guidance statements. We also introduce the extraction of meta-data that describe key aspects of the conduct of the review. Collated together, this summary record can help to facilitate rapid review and appraisal of the conduct of a systematic review or map, potentially speeding up the peer-review process. We present the results of initial road testing of ROSES with systematic review experts, and propose a plan for future development of ROSES.http://link.springer.com/article/10.1186/s13750-018-0121-7PRISMAQuality appraisalCEESATDARTAMSTARQUORUM |
spellingShingle | Neal R. Haddaway Biljana Macura Paul Whaley Andrew S. Pullin ROSES RepOrting standards for Systematic Evidence Syntheses: pro forma, flow-diagram and descriptive summary of the plan and conduct of environmental systematic reviews and systematic maps Environmental Evidence PRISMA Quality appraisal CEESAT DART AMSTAR QUORUM |
title | ROSES RepOrting standards for Systematic Evidence Syntheses: pro forma, flow-diagram and descriptive summary of the plan and conduct of environmental systematic reviews and systematic maps |
title_full | ROSES RepOrting standards for Systematic Evidence Syntheses: pro forma, flow-diagram and descriptive summary of the plan and conduct of environmental systematic reviews and systematic maps |
title_fullStr | ROSES RepOrting standards for Systematic Evidence Syntheses: pro forma, flow-diagram and descriptive summary of the plan and conduct of environmental systematic reviews and systematic maps |
title_full_unstemmed | ROSES RepOrting standards for Systematic Evidence Syntheses: pro forma, flow-diagram and descriptive summary of the plan and conduct of environmental systematic reviews and systematic maps |
title_short | ROSES RepOrting standards for Systematic Evidence Syntheses: pro forma, flow-diagram and descriptive summary of the plan and conduct of environmental systematic reviews and systematic maps |
title_sort | roses reporting standards for systematic evidence syntheses pro forma flow diagram and descriptive summary of the plan and conduct of environmental systematic reviews and systematic maps |
topic | PRISMA Quality appraisal CEESAT DART AMSTAR QUORUM |
url | http://link.springer.com/article/10.1186/s13750-018-0121-7 |
work_keys_str_mv | AT nealrhaddaway rosesreportingstandardsforsystematicevidencesynthesesproformaflowdiagramanddescriptivesummaryoftheplanandconductofenvironmentalsystematicreviewsandsystematicmaps AT biljanamacura rosesreportingstandardsforsystematicevidencesynthesesproformaflowdiagramanddescriptivesummaryoftheplanandconductofenvironmentalsystematicreviewsandsystematicmaps AT paulwhaley rosesreportingstandardsforsystematicevidencesynthesesproformaflowdiagramanddescriptivesummaryoftheplanandconductofenvironmentalsystematicreviewsandsystematicmaps AT andrewspullin rosesreportingstandardsforsystematicevidencesynthesesproformaflowdiagramanddescriptivesummaryoftheplanandconductofenvironmentalsystematicreviewsandsystematicmaps |