Toward a comprehensive evidence map of overview of systematic review methods: paper 1—purpose, eligibility, search and data extraction
Abstract Background Overviews of systematic reviews attempt to systematically retrieve and summarise the results of multiple systematic reviews. Methods for conducting, interpreting and reporting overviews are in their infancy. To date, there has been no evidence map of the methods used in overviews...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
BMC
2017-11-01
|
| Series: | Systematic Reviews |
| Subjects: | |
| Online Access: | http://link.springer.com/article/10.1186/s13643-017-0617-1 |
| _version_ | 1811256223395217408 |
|---|---|
| author | Carole Lunny Sue E. Brennan Steve McDonald Joanne E. McKenzie |
| author_facet | Carole Lunny Sue E. Brennan Steve McDonald Joanne E. McKenzie |
| author_sort | Carole Lunny |
| collection | DOAJ |
| description | Abstract Background Overviews of systematic reviews attempt to systematically retrieve and summarise the results of multiple systematic reviews. Methods for conducting, interpreting and reporting overviews are in their infancy. To date, there has been no evidence map of the methods used in overviews, thus making it difficult to determine the gaps and priorities for methods research. Our objectives were to develop and populate a comprehensive framework of methods for conducting, interpreting and reporting overviews (stage I) and to create an evidence map by mapping studies that have evaluated overview methods to the framework (stage II). Methods We searched methods collections (e.g. Cochrane Methodology Register, Meth4ReSyn library, AHRQ Effective Health Care Program) to identify eligible studies for both stages of this research. In stage I, cross-sectional studies, guidance documents and commentaries that described methods proposed for, or used in, overviews were used to develop and populate the framework of methods. Drafts and multiple iterations of the framework were discussed and refined by all authors. In stage II, we identified and described studies evaluating overview methods and mapped these evaluations to the framework. Results In this paper, we present results for the four initial steps of conducting an overview: (a) specification of the purpose, objectives and scope, (b) specification of the eligibility criteria, (c) search methods and (d) data extraction. Twenty-nine studies mentioned or described methods relevant to one or more of these steps. In the developed framework, identified methods and approaches were grouped according to the steps an overview author would need to undertake. Fifteen studies evaluated identified methods, all of which mapped to the search methods step. These studies either reported the development and evaluation of a new search filter to retrieve systematic reviews or compared the performance of multiple filters. Conclusion Gaps in the evaluation of methods were found for the majority of steps in the framework. More empirical studies are needed to evaluate the methods outlined and provide a comprehensive evidence map. The framework is useful for planning these evaluations and for planning methods required to deal with challenges that arise when conducting an overview. |
| first_indexed | 2024-04-12T17:37:48Z |
| format | Article |
| id | doaj.art-aa3c05fe429c42b286d97d35b03236a9 |
| institution | Directory Open Access Journal |
| issn | 2046-4053 |
| language | English |
| last_indexed | 2024-04-12T17:37:48Z |
| publishDate | 2017-11-01 |
| publisher | BMC |
| record_format | Article |
| series | Systematic Reviews |
| spelling | doaj.art-aa3c05fe429c42b286d97d35b03236a92022-12-22T03:22:55ZengBMCSystematic Reviews2046-40532017-11-016112710.1186/s13643-017-0617-1Toward a comprehensive evidence map of overview of systematic review methods: paper 1—purpose, eligibility, search and data extractionCarole Lunny0Sue E. Brennan1Steve McDonald2Joanne E. McKenzie3Cochrane Australia, School of Public Health and Preventive Medicine, Monash UniversityCochrane Australia, School of Public Health and Preventive Medicine, Monash UniversityCochrane Australia, School of Public Health and Preventive Medicine, Monash UniversitySchool of Public Health and Preventive Medicine, Monash UniversityAbstract Background Overviews of systematic reviews attempt to systematically retrieve and summarise the results of multiple systematic reviews. Methods for conducting, interpreting and reporting overviews are in their infancy. To date, there has been no evidence map of the methods used in overviews, thus making it difficult to determine the gaps and priorities for methods research. Our objectives were to develop and populate a comprehensive framework of methods for conducting, interpreting and reporting overviews (stage I) and to create an evidence map by mapping studies that have evaluated overview methods to the framework (stage II). Methods We searched methods collections (e.g. Cochrane Methodology Register, Meth4ReSyn library, AHRQ Effective Health Care Program) to identify eligible studies for both stages of this research. In stage I, cross-sectional studies, guidance documents and commentaries that described methods proposed for, or used in, overviews were used to develop and populate the framework of methods. Drafts and multiple iterations of the framework were discussed and refined by all authors. In stage II, we identified and described studies evaluating overview methods and mapped these evaluations to the framework. Results In this paper, we present results for the four initial steps of conducting an overview: (a) specification of the purpose, objectives and scope, (b) specification of the eligibility criteria, (c) search methods and (d) data extraction. Twenty-nine studies mentioned or described methods relevant to one or more of these steps. In the developed framework, identified methods and approaches were grouped according to the steps an overview author would need to undertake. Fifteen studies evaluated identified methods, all of which mapped to the search methods step. These studies either reported the development and evaluation of a new search filter to retrieve systematic reviews or compared the performance of multiple filters. Conclusion Gaps in the evaluation of methods were found for the majority of steps in the framework. More empirical studies are needed to evaluate the methods outlined and provide a comprehensive evidence map. The framework is useful for planning these evaluations and for planning methods required to deal with challenges that arise when conducting an overview.http://link.springer.com/article/10.1186/s13643-017-0617-1Overviews of systematic reviewsOverviewMeta-reviewUmbrella reviewReview of reviewsOverview methods |
| spellingShingle | Carole Lunny Sue E. Brennan Steve McDonald Joanne E. McKenzie Toward a comprehensive evidence map of overview of systematic review methods: paper 1—purpose, eligibility, search and data extraction Systematic Reviews Overviews of systematic reviews Overview Meta-review Umbrella review Review of reviews Overview methods |
| title | Toward a comprehensive evidence map of overview of systematic review methods: paper 1—purpose, eligibility, search and data extraction |
| title_full | Toward a comprehensive evidence map of overview of systematic review methods: paper 1—purpose, eligibility, search and data extraction |
| title_fullStr | Toward a comprehensive evidence map of overview of systematic review methods: paper 1—purpose, eligibility, search and data extraction |
| title_full_unstemmed | Toward a comprehensive evidence map of overview of systematic review methods: paper 1—purpose, eligibility, search and data extraction |
| title_short | Toward a comprehensive evidence map of overview of systematic review methods: paper 1—purpose, eligibility, search and data extraction |
| title_sort | toward a comprehensive evidence map of overview of systematic review methods paper 1 purpose eligibility search and data extraction |
| topic | Overviews of systematic reviews Overview Meta-review Umbrella review Review of reviews Overview methods |
| url | http://link.springer.com/article/10.1186/s13643-017-0617-1 |
| work_keys_str_mv | AT carolelunny towardacomprehensiveevidencemapofoverviewofsystematicreviewmethodspaper1purposeeligibilitysearchanddataextraction AT sueebrennan towardacomprehensiveevidencemapofoverviewofsystematicreviewmethodspaper1purposeeligibilitysearchanddataextraction AT stevemcdonald towardacomprehensiveevidencemapofoverviewofsystematicreviewmethodspaper1purposeeligibilitysearchanddataextraction AT joanneemckenzie towardacomprehensiveevidencemapofoverviewofsystematicreviewmethodspaper1purposeeligibilitysearchanddataextraction |