Meta-analysis, complexity, and heterogeneity: a qualitative interview study of researchers’ methodological values and practices
Abstract Background Complex or heterogeneous data pose challenges for systematic review and meta-analysis. In recent years, a number of new methods have been developed to meet these challenges. This qualitative interview study aimed to understand researchers’ understanding of complexity and heteroge...
| Main Authors: | , , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
BMC
2016-11-01
|
| Series: | Systematic Reviews |
| Subjects: | |
| Online Access: | http://link.springer.com/article/10.1186/s13643-016-0366-6 |
| _version_ | 1818912751414673408 |
|---|---|
| author | Theo Lorenc Lambert Felix Mark Petticrew G J Melendez-Torres James Thomas Sian Thomas Alison O’Mara-Eves Michelle Richardson |
| author_facet | Theo Lorenc Lambert Felix Mark Petticrew G J Melendez-Torres James Thomas Sian Thomas Alison O’Mara-Eves Michelle Richardson |
| author_sort | Theo Lorenc |
| collection | DOAJ |
| description | Abstract Background Complex or heterogeneous data pose challenges for systematic review and meta-analysis. In recent years, a number of new methods have been developed to meet these challenges. This qualitative interview study aimed to understand researchers’ understanding of complexity and heterogeneity and the factors which may influence the choices researchers make in synthesising complex data. Methods We conducted interviews with a purposive sample of researchers (N = 19) working in systematic review or meta-analysis across a range of disciplines. We analysed data thematically using a framework approach. Results Participants reported using a broader range of methods and data types in complex reviews than in traditional reviews. A range of techniques are used to explore heterogeneity, but there is some debate about their validity, particularly when applied post hoc. Conclusions Technical considerations of how to synthesise complex evidence cannot be isolated from questions of the goals and contexts of research. However, decisions about how to analyse data appear to be made in a largely informal way, drawing on tacit expertise, and their relation to these broader questions remains unclear. |
| first_indexed | 2024-12-19T23:19:34Z |
| format | Article |
| id | doaj.art-c69703fc0e2340a484ae2897ee9c49b2 |
| institution | Directory Open Access Journal |
| issn | 2046-4053 |
| language | English |
| last_indexed | 2024-12-19T23:19:34Z |
| publishDate | 2016-11-01 |
| publisher | BMC |
| record_format | Article |
| series | Systematic Reviews |
| spelling | doaj.art-c69703fc0e2340a484ae2897ee9c49b22022-12-21T20:02:01ZengBMCSystematic Reviews2046-40532016-11-01511910.1186/s13643-016-0366-6Meta-analysis, complexity, and heterogeneity: a qualitative interview study of researchers’ methodological values and practicesTheo Lorenc0Lambert Felix1Mark Petticrew2G J Melendez-Torres3James Thomas4Sian Thomas5Alison O’Mara-Eves6Michelle Richardson7Centre for Reviews and Dissemination, University of YorkDepartment of Social and Environmental Health Research, London School of Hygiene & Tropical MedicineDepartment of Social and Environmental Health Research, London School of Hygiene & Tropical MedicineWarwick Evidence, Division of Health SciencesEPPI-Centre, Social Science Research Unit, UCL Institute of EducationDepartment of Social and Environmental Health Research, London School of Hygiene & Tropical MedicineEPPI-Centre, Social Science Research Unit, UCL Institute of EducationEPPI-Centre, Social Science Research Unit, UCL Institute of EducationAbstract Background Complex or heterogeneous data pose challenges for systematic review and meta-analysis. In recent years, a number of new methods have been developed to meet these challenges. This qualitative interview study aimed to understand researchers’ understanding of complexity and heterogeneity and the factors which may influence the choices researchers make in synthesising complex data. Methods We conducted interviews with a purposive sample of researchers (N = 19) working in systematic review or meta-analysis across a range of disciplines. We analysed data thematically using a framework approach. Results Participants reported using a broader range of methods and data types in complex reviews than in traditional reviews. A range of techniques are used to explore heterogeneity, but there is some debate about their validity, particularly when applied post hoc. Conclusions Technical considerations of how to synthesise complex evidence cannot be isolated from questions of the goals and contexts of research. However, decisions about how to analyse data appear to be made in a largely informal way, drawing on tacit expertise, and their relation to these broader questions remains unclear.http://link.springer.com/article/10.1186/s13643-016-0366-6ComplexityHeterogeneityMeta-analysisQualitative researchSystematic review methodology |
| spellingShingle | Theo Lorenc Lambert Felix Mark Petticrew G J Melendez-Torres James Thomas Sian Thomas Alison O’Mara-Eves Michelle Richardson Meta-analysis, complexity, and heterogeneity: a qualitative interview study of researchers’ methodological values and practices Systematic Reviews Complexity Heterogeneity Meta-analysis Qualitative research Systematic review methodology |
| title | Meta-analysis, complexity, and heterogeneity: a qualitative interview study of researchers’ methodological values and practices |
| title_full | Meta-analysis, complexity, and heterogeneity: a qualitative interview study of researchers’ methodological values and practices |
| title_fullStr | Meta-analysis, complexity, and heterogeneity: a qualitative interview study of researchers’ methodological values and practices |
| title_full_unstemmed | Meta-analysis, complexity, and heterogeneity: a qualitative interview study of researchers’ methodological values and practices |
| title_short | Meta-analysis, complexity, and heterogeneity: a qualitative interview study of researchers’ methodological values and practices |
| title_sort | meta analysis complexity and heterogeneity a qualitative interview study of researchers methodological values and practices |
| topic | Complexity Heterogeneity Meta-analysis Qualitative research Systematic review methodology |
| url | http://link.springer.com/article/10.1186/s13643-016-0366-6 |
| work_keys_str_mv | AT theolorenc metaanalysiscomplexityandheterogeneityaqualitativeinterviewstudyofresearchersmethodologicalvaluesandpractices AT lambertfelix metaanalysiscomplexityandheterogeneityaqualitativeinterviewstudyofresearchersmethodologicalvaluesandpractices AT markpetticrew metaanalysiscomplexityandheterogeneityaqualitativeinterviewstudyofresearchersmethodologicalvaluesandpractices AT gjmelendeztorres metaanalysiscomplexityandheterogeneityaqualitativeinterviewstudyofresearchersmethodologicalvaluesandpractices AT jamesthomas metaanalysiscomplexityandheterogeneityaqualitativeinterviewstudyofresearchersmethodologicalvaluesandpractices AT sianthomas metaanalysiscomplexityandheterogeneityaqualitativeinterviewstudyofresearchersmethodologicalvaluesandpractices AT alisonomaraeves metaanalysiscomplexityandheterogeneityaqualitativeinterviewstudyofresearchersmethodologicalvaluesandpractices AT michellerichardson metaanalysiscomplexityandheterogeneityaqualitativeinterviewstudyofresearchersmethodologicalvaluesandpractices |