Meta-analysis, complexity, and heterogeneity: a qualitative interview study of researchers’ methodological values and practices

<p>Background: Complex or heterogeneous data pose challenges for systematic review and meta-analysis. In recent years, a number of new methods have been developed to meet these challenges. This qualitative interview study aimed to understand researchers’ understanding of complexity and heterog...

Full description

Bibliographic Details
Main Authors: Lorenc, T, Felix, L, Petticrew, M, Melendez-Torres, G, Thomas, J, Thomas, S, O’Mara-Eves, A, Richardson, M
Format: Journal article
Published: BioMed Central 2016
_version_ 1826270814495834112
author Lorenc, T
Felix, L
Petticrew, M
Melendez-Torres, G
Thomas, J
Thomas, S
O’Mara-Eves, A
Richardson, M
author_facet Lorenc, T
Felix, L
Petticrew, M
Melendez-Torres, G
Thomas, J
Thomas, S
O’Mara-Eves, A
Richardson, M
author_sort Lorenc, T
collection OXFORD
description <p>Background: Complex or heterogeneous data pose challenges for systematic review and meta-analysis. In recent years, a number of new methods have been developed to meet these challenges. This qualitative interview study aimed to understand researchers’ understanding of complexity and heterogeneity and the factors which may influence the choices researchers make in synthesising complex data.</p><p> Methods: We conducted interviews with a purposive sample of researchers (N = 19) working in systematic review or meta-analysis across a range of disciplines. We analysed data thematically using a framework approach.</p><p> Results: Participants reported using a broader range of methods and data types in complex reviews than in traditional reviews. A range of techniques are used to explore heterogeneity, but there is some debate about their validity, particularly when applied post hoc.</p><p> Conclusions: Technical considerations of how to synthesise complex evidence cannot be isolated from questions of the goals and contexts of research. However, decisions about how to analyse data appear to be made in a largely informal way, drawing on tacit expertise, and their relation to these broader questions remains unclear.</p>
first_indexed 2024-03-06T21:46:45Z
format Journal article
id oxford-uuid:49d97e65-d0b4-4066-85f6-2412a3a18b00
institution University of Oxford
last_indexed 2024-03-06T21:46:45Z
publishDate 2016
publisher BioMed Central
record_format dspace
spelling oxford-uuid:49d97e65-d0b4-4066-85f6-2412a3a18b002022-03-26T15:34:14ZMeta-analysis, complexity, and heterogeneity: a qualitative interview study of researchers’ methodological values and practicesJournal articlehttp://purl.org/coar/resource_type/c_dcae04bcuuid:49d97e65-d0b4-4066-85f6-2412a3a18b00Symplectic Elements at OxfordBioMed Central2016Lorenc, TFelix, LPetticrew, MMelendez-Torres, GThomas, JThomas, SO’Mara-Eves, ARichardson, M<p>Background: Complex or heterogeneous data pose challenges for systematic review and meta-analysis. In recent years, a number of new methods have been developed to meet these challenges. This qualitative interview study aimed to understand researchers’ understanding of complexity and heterogeneity and the factors which may influence the choices researchers make in synthesising complex data.</p><p> Methods: We conducted interviews with a purposive sample of researchers (N = 19) working in systematic review or meta-analysis across a range of disciplines. We analysed data thematically using a framework approach.</p><p> Results: Participants reported using a broader range of methods and data types in complex reviews than in traditional reviews. A range of techniques are used to explore heterogeneity, but there is some debate about their validity, particularly when applied post hoc.</p><p> Conclusions: Technical considerations of how to synthesise complex evidence cannot be isolated from questions of the goals and contexts of research. However, decisions about how to analyse data appear to be made in a largely informal way, drawing on tacit expertise, and their relation to these broader questions remains unclear.</p>
spellingShingle Lorenc, T
Felix, L
Petticrew, M
Melendez-Torres, G
Thomas, J
Thomas, S
O’Mara-Eves, A
Richardson, M
Meta-analysis, complexity, and heterogeneity: a qualitative interview study of researchers’ methodological values and practices
title Meta-analysis, complexity, and heterogeneity: a qualitative interview study of researchers’ methodological values and practices
title_full Meta-analysis, complexity, and heterogeneity: a qualitative interview study of researchers’ methodological values and practices
title_fullStr Meta-analysis, complexity, and heterogeneity: a qualitative interview study of researchers’ methodological values and practices
title_full_unstemmed Meta-analysis, complexity, and heterogeneity: a qualitative interview study of researchers’ methodological values and practices
title_short Meta-analysis, complexity, and heterogeneity: a qualitative interview study of researchers’ methodological values and practices
title_sort meta analysis complexity and heterogeneity a qualitative interview study of researchers methodological values and practices
work_keys_str_mv AT lorenct metaanalysiscomplexityandheterogeneityaqualitativeinterviewstudyofresearchersmethodologicalvaluesandpractices
AT felixl metaanalysiscomplexityandheterogeneityaqualitativeinterviewstudyofresearchersmethodologicalvaluesandpractices
AT petticrewm metaanalysiscomplexityandheterogeneityaqualitativeinterviewstudyofresearchersmethodologicalvaluesandpractices
AT melendeztorresg metaanalysiscomplexityandheterogeneityaqualitativeinterviewstudyofresearchersmethodologicalvaluesandpractices
AT thomasj metaanalysiscomplexityandheterogeneityaqualitativeinterviewstudyofresearchersmethodologicalvaluesandpractices
AT thomass metaanalysiscomplexityandheterogeneityaqualitativeinterviewstudyofresearchersmethodologicalvaluesandpractices
AT omaraevesa metaanalysiscomplexityandheterogeneityaqualitativeinterviewstudyofresearchersmethodologicalvaluesandpractices
AT richardsonm metaanalysiscomplexityandheterogeneityaqualitativeinterviewstudyofresearchersmethodologicalvaluesandpractices