Meta-analysis of neuroimaging data: a comparison of image-based and coordinate-based pooling of studies.

With the rapid growth of neuroimaging research and accumulation of neuroinformatic databases the synthesis of consensus findings using meta-analysis is becoming increasingly important. Meta-analyses pool data across many studies to identify reliable experimental effects and characterize the degree o...

Full description

Bibliographic Details
Main Authors: Salimi-Khorshidi, G, Smith, S, Keltner, JR, Wager, T, Nichols, T
Format: Journal article
Language:English
Published: 2009
_version_ 1797083992367824896
author Salimi-Khorshidi, G
Smith, S
Keltner, JR
Wager, T
Nichols, T
author_facet Salimi-Khorshidi, G
Smith, S
Keltner, JR
Wager, T
Nichols, T
author_sort Salimi-Khorshidi, G
collection OXFORD
description With the rapid growth of neuroimaging research and accumulation of neuroinformatic databases the synthesis of consensus findings using meta-analysis is becoming increasingly important. Meta-analyses pool data across many studies to identify reliable experimental effects and characterize the degree of agreement across studies. Coordinate-based meta-analysis (CBMA) methods are the standard approach, where each study entered into the meta-analysis has been summarized using only the (x, y, z) locations of peak activations (with or without activation magnitude) reported in published reports. Image-based meta-analysis (IBMA) methods use the full statistic images, and allow the use of hierarchical mixed effects models that account for differing intra-study variance and modeling of random inter-study variation. The purpose of this work is to compare image-based and coordinate-based meta-analysis methods applied to the same dataset, a group of 15 fMRI studies of pain, and to quantify the information lost by working only with the coordinates of peak activations instead of the full statistic images. We apply a 3-level IBMA mixed model for a "mega-analysis", and highlight important considerations in the specification of each model and contrast. We compare the IBMA result to three CBMA methods: ALE (activation likelihood estimation), KDA (kernel density analysis) and MKDA (multi-level kernel density analysis), for various CBMA smoothing parameters. For the datasets considered, we find that ALE at sigma=15 mm, KDA at rho=25-30 mm and MKDA at rho=15 mm give the greatest similarity to the IBMA result, and that ALE was the most similar for this particular dataset, though only with a Dice similarity coefficient of 0.45 (Dice measure ranges from 0 to 1). Based on this poor similarity, and the greater modeling flexibility afforded by hierarchical mixed models, we suggest that IBMA is preferred over CBMA. To make IBMA analyses practical, however, the neuroimaging field needs to develop an effective mechanism for sharing image data, including whole-brain images of both effect estimates and their standard errors.
first_indexed 2024-03-07T01:49:21Z
format Journal article
id oxford-uuid:9988c860-2018-4e3e-b3ed-2927d7490645
institution University of Oxford
language English
last_indexed 2024-03-07T01:49:21Z
publishDate 2009
record_format dspace
spelling oxford-uuid:9988c860-2018-4e3e-b3ed-2927d74906452022-03-27T00:15:04ZMeta-analysis of neuroimaging data: a comparison of image-based and coordinate-based pooling of studies.Journal articlehttp://purl.org/coar/resource_type/c_dcae04bcuuid:9988c860-2018-4e3e-b3ed-2927d7490645EnglishSymplectic Elements at Oxford2009Salimi-Khorshidi, GSmith, SKeltner, JRWager, TNichols, TWith the rapid growth of neuroimaging research and accumulation of neuroinformatic databases the synthesis of consensus findings using meta-analysis is becoming increasingly important. Meta-analyses pool data across many studies to identify reliable experimental effects and characterize the degree of agreement across studies. Coordinate-based meta-analysis (CBMA) methods are the standard approach, where each study entered into the meta-analysis has been summarized using only the (x, y, z) locations of peak activations (with or without activation magnitude) reported in published reports. Image-based meta-analysis (IBMA) methods use the full statistic images, and allow the use of hierarchical mixed effects models that account for differing intra-study variance and modeling of random inter-study variation. The purpose of this work is to compare image-based and coordinate-based meta-analysis methods applied to the same dataset, a group of 15 fMRI studies of pain, and to quantify the information lost by working only with the coordinates of peak activations instead of the full statistic images. We apply a 3-level IBMA mixed model for a "mega-analysis", and highlight important considerations in the specification of each model and contrast. We compare the IBMA result to three CBMA methods: ALE (activation likelihood estimation), KDA (kernel density analysis) and MKDA (multi-level kernel density analysis), for various CBMA smoothing parameters. For the datasets considered, we find that ALE at sigma=15 mm, KDA at rho=25-30 mm and MKDA at rho=15 mm give the greatest similarity to the IBMA result, and that ALE was the most similar for this particular dataset, though only with a Dice similarity coefficient of 0.45 (Dice measure ranges from 0 to 1). Based on this poor similarity, and the greater modeling flexibility afforded by hierarchical mixed models, we suggest that IBMA is preferred over CBMA. To make IBMA analyses practical, however, the neuroimaging field needs to develop an effective mechanism for sharing image data, including whole-brain images of both effect estimates and their standard errors.
spellingShingle Salimi-Khorshidi, G
Smith, S
Keltner, JR
Wager, T
Nichols, T
Meta-analysis of neuroimaging data: a comparison of image-based and coordinate-based pooling of studies.
title Meta-analysis of neuroimaging data: a comparison of image-based and coordinate-based pooling of studies.
title_full Meta-analysis of neuroimaging data: a comparison of image-based and coordinate-based pooling of studies.
title_fullStr Meta-analysis of neuroimaging data: a comparison of image-based and coordinate-based pooling of studies.
title_full_unstemmed Meta-analysis of neuroimaging data: a comparison of image-based and coordinate-based pooling of studies.
title_short Meta-analysis of neuroimaging data: a comparison of image-based and coordinate-based pooling of studies.
title_sort meta analysis of neuroimaging data a comparison of image based and coordinate based pooling of studies
work_keys_str_mv AT salimikhorshidig metaanalysisofneuroimagingdataacomparisonofimagebasedandcoordinatebasedpoolingofstudies
AT smiths metaanalysisofneuroimagingdataacomparisonofimagebasedandcoordinatebasedpoolingofstudies
AT keltnerjr metaanalysisofneuroimagingdataacomparisonofimagebasedandcoordinatebasedpoolingofstudies
AT wagert metaanalysisofneuroimagingdataacomparisonofimagebasedandcoordinatebasedpoolingofstudies
AT nicholst metaanalysisofneuroimagingdataacomparisonofimagebasedandcoordinatebasedpoolingofstudies