Potential reporting bias in fMRI studies of the brain.
Functional magnetic resonance imaging (fMRI) studies have reported multiple activation foci associated with a variety of conditions, stimuli or tasks. However, most of these studies used fewer than 40 participants.After extracting data (number of subjects, condition studied, number of foci identifie...
| Main Authors: | , , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Public Library of Science (PLoS)
2013-01-01
|
| Series: | PLoS ONE |
| Online Access: | http://europepmc.org/articles/PMC3723634?pdf=render |
| _version_ | 1818848220986474496 |
|---|---|
| author | Sean P David Jennifer J Ware Isabella M Chu Pooja D Loftus Paolo Fusar-Poli Joaquim Radua Marcus R Munafò John P A Ioannidis |
| author_facet | Sean P David Jennifer J Ware Isabella M Chu Pooja D Loftus Paolo Fusar-Poli Joaquim Radua Marcus R Munafò John P A Ioannidis |
| author_sort | Sean P David |
| collection | DOAJ |
| description | Functional magnetic resonance imaging (fMRI) studies have reported multiple activation foci associated with a variety of conditions, stimuli or tasks. However, most of these studies used fewer than 40 participants.After extracting data (number of subjects, condition studied, number of foci identified and threshold) from 94 brain fMRI meta-analyses (k = 1,788 unique datasets) published through December of 2011, we analyzed the correlation between individual study sample sizes and number of significant foci reported. We also performed an analysis where we evaluated each meta-analysis to test whether there was a correlation between the sample size of the meta-analysis and the number of foci that it had identified. Correlation coefficients were then combined across all meta-analyses to obtain a summary correlation coefficient with a fixed effects model and we combine correlation coefficients, using a Fisher's z transformation.There was no correlation between sample size and the number of foci reported in single studies (r = 0.0050) but there was a strong correlation between sample size and number of foci in meta-analyses (r = 0.62, p<0.001). Only studies with sample sizes <45 identified larger (>40) numbers of foci and claimed as many discovered foci as studies with sample sizes ≥ 45, whereas meta-analyses yielded a limited number of foci relative to the yield that would be anticipated from smaller single studies.These results are consistent with possible reporting biases affecting small fMRI studies and suggest the need to promote standardized large-scale evidence in this field. It may also be that small studies may be analyzed and reported in ways that may generate a larger number of claimed foci or that small fMRI studies with inconclusive, null, or not very promising results may not be published at all. |
| first_indexed | 2024-12-19T06:13:53Z |
| format | Article |
| id | doaj.art-d88c0c98584c4cb491d1c8a3ee2ab442 |
| institution | Directory Open Access Journal |
| issn | 1932-6203 |
| language | English |
| last_indexed | 2024-12-19T06:13:53Z |
| publishDate | 2013-01-01 |
| publisher | Public Library of Science (PLoS) |
| record_format | Article |
| series | PLoS ONE |
| spelling | doaj.art-d88c0c98584c4cb491d1c8a3ee2ab4422022-12-21T20:32:56ZengPublic Library of Science (PLoS)PLoS ONE1932-62032013-01-0187e7010410.1371/journal.pone.0070104Potential reporting bias in fMRI studies of the brain.Sean P DavidJennifer J WareIsabella M ChuPooja D LoftusPaolo Fusar-PoliJoaquim RaduaMarcus R MunafòJohn P A IoannidisFunctional magnetic resonance imaging (fMRI) studies have reported multiple activation foci associated with a variety of conditions, stimuli or tasks. However, most of these studies used fewer than 40 participants.After extracting data (number of subjects, condition studied, number of foci identified and threshold) from 94 brain fMRI meta-analyses (k = 1,788 unique datasets) published through December of 2011, we analyzed the correlation between individual study sample sizes and number of significant foci reported. We also performed an analysis where we evaluated each meta-analysis to test whether there was a correlation between the sample size of the meta-analysis and the number of foci that it had identified. Correlation coefficients were then combined across all meta-analyses to obtain a summary correlation coefficient with a fixed effects model and we combine correlation coefficients, using a Fisher's z transformation.There was no correlation between sample size and the number of foci reported in single studies (r = 0.0050) but there was a strong correlation between sample size and number of foci in meta-analyses (r = 0.62, p<0.001). Only studies with sample sizes <45 identified larger (>40) numbers of foci and claimed as many discovered foci as studies with sample sizes ≥ 45, whereas meta-analyses yielded a limited number of foci relative to the yield that would be anticipated from smaller single studies.These results are consistent with possible reporting biases affecting small fMRI studies and suggest the need to promote standardized large-scale evidence in this field. It may also be that small studies may be analyzed and reported in ways that may generate a larger number of claimed foci or that small fMRI studies with inconclusive, null, or not very promising results may not be published at all.http://europepmc.org/articles/PMC3723634?pdf=render |
| spellingShingle | Sean P David Jennifer J Ware Isabella M Chu Pooja D Loftus Paolo Fusar-Poli Joaquim Radua Marcus R Munafò John P A Ioannidis Potential reporting bias in fMRI studies of the brain. PLoS ONE |
| title | Potential reporting bias in fMRI studies of the brain. |
| title_full | Potential reporting bias in fMRI studies of the brain. |
| title_fullStr | Potential reporting bias in fMRI studies of the brain. |
| title_full_unstemmed | Potential reporting bias in fMRI studies of the brain. |
| title_short | Potential reporting bias in fMRI studies of the brain. |
| title_sort | potential reporting bias in fmri studies of the brain |
| url | http://europepmc.org/articles/PMC3723634?pdf=render |
| work_keys_str_mv | AT seanpdavid potentialreportingbiasinfmristudiesofthebrain AT jenniferjware potentialreportingbiasinfmristudiesofthebrain AT isabellamchu potentialreportingbiasinfmristudiesofthebrain AT poojadloftus potentialreportingbiasinfmristudiesofthebrain AT paolofusarpoli potentialreportingbiasinfmristudiesofthebrain AT joaquimradua potentialreportingbiasinfmristudiesofthebrain AT marcusrmunafo potentialreportingbiasinfmristudiesofthebrain AT johnpaioannidis potentialreportingbiasinfmristudiesofthebrain |