Publication Bias in Neuroimaging Research: Implications for Meta-Analyses
- 907 Downloads
Neuroimaging and the neurosciences have made notable advances in sharing activation results through detailed databases, making meta-analysis of the published research faster and easier. However, the effect of publication bias in these fields has not been previously addressed or accounted for in the developed meta-analytic methods. In this article, we examine publication bias in functional magnetic resonance imaging (fMRI) for tasks involving working memory in the frontal lobes (Brodmann Areas 4, 6, 8, 9, 10, 37, 45, 46, and 47). Seventy-four studies were selected from the literature and the effect of publication bias was examined using a number of regression-based techniques. Pearson’s r correlation coefficient and Cohen’s d effect size estimates were computed for the activation in each study and compared to the study sample size using Egger’s regression, Macaskill’s regression, and the ‘Trim and Fill’ method. Evidence for publication bias was identified in this body of literature (p < 0.01 for each test), generally, though was neither task- nor sub-region-dependent. While we focused our analysis on this subgroup of brain mapping studies, we believe our findings generalize to the brain imaging literature as a whole and databases seeking to curate their collective results. While neuroimaging databases of summary effects are of enormous value to the community, the potential publication bias should be considered when performing meta-analyses based on database contents.
KeywordsBrain imaging fMRI Databases Meta-analysis Publication bias
This work was supported by NIH grant RC1MH088194 to JVH. The authors wish to thank the members of the Laboratory of Neuro Imaging (LONI) in the Department of Neurology at the UCLA David Geffen School of Medicine and three anonymous reviewers of a previous version of this article.
- Cohen, J. (1988). Statistical power analysis for the behavioral sciences. Hillsdale: Erlbaum Associates.Google Scholar
- Fitzgerald, P. B., Srithiran A., et al. (2008). An fMRI study of prefrontal brain activation during multiple tasks in patients with major depressive disorder. Hum Brain Mapp, 29(4), 490–501Google Scholar
- Fox, P. T., Mikiten, S., Davis, G., & Lancaster, J. (1994). BrainMap: A database of human function brain mapping. In R. W. Thatcher, M. Hallett, T. Zeffiro, E. R. John, & M. Heurta (Eds.), Functional neuroimaging technical foundations (pp. 95–105). San Diego: Academic.Google Scholar
- Fusar-Poli, P., Placentino, A., Carletti, F., Landi, P., Allen, P., Surguladze, S., et al. (2009). Functional atlas of emotional faces processing: a voxel-based meta-analysis of 105 functional magnetic resonance imaging studies. Journal of Psychiatry & Neuroscience, 34(6), 418–432.Google Scholar
- Hopewell S, Loudon K, Clarke MJ, Oxman AD, Dickersin K (2009) Publication bias in clinical trials due to statistical significance or direction of trial results. Cochrane Database Syst Rev. (1): MR000006.Google Scholar
- Kim, J. J., Kwon, J. S., et al. (2003). Functional disconnection between the prefrontal and parietal cortices during working memory processing in schizophrenia: a[15(O)]H2O PET study. Am J Psychiatry, 160(5), 919–923Google Scholar
- Light, R. J., & Pillemer, D. B. (1984). Summing up. The science of reviewing research. Cambridge: Harvard University Press.Google Scholar
- Lumley T (2009). rmeta: Meta-analysis. R package version 2.16. from http://CRAN.R-project.org/package=rmeta.
- Malhi, G. S, Lagopoulos, J., et al. (2007). Reduced activation to implicit affect induction in euthymic bipolar patients: an fMRI study. J Affect Disord, 97(1–3), 109–122Google Scholar
- Polyzos NP, Valachis A, Patavoukas E, Papanikolaou EG, Messinis IE, Tarlatzis BC, et al. Publication bias in reproductive medicine: from the European Society of Human Reproduction and Embryology annual meeting to publication. Hum Reprod. 2011.Google Scholar
- Rendina-Gobioff G, Kromrey JD (2006) PUB_BIAS: A SAS macro for detecting publication bias in meta-analysis. 14th Annual SouthEast SAS Users Group (SESUG) Conference. Atlanta, GA, SouthEast SAS Users Group (SESUG). PO05.Google Scholar
- Saeed M, Paulson K, Lambert P, Szwajcer D, Seftel M (2010) Publication bias in blood and marrow transplantation. Biol Blood Marrow Transplant.Google Scholar
- Scargle, J. D. (2000). Publication bias: the “File-Drawer” problem in scientific inference. Journal of Scientific Exploration, 14(1), 91–106.Google Scholar
References to Articles Used in the Analyses of Publication Bias
- Lagopoulos, J., Ivanovski, B., et al. (2007). An event-related functional MRI study of working memory in euthymic bipolar disorder. Journal of Psychiatry & Neuroscience, 32(3), 174–184.Google Scholar