Number of events and reliability in fMRI
Relatively early in the history of fMRI, research focused on issues of power and reliability, with an important line concerning the establishment of optimal procedures for experimental design in order to maximize the various statistical properties of such designs. However, in recent years, tasks wherein events are defined only a posteriori, on the basis of behavior, have become increasingly common. Although these designs enable a much wider array of questions to be answered, they are not amenable to the tight control afforded by designs with events defined entirely a priori, and little work has assessed issues of power and reliability in such designs. We demonstrate how differences in numbers of events—as can occur with a posteriori event definition—affect reliability, both through simulation and in real data.
KeywordsNeuroimaging Design and analysis Statistical power
- Bennett, C. M., & Miller, M. B. (2013). Differences in reliability of block versus event-related designs. Manuscript submitted for publication.Google Scholar
- Green, D. M., & Swets, J. A. (1974). Signal detection theory and psychophysics (Rev. ed). Huntington, NY: Krieger.Google Scholar
- Macmillan, N. A., & Creelman, C. D. (2005). Detection theory: A user’s guide. Mahwah, NJ: Erlbaum.Google Scholar
- Miller, M. B., Van Horn, J. D., Wolford, G. L., Handy, T. C., Valsangkar-Smyth, M., Inati, S., . . . Gazzaniga, M. S. (2002). Extensive individual differences in brain activations associated with episodic retrieval are reliable over time. Journal of Cognitive Neuroscience, 14, 1200–1214.Google Scholar
- Turner, B. O., Donovan, C.-L., & Miller, M. B. (2013). Dissociating memory processes by their differences in neural stability. Poster presented at the annual meeting of the Cognitive Neuroscience Society.Google Scholar