Skip to main content

Multimodal Integration of fMRI and EEG Data for High Spatial and Temporal Resolution Analysis of Brain Networks

Brain Topography volume 23, pages 150–158 (2010)Cite this article

Abstract

Two major non-invasive brain mapping techniques, electroencephalography (EEG) and functional magnetic resonance imaging (fMRI), have complementary advantages with regard to their spatial and temporal resolution. We propose an approach based on the integration of EEG and fMRI, enabling the EEG temporal dynamics of information processing to be characterized within spatially well-defined fMRI large-scale networks. First, the fMRI data are decomposed into networks by means of spatial independent component analysis (sICA), and those associated with intrinsic activity and/or responding to task performance are selected using information from the related time-courses. Next, the EEG data over all sensors are averaged with respect to event timing, thus calculating event-related potentials (ERPs). The ERPs are subjected to temporal ICA (tICA), and the resulting components are localized with the weighted minimum norm (WMNLS) algorithm using the task-related fMRI networks as priors. Finally, the temporal contribution of each ERP component in the areas belonging to the fMRI large-scale networks is estimated. The proposed approach has been evaluated on visual target detection data. Our results confirm that two different components, commonly observed in EEG when presenting novel and salient stimuli, respectively, are related to the neuronal activation in large-scale networks, operating at different latencies and associated with different functional processes.

This is a preview of subscription content, access via your institution.

Access options

Buy single article

Instant access to the full article PDF.

43,34 €

Price includes VAT (Finland)
Tax calculation will be finalised during checkout.

Fig. 1
Fig. 2
Fig. 3
Fig. 4

References

  • Benar CG, Schon D, Grimault S, Nazarian B, Burle B, Roth M, Badier JM, Marquis P, Liegeois-Chauvel C, Anton JL (2007) Single-trial analysis of oddball event-related potentials in simultaneous EEG-fMRI. Hum Brain Mapp 28:602–613

    Article  PubMed  Google Scholar 

  • Bledowski C, Prvulovic D, Goebel R, Zanella FE, Linden DE (2004) Attentional systems in target and distractor processing: a combined ERP and fMRI study. Neuroimage 22:530–540

    Article  PubMed  Google Scholar 

  • Calhoun VD, Adali T, Pearlson GD, Kiehl KA (2006) Neuronal chronometry of target detection: fusion of hemodynamic and event-related potential. Neuroimage 30:544–553

    Article  CAS  PubMed  Google Scholar 

  • Corbetta M, Shulman GL (2002) Control of goal-directed and stimulus-driven attention in the brain. Nat Rev Neurosci 3:201–215

    Article  CAS  PubMed  Google Scholar 

  • Dale AM, Liu AK, Fischl BR, Buckner RL, Belliveau JW, Lewine JD, Halgren E (2000) Dynamic statistical parametric neurotechnique mapping: combining fMRI and MEG for high-resolution imaging of cortical activity. Neuron 26:55–67

    Article  CAS  PubMed  Google Scholar 

  • Debener S, Ullsperger M, Siegel M, Fiehler K, von Cramon DY, Engel AK (2005) Trial-by-trial coupling of concurrent electroencephalogram and functional magnetic resonance imaging identifies the dynamics of performance monitoring. J Neurosci 25:11730–11737

    Article  CAS  PubMed  Google Scholar 

  • Dosenbach NU, Visscher KM, Palmer ED, Miezin FM, Wenger KK, Kang HC, Burgund ED, Grimes AL, Schlaggar BL, Petersen SE (2006) A core system for the implementation of task sets. Neuron 50:799–812

    Article  CAS  PubMed  Google Scholar 

  • Eichele T, Calhoun VD, Moosmann M, Specht K, Jongsma ML, Quiroga RQ, Nordby H, Hugdahl K (2008) Unmixing concurrent EEG-fMRI with parallel independent component analysis. Int J Psychophysiol 67:222–234

    Article  PubMed  Google Scholar 

  • Esposito F, Scarabino T, Hyvärinen A, Himberg J, Formisano E, Comani S, Tedeschi G, Goebel R, Seifritz E, Di Salle F (2005) Independent component analysis of fMRI group studies by self-organizing clustering. Neuroimage 25:193–205

    Article  PubMed  Google Scholar 

  • Fox MD, Snyder AZ, Zacks JM, Raichle ME (2006) Coherent spontaneous activity accounts for trial-to-trial variability in human evoked brain responses. Nat Neurosci 9:23–25

    Article  CAS  PubMed  Google Scholar 

  • Fuchs M, Drenckhahn R, Wischmann HA, Wagner M (1998) An improved boundary element method for realistic volume-conductor modeling. IEEE Trans Biomed Eng 45:980–997

    Article  CAS  PubMed  Google Scholar 

  • Goldstein A, Spencer KM, Donchin E (2002) The influence of stimulus deviance and novelty on the P300 and novelty P3. Psychophysiology 39:781–790

    Article  PubMed  Google Scholar 

  • Gonçalves SI, Pouwels PJ, Kuijer JP, Heethaar RM, de Munck JC (2007) Artifact removal in co-registered EEG-fMRI by selective average subtraction. Clin Neurophysiol 118:2437–2450

    Article  PubMed  Google Scholar 

  • Hamalainen MS, Ilmoniemi RJ (1994) Interpreting magnetic fields of the brain: minimum norm estimates. Med Biol Eng Comput 32:35–42

    Article  CAS  PubMed  Google Scholar 

  • Heeger DJ, Ress D (2002) What does fMRI tell us about neuronal activity? Nat Rev Neurosci 3:142–151

    Article  CAS  PubMed  Google Scholar 

  • Hyvärinen A (1999) Fast and robust fixed-point algorithms for independent component analysis. IEEE Trans Neural Netw 10:626–634

    Article  PubMed  Google Scholar 

  • James CJ, Hesse CW (2005) Independent component analysis for biomedical signals. Physiol Meas 26:R15–R39

    Article  PubMed  Google Scholar 

  • Liu AK, Belliveau JW, Dale AM (1998) Spatiotemporal imaging of human brain activity using functional MRI constrained magnetoencephalography: Monte Carlo simulations. ProcNatl Acad Sci USA 95:8945–8950

    Article  CAS  Google Scholar 

  • Makeig S, Jung TP, Bell AJ, Ghahremani D, Sejnowski TJ (1997) Blind separation of auditory event-related brain responses into independent components. Proc Natl Acad Sci USA 94:10979–10984

    Article  CAS  PubMed  Google Scholar 

  • Makeig S, Westerfield M, Townsend J, Jung TP, Courchesne E, Sejnowski TJ (1999) Functionally independent components of early event-related potentials in a visual spatial attention task. Philos Trans R Soc Lond B Biol Sci 354:1135–1144

    Article  CAS  PubMed  Google Scholar 

  • Mantini D, Perrucci MG, Cugini S, Ferretti A, Romani GL, Del Gratta C (2007a) Complete artifact removal for EEG recorded during continuous fMRI using independent component analysis. Neuroimage 34:598–607

    Article  CAS  PubMed  Google Scholar 

  • Mantini D, Perrucci MG, Del Gratta C, Romani GL, Corbetta M (2007b) Electrophysiological signatures of resting state networks in the human brain. Proc Natl Acad Sci USA 104:13170–13175

    Article  CAS  PubMed  Google Scholar 

  • Mantini D, Corbetta M, Perrucci MG, Romani GL, Del Gratta C (2009) Large-scale brain networks account for sustained and transient activity during target detection. Neuroimage 44:265–274

    Article  PubMed  Google Scholar 

  • Maris E, Oostenveld R (2007) Nonparametric statistical testing of EEG- and MEG-data. J Neurosci Methods 164:177–190

    Article  PubMed  Google Scholar 

  • McKeown MJ, Makeig S, Brown GG, Jung TP, Kindermann SS, Bell AJ, Sejnowski TJ (1998) Analysis of fMRI data by blind separation into independent spatial components. Hum Brain Mapp 6:160–188

    Article  CAS  PubMed  Google Scholar 

  • Mulert C, Jager L, Schmitt R, Bussfeld P, Pogarell O, Moller HJ, Juckel G, Hegerl U (2004) Integration of fMRI and simultaneous EEG: towards a comprehensive understanding of localization and time-course of brain activity in target detection. Neuroimage 22:83–94

    Article  PubMed  Google Scholar 

  • Nir Y, Hasson U, Levy I, Yeshurun Y, Malach R (2006) Widespread functional connectivity and fMRI fluctuations in human visual cortex in the absence of visual stimulation. Neuroimage 30:1313–1324

    Article  PubMed  Google Scholar 

  • Zar JH (1996) Biostatistical analysis. Prentice-Hall, Upper Saddle River, NJ

    Google Scholar 

Download references

Acknowledgments

The authors wish to thank Simone Cugini and Mauro Gianni Perrucci for technical assistance and data acquisition. Dante Mantini was partly supported by the Research Foundation Flanders (FWO).

Author information

Affiliations

  1. Department of Clinical Sciences and Bio-imaging, University “G. D’Annunzio”, Chieti, Italy

    D. Mantini, L. Marzetti, M. Corbetta, G. L. Romani & C. Del Gratta

  2. ITAB—Institute for Advanced Biomedical Technologies, “G. D’Annunzio University” Foundation, 66013, Chieti, Italy

    D. Mantini, L. Marzetti, M. Corbetta, G. L. Romani & C. Del Gratta

  3. Laboratory for Neuro-psychophysiology, K.U.Leuven Medical School, Leuven, Belgium

    D. Mantini

  4. Department of Neurology, Washington University, St. Louis, MO, USA

    M. Corbetta

  5. Department of Radiology, Washington University, St. Louis, Missouri, USA

    M. Corbetta

Authors
  1. D. Mantini
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. L. Marzetti
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. M. Corbetta
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. G. L. Romani
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. C. Del Gratta
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to D. Mantini.

Additional information

This is one of several papers published together in Brain Topography on the “Special Topic: Cortical Network Analysis with EEG/MEG”.

Rights and permissions

Reprints and Permissions

About this article

Cite this article

Mantini, D., Marzetti, L., Corbetta, M. et al. Multimodal Integration of fMRI and EEG Data for High Spatial and Temporal Resolution Analysis of Brain Networks. Brain Topogr 23, 150–158 (2010). https://doi.org/10.1007/s10548-009-0132-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10548-009-0132-3

Keywords

  • EEG
  • fMRI
  • Independent component analysis
  • P300
  • Target detection
  • Visual oddball task