Skip to main content
SpringerLink
Log in

Psychophysiology-Informed (Multimodal) Imaging

  • Chapter
  • First Online:
Electrophysiology and Psychophysiology in Psychiatry and Psychopharmacology

Part of the book series: Current Topics in Behavioral Neurosciences ((CTBN,volume 21))

  • 1878 Accesses

Abstract

Electroencephalography (EEG) and magnetic resonance imaging are two popular methodologies for brain research. While EEG has a high temporal resolution, yet a low spatial resolution, MRI has the complete opposite, a high spatial resolution, yet a low temporal resolution. Obviously therefore, researchers have been searching for ways combining the two methodologies, for more than two decades. However, there are many issues that have to be solved before the methodologies can be successfully and, more importantly reliably, combined. Here, we give an overview of these issues, and present strategies that have been used over the past two decades to overcome them. We start with a general description of EEG and (f)MRI methodology, then present the difficulties involved in combining both methodologies, and lastly present and discuss the most popular strategies that have been used over the past two decades to solve these problems. We conclude that in spite of the many issues, the two methodologies can be combined successfully, provided that the correct procedures are followed.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  • Aggernaes B, Glenthoj BY, Ebdrup BH, Rasmussen H, Lublin H, Oranje B (2010) Sensorimotor gating and habituation in antipsychotic-naïve, first-episode schizophrenia patients before and after six months treatment with quetiapine. Int J Neuropsychopharmacol 13(10):1383–1395

    Article  CAS  PubMed  Google Scholar 

  • Allen PJ, Josephs O, Turner R (2000) A method for removing imaging artifact from continuous EEG recorded during functional MRI. Neuroimage 12(2):230–239

    Article  CAS  PubMed  Google Scholar 

  • Allen PJ, Polizzi G, Krakow K, Fish DR, Lemieux L (1998) Identification of EEG events in the MR scanner: the problem of pulse artifact and a method for its subtraction. Neuroimage 8(3):229–239

    Article  CAS  PubMed  Google Scholar 

  • Arciniegas DB, Topkoff JL, Rojas DC, Sheeder J, Teale P, Young DA, Sandberg E, Reite ML, Adler LE (2001) Reduced hippocampal volume in association with p50 nonsuppression following traumatic brain injury. J Neuropsychiatry Clin Neurosci 13(2):213–221

    Article  CAS  PubMed  Google Scholar 

  • Bak N, Glenthoj BY, Rostrup E, Larsson H, Oranje B (2011) Source localization of sensory gating: a combined EEG and fMRI study in healthy volunteers. Neuroimage 54(4):2711–2718

    Article  PubMed  Google Scholar 

  • Bak N, Rostrup E, Larsson HB, Glenthoj BY, Oranje B (2013) Concurrent functional magnetic resonance imaging and electroencephalography assessment of sensory gating in schizophrenia. Hum Brain Mapp

    Google Scholar 

  • Barry RJ, Clarke AR, Johnstone SJ (2003a) A review of electrophysiology in attention-deficit/hyperactivity disorder: I Qualitative and quantitative electroencephalography. Clin Neurophysiol 114(2):171–183

    Article  PubMed  Google Scholar 

  • Barry RJ, Johnstone SJ, Clarke AR (2003b) A review of electrophysiology in attention-deficit/hyperactivity disorder: II. Event-related potentials. Clin Neurophysiol 114(2):184–198

    Article  PubMed  Google Scholar 

  • Benar CG, Schon D, Grimault S, Nazarian B, Burle B, Roth M, Badier JM, Marquis P, Liegeois-Chauvel C, Anton JL (2007) Single-trial analysis of oddball event-related potentials in simultaneous EEG-fMRI. Hum Brain Mapp 28(7):602–613

    Article  PubMed  Google Scholar 

  • Berger H (1929) Uber das Elektrenkephalogramm des Menschen. Archiv für Psychiatrie und Nervenkrankheiten 87(1):527–570

    Article  Google Scholar 

  • Bregadze N, Lavric A (2006) ERP differences with vs. without concurrent fMRI. Int J Psychophysiol 62(1):54–59

    Article  PubMed  Google Scholar 

  • Coull JT (1998) Neural correlates of attention and arousal: insights from electrophysiology, functional neuroimaging and psychopharmacology. Prog Neurobiol 55(4):343–361

    Article  CAS  PubMed  Google Scholar 

  • Counter SA, Olofsson A, Grahn HF, Borg E (1997) MRI acoustic noise: sound pressure and frequency analysis. J Magn Reson Imaging 7(3):606–611

    Article  CAS  PubMed  Google Scholar 

  • Debener S, Ullsperger M, Siegel M, Engel AK (2006) Single-trial EEG-fMRI reveals the dynamics of cognitive function. Trends Cogn Sci 10(12):558–563

    Article  PubMed  Google Scholar 

  • Debener S, Ullsperger M, Siegel M, Fiehler K, von Cramon DY, Engel AK (2005) Trial-by-trial coupling of concurrent electroencephalogram and functional magnetic resonance imaging identifies the dynamics of performance monitoring. J Neurosci 25(50):11730–11737

    Article  CAS  PubMed  Google Scholar 

  • Egan MF, Duncan CC, Suddath RL, Kirch DG, Mirsky AF, Wyatt RJ (1994) Event-related potential abnormalities correlate with structural brain alterations and clinical features in patients with chronic schizophrenia. Schizophr Res 11(3):259–271

    Article  CAS  PubMed  Google Scholar 

  • Eichele T, Calhoun VD, Debener S (2009) Mining EEG-fMRI using independent component analysis. Int J Psychophysiol 73(1):53–61

    Article  PubMed Central  PubMed  Google Scholar 

  • Fabiani M, Gratton G, Coles MG (2000) Event-related brain potentials. In: Cacioppo JT (ed) Cambridge University Press, New York, pp 53–84

    Google Scholar 

  • Fuglo D, Pedersen H, Rostrup E, Hansen AE, Larsson HB (2012) Correlation between single-trial visual evoked potentials and the blood oxygenation level dependent response in simultaneously recorded electroencephalography-functional magnetic resonance imaging. Magn Reson Med 68(1):252–260

    Article  PubMed  Google Scholar 

  • Fusar-Poli P, Crossley N, Woolley J, Carletti F, Perez-Iglesias R, Broome M, Johns L, Tabraham P, Bramon E, McGuire P (2011) White matter alterations related to P300 abnormalities in individuals at high risk for psychosis: an MRI-EEG study. J Psychiatry Neurosci 36(4):239–248

    Article  PubMed Central  PubMed  Google Scholar 

  • Hammer TB, Oranje B, Skimminge A, Aggernaes B, Ebdrup BH, Glenthoj BY, Baare W (2012). Structural brain correlates of sensorimotor gating in antipsychotic-naïve men with first-episode schizophrenia. J Psychiatry Neurosci 37(4):8

    Google Scholar 

  • Hazlett EA, Buchsbaum MS, Tang CY, Fleischman MB, Wei TC, Byne W, Haznedar MM (2001) Thalamic activation during an attention-to-prepulse startle modification paradigm: a functional MRI study. Biol Psychiatry 50(4):281–291

    Article  CAS  PubMed  Google Scholar 

  • Hazlett EA, Buchsbaum MS, Zhang J, Newmark RE, Glanton CF, Zelmanova Y, Haznedar MM, Chu KW, Nenadic I, Kemether EM, Tang CY, New AS, Siever LJ (2008) Frontal-striatal-thalamic mediodorsal nucleus dysfunction in schizophrenia-spectrum patients during sensorimotor gating. Neuroimage 42(3):1164–1177

    Article  PubMed Central  PubMed  Google Scholar 

  • Herrmann CS, Debener S (2008) Simultaneous recording of EEG and BOLD responses: a historical perspective. Int J Psychophysiol 67(3):161–168

    Article  PubMed  Google Scholar 

  • Huster RJ, Debener S, Eichele T, Herrmann CS (2012) Methods for simultaneous EEG-fMRI: an introductory review. J Neurosci 32(18):6053–6060

    Article  CAS  PubMed  Google Scholar 

  • Im CH, Liu Z, Zhang N, Chen W, He B (2006) Functional cortical source imaging from simultaneously recorded ERP and fMRI. J Neurosci Methods 157(1):118–123

    Article  PubMed Central  PubMed  Google Scholar 

  • Jezzard P, Matthews PM, Smith SM (2008) Functional MRI. In: Jezzard P, Matthews PM, Smith SM (eds) Oxford University Press, New York

    Google Scholar 

  • Jung R, Berger W (1979) Fiftieth anniversary of Hans Berger’s publication of the electroencephalogram. His first records in 1924–1931 (author’s transl). Arch Psychiatr Nervenkr 227(4):279–300

    Article  CAS  PubMed  Google Scholar 

  • Keshavan MS, Reynolds CF, Kupfer DJ (1990) Electroencephalographic sleep in schizophrenia: a critical review. Compr Psychiatry 31(1):34–47

    Article  CAS  PubMed  Google Scholar 

  • Kiloh LG, McComas AJ, Osselton JW (1972) Clinical electroencephalography. In: Kiloh LG, McComas AJ, Osselton JW (eds) vol 3. Butterworth & co, London

    Google Scholar 

  • Kooi KA, Tucker RP, Marshall RE (1978) Basic electrical principles-genesis and regulation of electrical activity of the brain. Fundam Electroencephal 2(1–4):3–48

    Google Scholar 

  • Krakow K, Allen PJ, Symms MR, Lemieux L, Josephs O, Fish DR (2000) EEG recording during fMRI experiments: image quality. Hum Brain Mapp 10(1):10–15

    Article  CAS  PubMed  Google Scholar 

  • Kumari V, Antonova E, Zachariah E, Galea A, Aasen I, Ettinger U, Mitterschiffthaler MT, Sharma T (2005) Structural brain correlates of prepulse inhibition of the acoustic startle response in healthy humans. Neuroimage 26(4):1052–1058

    Article  PubMed  Google Scholar 

  • Kumari V, Fannon D, Geyer MA, Premkumar P, Antonova E, Simmons A, Kuipers E (2008) Cortical grey matter volume and sensorimotor gating in schizophrenia. Cortex 44(9):1206–1214

    Article  PubMed Central  PubMed  Google Scholar 

  • Kumari V, Gray JA, Geyer MA, Ffytche D, Soni W, Mitterschiffthaler MT, Vythelingum GN, Simmons A, Williams SC, Sharma T (2003) Neural correlates of tactile prepulse inhibition: a functional MRI study in normal and schizophrenic subjects. Psychiatry Res 122(2):99–113

    Google Scholar 

  • Logothetis NK, Pauls J, Augath M, Trinath T, Oeltermann A (2001) Neurophysiological investigation of the basis of the fMRI signal. Nature 412(6843):150–157

    Article  CAS  PubMed  Google Scholar 

  • Logothetis NK, Wandell BA (2004) Interpreting the BOLD signal. Annu Rev Physiol 66:735–769

    Article  CAS  PubMed  Google Scholar 

  • Madsen GF, Bilenberg N, Cantio C, Oranje B (2013) Increased prepulse inhibition and sensitization of the startle reflex in autistic children. Autism Res (Accepted Epub)

    Google Scholar 

  • Markand ON (1994) Brainstem auditory evoked potentials. J Clin Neurophysiol 11(3):319–342

    Article  CAS  PubMed  Google Scholar 

  • Mathiak K, Ackermann H, Rapp A, Mathiak KA, Shergill S, Riecker A, Kircher TT (2011) Neuromagnetic oscillations and hemodynamic correlates of P50 suppression in schizophrenia. Psychiatry Res 194(1):95–104

    Article  PubMed  Google Scholar 

  • Mayer AR, Hanlon FM, Franco AR, Teshiba TM, Thoma RJ, Clark VP, Canive JM (2009) The neural networks underlying auditory sensory gating. Neuroimage 44(1):182–189

    Article  CAS  PubMed Central  PubMed  Google Scholar 

  • McCarley RW, Salisbury DF, Hirayasu Y, Yurgelun-Todd DA, Tohen M, Zarate C, Kikinis R, Jolesz FA, Shenton ME (2002) Association between smaller left posterior superior temporal gyrus volume on magnetic resonance imaging and smaller left temporal P300 amplitude in first-episode schizophrenia. Arch Gen Psychiatry 59(4):321–331

    Article  PubMed  Google Scholar 

  • Mobascher A, Warbrick T, Brinkmeyer J, Musso F, Stoecker T, Jon SN, Winterer G (2012) Nicotine effects on anterior cingulate cortex in schizophrenia and healthy smokers as revealed by EEG-informed fMRI. Psychiatry Res 204(2–3):168–177

    Article  CAS  PubMed  Google Scholar 

  • Mulert C, Jager L, Schmitt R, Bussfeld P, Pogarell O, Moller HJ, Juckel G, Hegerl U (2004) Integration of fMRI and simultaneous EEG: towards a comprehensive understanding of localization and time-course of brain activity in target detection. Neuroimage 22(1):83–94

    Article  PubMed  Google Scholar 

  • Mullinger K, Debener S, Coxon R, Bowtell R (2008) Effects of simultaneous EEG recording on MRI data quality at 1.5, 3 and 7 tesla. Int J Psychophysiol 67(3):178–188

    Article  PubMed  Google Scholar 

  • Näätänen R (1990) The role of attention in auditory information processing as revealed by event-related potentials and other brain measures of cognitive function. Behav and Brain Sci 13(2):201–288

    Article  Google Scholar 

  • Niedermeyer E, Lopes da Silva F (2005) Electroencephalography, basic principles, clinical applications, and related fields. In: Niedermeyer E, Lopes da Silva F (eds) vol 5. Lippincott WIlliams & Wilkins, Philadelphia

    Google Scholar 

  • Ogawa S, Lee TM, Kay AR, Tank DW (1990) Brain magnetic resonance imaging with contrast dependent on blood oxygenation. Proc Natl Acad Sci USA 87(24):9868–9872

    Article  CAS  PubMed Central  PubMed  Google Scholar 

  • Oranje B, Aggernaes B, Rasmussen H, Ebdrup BH, Glenthoj BY (2013) P50 suppression and its neural generators in antipsychotic-naïve, first-episode schizophrenia before and after 6 months of quetiapine treatment. Schizophr Bull 39(2):472–480

    Google Scholar 

  • Oranje B, Geyer MA, Kenemans JL, Verbaten MN (2006) Prepulse inhibition and P50 suppression: commonalities and dissociations. Psychiatry Res 143(2–3):147–158

    Article  PubMed  Google Scholar 

  • Pae JS, Kwon JS, Youn T, Park HJ, Kim MS, Lee B, Park KS (2003) LORETA imaging of P300 in schizophrenia with individual MRI and 128-channel EEG. Neuroimage 20(3):1552–1560

    Article  PubMed  Google Scholar 

  • Pfefferbaum A, Roth WT, Ford JM (1995) Event-related potentials in the study of psychiatric disorders. Arch Gen Psychiatry 52(7):559–563

    Article  CAS  PubMed  Google Scholar 

  • Raichle ME, Mintun MA (2006) Brain work and brain imaging. Annu Rev Neurosci 29:449–476

    Article  CAS  PubMed  Google Scholar 

  • Rasser PE, Schall U, Todd J, Michie PT, Ward PB, Johnston P, Helmbold K, Case V, Soyland A, Tooney PA, Thompson PM (2011) Gray matter deficits, mismatch negativity, and outcomes in schizophrenia. Schizophr Bull 37(1):131–140

    Article  CAS  PubMed Central  PubMed  Google Scholar 

  • Ritter P, Villringer A (2006) Simultaneous EEG-fMRI. Neurosci Biobehav Rev 30(6):823–838

    Article  PubMed  Google Scholar 

  • Scherg M (1990) Fundamentals of dipole source potential analysis. In: Grandori, F, Hoke M, Romani GL (eds) auditory evoked magnetic fields and electric potentials. Karger, Αdvanced Audiology 6, Basel, pp 40–69

    Google Scholar 

  • Scherg M, Ille N, Bornfleth H, Berg P (2002) Advanced tools for digital EEG review: virtual source montages, whole-head mapping, correlation, and phase analysis. J Clin Neurophysiol 19(2):91–112

    Article  PubMed  Google Scholar 

  • Scherg M, Picton TW (1991) Separation and identification of event-related potential components by brain electric source analysis. Electroencephalogr Clin Neurophysiol Suppl 42:24–37

    Google Scholar 

  • Sumich AL, Kumari V, Heasman BC, Gordon E, Brammer M (2006) Abnormal asymmetry of N200 and P300 event-related potentials in subclinical depression. J Affect Disord 92(2–3):171–183

    Article  PubMed  Google Scholar 

  • Tregellas JR, Davalos DB, Rojas DC, Waldo MC, Gibson L, Wylie K, Du YP, Freedman R (2007) Increased hemodynamic response in the hippocampus, thalamus and prefrontal cortex during abnormal sensory gating in schizophrenia. Schizophr Res 92(1–3):262–272

    Article  PubMed Central  PubMed  Google Scholar 

Download references

Acknowledgments

The authors have no conflicts of interest.

Author information

Authors and Affiliations

  1. Center for Clinical Intervention and Neuropsychiatric Schizophrenia Research (CINS), Copenhagen University Hospital, Psychiatric Center Glostrup, Glostrup, Denmark

    Nikolaj Bak & Bob Oranje

  2. Center for Neuropsychiatric Schizophrenia Research (CNSR), Copenhagen University Hospital, Psychiatric Center Glostrup, Glostrup, Denmark

    Nikolaj Bak & Bob Oranje

  3. Department of Neurology, Faculty of Health Sciences, Psychiatry, and Sensory Sciences, University of Copenhagen, Copenhagen, Denmark

    Bob Oranje

  4. Department of Psychiatry, Brain Center Rudolf Magnus, University Medical Center Utrecht, Heidelberglaan 100, 3584 CX, Utrecht, The Netherlands

    Bob Oranje

Authors
  1. Nikolaj Bak
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Bob Oranje
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Bob Oranje .

Editor information

Editors and Affiliations

  1. Department of Psychology,, Department of Psychology, Institute of Psychiatry, Psychology and Neuroscience, King’s College London, London, United Kingdom

    Veena Kumari

  2. Center for Neuropsych Research of Traumatic Stress, Charles University Department of Psychiatry, Prague, Czech Republic

    Petr Bob

  3. Department of Psychiatry and Neurosciences, Department of Psychiatry and Neurosciences, University of Missouri Kansas City (UMKC), Kansas City, Missouri, USA

    Nash N. Boutros

Rights and permissions

Reprints and permissions

Copyright information

© 2014 Springer-Verlag Berlin Heidelberg

About this chapter

Cite this chapter

Bak, N., Oranje, B. (2014). Psychophysiology-Informed (Multimodal) Imaging. In: Kumari, V., Bob, P., Boutros, N. (eds) Electrophysiology and Psychophysiology in Psychiatry and Psychopharmacology. Current Topics in Behavioral Neurosciences, vol 21. Springer, Cham. https://doi.org/10.1007/7854_2014_323

Download citation

Publish with us

Policies and ethics

Search

Navigation