Skip to main content
Log in

Diffusion tensor imaging shows white matter tracts between human auditory and visual cortex

  • Research Article
  • Published:
Experimental Brain Research Aims and scope Submit manuscript

Abstract

Although it is known that sounds can affect visual perception, the neural correlates for crossmodal interactions are still disputed. Previous tracer studies in non-human primates revealed direct anatomical connections between auditory and visual brain areas. We examined the structural connectivity of the auditory cortex in normal humans by diffusion-weighted tensor magnetic resonance imaging and probabilistic tractography. Tracts were seeded in Heschl’s region or the planum temporale. Fibres crossed hemispheres at the posterior corpus callosum. Ipsilateral fibres seeded in Heschl’s region projected to the superior temporal sulcus, the supramarginal gyrus and intraparietal sulcus and the occipital cortex including the calcarine sulcus. Fibres seeded in the planum temporale terminated primarily in the superior temporal sulcus, the supramarginal gyrus, the central sulcus and adjacent regions. Our findings suggest the existence of direct white matter connections between auditory and visual cortex—in addition to subcortical, temporal and parietal connections.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3

Similar content being viewed by others

References

  • Baumann O, Greenlee MW (2007) Neural correlates of coherent audiovisual motion perception. Cereb Cortex 17:1433–1443

    Article  PubMed  Google Scholar 

  • Baumann O, Mattingley JB (2010) Scaling of neural responses to visual and auditory motion in the human cerebellum. J Neurosci 30:4489–4495

    Article  PubMed  CAS  Google Scholar 

  • Bavelier D, Neville HJ (2002) Cross-modal plasticity: Where and how? Nat Rev Neurosci 3:443–452

    PubMed  CAS  Google Scholar 

  • Beauchamp MS (2005) See me, hear me, touch me: Multisensory integration in lateral occipital-temporal cortex. Curr Opin Neurobiol 15:145–153

    Article  PubMed  CAS  Google Scholar 

  • Beer AL, Röder B (2004) Unimodal and crossmodal effects of endogenous attention to visual and auditory motion. Cogn Affect Behav Neurosci 4:230–240

    Article  PubMed  Google Scholar 

  • Beer AL, Röder B (2005) Attending to visual or auditory motion affects perception within and across modalities: An event-related potential study. Eur J Neurosci 21:1116–1130

    Article  PubMed  Google Scholar 

  • Beer AL, Watanabe T (2009) Specificity of auditory-guided visual perceptual learning suggests crossmodal plasticity in early visual cortex. Exp Brain Res 198:353–361

    Article  PubMed  Google Scholar 

  • Beer AL, Watanabe T, Ni R, Sasaki Y, Andersen GJ (2009) 3D surface perception from motion involves a temporal-parietal network. Eur J Neurosci 30:703–713

    Article  PubMed  Google Scholar 

  • Beer AL, Batson MA, Watanabe T (2011) Multisensory perceptual learning reshapes both fast and slow mechanisms of crossmodal processing. Cogn Affect Behav Neurosci 11:1–12

    Article  PubMed  Google Scholar 

  • Behrens TE, Woolrich MW, Jenkinson M, Johansen-Berg H, Nunes RG, Clare S, Matthews PM, Brady JM, Smith SM (2003) Characterization and propagation of uncertainty in diffusion-weighted MR imaging. Magn Reson Med 50:1077–1088

    Article  PubMed  CAS  Google Scholar 

  • Behrens TE, Berg HJ, Jbabdi S, Rushworth MF, Woolrich MW (2007) Probabilistic diffusion tractography with multiple fibre orientations: What can we gain? Neuroimage 34:144–155

    Article  PubMed  CAS  Google Scholar 

  • Bremmer F, Schlack A, Shah NJ, Zafiris O, Kubischik M, Hoffmann K-P, Ziller K, Fink GR (2001) Polymodal motion processing in posterior parietal and premotor cortex: a human fMRI study strongly implies equivalencies between humans and monkeys. Neuron 29:287–296

    Article  PubMed  CAS  Google Scholar 

  • Büchel C, Price C, Frackowiak RSJ, Friston K (1998) Different activation patterns in the visual cortex of late and congenitally blind subjects. Brain 121:409–419

    Article  PubMed  Google Scholar 

  • Budinger E, Heil P, Hess A, Scheich H (2006) Multisensory processing via early cortical stages: Connections of the primary auditory cortical field with other sensory systems. Neuroscience 143:1065–1083

    Article  PubMed  CAS  Google Scholar 

  • Catani M, Howard RJ, Pajevic S, Jones DK (2002) Virtual in vivo interactive dissection of white matter fasciculi in the human brain. Neuroimage 17:77–94

    Article  PubMed  Google Scholar 

  • Catani M, Jones DK, Donato R, Ffytche DH (2003) Occipito-temporal connections in the human brain. Brain 126:2093–2107

    Article  PubMed  Google Scholar 

  • Celsis P, Boulanouar K, Doyon B, Ranjeva JP, Berry I, Nespoulous JL, Chollet F (1999) Differential fMRI responses in the left posterior superior temporal gyrus and left supramarginal gyrus to habituation and change detection in syllables and tones. Neuroimage 9:135–144

    Article  PubMed  CAS  Google Scholar 

  • Chao YP, Cho KH, Yeh CH, Chou KH, Chen JH, Lin CP (2009) Probabilistic topography of human corpus callosum using cytoarchitectural parcellation and high angular resolution diffusion imaging tractography. Hum Brain Mapp 30:3172–3187

    Article  PubMed  Google Scholar 

  • Dale AM, Fischl B, Sereno MI (1999) Cortical surface-based analysis. I. Segmentation and surface reconstruction. Neuroimage 9:179–194

    CAS  Google Scholar 

  • Desikan RS, Segonne F, Fischl B, Quinn BT, Dickerson BC, Blacker D, Buckner RL, Dale AM, Maguire RP, Hyman BT, Albert MS, Killiany RJ (2006) An automated labeling system for subdividing the human cerebral cortex on MRI scans into gyral based regions of interest. Neuroimage 31:968–980

    Article  PubMed  Google Scholar 

  • Dougherty RF, Ben-Shachar M, Bammer R, Brewer AA, Wandell BA (2005) Functional organization of human occipital-callosal fiber tracts. Proc Natl Acad Sci USA 102:7350–7355

    Article  PubMed  CAS  Google Scholar 

  • Eckert MA, Kamdar NV, Chang CE, Beckmann CF, Greicius MD, Menon V (2008) A cross-modal system linking primary auditory and visual cortices: evidence from intrinsic fMRI connectivity analysis. Hum Brain Mapp 29:848–857

    Article  PubMed  Google Scholar 

  • Eimer M (2001) Crossmodal links in spatial attention between vision, audition, and touch: Evidence from event-related brain potentials. Neuropsychologia 39:1292–1303

    Article  PubMed  CAS  Google Scholar 

  • Eriksson SH, Rugg-Gunn FJ, Symms MR, Barker GJ, Duncan JS (2001) Diffusion tensor imaging in patients with epilepsy and malformations of cortical development. Brain 124:617–626

    Article  PubMed  CAS  Google Scholar 

  • Falchier A, Clavagnier S, Barone P, Kennedy H (2002) Anatomical evidence of multimodal integration in primate striate cortex. J Neurosci 22:5749–5759

    PubMed  CAS  Google Scholar 

  • Fischl B, Dale AM (2000) Measuring the thickness of the human cerebral cortex from magnetic resonance images. Proc Natl Acad Sci USA 97:11050–11055

    Article  PubMed  CAS  Google Scholar 

  • Fischl B, Sereno MI, Dale AM (1999a) Cortical surface-based analysis. II: Inflation, flattening, and a surface-based coordinate system. Neuroimage 9:195–207

    CAS  Google Scholar 

  • Fischl B, Sereno MI, Tootell RB, Dale AM (1999b) High-resolution intersubject averaging and a coordinate system for the cortical surface. Hum Brain Mapp 8:272–284

    Article  PubMed  CAS  Google Scholar 

  • Fischl B, Liu A, Dale AM (2001) Automated manifold surgery: constructing geometrically accurate and topologically correct models of the human cerebral cortex. IEEE Trans Med Imaging 20:70–80

    Article  PubMed  CAS  Google Scholar 

  • Fischl B, Salat DH, Busa E, Albert M, Dieterich M, Haselgrove C, van der Kouwe A, Killiany R, Kennedy D, Klaveness S, Montillo A, Makris N, Rosen B, Dale AM (2002) Whole brain segmentation: automated labeling of neuroanatomical structures in the human brain. Neuron 33:341–355

    Article  PubMed  CAS  Google Scholar 

  • Fischl B, Salat DH, van der Kouwe AJ, Makris N, Segonne F, Quinn BT, Dale AM (2004a) Sequence-independent segmentation of magnetic resonance images. Neuroimage 23(1):S69–S84

    Article  PubMed  Google Scholar 

  • Fischl B, van der Kouwe A, Destrieux C, Halgren E, Segonne F, Salat DH, Busa E, Seidman LJ, Goldstein J, Kennedy D, Caviness V, Makris N, Rosen B, Dale AM (2004b) Automatically parcellating the human cerebral cortex. Cereb Cortex 14:11–22

    Article  PubMed  Google Scholar 

  • Foxe JJ, Schroeder CE (2005) The case for feedforward multisensory convergence during early cortical processing. Neuroreport 16:419–423

    Article  PubMed  Google Scholar 

  • Frassinetti F, Bolognini N, Ladavas E (2002) Enhancement of visual perception by crossmodal visuo-auditory interaction. Exp Brain Res 147:332–343

    Article  PubMed  Google Scholar 

  • Gelfand JR, Bookheimer SY (2003) Dissociating neural mechanisms of temporal sequencing and processing phonemes. Neuron 38:831–842

    Article  PubMed  CAS  Google Scholar 

  • Glasser MF, Rilling JK (2008) DTI tractography of the human brain’s language pathways. Cereb Cortex 18:2471–2482

    Article  PubMed  Google Scholar 

  • Gougoux F, Zatorre RJ, Lassonde M, Voss P, Lepore F (2005) A functional neuroimaging study of sound localization: visual cortex activity predicts performance in early-blind individuals. PLoS Biol 3:e27

    Article  PubMed  Google Scholar 

  • Jones DK, Williams SC, Gasston D, Horsfield MA, Simmons A, Howard R (2002) Isotropic resolution diffusion tensor imaging with whole brain acquisition in a clinically acceptable time. Hum Brain Mapp 15:216–230

    Article  PubMed  Google Scholar 

  • Kaas JH, Hackett TA (2000) Subdivisions of auditory cortex and processing streams in primates. Proc Natl Acad Sci USA 97:11793–11799

    Article  PubMed  CAS  Google Scholar 

  • Lee SK, Kim DI, Kim J, Kim DJ, Kim HD, Kim DS, Mori S (2005) Diffusion-tensor MR imaging and fiber tractography: a new method of describing aberrant fiber connections in developmental CNS anomalies. Radiographics 25:53–65 (discussion 66–58)

    Article  PubMed  Google Scholar 

  • Macaluso E, Frith CD, Driver J (2000) Modulation of human visual cortex by crossmodal spatial attention. Science 289:1206–1208

    Article  PubMed  CAS  Google Scholar 

  • Mazza V, Turatto M, Rossi M, Umiltà C (2007) How automatic are audiovisual links in exogenous spatial attention? Neuropsychologia 45:514–522

    Article  PubMed  Google Scholar 

  • McDonald JJ, Teder-Sälejärvi WA, Hillyard SA (2000) Involuntary orienting to sound improves visual perception. Nature 407:906–908

    Article  PubMed  CAS  Google Scholar 

  • McDonald JJ, Teder-Sälejärvi WA, Di Russo F, Hillyard SA (2003) Neural substrates of perceptual enhancement by cross-modal spatial attention. J Cogn Neurosci 15:10–19

    Article  PubMed  Google Scholar 

  • McDonald JJ, Teder-Sälejärvi WA, Di Russo F, Hillyard SA (2005) Neural basis of auditory-induced shifts in visual time-order perception. Nat Neurosci 8:1197–1202

    Article  PubMed  CAS  Google Scholar 

  • Meredith MA (2002) On the neuronal basis for multisensory convergence: A brief overview. Cogn Brain Res 14:31–40

    Article  Google Scholar 

  • Meredith MA, Stein BE (1986) Visual, auditory, and somatosensory convergence on cells in superior colliculus results in multisensory integration. J Neurophysiol 56:640–662

    PubMed  CAS  Google Scholar 

  • Meyer GF, Wuerger SM, Rohrbein F, Zetzsche C (2005) Low-level integration of auditory and visual motion signals requires spatial co-localisation. Exp Brain Res 166:538–547

    Article  PubMed  Google Scholar 

  • Meyer GF, Wuerger S, Greenlee M (2010) Interactions between auditory and visual semantic stimulus classes: evidence for common processing networks for speech and body actions. J Cogn Neurosci. doi:10.1162/jocn.2010.21593

  • Mori S (2007) Introduction to diffusion tensor imaging. Elsevier, Amsterdam

    Google Scholar 

  • Poirier C, Collignon O, De Volder AG, Renier L, Vanlierde A, Tranduy D, Scheiber C (2005) Specific activation of the V5 brain area by auditory motion processing: An fMRI study. Cogn Brain Res 25:650–658

    Article  Google Scholar 

  • Ramnani N, Behrens TEJ, Penny W, Matthews PM (2004) New approaches for exploring anatomical and functional connectivity in the human brain. Biol Psychiatry 56:613–619

    Article  PubMed  Google Scholar 

  • Rilling JK, Glasser MF, Preuss TM, Ma X, Zhao T, Hu X, Behrens TE (2008) The evolution of the arcuate fasciculus revealed with comparative DTI. Nat Neurosci 11:426–428

    Article  PubMed  CAS  Google Scholar 

  • Rockland KS, Ojima H (2003) Multisensory convergence in calcarine visual areas in macaque monkey. Int J Psychophysiol 50:19–26

    Article  PubMed  Google Scholar 

  • Röder B, Stock O, Bien S, Neville H, Rösler F (2002) Speech processing activates visual cortex in congenitally blind humans. Eur J Neurosci 16:930–936

    Article  PubMed  Google Scholar 

  • Segonne F, Dale AM, Busa E, Glessner M, Salat D, Hahn HK, Fischl B (2004) A hybrid approach to the skull stripping problem in MRI. Neuroimage 22:1060–1075

    Article  PubMed  CAS  Google Scholar 

  • Segonne F, Pacheco J, Fischl B (2007) Geometrically accurate topology-correction of cortical surfaces using nonseparating loops. IEEE Trans Med Imaging 26:518–529

    Article  PubMed  Google Scholar 

  • Sled JG, Zijdenbos AP, Evans AC (1998) A nonparametric method for automatic correction of intensity nonuniformity in MRI data. IEEE Trans Med Imaging 17:87–97

    Article  PubMed  CAS  Google Scholar 

  • Smith SM, Jenkinson M, Woolrich MW, Beckmann CF, Behrens TE, Johansen-Berg H, Bannister PR, De Luca M, Drobnjak I, Flitney DE, Niazy RK, Saunders J, Vickers J, Zhang Y, De Stefano N, Brady JM, Matthews PM (2004) Advances in functional and structural MR image analysis and implementation as FSL. Neuroimage 23(1):S208–S219

    Article  PubMed  Google Scholar 

  • Spence C, Driver J (1997) Audiovisual links in exogenous covert spatial orienting. Percept Psychophys 59:1–22

    Article  PubMed  CAS  Google Scholar 

  • Teder-Sälejärvi WA, Münte TF, Sperlich F-J, Hillyard SA (1999) Intra-modal and cross-modal spatial attention to auditory and visual stimuli. An event-related brain potential study. Cogn Brain Res 8:327–343

    Google Scholar 

  • Wakana S, Caprihan A, Panzenboeck MM, Fallon JH, Perry M, Gollub RL, Hua K, Zhang J, Jiang H, Dubey P, Blitz A, van Zijl P, Mori S (2007) Reproducibility of quantitative tractography methods applied to cerebral white matter. Neuroimage 36:630–644

    Article  PubMed  Google Scholar 

  • Wallace MT, Stein BE (2007) Early experience determines how the senses will interact. J Neurophysiol 97:921–926

    Article  PubMed  Google Scholar 

  • Weeks R, Horwitz B, Aziz-Sultan A, Tian B, Wessinger CM, Cohen LG, Hallett M, Rauschecker JP (2000) A positron emission tomographic study of auditory localization in the congenitally blind. J Neurosci 20:2664–2672

    PubMed  CAS  Google Scholar 

  • Woolrich MW, Jbabdi S, Patenaude B, Chappell M, Makni S, Behrens T, Beckmann C, Jenkinson M, Smith SM (2009) Bayesian analysis of neuroimaging data in FSL. Neuroimage 45:S173–S186

    Article  PubMed  Google Scholar 

Download references

Acknowledgments

This work was supported in part by the Deutsche Forschungsgemeinschaft (FOR 1075), the Bayerische Forschungsstiftung (BayernBrain 3T project) and the Elitenetzwerk Bayern. We thank an anonymous reviewer for valuable comments.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Anton L. Beer.

Electronic supplementary material

Below is the link to the electronic supplementary material.

Supplementary material 1 (PDF 976 kb)

Rights and permissions

Reprints and permissions

About this article

Cite this article

Beer, A.L., Plank, T. & Greenlee, M.W. Diffusion tensor imaging shows white matter tracts between human auditory and visual cortex. Exp Brain Res 213, 299–308 (2011). https://doi.org/10.1007/s00221-011-2715-y

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00221-011-2715-y

Keywords

Navigation