Abstract
Auditory and visual target locations are encoded differently in the brain, but must be co-calibrated to maintain cross-sensory concordance. Mechanisms that adjust spatial calibration across modalities have been described (for example, prism adaptation in owls), though rudimentarily in humans. We quantified the adaptation of human sound localization in response to spatially compressed vision (0.5× lenses for 2–3 days). This induced a corresponding compression of auditory localization that was most pronounced for azimuth (minimal for elevation) and was restricted to the visual field of the lenses. Sound localization was also affected outside the field of visual–auditory interaction (shifted centrally, not compressed). These results suggest that spatially modified vision induces adaptive changes in adult human sound localization, including novel mechanisms that account for spatial compression. Findings are consistent with a model in which the central processing of sound location is encoded by recruitment rather than by a place code.
Similar content being viewed by others
References
Knudsen, E.I. & Knudsen, P.F. Vision guides the adjustment of auditory localization in young barn owls. Science 230, 545–548 (1985).
Wallace, M.T., Meredith, M.A. & Stein, B.E. Multisensory integration in the superior colliculus of the alert cat. J. Neurophysiol. 80, 1006–1010 (1998).
Rauschecker, J.P. Compensatory plasticity and sensory substitution in the cerebral cortex. Trends Neurosci. 18, 36–43 (1995).
King, A.J., Hutchings, M.E., Moore, D.R. & Blakemore, C. Developmental plasticity in the visual and auditory representation in the mammalian superior colliculus. Nature 332, 73–76 (1988).
Lessard, N., Paré, M., Lepore, F. & Lassonde, M. Early-blind human subjects localize sound sources better than sighted subjects. Nature 395, 278–280 (1998).
Röder, B. et al. Improved auditory spatial tuning in blind humans. Nature 400, 162–166 (1999).
Zwiers, M.P., van Opstal, A.J. & Cruysberg, J.R. A spatial hearing deficit in early-blind humans. J. Neurosci. 21, RC142, 1–5 (2001).
Brainard, M.S. & Knudsen, E.I. Dynamics of visually guided auditory plasticity in the optic tectum of the barn owl. J. Neurophysiol. 73, 595–614 (1995).
Lackner, J.R. Influence of abnormal postural and sensory conditions on human sensorimotor localization. Environ. Biol. Med. 2, 137–177 (1976).
Shinn-Cunningham, B.G. Adapting to remapped auditory localization cues: a decision-theory model. Percept. Psychophys. 62, 33–47 (2000).
Shinn-Cunningham, B.G., Durlach, N.I. & Held, R.M. Adapting to supernormal auditory localization cues. II. Constraints on adaptation of mean response. J. Acoust. Soc. Am. 103, 3667–3676 (1998).
Blauert, J. Spatial Hearing: the Psychophysics of Human Sound Localization (MIT Press, Cambridge, Massachusetts, 1997).
Middlebrooks, J.C. Narrow-band sound localization related to external ear acoustics. J. Acoust. Soc. Am. 92, 2607–2624 (1992).
Hofman, P.M. & Van Opstal, A.J. Spectro-temporal factors in two-dimensional human sound localization. J. Acoust. Soc. Am. 103, 2634–2648 (1998).
Berthoz, A. & Jones, G.M. (eds.) Adaptive mechanisms in gaze control. in Reviews in Oculomotor Research Vol. 1 (Elsevier, Amsterdam, 1985).
Irvine, D.R.F. The auditory brainstem: a review of the structure and function of auditory brainstem processing mechanisms. in Progress in Sensory Physiology Vol. 7 (ed. Ottoson, D.) (Springer-Verlag, Berlin, 1986).
Wightman, F.L. & Kistler, D.J. Headphone simulation of free-field listening. I. Stimulus synthesis. J. Acoust. Soc. Am. 85, 858–867 (1989).
Wightman, F.L. & Kistler, D.J. Monaural sound localization revisited. J. Acoust. Soc. Am. 101, 1050–1063 (1997).
Zwiers, M.P., van Opstal, A.J. & Cruysberg, J.R. Two-dimensional sound-localization behavior of early-blind humans. Exp. Brain Res. 140, 206–222 (2001).
Goossens, H.H.L.M. & Van Opstal, A.J. Influence of head position on the spatial representation of acoustic targets. J. Neurophysiol. 81, 2720–2736 (1999).
Oldfield, S.R. & Parker, S.P. Acuity of sound localization. A topography of auditory space. III. Monaural hearing conditions. Perception 15, 67–81 (1986).
Hofman, P.M., Van Riswick, J.G. & Van Opstal, A.J. Relearning sound localization with new ears. Nat. Neurosci. 1, 417–421 (1998).
Good, M.D. & Gilkey, R.H. Sound localization in noise: the effect of signal-to-noise ratio. J. Acoust. Soc. Am. 99, 1108–1117 (1996).
Frens, M.A. & Van Opstal, A.J. Transfer of short-term adaptation in human saccadic eye movements. Exp. Brain Res. 100, 293–306 (1994).
Knudsen, E.I. & Knudsen, P.F. The sensitive period for auditory localization in barn owls is limited by age, not by experience. J. Neurosci. 6, 1918–1924 (1986).
Knudsen, E.I. Capacity for plasticity in the adult owl auditory system expanded by juvenile experience. Science 279, 1531–1533 (1998).
King, A.J. & Moore, D.R. Plasticity of auditory maps in the brain. Trends Neurosci. 14, 31–37 (1991).
Knudsen, E.I. & Brainard, M.S. Creating a unified representation of visual and auditory space in the brain. Annu. Rev. Neurosci. 18, 19–43 (1995).
Middlebrooks, J.C. & Knudsen, E.I. A neural code for auditory space in the cat's superior colliculus. J. Neurosci. 4, 2621–2634 (1984).
Hyde, P.S. & Knudsen, E.I. A topographic instructive signal guides the adjustment of the auditory space map in the optic tectum. J. Neurosci. 21, 8586–8593 (2001).
Wise, L.Z. & Irvine, D.R. Topographic organization of interaural intensity difference sensitivity in deep layers of cat superior colliculus: implications for auditory spatial representation. J. Neurophysiol. 54, 185–211 (1985).
Smith, P.H., Joris, P.X. & Yin, T.C. Projections of physiologically characterized spherical bushy cell axons from the cochlear nucleus of the cat: evidence for delay lines to the medial superior olive. J. Comp. Neurol. 331, 245–260 (1993).
Carr, C.E. & Boudreau, R.E. Organization of the nucleus magnocellularis and the nucleus laminaris in the barn owl: encoding and measuring interaural time differences. J. Comp. Neurol. 334, 337–355 (1993).
Paige, G., Telford, L., Seidman, S.H. & Barnes, G.R. Human vestibuloocular reflex and its interactions with vision and fixation distance during linear and angular head movement. J. Neurophysiol. 80, 2391–2404 (1998).
Acknowledgements
This research was supported by the Human Frontiers Science Program (RG0174/1998–B), National Institutes of Health grants AG16319, DC01935 and RR09283, the Centers for Visual Science and for Navigation and Communication Sciences, the Nijmegen Institute for Cognition and Information in the Netherlands (965NWOW2701 to M.P.Z.), and the Universities of Rochester, NY (G.D.P.) and Nijmegen, NL (M.P.Z. and J.V.O.). We would like to thank all subjects who participated in the experiments and L. Nagy, J. Housel and M. Gira for their technical assistance.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Competing interests
The authors declare no competing financial interests.
Rights and permissions
About this article
Cite this article
Zwiers, M., Van Opstal, A. & Paige, G. Plasticity in human sound localization induced by compressed spatial vision. Nat Neurosci 6, 175–181 (2003). https://doi.org/10.1038/nn999
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1038/nn999
- Springer Nature America, Inc.
This article is cited by
-
Audiovisual adaptation is expressed in spatial and decisional codes
Nature Communications (2022)
-
Distinct mechanisms govern recalibration to audio-visual discrepancies in remote and recent history
Scientific Reports (2019)
-
Peripheral sounds elicit stronger activity in contralateral occipital cortex in blind than sighted individuals
Scientific Reports (2019)
-
Stronger responses in the visual cortex of sighted compared to blind individuals during auditory space representation
Scientific Reports (2019)
-
Spatial and frequency specificity of the ventriloquism aftereffect revisited
Psychological Research (2019)