Skip to main content
SpringerLink
Log in

Multisensory integration in multiple reference frames in the posterior parietal cortex

  • Research Report
  • Published:
Cognitive Processing Aims and scope Submit manuscript

Abstract

Spatial information processing takes place in different brain regions that receive converging inputs from several sensory modalities. Because of our own movements—for example, changes in eye position, head rotations, and so forth—unimodal sensory representations move continuously relative to one another. It is generally assumed that for multisensory integration to be an orderly process, it should take place between stimuli at congruent spatial locations. In the monkey posterior parietal cortex, the ventral intraparietal (VIP) area is specialized for the analysis of movement information using visual, somatosensory, vestibular, and auditory signals. Focusing on the visual and tactile modalities, we found that in area VIP, like in the superior colliculus, multisensory signals interact at the single neuron level, suggesting that this area participates in multisensory integration. Curiously, VIP does not use a single, invariant coordinate system to encode locations within and across sensory modalities. Visual stimuli can be encoded with respect to the eye, the head, or halfway between the two reference frames, whereas tactile stimuli seem to be prevalently encoded relative to the body. Hence, while some multisensory neurons in VIP could encode spatially congruent tactile and visual stimuli independently of current posture, in other neurons this would not be the case. Future work will need to evaluate the implications of these observations for theories of optimal multisensory integration.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2a–c
Fig. 3a, b

Similar content being viewed by others

References

  • Andersen RA, Bracewell RM, Barash RM, Gnadt JW, Fogassi L (1990) Eye position effects on visual, memory, and saccade-related activity in areas LIP and 7a of the macaque. J Neurosci 66:1176–1196

    Google Scholar 

  • Bell AH, Corneil BD, Meredith MA, Munoz DP (2001) The influence of stimulus properties on multisensory processing in the awake primate superior colliculus. Can J Exp Psychol 55:125–134

    Google Scholar 

  • Bremmer F, Schlack A, Jon Shah N, Zafiris O, Kubischik M, Hoffmann K-P, Zilles K, Fink GR (2001) Polymodal motion processing in posterior parietal and premotor cortex: a human fMRI study strongly implies equivalencies between humans ans monkeys. Neuron 29:287–296

    Article  CAS  PubMed  Google Scholar 

  • Bremmer F, Klam F, Duhamel J-R, Ben Hamed S, Graf W (2002) Visual-vestibular interactive responses in the macaque ventral intraparietal area (VIP). Eur J Neurosci 16:1569–1586

    Article  PubMed  Google Scholar 

  • Bruce C, Desimone R, Gross CG (1981) Visual properties of neurons in a polysensory area in superior temporal sulcus of the macaque. J Neurophysiol 46:369–384

    CAS  PubMed  Google Scholar 

  • Calvert GA, Bullmore ET, Brammer MJ, Campbell R, Williams SC, McGuire PK, Woodruff PW, Iversen SD, David AS (1997) Activation of auditory cortex during silent lipreading. Science 276:593–596

    Article  CAS  PubMed  Google Scholar 

  • Calvert GA, Hansen PC, Iversen SD, Brammer MJ (2001) Detection of audio-visual integration sites in humans by application of electrophysiological criteria to the BOLD effect. NeuroImage 14:427–438

    Article  CAS  PubMed  Google Scholar 

  • Cavada C (2001) The visual parietal areas in the macaque monkey: current structural knowledge and ignorance. NeuroImage 14:S21–S26

    Article  CAS  PubMed  Google Scholar 

  • Colby CL, Duhamel J-R (1991) Heterogeneity of extrastriate visual areas and multiple parietal areas in the macaque monkey. Neuropsychologia 6:517–537

    Article  Google Scholar 

  • Colby CL, Duhamel J-R, Goldberg ME (1993) Ventral intraparietal area of the macaque: anatomic location and visual response properties. J Neurophysiol 69:902–914

    CAS  PubMed  Google Scholar 

  • Cooke DF, Taylor CSR, Moore T, Graziano MSA (2003) Complex movements evoked by microstimulation of the ventral intraparietal area. Proc Natl Acad Sci U S A 100:6163–6168

    Article  CAS  PubMed  Google Scholar 

  • Deneve S, Pouget A (2001) Efficient computation and cue integration with noisy population codes. Nat Neurosci 4:826–831

    Article  CAS  PubMed  Google Scholar 

  • Duhamel J-R, Colby CL, Goldberg ME (1991) Congruent representations of visual and somatosensory space single neurons of monkey ventral intra-parietal cortex (area VIP). In: Paillard J (ed) Brain and space. Oxford University Press, Oxford, pp 223–236

  • Duhamel J-R, Bremmer F, BenHamed S, Graf W (1997) Spatial invariance of visual receptive fields in parietal cortex neurons. Nature 389:845–848

    Article  CAS  PubMed  Google Scholar 

  • Duhamel J-R, Colby CL, Goldberg ME (1998) Ventral intraparietal area of the macaque: congruent visual and somatic response properties. J Neurophysiol 79:126–136

    CAS  PubMed  Google Scholar 

  • Fogassi L, Gallese V, Di Pellegrino G, Fadiga L, Gentilucci M, Luppino G, Pedotti A, Rizzolatti G (1992) Space coding by premotor cortex. Exp Brain Res 89:686–690

    CAS  PubMed  Google Scholar 

  • Fogassi L, Gallese V, Fadiga L, Luppino G, Matelli M, Rizzolatti G (1996) Coding of peripersonal space in inferior premotor cortex (area F4). J Neurophysiol 76:141–157

    CAS  PubMed  Google Scholar 

  • Foxe JJ, Wylie GR, Martinez A, Schroeder CE, Javitt DC, Guilfoyle D, Ritter W, Murray MM (2002) Auditory-somatosensory multisensory processing in auditory association cortex: an fMRI study. J Neurophysiol 88:540–543

    PubMed  Google Scholar 

  • Galletti C, Battaglini PP, Fattori P (1993) Parietal neurons encoding spatial locations in craniotopic coordinates. Exp Brain Res 96:221–229

    CAS  PubMed  Google Scholar 

  • Gentilucci M, Scandolara C, Pigarev IN, Rizzolatti G (1983) Visual responses in the postarcuate cortex (area 6) of the monkey that are independent of eye position. Exp Brain Res 50:464–468

    CAS  PubMed  Google Scholar 

  • Graziano MSA, Gross CG (1994) The representation of extrapersonal space: a possible role for bimodal, visual-tactile neurons. In: Gazzaniga MS (ed) The cognitive neurosciences. MIT Press, Cambridge, Mass., pp 1021–1034

  • Graziano MSA, Yap GS, Gross CG (1994) Coding of visual space by premotor neurons. Science 266:1054–1057

    CAS  PubMed  Google Scholar 

  • Iriki A, Tanaka M, Iwamura Y (1996) Coding of modified body schema during tool use by macaque postcentral neurones. Neuroreport 7:2325–2330

    CAS  PubMed  Google Scholar 

  • Jay MF, Sparks DL (1987) Sensorimotor integration in the primate superior colliculus. II. Coordinates of auditory signals. J Neurophysiol 57:35–55

    CAS  PubMed  Google Scholar 

  • Jousmaki V, Hari R (1998) Parchment-skin illusion: sound-biased touch. Curr Biol 8:R190

    CAS  PubMed  Google Scholar 

  • Lewis JW, Van Essen DC (2000) Corticocortical connections of visual, sensorimotor, and multimodal processing areas in the parietal lobe of the macaque monkey. J Comp Neurol 428:112–137

    Article  CAS  PubMed  Google Scholar 

  • Luppino G, Murata A, Govoni P, Matelli M (1999) Largely segregated parietofrontal connections linking rostral intraparietal cortex (areas AIP and VIP) and the ventral premotor cortex (areas F5 ans F4). Exp Brain Res 128:181–187

    Article  CAS  PubMed  Google Scholar 

  • Macaluso E, Frith CD, Driver J (2000) Modulation of human visual cortex by crossmodal spatial attention. Science 289:1206–1208

    Article  CAS  PubMed  Google Scholar 

  • Macaluso E, Frith CD, Driver J (2002) Crossmodal spatial influences of touch on extrastriate visual areas take current gaze direction into account. Neuron 34:647–658

    Article  CAS  PubMed  Google Scholar 

  • Matelli M, Govoni P, Galletti C, Kutz DF, Luppino G (1998) Superior area 6 afferents from the superior parietal lobule in the macaque monkey. J Comp Neurol 402:327–352

    Article  CAS  PubMed  Google Scholar 

  • Maunsell JHR, Van Essen DC (1983) The connections of the middle temporal visual area (MT) and their relationship to a cortical hierarchy in the macaque monkey. J Neurosci 3:2563–2580

    CAS  PubMed  Google Scholar 

  • McGurk J, MacDonald H (1976) Hearing lips and seeing voices. Nature 264:746–748

    CAS  PubMed  Google Scholar 

  • Meredith MA, Stein BE (1983) Interactions among converging sensory inputs in the superior colliculus. Science 221:389–391

    CAS  PubMed  Google Scholar 

  • Meredith MA, Stein BE (1986a) Spatial factors determine the activity of multisensory neurons in cat superior colliculus. Brain Res 365:350–354

    Article  CAS  PubMed  Google Scholar 

  • Meredith MA, Stein BE (1986b) Visual, auditory, and somatosensory convergence on cells in superior colliculus results in multisensory integration. J Neurophysiol 56:640–662

    CAS  PubMed  Google Scholar 

  • Meredith MA, Stein BE (1996) Spatial determinants of multisensory integration in cat superior colliculus neurons. J Neurophysiol 75:1843–1857

    CAS  PubMed  Google Scholar 

  • Meredith MA, Nemitz JW, Stein BE (1987) Determinants of multisensory integration in superior colliculus neurons. I. Temporal factors. J Neurosci 7:3215–3229

    CAS  PubMed  Google Scholar 

  • Neppi-Mòdona M, Auclair D, Sirigu A, Duhamel J-R (2004) Spatial coding of the predicted impact location of a looming object. Curr Biol (in press)

  • Pouget A, Sejnowski TJ (2001) Simulating a lesion in a basis function model of spatial representations: comparison with hemineglect. Psychol Rev 108:653–673

    Article  CAS  PubMed  Google Scholar 

  • Pouget A, Deneve S, Duhamel J-R (2002) A computational perspective on the neural basis of multisensory spatial representations. Nat Rev Neurosci 3:741–747

    Article  CAS  PubMed  Google Scholar 

  • Rizzolatti G, Scandolara C, Matelli M, Gentilucci M (1981) Afferent properties of periarcuate neurons in macaque monkeys I. Somatosensory responses. Behav Brain Res 2:125–146

    Article  CAS  PubMed  Google Scholar 

  • Schaafsma SJ, Duysens J (1996) Neurons in the ventral intraparietal area of awake macaque monkey closely resemble neurons in the dorsal part of the medial superior temporal area in their responses to optic flow patterns. J Neurophysiol 76:4056–4068

    CAS  PubMed  Google Scholar 

  • Schlack A, Hoffmann K-P, Bremmer F (2003) Selectivity of macaque area VIP for smooth pursuit eye movements. J Neurophysiol

  • Spence C, Driver J (2002) Crossmodal space and crossmodal attention. Oxford University Press, Oxford

  • Stein BE, Meredith MA (1993) The merging of the senses. MIT Press/Bradford Books, Cambridge, Mass.

  • Stricanne B, Andesen RA, Mazzoni P (1996) Eye-centered, head-centered, and intermediate coding of remembered sound locations in area LIP. J Neurophysiol 76:2071–2076

    CAS  PubMed  Google Scholar 

  • Wallace MT, Meredith MA, Stein BE (1992) Integration of multiple sensory modalities in cat cortex. Exp Brain Res 91:484–488

    CAS  PubMed  Google Scholar 

  • Wallace MT, Wilkinson LK, Stein BE (1996) Representation and integration of multiple sensory inputs in primate superior colliculus. J Neurophysiol 76:1246–1266

    CAS  PubMed  Google Scholar 

  • Zipser D, Andersen RA (1988) A back-propagation programmed network that simulates response properties of a subset of posterior parietal neurons. Nature 331:679–684

    Article  CAS  PubMed  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Institut des Sciences Cognitives, CNRS, 67 Bd Pinel, 69675, Bron, France

    Marie Avillac, Sophie Denève, Suliann Ben Hamed & Jean-René Duhamel

  2. Gatsby Computational Unit, University College London, Queen Square, London, UK

    Sophie Denève

  3. Laboratoire de Neurophysiologie, Université Catholique de Louvain, Brussels, Belgium

    Etienne Olivier

Authors
  1. Marie Avillac
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Etienne Olivier
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Sophie Denève
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Suliann Ben Hamed
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Jean-René Duhamel
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jean-René Duhamel.

Additional information

Edited by: Marie-Hélène Giard and Mark Wallace

Rights and permissions

Reprints and permissions

About this article

Cite this article

Avillac, M., Olivier, E., Denève, S. et al. Multisensory integration in multiple reference frames in the posterior parietal cortex. Cogn Process 5, 159–166 (2004). https://doi.org/10.1007/s10339-004-0021-3

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10339-004-0021-3

Keywords

Search

Navigation