Abstract
To be aware of and to move one’s body, the brain must maintain a coherent representation of the body. While the body and the brain are connected by dense ascending and descending sensory and motor pathways, representation of the body is not hardwired. This is demonstrated by the well-known rubber hand illusion in which a visible fake hand is erroneously felt as one’s own hand when it is stroked in synchrony with the viewer’s unseen actual hand. Thus, body representation in the brain is not mere maps of tactile and proprioceptive inputs, but a construct resulting from the interpretation and integration of inputs across sensory modalities.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Alais D, Burr D (2004) Ventriloquist effect results from near-optimal bimodal integration. Curr Biol 14(3):257–262. https://doi.org/10.1016/S0960-9822(04)00043-0
Antal, Haans Wijnand A., IJsselsteijn Yvonne A.W., de Kort (2008) The effect of similarities in skin texture and hand shape on perceived ownership of a fake limb Body Image 5(4) 389–394 https://doi.org/10.1016/j.bodyim.2008.04.003
Austen EL, Soto-Faraco S, Enns JT, Kingstone A (2004) Mislocalizations of touch to a fake hand. Cogn Affect Behav Neurosci 4(2):170–181. https://doi.org/10.3758/CABN.4.2.170
Avillac M, Deneve S, Olivier E, Pouget A, Duhamel JR (2005) Reference frames for representing visual and tactile locations in parietal cortex. Nat Neurosci 8(7):941–949. https://doi.org/10.1038/nn1480
Avillac M, Ben Hamed S, Duhamel JR (2007) Multisensory integration in the ventral intraparietal area of the macaque monkey. J Neuroscience 27(8):1922–1932. https://doi.org/10.1523/jneurosci.2646-06.2007
Blanke O, Slater M, Serino A (2015) Behavioral, neural, and computational principles of bodily self-consciousness. Neuron 88(1):145–166. https://doi.org/10.1016/j.neuron.2015.09.029
Botvinick M, Cohen J (1998) Rubber hands ‘feel’ touch that eyes see. Nature 1998 391:6669 391(6669):756–756. https://doi.org/10.1038/35784
Brozzoli C, Gentile G, Petkova VI, Ehrsson HH (2011) FMRI adaptation reveals a cortical mechanism for the coding of space near the hand. J Neurosci 31(24):9023–9031. https://doi.org/10.1523/JNEUROSCI.1172-11.2011
Brozzoli C, Gentile G, Ehrsson HH (2012) That's near my hand! Parietal and premotor coding of hand-centered space contributes to localization and self-attribution of the hand. J Neurosci 32(42):14573–14582. https://doi.org/10.1523/jneurosci.2660-12.2012
Buxbaum LJ, Coslett HB (2010) Specialised structural descriptions for human body parts: evidence from autotopagnosia. Cogn Neuropsychol 18(4):289–306. https://doi.org/10.1080/02643290126172
Cooke DF, Graziano MS (2003) Defensive movements evoked by air puff in monkeys. J Neurophysiol 90(5):3317–3329. https://doi.org/10.1152/jn.00513.2003
Cooper LA, Shepard RN (1975) Mental transformation in the identification of left and right hands. J Exp Psychol Hum Percept Perform 1(1):48–56. https://doi.org/10.1037/0096-1523.1.1.48
Costantini M, Haggard P (2007) The rubber hand illusion: sensitivity and reference frame for body ownership. Conscious Cogn 16(2):229–240. https://doi.org/10.1016/j.concog.2007.01.001
David R., Wozny Ulrik R., Beierholm Ladan, Shams (2010) Probability Matching as a Computational Strategy Used in Perception PLoS Computational Biology 6(8):e1000871. https://doi.org/10.1371/journal.pcbi.1000871
Ehrsson HH, Spence C, Passingham RE (2004) That’s my hand! Activity in premotor cortex reflects feeling of ownership of a limb. Science 305(5685):875–877. https://doi.org/10.1126/SCIENCE.1097011
Ehrsson HH, Holmes NP, Passingham RE (2005) Touching a rubber hand: feeling of body ownership is associated with activity in multisensory brain areas. J Neurosci 25(45):10564–10573. https://doi.org/10.1523/JNEUROSCI.0800-05.2005
Ernst MO, Banks MS (2002) Humans integrate visual and haptic information in a statistically optimal fashion. Nature 415(6870):429–433. https://doi.org/10.1038/415429a
Ernst MO, Bülthoff HH (2004) Merging the senses into a robust percept. Trends Cogn Sci 8(4):162–169. https://doi.org/10.1016/j.tics.2004.02.002
Fang W, Li J, Qi G, Li S, Sigman M, Wang L (2019) Statistical inference of body representation in the macaque brain. Proc Natl Acad Sci U S A 116(40):20151–20157. https://doi.org/10.1073/PNAS.1902334116/-/DCSUPPLEMENTAL
Farmer H, Tajadura-Jiménez A, Tsakiris M (2012) Beyond the colour of my skin: how skin colour affects the sense of body-ownership. Conscious Cogn 21(3):1242–1256. https://doi.org/10.1016/j.concog.2012.04.011
Farmer H, Maister L, Tsakiris M (2014) Change my body, change my mind: the effects of illusory ownership of an outgroup hand on implicit attitudes toward that outgroup. Front Psychol 4(JAN):1016. https://doi.org/10.3389/FPSYG.2013.01016/BIBTEX
Fogassi L, Gallese V, Fadiga L, Luppino G, Matelli M, Rizzolatti G (1996) Coding of peripersonal space in inferior premotor cortex (area F4). J Neurophysiol 76(1):141–157. https://doi.org/10.1152/jn.1996.76.1.141
French RL, DeAngelis GC (2020) Multisensory neural processing: from cue integration to causal inference. Curr Opin Physio 16:8–13. https://doi.org/10.1016/j.cophys.2020.04.004
Gentile G, Petkova VI, Ehrsson HH (2011) Integration of visual and tactile signals from the hand in the human brain: an FMRI study. J Neurophysiol 105(2):910–922. Retrieved from http://jn.physiology.org/content/105/2/910.full.pdf
Graziano MSA (1999) Where is my arm? The relative role of vision and proprioception in the neuronal representation of limb position. Proc Natl Acad Sci U S A 96(18):10418–10421. https://doi.org/10.1073/pnas.96.18.10418
Graziano MSA (2000) Coding the location of the arm by sight. Science 290(5497):1782–1786. https://doi.org/10.1126/science.290.5497.1782
Graziano MS, Cooke DF (2006) Parieto-frontal interactions, personal space, and defensive behavior. Neuropsychologia 44(13):2621–2635. Retrieved from https://www.ncbi.nlm.nih.gov/pubmed/17128446
Graziano MS, Yap GS, Gross CG (1994) Coding of visual space by premotor neurons. Science 266(5187):1054–1057. https://doi.org/10.1126/science.7973661
Graziano MS, Hu XT, Gross CG (1997) Visuospatial properties of ventral premotor cortex. J Neurophysiol 77(5):2268–2292. https://doi.org/10.1152/jn.1997.77.5.2268
Graziano MS, Reiss LA, Gross CG (1999) A neuronal representation of the location of nearby sounds. Nature 397(6718):428–430. https://doi.org/10.1038/17115
Head and Holmes (1911) Sensory Disturbances From Cerebral Lesions Brain 34(2–3):102–254. https://doi.org/10.1093/brain/34.2-3.102
Holmes NP, Spence C (2005) Visual bias of unseen hand position with a mirror: spatial and temporal factors. Exp Brain Res 166(3–4):489–497. https://doi.org/10.1007/s00221-005-2389-4
Holmes NP, Crozier G, Spence C (2004) When mirrors lie: “visual capture” of arm position impairs reaching performance. Cogn Affect Behav Neurosci 4(2):193–200. https://doi.org/10.3758/CABN.4.2.193
Holmes NP, Snijders HJ, Spence C (2006) Reaching with alien limbs: visual exposure to prosthetic hands in a mirror biases proprioception without accompanying illusions of ownership. Perception & Psychophysics 2006 68:4 68(4):685–701. https://doi.org/10.3758/BF03208768
Ide M (2013) The effect of “anatomical plausibility” of hand angle on the rubber-hand illusion. Perception 42:103–111. https://doi.org/10.1068/p7322
Iriki A, Tanaka M, Iwamura Y (1996) Coding of modified body schema during tool use by macaque postcentral neurones. Neuroreport 7(14):2325–2330. Retrieved from http://www.ncbi.nlm.nih.gov/pubmed/8951846
Jiang HH, Hu YZ, Wang JH, Ma YY, Hu XT (2013) Visuospatial properties of caudal area 7b in Macaca fascicularis. Dongwuxue Yanjiu 34(E2):E50–E61. https://doi.org/10.3724/SP.J.1141.2013.E02E50
Kilteni K, Maselli A, Kording KP, Slater M (2015) Over my fake body: body ownership illusions for studying the multisensory basis of own-body perception. Front Hum Neurosci 9(MAR):141. https://doi.org/10.3389/FNHUM.2015.00141/BIBTEX
Körding KP, Beierholm U, Ma WJ, Quartz S, Tenenbaum JB, Shams L (2007) Causal inference in multisensory perception. PLoS One 2(9):e943. https://doi.org/10.1371/journal.pone.0000943
Làdavas et al. (1998) Visual peripersonal space centred on the face in humans Brain 121(12):2317–2326. https://doi.org/10.1093/brain/121.12.2317
Leinonen L (1980) Functional properties of neurones in the posterior part of area 7 in awake monkey. Acta Physiol Scand 108(3):301–308. https://doi.org/10.1111/j.1748-1716.1980.tb06536.x
Liu Y, Medina J (2017) Influence of the body schema on multisensory integration: evidence from the Mirror box illusion. Scientific Reports 2017 7:1 7(1):1–11. https://doi.org/10.1038/s41598-017-04797-0
Liu Y, Medina J (2018) Integrating multisensory information across external and motor-based frames of reference. Cognition 173:75–86. https://doi.org/10.1016/j.cognition.2018.01.005
Lloyd DM (2007) Spatial limits on referred touch to an alien limb may reflect boundaries of visuo-tactile peripersonal space surrounding the hand. Brain Cogn 64(1):104–109. https://doi.org/10.1016/j.bandc.2006.09.013
Lloyd D, Morrison I, Roberts N (2006) Role for human posterior parietal cortex in visual processing of aversive objects in peripersonal space. J Neurophysiol 95(1):205–214. https://doi.org/10.1152/jn.00614.2005
Makin TR, Holmes NP, Zohary E (2007) Is that near my hand? Multisensory representation of peripersonal space in human intraparietal sulcus. J Neurosci 27(4):731–740. https://doi.org/10.1523/JNEUROSCI.3653-06.2007
Makin TR, Holmes NP, Ehrsson HH (2008) On the other hand: dummy hands and peripersonal space. Behav Brain Res 191(1):1–10. https://doi.org/10.1016/j.bbr.2008.02.041
Medina J, Khurana P, Coslett HB (2015) The influence of embodiment on multisensory integration using the mirror box illusion. Conscious Cogn 37:71–82. https://doi.org/10.1016/j.concog.2015.08.011
Meredith MA, Nemitz JW, Stein BE (1987) Determinants of multisensory integration in superior colliculus neurons. I. Temporal factors. J Neurosci 7(10):3215–3229. doi: citeulike-article-id:409430
Meredith MA, Stein BE (1986) Spatial factors determine the activity of multisensory neurons in cat superior colliculus. Brain Res 5:350–354. https://doi.org/10.1016/0006-8993(86)91648-3
Mountcastle VB, Lynch JC, Georgopoulos A, Sakata H, Acuna C (1975) Posterior parietal association cortex of the monkey: command functions for operations within extrapersonal space. J Neurophysiol 38(4):871–908. Retrieved from http://www.ncbi.nlm.nih.gov/pubmed/808592
Noel JP, Blanke O, Serino A (2018) From multisensory integration in peripersonal space to bodily self-consciousness: from statistical regularities to statistical inference. Ann N Y Acad Sci 1426(1):146–165. https://doi.org/10.1111/nyas.13867
Parsons LM (1994) Temporal and kinematic properties of motor behavior reflected in mentally simulated action. J Exp Psychol Hum Percept Perform 20(4):709–730. https://doi.org/10.1037/0096-1523.20.4.709
Parsons (1987) Imagined spatial transformation of one’s body. Journal of Experimental Psychology: General 116(2):172–191. https://doi.org/10.1037/0096-3445.116.2.172
Pavani and Zampini (2007) The Role of Hand Size in the Fake-Hand Illusion Paradigm Perception 36(10):1547–1554. https://doi.org/10.1068/p5853
Peck TC, Seinfeld S, Aglioti SM, Slater M (2013) Putting yourself in the skin of a black avatar reduces implicit racial bias. Conscious Cogn 22(3):779–787. https://doi.org/10.1016/j.concog.2013.04.016
Ramachandran and Rogers-Ramachandran (1996) Synaesthesia in phantom limbs induced with mirrors Proceedings of the Royal Society of London. Series B: Biological Sciences 263(1369):377–386. https://doi.org/10.1098/rspb.1996.0058
Rideaux R, Storrs KR, Maiello G, Welchman AE (2021) How multisensory neurons solve causal inference. Proc Natl Acad Sci U S A 118(32):e2106235118. https://doi.org/10.1073/pnas.2106235118
Samad M, Chung AJ, Shams L (2015) Perception of body ownership is driven by Bayesian sensory inference. PLoS One 10(2):1–23. https://doi.org/10.1371/journal.pone.0117178
Schlack A, Sterbing-D'Angelo SJ, Hartung K, Hoffmann KP, Bremmer F (2005) Multisensory space representations in the macaque ventral intraparietal area. J Neurosci 25(18):4616–4625. https://doi.org/10.1523/JNEUROSCI.0455-05.2005
Schwoebel J, Coslett HB (2005) Evidence for multiple, distinct representations of the human body. J Cogn Neurosci 17(4):543–553. https://doi.org/10.1162/0898929053467587
Sereno MI, Huang RS (2006) A human parietal face area contains aligned head-centered visual and tactile maps. Nat Neurosci 9(10):1337–1343. https://doi.org/10.1038/nn1777
Shams L, Beierholm UR (2010) Causal inference in perception. Trends Cogn Sci 14(9):425–432. https://doi.org/10.1016/j.tics.2010.07.001
Spence C, Pavani F, Driver J (2004) Spatial constraints on visual-tactile cross-modal distractor congruency effects. Cogn Affect Behav Neurosci 4(2):148–169. https://doi.org/10.3758/CABN.4.2.148
Stein BE, Stanford TR (2008) Multisensory integration: current issues from the perspective of the single neuron. Nat Rev Neurosci 9(4):255–266. https://doi.org/10.1038/nrn2331
Tsakiris M (2010) My body in the brain: a neurocognitive model of body-ownership. Neuropsychologia 48(3):703–712. https://doi.org/10.1016/j.neuropsychologia.2009.09.034
Tsakiris M, Haggard P (2005) The rubber hand illusion revisited: Visuotactile integration and self-attribution. J Exp Psychol Hum Percept Perform 31(1):80–91. https://doi.org/10.1037/0096-1523.31.1.80
Tsakiris M, Hesse MD, Boy C, Haggard P, Fink GR (2007) Neural signatures of body ownership: a sensory network for bodily self-consciousness. Cereb Cortex 17(10):2235–2244. https://doi.org/10.1093/cercor/bhl131
Tsakiris M, Costantini M, Haggard P (2008) The role of the right temporo-parietal junction in maintaining a coherent sense of one’s body. Neuropsychologia 46(12):3014–3018. https://doi.org/10.1016/j.neuropsychologia.2008.06.004
Tsakiris M, Carpenter L, James D, Fotopoulou A (2010) Hands only illusion: multisensory integration elicits sense of ownership for body parts but not for non-corporeal objects. Exp Brain Res 204(3):343–352. https://doi.org/10.1007/s00221-009-2039-3
Van Beers RJ, Sittig AC, Denier Van Der Gon JJ (1999) Integration of proprioceptive and visual position-information: an experimentally supported model. J Neurophysiol 81(3):1355–1364. https://www.ncbi.nlm.nih.gov/pubmed/10085361
Witten IB, Knudsen EI (2005) Why seeing is believing: merging auditory and visual worlds. Neuron 48(3):489–496. https://doi.org/10.1016/j.neuron.2005.10.020
Wozny DR, Beierholm UR, Shams L (2008) Human trimodal perception follows optimal statistical inference. J Vis 8(3):24. https://doi.org/10.1167/8.3.24
Zapparoli L, Invernizzi P, Gandola M, Berlingeri M, De Santis A, Zerbi A et al (2014) Like the back of the (right) hand? A new fMRI look on the hand laterality task. Exp Brain Res 232(12):3873–3895
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this chapter
Cite this chapter
Fang, W., Liu, Y., Wang, L. (2024). Multisensory Integration in Body Representation. In: Gu, Y., Zaidel, A. (eds) Advances of Multisensory Integration in the Brain. Advances in Experimental Medicine and Biology, vol 1437. Springer, Singapore. https://doi.org/10.1007/978-981-99-7611-9_5
Download citation
DOI: https://doi.org/10.1007/978-981-99-7611-9_5
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-99-7610-2
Online ISBN: 978-981-99-7611-9
eBook Packages: Biomedical and Life SciencesBiomedical and Life Sciences (R0)