Skip to main content
SpringerLink
Log in

Grounded Internal Body Models for Communication: Integration of Sensory and Motor Spaces for Mediating Conceptualization

  • Chapter
  • First Online:
Language Grounding in Robots

  • 1004 Accesses

Abstract

An internal model of the own body is a central and early representation, which is first used for motor control and then for planning ahead using internal simulation. The body model is also important for the conceptualization of actions for language, not only when performed by oneself but also when used in a cooperative scenario. This chapter focusses on how this internal model can be recruited in order to mediate between different sensory domains, as it is necessary to connect, e.g., the proprioceptive space when performing an action with a visual space, when seeing an action, in order to constitute a comprehensive conceptualization. The article introduces the biologically inspired neural network approach which can subserve these different functions in different contexts.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  • Barsalou LW (2008) Grounded cognition. Annual Review of Psychology 59:617– 645

    Article  Google Scholar 

  • van Beers R, Wolpert D, Haggard P (2002) When feeling is more important than seeing in sensorimotor adaptation. Current Biology 12:834–837

    Article  Google Scholar 

  • Bernstein NA (1967) The Co-ordination and regulation of movements. Pergamon Press Ltd., Oxford

    Google Scholar 

  • Botvinick M, Cohen J (1998) Rubber hands ‘feel’ touch that eyes see. Nature 391(6669):756–756

    Article  Google Scholar 

  • Buccino G, Binkofski F, Fink GR, Fadiga L, Fogassi L, Gallese V, Seitz RJ, Zilles

    Google Scholar 

  • K, Rizzolatti G, Freund HJ (2001) Action observation activates premotor and parietal areas in a somatotopic manner: an fMRI study. European Journal of Neuroscience 13(2):400–404

    Google Scholar 

  • Cimpian A, Markman EM (2009) Information learned from generic language becomes central to children’s biological concepts: evidence from their open-ended explanations. Cognition 113(1):14–25

    Article  Google Scholar 

  • Cruse H (1999) Feeling our body - the basis of cognition? Evolution and Cognition 5(2):162–173

    Google Scholar 

  • Decety J, Grezes J (1999) Neural mechanisms subserving the perception of human actions. Trends in Cognitive Sciences 3(5):172–178

    Article  Google Scholar 

  • Desmurget M, Grafton S (2000) Forward modeling allows feedback control for fast reaching movements. Trends in Cognitive Sciences 4(11):423–431

    Article  Google Scholar 

  • Evans N, Levinson SC (2009) The myth of language universals: language diversity and its importance for cognitive science. Behav Brain Sci 32(5):429–48; discussion 448–494

    Google Scholar 

  • Feldman J, Narayanan S (2004) Embodied meaning in a neural theory of language. Brain and Language 89(2):385–392

    Article  Google Scholar 

  • Fischer MH, Zwaan RA (2008) Embodied language: A review of the role of the motor system in language comprehension. The Quarterly Journal of Experimental Psychology 61(6):825–850

    Article  Google Scholar 

  • Gibson JJ (1979) The Ecological Approach to Visual Perception. New Jersey: Lawrence Erlbaum Associates

    Google Scholar 

  • Gilbert AL, Regier T, Kay P, Ivry RB (2006) Whorf hypothesis is supported in the right visual field but not the left. Proceedings of the National Academy of Sciences of the United States of America 103(2):489–494

    Article  Google Scholar 

  • Glenberg AM (1997) What memory is for. Behavioral and Brain Sciences 20(1):1– 55

    Google Scholar 

  • Glenberg AM, Kaschak MP (2002) Grounding language in action. Psychonomic Bulletin & Review 9:558–565

    Article  Google Scholar 

  • Grusser OJ (1995) On the history of the ideas of efference copy and reafference. Clio Medica 33:35–55

    Google Scholar 

  • Herrmann E, Call J, Hernandez-Lloreda MV, Hare B, Tomasello M (2007) Humans have evolved specialized skills of social cognition: The cultural intelligence hypothesis. Science 317(5843):1360–1366

    Article  Google Scholar 

  • Hesslow G (2002) Conscious thought as simulation of behaviour and perception. Trends in Cognitive Sciences 6(6):242–247

    Article  Google Scholar 

  • Hu MK (1962) Visual pattern recognition by moment invariants. IEEE Transactions on Information Theory 8(2):179–187, DOI 10.1109/TIT.1962.1057692, URL http://dx.doi.org/10.1109/TIT.1962.1057692

    Google Scholar 

  • Jeannerod M (1999) To act or not to act: Perspectives on the representation of actions. Quarterly Journal of Experimental Psychology 52A:1–29

    Article  Google Scholar 

  • Morasso P (1981) Spatial control of arm movements. Experimental Brain Research 42(2):223–227

    Article  Google Scholar 

  • Mukundan R, Ramakrishnan K (1998) Moment Functions in Image Analysis: Theory and Applications. World Scientific, London, UK

    Book  MATH  Google Scholar 

  • Narayanan S (1997) Talking the talk is like walking the walk: A computational model of verbal aspect. In: COGSCI-97, Stanford, CA, pp 548–553

    Google Scholar 

  • Pulvermuller F (2005) Brain mechanisms linking language and action. Nature Reviews Neuroscience 6(7):576–582

    Article  Google Scholar 

  • Regier T, Kay P (2009) Language, thought, and color: Whorf was half right. Trends in Cognitive Sciences 13(10):439–446

    Article  Google Scholar 

  • Rizzolatti G (2005) The mirror neuron system and its function in humans. Anatomy and Embryology 210(5–6):419–421

    Article  Google Scholar 

  • Rizzolatti G, Arbib M (1998) Language within our grasp. Trends in Neurosciences 21(5):188–194

    Article  Google Scholar 

  • Rizzolatti G, Luppino G (2001) The cortical motor system. Neuron 31(6):889 – 901

    Article  Google Scholar 

  • Schacter DL, Addis DR, Buckner R (2007) Remembering the past to imagine the future: the prospective brain. Nature Reviews Neuroscience 8(7):657–661

    Article  Google Scholar 

  • Schilling M (2011) Universally manipulable body models—dual quaternion representations in layered and dynamic MMCs. Autonomous Robots 30(4):399–425, URL http://dx.doi.org/10.1007/s10514-011-9226-3

  • Schilling M, Cruse H (2007) Hierarchical MMC Networks as a manipulable body model. In: Proceedings of the International Joint Conference on Neural Networks (IJCNN 2007), Orlando, FL, pp 2141–2146 Schilling M, Cruse H (2008) The evolution of cognition – from first order to second order embodiment. In:Wachsmuth I, Knoblich G (eds) Modeling Communication with Robots and Virtual Humans, Berlin: Springer, pp 77–108

    Google Scholar 

  • Shadmehr R, Wise SP (2005) The Computational Neurobiology of Reaching and Pointing : A Foundation for Motor Learning (Computational Neuroscience). The MIT Press

    Google Scholar 

  • Steels L (1995) A self-organizing spatial vocabulary. Artificial Life 2(3):319–332

    Article  Google Scholar 

  • Steels L (2003) Intelligence with representation. Philosophical Transactions: Mathematical, Physical and Engineering Sciences 361(1811):2381–2395

    Article  MathSciNet  Google Scholar 

  • Steels L (2012) Grounding Language through Evolutionary Language Games. In:

    Google Scholar 

  • Steels L, Hild M (eds) Language Grounding in Robots, Springer, New York

    Google Scholar 

  • Steels L, Belpaeme T (2005) Coordinating perceptually grounded categories through language: A case study for colour. Behavioral and Brain Sciences 28(04):469–489

    Google Scholar 

  • Steels L, Spranger M (2008a) Can body language shape body image? In: Bullock S, Noble J, Watson R, Bedau MA (eds) Artificial Life XI: Proceedings of the Eleventh International Conference on the Simulation and Synthesis of Living Systems, MIT Press, Cambridge, MA, pp 577–584

    Google Scholar 

  • Steels L, Spranger M (2008b) The robot in the mirror. Connection Science 20(4):337–358

    Article  Google Scholar 

  • Steels L, Spranger M (2012) Emergent mirror systems for body language. In: Steels L (ed) Experiments in Cultural Language Evolution, John Benjamins

    Google Scholar 

  • Steinkuhler U, Cruse H (1998) A holistic model for an internal representation to control the movement of a manipulator with redundant degrees of freedom. Biological Cybernetics 79(6):457–466

    Article  Google Scholar 

  • Tomasello M (1999) The Cultural Origins of Human Cognition. Harvard University Press

    Google Scholar 

  • Tomasello M (2008) The Origins of Human Communication. MIT Press

    Google Scholar 

  • Umilta MA, Escola L, Intskirveli I, Grammont F, Rochat M, Caruana F, Jezzini A

    Google Scholar 

  • Gallese V, Rizzolatti G (2008) When pliers become fingers in the monkey motor system. Proceedings of the National Academy of Sciences 105(6):2209–2213

    Article  Google Scholar 

  • Verschure PF, Althaus P (1999) The study of learning and problem solving using artificial devices: Synthetic epistemology. Bildung und Erziehung 52(3):317–333

    Google Scholar 

  • Wolpert D, Ghahramani Z, Jordan M (1995) An internal model for sensorimotor integration. Science 269:1880–1882

    Article  Google Scholar 

  • Wolpert DM, Ghahramani Z (2000) Computational principles of movement neuroscience. Nature Neuroscience 3:1212–1217

    Article  Google Scholar 

  • Wolpert DM, Kawato M (1998) Multiple paired forward and inverse models for motor control. Neural Networks 11(7-8):1317–1329

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. International Computer Science Institute Berkeley, 1947 Center Street, CA, 94704, Berkeley, USA

    Malte Schilling

Authors
  1. Malte Schilling
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Malte Schilling .

Editor information

Editors and Affiliations

  1. Sony Computer Science Lab, 6 rue Amyot, Paris, 75005, France

    Luc Steels

  2. , Neurorobotics Research Labatory, Humboldt-Universität zu Berlin, Berlin, 10099, Berlin, Germany

    Manfred Hild

Rights and permissions

Reprints and permissions

Copyright information

© 2012 Springer Science+Business Media, LLC

About this chapter

Cite this chapter

Schilling, M. (2012). Grounded Internal Body Models for Communication: Integration of Sensory and Motor Spaces for Mediating Conceptualization. In: Steels, L., Hild, M. (eds) Language Grounding in Robots. Springer, Boston, MA. https://doi.org/10.1007/978-1-4614-3064-3_7

Download citation

  • DOI: https://doi.org/10.1007/978-1-4614-3064-3_7

  • Published:

  • Publisher Name: Springer, Boston, MA

  • Print ISBN: 978-1-4614-3063-6

  • Online ISBN: 978-1-4614-3064-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation