Mirroring, Deixis, and Interaction Topology in the Emergence of Shared Vocabularies

  • Jean Baillie
  • Chrystopher L. Nehaniv
  • Patrick Quick
  • Attila Egri-Nagy
  • Sandra Warren
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3609)


Neuroscientists have suggested that the mirror-neurons in our primate ancestors may have provided a substrate for the emergence of language in humans. Simulation studies of the emergence of language, using minimal implementations of proposed mechanisms, are a way to assess their explanatory power for the emergence and evolution of communication. In this work, we study the emergence and stability of linguistic labelling in a communities of agents with mirror-neuron mechanisms for associating deictic reference with speech utterances. These minimal agents possessing a built-in mirror-neuron style temporal recurrent neural network architecture are capable of perceiving and carrying out deixis (‘pointing’) to refer to others in their group, as well as producing and perceiving utterances of another agent in their group. They are able to generate and learn temporally extended phonetic utterances (‘names’) and associate these to deictic referents. Thus, the agents utter what they hear, and tend refer to the same entities as another agent that they watch when it points. Previous work has shown the emergence and stability of arbitrary names generated by the agents in certain fixed topologies of interaction. In this work, we systematically study the effects of different interaction topologies on the dynamics of convergence to a common vocabulary in the population, and its stability over time. Results show that certain topologies of interaction to be more conducive than others to the emergence of a stable vocabulary. Moreover, some topologies of interaction (such as cycles) are seen to yield instability and to amplify feedback given the mirror-neuron system. Linguistic convergence and change bear similarity to those of natural language. Homophony and multiple referents of particular proto-words may also emerge. In light of results, we suggest that mechanisms for confirming joint-attention and for suppression of mirroring could play an essential role in maintaining stability in the emergence of linguistic reference.


Joint Attention Mirror Neuron Robotic Agent Minimal Agent Interaction Topology 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Chomsky, N.: Language and Mind. Harcourt, Brace and World, New York (1968)Google Scholar
  2. 2.
    Chomsky, N.: Reflections on Language. Pantheon Books, New York (1975)Google Scholar
  3. 3.
    Bickerton, D.: Language and Species. Chicago (1990)Google Scholar
  4. 4.
    Pinker, S., Bloom, P.: Natural language and natural selection. Brain and Behavioural Sciences 13, 707–784 (1990)Google Scholar
  5. 5.
    Steels, L.: A self-organizing spatial vocabulary. Artificial Life 2(4), 315–332 (1996)MathSciNetGoogle Scholar
  6. 6.
    Hurford, J., Knight, C., Studdert, M. (eds.): Approaches to the Evolution of Language: Social and Cognitive Bases. Cambridge University Press, Cambridge (1998)Google Scholar
  7. 7.
    Arbib, M.A.: The mirror system, imiation, and the evolution of language. In: Dautenhahn, K., Nehaniv, C. (eds.) Imitation in Animals and Artifacts, MIT Press, Cambridge (2002)Google Scholar
  8. 8.
    Savage-Rumbaugh, S., Brakke, K.E.: Animal language: Methodological and interpretative issues. In: Bekoff, M., Jamieson, D. (eds.) Readings in Animal Cognition, pp. 269–288. MIT Press, Cambridge (1996)Google Scholar
  9. 9.
    Herman, L.M., Austad, S.N.: Knowledge acquisition and asymmetry between language comprehension and production: Dolphins and apes as general models for animals. In: Bekoff, M., Jamieson, D. (eds.) Readings in Animal Cognition, pp. 289–306. MIT Press, Cambridge (1996)Google Scholar
  10. 10.
    Pepperberg, I.M.: Allospecific referential speech acquisition in grey parrots (Psittacus erithacus): Evidence for multiple levels of avian vocal imitation. In: Dautenhahn, K., Nehaniv, C. (eds.) Imitation in Animals and Artifacts, MIT Press, Cambridge (2002)Google Scholar
  11. 11.
    Steels, L.: The synthetic modelling of language origins. Evolution of Communication 1(1) (1997)Google Scholar
  12. 12.
    Steels, L.: Synthesising the origins of language and meaning using co-evolution, self-organization and level formation. In: Hurford, J., Studdert-Kennedy, M. (eds.) Approaches to the Evolution of Language, Cambridge University Press, Cambridge (1998)Google Scholar
  13. 13.
    Billard, A., Hayes, G.: DRAMA, a connectionist architecture for control and learning in autonomous robots. Adaptive Behavior 7(1), 35–63 (1999)CrossRefGoogle Scholar
  14. 14.
    Billard, A., Dautenhahn, K.: Experiments in learning by imitation - grounding and use of communication in robotic agents. Adaptive Behavior 7(3/4) (1999)Google Scholar
  15. 15.
    Nehaniv, C.L.: The making of meaning in societies: Semiotic and information-theoretic background to the evolution of communication. In: AISB Symposium: Starting from Society: the application of social analogies to computational systems, Society for the Study of Artificial Intelligence & the Simulation of Behaviour (2000)Google Scholar
  16. 16.
    Baillie, J., Nehaniv, C.: Deixis and the development of naming in asynchronously interacting connectionist agents. In: Proc. First International Workshop on Epigenetic Robotics, Lund, Sweden, 17-18 September 2001. Lund University Cognitive Studies, vol. 85, pp. 123–129 (2001)Google Scholar
  17. 17.
    Scaife, M., Bruner, J.: The capacity for joint visual attention in the infant. Nature 253, 265–266 (1975)CrossRefGoogle Scholar
  18. 18.
    Butterworth, G.: The ontogeny and phylogeny of joint visual attention. In: Whiten, A. (ed.) Natural Theories of Mind, Blackwell, Malden (1991)Google Scholar
  19. 19.
    Moore, C., Dunham, P.J. (eds.): Joint Attention: Its Origins and Role in Development. Lawrence Erlbaum, Mahwah (1995)Google Scholar
  20. 20.
    Scassellati, B.: Imitation and mechanisms of joint attention: A developmental structure for building social skills on a humanoid robot. In: Nehaniv, C.L. (ed.) Computation for Metaphors, Analogy, and Agents. LNCS (LNAI), vol. 1562, pp. 176–195. Springer, Heidelberg (1999)CrossRefGoogle Scholar
  21. 21.
    Dautenhahn, K.: Trying to imitate – a step towards releasing robots from social isolation. In: Proc. From Perception to Action Conference, Lausanne, Switzerland, Sept. 7-9, 1994, pp. 290–301. IEEE Computer Society Press, Los Alamitos (1994)Google Scholar
  22. 22.
    Dautenhahn, K.: I could be you — the phenomenological dimension of social understanding. Cybernetics and Systems 25(8), 418–453 (1997)Google Scholar
  23. 23.
    Nehaniv, C.L.: Meaning for observers and agents. In: IEEE International Symposium on Intelligent Control/Intelligent Systems & Semiotics, pp. 435–440. IEEE Computer Society Press, Los Alamitos (1999)Google Scholar
  24. 24.
    Baillie, J., Nehaniv, C.: Deixis and the development of a proto-language in asynchronously communicating connectionist agents. Paper presented at the Fourth International Conference on the Evolution of Language, 27-30 March, Harvard (2002)Google Scholar
  25. 25.
    Butterworth, G.: Pointing is the royal road to language. In: Kita, S. (ed.) Pointing: Where Language, Culture, and Cognition Meet, pp. 9–33. Lawrence Erlbaum, Mahwah (2003)Google Scholar
  26. 26.
    Rizzolatti, G., Arbib, M.A.: Language within our grasp. Trends in Neurosciences 21(5), 188–194 (1998)CrossRefGoogle Scholar
  27. 27.
    Jeffers, R.J., Lehiste, I.: Principles and Methods for Historical Linguistics. MIT Press, Cambridge (1979)Google Scholar
  28. 28.
    Steels, L.: The origins of syntax in visually grounded robotic agents. Artificial Intelligence 103, 1–24 (1998)CrossRefGoogle Scholar

Copyright information

© Springer Berlin Heidelberg 2007

Authors and Affiliations

  • Jean Baillie
    • 1
  • Chrystopher L. Nehaniv
    • 1
  • Patrick Quick
    • 1
  • Attila Egri-Nagy
    • 1
  • Sandra Warren
    • 1
  1. 1.School of Computer Science, University of Hertfordshire, College Lane, Hatfield, Herts AL10 9ABUnited Kingdom

Personalised recommendations