Cognitive Robotics: Command, Interrogation and Teaching in Robot Coaching

  • Alfredo Weitzenfeld
  • Peter Ford Dominey
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4434)


The objective of the current research is to develop a generalized approach for human-robot interaction via spoken language that exploits recent developments in cognitive science, particularly notions of grammatical constructions as form-meaning mappings in language, and notions of shared intentions as distributed plans for interaction and collaboration. We demonstrate this approach distinguishing among three levels of human-robot interaction. The first level is that of commanding or directing the behavior of the robot. The second level is that of interrogating or requesting an explanation from the robot. The third and most advanced level is that of teaching the robot a new form of behavior. Within this context, we exploit social interaction by structuring communication around shared intentions that guide the interactions between human and robot. We explore these aspects of communication on distinct robotic platforms, the Event Perceiver and the Sony AIBO robot in the context of four-legged RoboCup soccer league. We provide a discussion on the state of advancement of this work.


Grammatical Construction Shared Intention Dialog Management Rapid Application Development Cognitive Robotic 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. 1.
    Dominey, P.F., Hoen, M., Lelekov, T., Blanc, J.M.: Neurological basis of language in sequential cognition: Evidence from simulation, aphasia and ERP studies. Brain and Language 86(2), 207–225 (2003)CrossRefGoogle Scholar
  2. 2.
    Tomasello, M.: Constructing a language: A usage-based theory of language acquisition. Harvard University Press, Cambridge (2003)Google Scholar
  3. 3.
    Tomasello, M., Carpenter, M., Call, J., Behne, T., Moll, H.: Understanding and sharing intentions: The origins of cultural cognition, Behavioral and Brain Sciences (2006)Google Scholar
  4. 4.
    Dominey, P.F., Boucher, J.D.: Developmental stages of perception and language acquisition in a perceptually grounded robot. Cognitive Systems Research 6(3), 243–259 (2005)CrossRefGoogle Scholar
  5. 5.
    Dominey, P.F., Boucher, J.D.: Learning to talk about events from narrated video in a construction grammar framework. Artificial Intelligence 167(1-2), 31–61 (2005)CrossRefGoogle Scholar
  6. 6.
    Dominey, P.F., Weitzenfeld, A.: Robot Command, Interrogation and Teaching via Social Interaction. In: IEEE-RAS International Conference on Humanoid Robots, December 6-7, Tsukuba, Japan (2005)Google Scholar
  7. 7.
    Kotovsky, L., Baillargeon, R.: The development of calibration-based reasoning about collision events in young infants. Cognition 67, 311–351 (1998)CrossRefGoogle Scholar
  8. 8.
    Siskind, J.M.: Grounding the lexical semantics of verbs in visual perception using force dynamics and event logic. Journal of AI Research 15, 31–90 (2001)zbMATHGoogle Scholar
  9. 9.
    Steels, L., Baillie, J.C.: Shared Grounding of Event Descriptions by Autonomous Robots. Robotics and Autonomous Systems 43(2-3), 163–173 (2002)CrossRefGoogle Scholar
  10. 10.
    Dominey, P.F., Inui, T.: A Developmental Model of Syntax Acquisition in the Construction Grammar Framework with Cross-Linguistic Validation in English and Japanese. In: Proceedings of the CoLing Workshop on Psycho-Computational Models of Language Acquisition, Geneva, pp. 33–40 (2004)Google Scholar
  11. 11.
    Goldberg, A.: Constructions. U Chicago Press, Chicago and London (1995)Google Scholar
  12. 12.
    Bates, E., McNew, S., MacWhinney, B., Devescovi, A., Smith, S.: Functional constraints on sentence processing: A cross linguistic study. Cognition 11, 245–299 (1982)CrossRefGoogle Scholar
  13. 13.
    CSLU Speech Tools Rapid application Development (RAD),
  14. 14.
    Kitano, H., Asada, M., Kuniyoshi, Y., Noda, I., Osawa, E.: Robocup: The robot world cup initiative. In: Proceedings of the IJCAI-95 Workshop on Entertainment and AI/ALife (1995)Google Scholar
  15. 15.
    Martínez-Gómez, J.A., Medrano, A., Chavez, A., Muciño, B., Weitzenfeld, A.: Eagle Knights AIBO Team, Team Description Paper. In: Bredenfeld, A., Jacoff, A., Noda, I., Takahashi, Y. (eds.) RoboCup 2005. LNCS (LNAI), vol. 4020, Springer, Heidelberg (2006)Google Scholar
  16. 16.
    Martínez-Gómez, J.A., Weitzenfeld, A.: Real Time Localization in Four Legged RoboCup Soccer. In: Martínez-Gómez, J.A, Weitzenfeld, A. (eds.) Proc. 2nd IEEE-RAS Latin American Robotics Symposium, Sao Luis, Maranhao Brasil (September 24-25, 2005)Google Scholar
  17. 17.
    Riley, P., Veloso, M., Kaminka, G.: An empirical study of coaching. In: Distributed Autonomous Robotic Systems 6, Springer, Heidelberg (2002)Google Scholar
  18. 18.
    Kaminka, G., Fidanboylu, M., Veloso, M.: Learning the Sequential Coordinated Behavior of Teams from Observations. In: Kaminka, G.A., Lima, P.U., Rojas, R. (eds.) RoboCup 2002. LNCS (LNAI), vol. 2752, Springer, Heidelberg (2003)Google Scholar
  19. 19.
  20. 20.
    Dominey, P.F., Weitzenfeld, A.: Videos for command, interrogate and teach AIBO robots,
  21. 21.
    Universal Real-time Behavior Interface:

Copyright information

© Springer-Verlag Berlin Heidelberg 2007

Authors and Affiliations

  • Alfredo Weitzenfeld
    • 1
  • Peter Ford Dominey
    • 2
  1. 1.ITAM, San Angel Tizapán, México DF, CP 0100 
  2. 2.Institut des Sciences Cognitives, CNRS, 67 Blvd. Pinel, 69675 Bron CedexFrance

Personalised recommendations