From Humanoid Embodiment to Theory of Mind

  • Yasuo Kuniyoshi
  • Yasuaki Yorozu
  • Yoshiyuki Ohmura
  • Koji Terada
  • Takuya Otani
  • Akihiko Nagakubo
  • Tomoyuki Yamamoto
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3139)


We propose to investigate the foundations of communication and symbolic behavior by means or a robotics approach, i.e. by studying how these behaviors might emerge from the physical dynamics of an agent and its sensory-motor interactions with the real world. In this perspective, the human-robot interface problem can be viewed as one of coupling the interaction dynamics of all agents. Through a number of case studies we will show that within this interaction dynamics there is sparse global structure, i.e. a structure that can be characterized by only a small number of points in phase space, and that it is best to interact with the agent, i.e. interfere with its dynamics, at these points. We introduce a humanoid robot with the capability for dynamic full-body movement. The preliminary results of two experiments, sitting and standing up, are presented. Lastly, experiments with self exploratory learning of embodiment and visual motor learning of neonatal imitation abilities are introduced.


Action Recognition Humanoid Robot Intelligent Robot Motion Capture Data Exploratory Learning 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Kuniyoshi, Y., Nagakubo, A.: Humanoid as a research vehicle into flexible complex interaction. In: Proc. IEEE Int. Conf. Intelligent Robots and Systems, pp. 811–819 (1997)Google Scholar
  2. 2.
    Kuniyoshi, Y., Inaba, M., Inoue, H.: Learning by watching: Extracting reusable task knowledge from visual observation of human performance. IEEE Trans. Robotics and Automation 10 (1994)Google Scholar
  3. 3.
    Kuniyoshi, Y., Inoue, H.: Qualitative recognition of ongoing human action sequences. In: Proc. International Joint Conf. on Artificial Intelligence, pp. 1600–1609. Morgan Kaufmann, San Francisco (1993)Google Scholar
  4. 4.
    Newtson, D., et al.: The objective basis of behavior units. J. of Personality and Social Psychology 35, 847–862 (1977)CrossRefGoogle Scholar
  5. 5.
    Yamamoto, T., Kuniyoshi, Y.: Stability and controllability in a rising motion: a global dynamics approach. In: Proceedings of the International Conference on Intelligent Robots and Systems, pp. 2467–2472 (2002)Google Scholar
  6. 6.
    Taga, G., Yamaguchi, Y., Shimizu, H.: Self-organized control of bipedal locomotion in unpredictable environment. Biol. Cybern. 65, 147–159 (1991)zbMATHCrossRefGoogle Scholar
  7. 7.
    Rizzi, A.A., Koditschek, D.E.: Further progress in robot juggling: The spatial two-juggle. In: Proc. IEEE Int. Conf. Robotics and Automation, pp. 919–924 (1993)Google Scholar
  8. 8.
    Miyakoshi, S., Taga, G., Kuniyoshi, Y., Nagakubo, A.: Three dimensional bipedal stepping motion using neural oscillators – towards humanoid motion in the real world. In: Proc. IEEE Int. Conf. Intelligent Robots and Systems (1998)Google Scholar
  9. 9.
    Kuniyoshi, Y., Nagakubo, A.: Humanoid Interaction Approach: Exploring Meaningful Order in Complex Interactions. In: Proceedings of the International Conference on Complex Systems (1997)Google Scholar
  10. 10.
    Kuniyoshi, Y., Nagakubo, A.: Humanoid As a Research Vehicle Into Flexible Complex Interaction. In: Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS 1997 (1997)Google Scholar
  11. 11.
    Raibert, M.H.: Legged Robots That Balance. The MIT Press, Cambridge (1986)Google Scholar
  12. 12.
    Pfeifer, R., Bongard, J., Iida, F.: New robotics: design principles for intelligent systems. Artificial Life (2004)Google Scholar
  13. 13.
    Nagakubo, A., Kuniyoshi, Y., Cheng, G.: Development of a High-Performance Upper-Body Humanoid System. In: Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS 2000 (2000)Google Scholar
  14. 14.
    Cheng, G., Kuniyoshi, Y.: Complex continuous meaningful humanoid interaction: A multi sensory-cue based approach. In: Proceedings of IEEE International Conference on Robotics and Automation, San Francisco, U.S.A (2000) (to appear)Google Scholar
  15. 15.
    Morita, M.: Memory and learning of sequential patterns by nonmonotone neural networks. Neural Networks 9, 1477–1489 (1996)CrossRefGoogle Scholar
  16. 16.
    Piaget, J.: Play, Dreams and Imitation in Childhood. W. W. Norton, New York (1962)Google Scholar
  17. 17.
    Meltzoff, A.N., Moore, M.K.: Imitation of facial and manual gestures by human neonates. Science 198, 75–78 (1977)CrossRefGoogle Scholar
  18. 18.
    Kuniyoshi, Y., Yorozu, Y., Inaba, M., Inoue, H.: From visuo-motor self learning to early imitation – a neural architecture for humanoid learning. In: Proc. IEEE Int. Conf. on Robotics and Automation, pp. 3132–3139 (2003)Google Scholar
  19. 19.
    Sato, T., Hirai, S.: Language-aided robotic teleoperation system (larts) for advanced teleoperation. IEEE J. Robotics and Automation 3, 476–481 (1987)CrossRefGoogle Scholar
  20. 20.
    Lee, S.: Intelligent sensing and control for advanced teleoperation. IEEE Control Systems Magazine 13, 19–28 (1993)CrossRefGoogle Scholar
  21. 21.
    Brunner, B., Arbter, K., Hirzinger, G.: Task directed programming of sensor based robots. In: Proc. IEEE/RSJ/GI Int. Conf. Intelligent Robots and Systems (IROS), pp. 1080–1087 (1994)Google Scholar
  22. 22.
    Asao, T.: From Gestures to Language. Shin’yosha (1992)( in Japanese)Google Scholar
  23. 23.
    Kuniyoshi, Y.: Behavior matching by observation for multi-robot cooperation. In: Giralt, G., Hirzinger, G. (eds.) Robotics Research – The Seventh International Symposium., pp. 343–352. Springer, Heidelberg (1996)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2004

Authors and Affiliations

  • Yasuo Kuniyoshi
    • 1
  • Yasuaki Yorozu
    • 1
  • Yoshiyuki Ohmura
    • 1
  • Koji Terada
    • 1
  • Takuya Otani
    • 1
  • Akihiko Nagakubo
    • 2
  • Tomoyuki Yamamoto
    • 3
  1. 1.The University of TokyoBunkyo-ku, TokyoJapan
  2. 2.National Institute for Advanced Industrial Science and Technology 
  3. 3.Japan Advanced Institute of Science and Technology 

Personalised recommendations