Integrating Built-in Sensors of an Android with Sensors Embedded in the Environment for Studying a More Natural Human-Robot Interaction

  • Giuseppe Balistreri
  • Shuichi Nishio
  • Rosario Sorbello
  • Hiroshi Ishiguro
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6934)


Several studies supported that there is a strict and complex relationship between outer appearance and the behavior showed by the robot and that a human-like appearance is not enough for give a positive impression. The robot should behave closely to humans, and should have a sense of perception that enables it to communicate with humans. Our past experience with the android “Geminoid HI-1” demonstrated that the sensors equipping the robot are not enough to perform a human-like communication, mainly because of a limited sensing range. To overcome this problem, we endowed the environment around the robot with perceptive capabilities by embedding sensors such as cameras into it. This paper reports a preliminary study about an improvement of the controlling system by integrating cameras in the surrounding environment, so that a human-like perception can be provided to the android. The integration of the development of androids and the investigations of human behaviors constitute a new research area fusing engineering and cognitive sciences.


Android gaze sensor network 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Kanda, T., Hirano, T., Eaton, D., Ishiguro, H.: Interactive Robots as Social Partners and Peer Tutors for Children: A Field Trial. Human Computer Interaction (Special Issues on Human-Robot Interaction) 19, 61–84 (2004)Google Scholar
  2. 2.
    Shimada, M., Minato, T., Itakura, S., Ishiguro, H.: Evaluation of android using unconscious recognition. In: Proceedings of the IEEE-RAS International Conference on Humanoid Robots, pp. 157–162 (2006)Google Scholar
  3. 3.
    Nishio, S., Ishiguro, H., Hagita, N.: Geminoid: Teleoperated Android of an Existing Person. In: Humanoid Robots, New Developments, I-Tech, pp. 343–352 (2007)Google Scholar
  4. 4.
    Morishita, H., Watanabe, K., Kuroiwa, T., Mori, T., Sato, T.: Development of robotic kitchen counter: A kitchen counter equipped with sensors and actuator for action-adapted and personally assistance. In: Proceedings of the 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 1839–1844 (2003)Google Scholar
  5. 5.
    Mori, T., Noguchi, H., Sato, T.: Daily life experience reservoir and epitomization with sensing room. In: Proceedings of Workshop on Network Robot Systems: Toward Intelligent Robotic Systems Integrated with Environments (2005)Google Scholar
  6. 6.
    Ishiguro, H.: Distributed vision system: A perceptual information infrastructure for robot navigation. In: International Joint Conference on Artificial Intelligence (IJCAI 1997), pp. 36–41 (1997)Google Scholar
  7. 7.
    Becker-Asano, C., Ogawa, K., Nishio, S., Ishiguro, H.: Exploring the uncanny valley with Geminoid HI-1 in a real-world application. In: IADIS Intl. Conf. Interfaces and Human Computer Interaction, pp. 121–128 (2010)Google Scholar
  8. 8.
    Ishiguro, H.: Android Science: Toward a new cross-interdisciplinary framework. In: Proc. of the CogSci 2005 Workshop Toward Social Mechanisms of Android Science, Stresa, Italy, pp. 1–6 (2005)Google Scholar
  9. 9.
    MacDorman, K.F., Ishiguro, H.: The uncanny advantage of using androids in cognitive and social science research. Interaction Studies, 297–337 (2006)Google Scholar
  10. 10.
    Suzuki, T., Iwasaki, S., Kobayashi, Y., Sato, K., Sugimoto, A.: Incorporating environmental models for improving vision-based tracking of people. Syst. Comput. Jpn. 38(2), 1592–1600 (2007)CrossRefGoogle Scholar
  11. 11.
    Matsumoto, Y., Kato, T., Wada, T.: An occlusion robust likelihood integration method for multi-camera people head tracking. In: Proceedings of International Conference on Networked Sensing Systems (INSS), pp. 235–242 (2007)Google Scholar
  12. 12.
    Imai, M., Kanda, T., Ono, T., Ishiguro, H., Mase, K.: Robot mediated round table: Analysis of the effect of robot’s gaze. In: Proceedings of 11th IEEE International Workshop on Robot and Human Interactive Communication, pp. 411–416 (2002), doi:10.1109/ROMAN.2002.1045657Google Scholar
  13. 13.
    Brooks, R.A., Breazeal, C., Marjanović, M., Scassellati, B., Williamson, M.M.: The cog project: building a humanoid robot. In: Nehaniv, C.L. (ed.) CMAA 1998. LNCS (LNAI), vol. 1562, pp. 52–87. Springer, Heidelberg (1999)CrossRefGoogle Scholar
  14. 14.
    Matsumoto, Y., Wada, T., Nishio, S., Miyashita, T., Hagita, N.: Scalable and Robust Multi-people Head Tracking by Combining Distributed Multiple Sensors. Intelligent Service Robotics 3(1) (2010)Google Scholar
  15. 15.
    Argyle, M., Cook, M.: Gaze and Mutual Gaze. Cambridge University Press, Cambridge (1976)Google Scholar
  16. 16.
    Previc, F.H., Murphy, S.: Vertical eye movements during mental tasks: A reexamination and hypothesis. Percept. Motor Skills 84, 835–847 (1997)CrossRefGoogle Scholar
  17. 17.
    McCarthy, A., Muir, D.: Eye movements as social signals during thinking: Age differences. In: Biennial Meeting of the Society for Research in Child Development (2003)Google Scholar
  18. 18.
    MacDorman, K.F., Minato, T., Shimada, M., Itakura, S., Cowley, S.J., Ishiguro, H.: Assessing human likeness by eye contact in an android testbed. In: Proceedings of the XXVII Annual Meeting of the Cognitive Science Society, Stresa, Italy, July 21-23 (2005)Google Scholar
  19. 19.
    Chikaraishi, T., Minato, T., Ishiguro, H.: Development of an android system integrated with sensor networks. In: IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS 2008, September 22-26, pp. 326–333 (2008)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2011

Authors and Affiliations

  • Giuseppe Balistreri
    • 1
    • 2
  • Shuichi Nishio
    • 2
  • Rosario Sorbello
    • 1
  • Hiroshi Ishiguro
    • 2
    • 3
  1. 1.DICGIM Università degli Studi di PalermoPalermoItaly
  2. 2.ATR Intelligent Robotics and Communication LaboratorySourakugunJapan
  3. 3.Graduate School of Engineering ScienceOsaka UniversityToyonakaJapan

Personalised recommendations