Naturalistic Conversational Gaze Control for Humanoid Robots - A First Step

  • Hagen LehmannEmail author
  • Ingo Keller
  • Reza Ahmadzadeh
  • Frank Broz
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10652)


In this paper we introduce a new model for conversational gaze control for robots with physical eyes. We describe our modeling approach and present the results of a set of exploratory experiments. The work illustrated here is a first step of a larger research program dedicated to the development of a conversational gaze controller (CGC) for Human-Robot Interaction (HRI). The study presented has pilot character and was designed to inform the next development steps of the model. Despite the limitations of the presented version of the model, our results are in line with the findings of previous studies and illustrate the importance of eye movements for HRI.


Eye gaze Conversational gaze control Humanoid robots Social robotics Human-Robot Interaction 



Research supported by the Scottish Informatics and Computer Science Alliance.


  1. 1.
    Admoni, H., Scassellati, B.: Social eye gaze in human-robot interaction: a review. J. Human-Robot Interact. (2017)Google Scholar
  2. 2.
    Annosoft: Phoneme mapping (2015).
  3. 3.
    Argyle, M.: Bodily Communication, 2nd edn. Routledge, London (1988)Google Scholar
  4. 4.
    Aron, A., Aron, E.N., Smollan, D.: Inclusion of other in the self scale and the structure of interpersonal closeness. J. Pers. Soc. Psychol. (1992)Google Scholar
  5. 5.
    Baltrušaitis, T., Robinson, P., Morency, L.P.: 3d constrained local model for rigid and non-rigid facial tracking. In: 2012 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2610–2617. IEEE (2012)Google Scholar
  6. 6.
    Bartneck, C., Kulić, D., Croft, E., Zoghbi, S.: Measurement instruments for the anthropomorphism, animacy, likeability, perceived intelligence, and perceived safety of robots (2009)Google Scholar
  7. 7.
    Breazeal, C., Scassellati, B.: How to build robots that make friends and influence people. In: Proceedings of the IEEE International Conference on Intelligent Robots and Systems (IROS 1999), vol. 2, pp. 858–863 (1999)Google Scholar
  8. 8.
    Broz, F., Lehmann, H.: A gaze controller for coordinating mutual gaze during conversational turn-taking in human-robot interaction. In: HRI 2015 Extended Abstracts: Proceedings of the Tenth Annual ACM/IEEE International Conference on Human-Robot Interaction Extended Abstracts. ACM, New York (2015)Google Scholar
  9. 9.
    Broz, F., Lehmann, H., Nehaniv, C., Dautenhahn, K.: Mutual gaze, personality, and familiarity: dual eye-tracking during conversation. In: IEEE International Symposium on Robots and Human Interactive Communications (RO-MAN) (2012)Google Scholar
  10. 10.
    Cappelletta, L., Harte, N.: Phoneme-to-viseme mapping for visual speech recognition. In: Proceedings of ICPRAM, vol. 2, pp. 322–329 (2012)Google Scholar
  11. 11.
    Farroni, T.: Infants perceiving and acting on the eyes: tests of an evolutionary hypothesis. J. Exp. Child Psychol. 85(3), 199–212 (2003)CrossRefGoogle Scholar
  12. 12.
    Heider, F., Simmel, M.: An experimental study of apparent behaviour. Am. J. Psychol. 57, 243–259 (1944)CrossRefGoogle Scholar
  13. 13.
    Kleinke, C.: Gaze and eye contact: a research review. Psychol. Bull. 10(1), 78–100 (2003)Google Scholar
  14. 14.
    MaryTTS (2015).
  15. 15.
    Metta, G., Natale, L., Nori, F., Sandini, G., Vernon, D., Fadiga, L., Von Hofsten, C., Rosander, K., Lopes, M., Santos-Victor, J., Bernardino, A.: The ICUB humanoid robot: an open-systems platform for research in cognitive development. Neural Netw. 23(8), 1125–1134 (2010)CrossRefGoogle Scholar
  16. 16.
    Mori, M., MacDorman, K.: The uncanny valley. Energy (1970)Google Scholar
  17. 17.
    Roncone, A., Pattacini, U., Metta, G., Natale, L.: A cartesian 6-dof gaze controller for humanoid robots. In: Proceedings of Robotics: Science and Systems (2016)Google Scholar
  18. 18.
    Trevarthen, C., Aitken, K.: Infant intersubjectivity: research, theory, and clinical applications. J. Child Psychol. Psychiatry Allied Discipl. 42(1), 3–48 (2001)CrossRefGoogle Scholar

Copyright information

© Springer International Publishing AG 2017

Authors and Affiliations

  • Hagen Lehmann
    • 1
    Email author
  • Ingo Keller
    • 1
  • Reza Ahmadzadeh
    • 2
  • Frank Broz
    • 1
  1. 1.Heriot-Watt UniversityEdinburghScotland
  2. 2.Georgia Institute of TechnologyAtlantaUSA

Personalised recommendations