Studies on Grounding with Gaze and Pointing Gestures in Human-Robot-Interaction

  • Markus Häring
  • Jessica Eichberg
  • Elisabeth André
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7621)


In this study we investigated the use of gaze and pointing gestures in scenarios where a human has to follow the instructions of a humanoid robot. Our objective was to analyze the performance of a human participant, that solves an abstract jigsaw puzzle with the help of our robot instructor, in different grounding scenarios with varying difficulty. Furthermore we investigated how the attitude towards the robot and the self-assessment of the participant changed. Our results support that adding gaze to the interaction usually improves the interaction, but often additional pointing gestures are needed to make a significant difference.


Complex Condition Humanoid Robot Verbal Instruction Social Robot Puzzle Piece 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Breazeal, C., Kidd, C.D., Thomaz, A.L., Hoffman, G., Berlin, M.: Effects of nonverbal communication on efficiency and robustness in human-robot teamwork. In: Proc. IROS (2005)Google Scholar
  2. 2.
    Burghart, C., Gaertner, C., Woern, H.: Cooperative solving of a children’s jigsaw puzzle between human and robot: First results. In: Proc. AAAI (2006)Google Scholar
  3. 3.
    Clark, H.H., Brennan, S.E.: Grounding in communication. In: Perspectives on Socially Shared Cognition, pp. 127–149 (1991)Google Scholar
  4. 4.
    Faber, F., Bennewitz, M., Eppner, C., Görög, A., Gonsior, C., Joho, D., Schreiber, M., Behnke, S.: The humanoid museum tour guide robotinho. In: Proc. RO-MAN (2009)Google Scholar
  5. 5.
    Giuliani, M., Knoll, A.: Evaluating Supportive and Instructive Robot Roles in Human-Robot Interaction. In: Mutlu, B., Bartneck, C., Ham, J., Evers, V., Kanda, T. (eds.) ICSR 2011. LNCS, vol. 7072, pp. 193–203. Springer, Heidelberg (2011)CrossRefGoogle Scholar
  6. 6.
    Ishiguro, H., Ono, T., Imai, M., Maeda, T., Nakatsu, R., Kanda, T.: Robovie: An interactive humanoid robot. Industrial Robot: An International Journal, 498–503 (2001)Google Scholar
  7. 7.
    Salem, M., Rohlfing, K., Kopp, S., Joublin, F.: A friendly gesture: Investigating the effect of multimodal robot behavior in human-robot-interaction. In: Proc. RO-MAN (2011)Google Scholar
  8. 8.
    Sugiyama, O., Kanda, T., Imai, M., Ishiguro, H., Hagita, N.: Natural deictic communication with humanoid robots. In: Proc. IROS (2007)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2012

Authors and Affiliations

  • Markus Häring
    • 1
  • Jessica Eichberg
    • 1
  • Elisabeth André
    • 1
  1. 1.Institute of Computer Science, Human Centered MultimediaAugsburg UniversityGermany

Personalised recommendations