Detection of Head Pose and Gaze Direction for Human-Computer Interaction

  • Ulrich Weidenbacher
  • Georg Layher
  • Pierre Bayerl
  • Heiko Neumann
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4021)


In this contribution we extend existing methods for head pose estimation and investigate the use of local image phase for gaze detection. Moreover we describe how a small database of face images with given ground truth for head pose and gaze direction was acquired. With this database we compare two different computational approaches for extracting the head pose. We demonstrate that a simple implementation of the proposed methods without extensive training sessions or calibration is sufficient to accurately detect the head pose for human-computer interaction. Furthermore, we propose how eye gaze can be extracted based on the outcome of local filter responses and the detected head pose. In all, we present a framework where different approaches are combined to a single system for extracting information about the attentional state of a person.


Gesture Recognition Laser Pointer Head Angle Gabor Response Test Head 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. [Baluja and Pomerleau, 1994]
    Baluja, S., Pomerleau, D.: Non-intrusive gaze tracking using artificial neural networks. Technical Report CMU-CS-94-102, Carnegie Mellon University (1994)Google Scholar
  2. [Emery, 2000]
    Emery, N.: The eyes have it: the neuroethology, function and evolution of social gaze. Neuroscience and Biobehavioral Reviews 24, 581–604 (2000)CrossRefGoogle Scholar
  3. [Eyelink, 2006]
  4. [Gabor, 1946]
    Gabor, D.: Theory of communication. Journal of IEE 93, 457–492 (1946)Google Scholar
  5. [Gee and Cipolla, 1994]
    Gee, A.H., Cipolla, R.: Determining the gaze of faces in images. Image and Vision Computing 12(10), 639–647 (1994)CrossRefGoogle Scholar
  6. [Gibson and Pick, 1963]
    Gibson, J.J., Pick, A.D.: Perception of another persons looking behaviour. American Journal of Psychology 76, 386–394 (1963)CrossRefGoogle Scholar
  7. [Heinzmann and Zelinsky, 1998]
    Heinzmann, J., Zelinsky, A.: 3-d facial pose and gaze point estimation using a robust real-time tracking paradigma. In: Intern. Conf. on Automatic Face and Gesture Recognition (1998)Google Scholar
  8. [Hubel and Wiesel, 1968]
    Hubel, D., Wiesel, T.: Receptive fields and functional architecture of monkey striate cortex. Journal of Psychology 195, 215–243 (1968)Google Scholar
  9. [Hutchinson et al., 1989]
    Hutchinson, T., White Jr., K., Reichert, K., Frey, L.: Human-computer interaction using eyegaze input. IEEE Transactions on Systems, Man, and Cybernetics 19, 1527–1533 (1989)CrossRefGoogle Scholar
  10. [Ji and Zhu, 2003]
    Ji, Q., Zhu, W.: Non-intrusive eye gaze tracking for natural human computer interaction. MMI-Interactive 6 (2003)Google Scholar
  11. [Krüger et al., 1997]
    Krüger, N., Pötzsch, M., von der Malsburg, C.: Determination of face position and pose with a learned representation based on labelled graphs. Image Vision Comput. 15(8), 665–673 (1997)CrossRefGoogle Scholar
  12. [Langton et al., 2004]
    Langton, S.R., Honeyman, H., Tessler, E.: The influence of head contour and nose angle on the perception of eye-gaze direction. Perception & Psychophysics 66(5), 752–771 (2004)CrossRefGoogle Scholar
  13. [Langton et al., 2000]
    Langton, S.R., Watt, R., Bruce, V.: Do the eyes have it? cues to the direction of social attention. Trends in Cognitive Science 4(2), 50–59 (2000)CrossRefGoogle Scholar
  14. [Matsumoto and Zelinsky, 2000]
    Matsumoto, Y., Zelinsky, A.: An algorithm for real-time stereo vision implementation of head pose and gaze direction measurement. In: 4th Intern. Conf. on Face and Gesture Recognition, pp. 499–505 (2000)Google Scholar
  15. [Phillips et al., 2000]
    Phillips, P., Moon, H., Rauss, P., Rizvi, S.: The feret evaluation methodology for face recognition algorythems. IEEE Transactions on Pattern Analysis and Machine Intelligence 22(10), 1090–1104 (2000)CrossRefGoogle Scholar
  16. [Rae and Ritter, 1998]
    Rae, R., Ritter, H.: Recognition of human head orientation based on artificial neural networks. IEEE Transaction on Neural Networks 9(2), 257–265 (1998)CrossRefGoogle Scholar
  17. [Sim et al., 2003]
    Sim, S., Baker, S., Bsat, M.: The cmu pose, illumination, and expression database. IEEE Transactions on Pattern Analysis and Machine Intelligence 25(12), 1615–1618 (2003)CrossRefGoogle Scholar
  18. [Sinha, 2000]
    Sinha, P.: Last but not least. here’s looking at you, kid. Perception 29, 1005–1008 (2000)CrossRefGoogle Scholar
  19. [Steifelhagen et al., 1997]
    Steifelhagen, R., Yang, J., Waibel, A.: Tracking eyes and monitoring eye gaze. In: Proc. of the Workshop on Perceptual User Interfaces, pp. 98–100 (1997)Google Scholar
  20. [Trucco and Verri, 1998]
    Trucco, E., Verri, A.: Introductory Techniques for 3-D Computer Vision. Prentice Hall, Englewood Cliffs (1998)Google Scholar
  21. [Wang et al., 2003]
    Wang, K., Wang, Y., Yin, B., Kong, D.: Face pose estimation with a knowledge based model. In: IEEE Int. Conf. Neural Networks and Signal Processing, pp. 1131–1134 (2003)Google Scholar
  22. [Yoo and Chung, 2005]
    Yoo, D.H., Chung, M.J.: A novel non-intrusive eye gaze estimation using cross-ration under large head motion. Computer Vision and Image Understanding 98, 25–51 (2005)CrossRefGoogle Scholar
  23. [Zhu and Ji, 2005]
    Zhu, Z., Ji, Q.: Robust real-time eye detection and tracking under variable lighting conditions and various face orientations. Computer Vision and Image Understanding 98, 124–154 (2005)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Ulrich Weidenbacher
    • 1
  • Georg Layher
    • 1
  • Pierre Bayerl
    • 1
  • Heiko Neumann
    • 1
  1. 1.University of UlmGermany

Personalised recommendations