Skip to main content
SpringerLink
Log in

Detection of Head Pose and Gaze Direction for Human-Computer Interaction

  • Conference paper
Perception and Interactive Technologies (PIT 2006)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 4021))

Abstract

In this contribution we extend existing methods for head pose estimation and investigate the use of local image phase for gaze detection. Moreover we describe how a small database of face images with given ground truth for head pose and gaze direction was acquired. With this database we compare two different computational approaches for extracting the head pose. We demonstrate that a simple implementation of the proposed methods without extensive training sessions or calibration is sufficient to accurately detect the head pose for human-computer interaction. Furthermore, we propose how eye gaze can be extracted based on the outcome of local filter responses and the detected head pose. In all, we present a framework where different approaches are combined to a single system for extracting information about the attentional state of a person.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Baluja, S., Pomerleau, D.: Non-intrusive gaze tracking using artificial neural networks. Technical Report CMU-CS-94-102, Carnegie Mellon University (1994)

    Google Scholar 

  2. Emery, N.: The eyes have it: the neuroethology, function and evolution of social gaze. Neuroscience and Biobehavioral Reviews 24, 581–604 (2000)

    Article  Google Scholar 

  3. Eyelink (2006), http://www.eyelinkinfo.com

  4. Gabor, D.: Theory of communication. Journal of IEE 93, 457–492 (1946)

    Google Scholar 

  5. Gee, A.H., Cipolla, R.: Determining the gaze of faces in images. Image and Vision Computing 12(10), 639–647 (1994)

    Article  Google Scholar 

  6. Gibson, J.J., Pick, A.D.: Perception of another persons looking behaviour. American Journal of Psychology 76, 386–394 (1963)

    Article  Google Scholar 

  7. Heinzmann, J., Zelinsky, A.: 3-d facial pose and gaze point estimation using a robust real-time tracking paradigma. In: Intern. Conf. on Automatic Face and Gesture Recognition (1998)

    Google Scholar 

  8. Hubel, D., Wiesel, T.: Receptive fields and functional architecture of monkey striate cortex. Journal of Psychology 195, 215–243 (1968)

    Google Scholar 

  9. Hutchinson, T., White Jr., K., Reichert, K., Frey, L.: Human-computer interaction using eyegaze input. IEEE Transactions on Systems, Man, and Cybernetics 19, 1527–1533 (1989)

    Article  Google Scholar 

  10. Ji, Q., Zhu, W.: Non-intrusive eye gaze tracking for natural human computer interaction. MMI-Interactive 6 (2003)

    Google Scholar 

  11. Krüger, N., Pötzsch, M., von der Malsburg, C.: Determination of face position and pose with a learned representation based on labelled graphs. Image Vision Comput. 15(8), 665–673 (1997)

    Article  Google Scholar 

  12. Langton, S.R., Honeyman, H., Tessler, E.: The influence of head contour and nose angle on the perception of eye-gaze direction. Perception & Psychophysics 66(5), 752–771 (2004)

    Article  Google Scholar 

  13. Langton, S.R., Watt, R., Bruce, V.: Do the eyes have it? cues to the direction of social attention. Trends in Cognitive Science 4(2), 50–59 (2000)

    Article  Google Scholar 

  14. Matsumoto, Y., Zelinsky, A.: An algorithm for real-time stereo vision implementation of head pose and gaze direction measurement. In: 4th Intern. Conf. on Face and Gesture Recognition, pp. 499–505 (2000)

    Google Scholar 

  15. Phillips, P., Moon, H., Rauss, P., Rizvi, S.: The feret evaluation methodology for face recognition algorythems. IEEE Transactions on Pattern Analysis and Machine Intelligence 22(10), 1090–1104 (2000)

    Article  Google Scholar 

  16. Rae, R., Ritter, H.: Recognition of human head orientation based on artificial neural networks. IEEE Transaction on Neural Networks 9(2), 257–265 (1998)

    Article  Google Scholar 

  17. Sim, S., Baker, S., Bsat, M.: The cmu pose, illumination, and expression database. IEEE Transactions on Pattern Analysis and Machine Intelligence 25(12), 1615–1618 (2003)

    Article  Google Scholar 

  18. Sinha, P.: Last but not least. here’s looking at you, kid. Perception 29, 1005–1008 (2000)

    Article  Google Scholar 

  19. Steifelhagen, R., Yang, J., Waibel, A.: Tracking eyes and monitoring eye gaze. In: Proc. of the Workshop on Perceptual User Interfaces, pp. 98–100 (1997)

    Google Scholar 

  20. Trucco, E., Verri, A.: Introductory Techniques for 3-D Computer Vision. Prentice Hall, Englewood Cliffs (1998)

    Google Scholar 

  21. Wang, K., Wang, Y., Yin, B., Kong, D.: Face pose estimation with a knowledge based model. In: IEEE Int. Conf. Neural Networks and Signal Processing, pp. 1131–1134 (2003)

    Google Scholar 

  22. Yoo, D.H., Chung, M.J.: A novel non-intrusive eye gaze estimation using cross-ration under large head motion. Computer Vision and Image Understanding 98, 25–51 (2005)

    Article  Google Scholar 

  23. Zhu, Z., Ji, Q.: Robust real-time eye detection and tracking under variable lighting conditions and various face orientations. Computer Vision and Image Understanding 98, 124–154 (2005)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. University of Ulm, Germany

    Ulrich Weidenbacher, Georg Layher, Pierre Bayerl & Heiko Neumann

Authors
  1. Ulrich Weidenbacher
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Georg Layher
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Pierre Bayerl
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Heiko Neumann
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. University of Augsburg, Germany

    Elisabeth André

  2. Natural Interactive Systems Laboratory (NISLab), University of Southern Denmark,, Campusvej 55, 5230, Odense, Denmark

    Laila Dybkjær

  3. Department of Information Technology, University of Ulm, Ulm, Germany

    Wolfgang Minker

  4. Institute of Neural Information Processing, University of Ulm, 89069, Ulm

    Heiko Neumann

  5. Institut für Medieninformatik, Universität Ulm, Ulm, Germany

    Michael Weber

Rights and permissions

Reprints and permissions

Copyright information

© 2006 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Weidenbacher, U., Layher, G., Bayerl, P., Neumann, H. (2006). Detection of Head Pose and Gaze Direction for Human-Computer Interaction. In: André, E., Dybkjær, L., Minker, W., Neumann, H., Weber, M. (eds) Perception and Interactive Technologies. PIT 2006. Lecture Notes in Computer Science(), vol 4021. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11768029_2

Download citation

  • DOI: https://doi.org/10.1007/11768029_2

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-34743-9

  • Online ISBN: 978-3-540-34744-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation