Multi-level Face Tracking for Estimating Human Head Orientation in Video Sequences

  • Tobias Bausch
  • Pierre Bayerl
  • Heiko Neumann
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4021)


We propose a hierarchical scheme of tracking facial regions in video sequences. The hierarchy uses the face structure, facial regions and their components, such as eyes and mouth, to achieve improved robustness against structural deformations and the temporal loss of image components due to, e.g., self-occlusion. The temporal deformation of facial eye regions is mapped to estimate the head orientation around the yaw axis. The performance of the algorithm is demonstrated for free head motions.


Video Sequence Image Registration Facial Region Facial Expression Recognition Head Orientation 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Baker, S., Matthews, I.: Lucas-Kanade 20 years on: A unifying framework: Part1. Carnegie-Mellon Univ., Robotics Institute, CMU-RI-TR-02-16 (2002)Google Scholar
  2. 2.
    Black, M.J., Yacoob, Y.: Recognizing facial expressions in image sequences using local parametrized models of image motion. Int.’l J. of Computer Vision 25, 23–48 (1997)CrossRefGoogle Scholar
  3. 3.
    Essa, I.A., Pentland, A.P.: Facial expression recognition using a dynamic model and motion energy. In: Proc. 5th Int.’l Conf. on Computer Vision, ICCV 1995, pp. 360–367 (1995)Google Scholar
  4. 4.
    Gee, A., Cipolla, R.: Determining the gaze of faces in images. Image and Vision Comp. 30, 639–647 (1994)CrossRefGoogle Scholar
  5. 5.
    Krüger, N., Pötzsch, M., von der Malsburg, C.: Determination of face position and pose with a learned representation based on labeled graphs. Im. Vis. Comput. 15(8), 665–673 (1997)CrossRefGoogle Scholar
  6. 6.
    Lucas, B.D., Kanade, T.: An iterative image registration technique with an application to stereo vision. In: Proc. 7th Int.’l Conf. on Artif. Intell., IJCAI 1981, pp. 674–679 (1981)Google Scholar
  7. 7.
    Rae, R., Ritter, H.J.: Recognition of human head orientation based on artificial neural networks. IEEE Trans. on Neural Networks 9, 257–265 (1998)CrossRefGoogle Scholar
  8. 8.
    Tan, K.-H., Kriegman, D.J., Ahuja, N.: Appearance-based eye gaze estimation. In: Proc. 6th IEEE Workshop on Applications of Computer Vision, WACV 2002, pp. 191–195 (2002)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Tobias Bausch
    • 1
  • Pierre Bayerl
    • 1
  • Heiko Neumann
    • 1
  1. 1.Universität UlmUlmGermany

Personalised recommendations