Encyclopedia of Biometrics

2009 Edition
| Editors: Stan Z. Li, Anil Jain

Face Tracking

  • Amit K. Roy-Chowdhury
  • Yilei Xu
Reference work entry
DOI: https://doi.org/10.1007/978-0-387-73003-5_90



In many face recognition systems, the input is a video sequence consisting of one or more faces. It is necessary to track each face over this video sequence so as to extract the information that will be processed by the recognition system. Tracking is also necessary for 3D model-based recognition systems, where the 3D model is estimated from the input video. Face tracking can be divided along different lines depending upon the method used, e.g., head tracking, feature tracking, image-based tracking, model-based tracking. The output of the face tracker can be the 2D position of the face in each image of the video (2D tracking), the 3D pose of the face (3D tracking), or the location of features on the face. Some trackers are also able to output other parameters related to lighting or expression. The major challenges encountered by face tracking systems are robustness to pose changes, lighting variations, and facial deformations due to changes...

This is a preview of subscription content, log in to check access.


  1. 1.
    Zhou, S., Krueger, V., Chellappa, R.: Probabilistic recognition of human faces from video. Comput. Vision Image Understand. 91, 214–245 (2003)CrossRefGoogle Scholar
  2. 2.
    Fua, P.: Regularized bundle-adjustment to model heads from image sequences without calibration data. Int. J. Comput. Vision 38, 153–171 (2000)zbMATHCrossRefGoogle Scholar
  3. 3.
    Shan, Y., Liu, Z., Zhang, Z.: Model-based bundle adjustment with application to face modeling. In: Proceedings of IEEE International Conference on Computer Vision, pp. 644–651 (2001)Google Scholar
  4. 4.
    Roy-Chowdhury, A., Chellappa, R., Gupta, R.: 3D face modeling from monocular video sequences. In: Face Processing: Advanced Modeling and Methods. Academic Press, New York (2005)Google Scholar
  5. 5.
    Zhao, W., Chellappa, R., Phillips, P., Rosenfeld, A.: Face Recognition: A Literature Survey. ACM Transactions (2003)Google Scholar
  6. 6.
    Baker, S., Matthews, I.: Lucas–Kanade 20 years on: A unifying framework. Int. J. Comput. Vision 56, 221–255 (2004)CrossRefGoogle Scholar
  7. 7.
    Xu, Y., Roy-Chowdhury, A.: Integrating motion, illumination and structure in video sequences, with applications in illumination-invariant tracking. IEEE Trans. Pattern Anal. Machine Intell. Vol. 29, 793–806 (2007)Google Scholar
  8. 8.
    Luenburger, D.: Optimization by Vector Space Methods. Wiley, New York (1969)Google Scholar
  9. 9.
    Hager, G.D., Belhumeur, P.: Efficient region tracking with parametric models of geometry and illumination. IEEE Trans. Pattern Anal. Mach. Intell. 20, 1025–1039 (1998)CrossRefGoogle Scholar
  10. 10.
    Koterba, S., Baker, S., Matthews, I., Hu, C., Xiao, H., Cohn, J., Kanade, T.: Multi-view aam fitting and camera calibration. In: IEEE Intl. Conf. Comput. Vision (2005)Google Scholar
  11. 11.
    Lepetit, V., Fua, P.: Monocular Model-Based 3D Tracking of Rigid Objects. Now Publishers Inc. (2005)Google Scholar
  12. 12.
    Fasel, B., Luettin, J.: Automatic facial expression analysis: a survey. Pattern Recognit. 86, 259–275 (2003)Google Scholar
  13. 13.
    Terzopoulos, D., Waters, K.: Analysis and synthesis of facial image sequences using physical and anatomical models. IEEE Trans. Pattern Anal. Mach. Intell. 15, 569–579 (1993)CrossRefGoogle Scholar
  14. 14.
    Black, M., Yacoob, Y.: Tracking and recognizing rigid and non-rigid facial motions using local parametric models of image motion. In: International Conference on Computer Vision, pp. 374–381 (1995)Google Scholar
  15. 15.
    Blanz, V., Vetter, T.: Face recognition based on fitting a 3D morphable model. IEEE Trans. Pattern Anal. Mach. Intell. 25, 1063–1074 (2003)CrossRefGoogle Scholar
  16. 16.
    Arulampalam, M., Maskell, A., Gordon, N., Clapp, T.: A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking. IEEE Trans. Signal Process. 50 (2002)Google Scholar
  17. 17.
    Dedeoglu, G., Baker, S., Kanade, T.: Resolution-aware fitting of active appearance models to low-resolution images. In: European Conference on Computer Vision (2006)Google Scholar
  18. 18.
    Yu, J., Bhanu, B., Xu, Y., Roy-Chowdhury, A.: Super-resolved facial texture under changing pose and illumination. In: International Conference on Image Processing (2007)Google Scholar

Copyright information

© Springer Science+Business Media, LLC 2009

Authors and Affiliations

  • Amit K. Roy-Chowdhury
    • 1
  • Yilei Xu
    • 1
  1. 1.Department of Electrical EngineeringUniversity of CaliforniaRiversideUSA