Encyclopedia of Biometrics

2009 Edition
| Editors: Stan Z. Li, Anil Jain

Face Recognition, Video-Based

  • Rama Chellappa
  • Gaurav Aggarwal
  • S. Kevin Zhou
Reference work entry
DOI: https://doi.org/10.1007/978-0-387-73003-5_96



Video-based face recognition is the technique of establishing the identity of one or multiple persons present in a video, based on their facial characteristics. Given the input face video, a typical video-based face recognition approach combines the temporal characteristics of facial motion with appearance changes for recognition. This often involves  temporal characterization of faces for recognition, building 3D model or a super-resolution image of the face, or simply learning the appearance variations from the multiple video frames. The ability to generalize across pose, illumination, expression, etc. depends on the choice of combination. Video-based face recognition is particularly useful in surveillance scenarios in which it may not be possible to capture a single good frame as required by most still image based methods.


Face recognition is one of the most successful applications...

This is a preview of subscription content, log in to check access.


  1. 1.
    Zhao, W., Chellappa, R., Phillips, P.J., Rosenfeld, A.: Face recognition: A literature survey. ACM Comput. Surv. 35(4), 399–458 (2003)CrossRefGoogle Scholar
  2. 2.
    O’Toole, A.J., Roark, A., Abdi, H.: Recognizing moving faces: A psychological and neural synthesis. Trends Cogn. Sci. 6, 261–266 (2002)CrossRefGoogle Scholar
  3. 3.
    Hadid, A., Pietikainen, M.: An experimental investigation about the integration of facial dynamics in video-based face recognition. Electronic Lett. Comput. Vis. Image Anal. 5(1), 1–13 (2005)Google Scholar
  4. 4.
    Ekenel, H., Pnevmatikakis, A.: Video-based face recognition evaluation in the chil project - run 1. In: Proceedings of the seventh International Conference on Automatic Face and Gesture Recognition, pp. 85–90 (2006)Google Scholar
  5. 5.
    Gorodnichy , D. O. (Editor): Face processing in video sequences. Image and Vis. Comput. 24(6), 551–648 (2006)Google Scholar
  6. 6.
    Grother, P., Micheals, R., Phillips, P.: Face recognition vendor test 2002 performance metrics. In: Proceedings of fourth International Conference on Audio and Video-Based Biometric Person Authentication, pp. 937–945 (2003)Google Scholar
  7. 7.
    Zhou, S., Kruger, V., Chellappa, R.: Probabilistic recognition of human faces from video. Comput. Vis. Image Underst. 91(1–2), 214–245 (2003)CrossRefGoogle Scholar
  8. 8.
    Gross, R., Shi, J.: The cmu motion of body (mobo) database.Tech. Rep. CMU-RI-TR-01-18, Robotics Institute, CarnegieMellon University, Pittsburgh, PA (2001)Google Scholar
  9. 9.
    Lee, K.C., Ho, J., Yang, M.H., Kriegman, D.: Visual tracking and recognition using probabilistic appearance manifolds. Comput. Vis. Image Underst. 99(3), 303–331 (2005)CrossRefGoogle Scholar
  10. 10.
    Li, B., Chellappa, R.: Face verification through tracking facial features. J. Opt. Soc. Am. A 18(12), 2969–2981 (2001)CrossRefGoogle Scholar
  11. 11.
    Liu, X., Chen, T.: Video-based face recognition using adaptive hidden markov models. In: Proceedings of International Conference on Computer Vision and Pattern Recognition, pp. 340–345 (2003)Google Scholar
  12. 12.
    Aggarwal, G., Roy-Chowdhury, A.K., Chellappa, R.: A system identification approach for video-based face recognition. In: Proceedings of International Conference on Pattern Recognition, pp. 175–178 (2004)Google Scholar
  13. 13.
    Liu, J.S.: Monte carlo strategies in scientific computing. Springer (2002)Google Scholar
  14. 14.
    Aggarwal, G., Veeraraghavan, A., Chellappa, R.: 3d facial pose tracking in uncalibrated videos. In: Proceedings of International Conference on Pattern Recognition and Machine Intelligence, pp. 515–520 (2005)Google Scholar
  15. 15.
    Arandjelovic, O., Cipolla, R.: Face recognition for video using the general shape-illumination manifold. In: Proceedings of European Conference on Computer Vision, pp. 27–40 (2006)Google Scholar

Copyright information

© Springer Science+Business Media, LLC 2009

Authors and Affiliations

  • Rama Chellappa
    • 1
  • Gaurav Aggarwal
    • 1
  • S. Kevin Zhou
    • 2
  1. 1.University of MarylandCollege ParkUSA
  2. 2.Siemens Corporate ResearchPrincetonUSA