Abstract
In this paper, we present an effective approach for spatiotemporal face recognition from videos using an Extended set of Volume LBP (Local Binary Pattern features) and a boosting scheme. Among the key properties of our approach are: (1) the use of local Extended Volume LBP based spatiotemporal description instead of the holistic representations commonly used in previous works; (2) the selection of only personal specific facial dynamics while discarding the intra-personal temporal information; and (3) the incorporation of the contribution of each local spatiotemporal information. To the best of our knowledge, this is the first work addressing the issue of learning the personal specific facial dynamics for face recognition.
We experimented with three different publicly available video face databases (MoBo, CRIM and Honda/UCSD) and considered five benchmark methods (PCA, LDA, LBP, HMMs and ARMA) for comparison. Our extensive experimental analysis clearly assessed the excellent performance of the proposed approach, significantly outperforming the comparative methods and thus advancing the state-of-the-art.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
O’Toole, A.J., Roark, D.A., Abdi, H.: Recognizing moving faces: A psychological and neural synthesis. Trends in Cognitive Science 6, 261–266 (2002)
Zhao, W., Chellappa, R., Phillips, P.J., Rosenfeld, A.: Face recognition: A literature survey. ACM Computing Surveys 34(4), 399–458 (2003)
Li, Y.: Dynamic Face Models: Construction and Applications. PhD thesis, Queen Mary, University of London (2001)
Li, B., Chellappa, R.: Face verification through tracking facial features. Journal of the Optical Society of America 18, 2969–2981 (2001)
Zhou, S., Chellappa, R.: Probabilistic human recognition from video. In: European Conf. on Computer Vision, pp. 681–697 (May 2002)
Zhou, S., Krueger, V., Chellappa, R.: Face recognition from video: A condensation approach. In: IEEE Int. Conf. on Automatic Face and Gesture Recognition, pp. 221–228. IEEE Computer Society Press, Los Alamitos (2002)
Aggarwal, G., Chowdhury, A.R., Chellappa, R.: A system identification approach for video-based face recognition. In: 17th International Conference on Pattern Recognition, vol. 4, pp. 175–178 (August 2004)
Liu, X., Chen, T.: Video-based face recognition using adaptive hidden markov models. In: IEEE Int. Conf. on Computer Vision and Pattern Recognition, pp. 340–345. IEEE Computer Society Press, Los Alamitos (2003)
Lee, K.C., Ho, J., Yang, M.H., Kriegman, D.: Video-based face recognition using probabilistic appearance manifolds. In: IEEE Int. Conf. on Computer Vision and Pattern Recognition, pp. 313–320. IEEE Computer Society Press, Los Alamitos (2003)
Soatto, S., Doretto, G., Wu, Y.: Dynamic textures. In: International Conference on Computer Vision, Vancouver, BC, Canada, vol. 2, pp. 439–446 (July 2001)
Heisele, B., Ho, P., Wu, J., Poggio, T.: Face recognition: Component based versus global approaches. Computer Vision and Image Understanding 91(1-2), 6–21 (2003)
Ojala, T., Pietikäinen, M., Mäenpää, T.: Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. IEEE Transactions on Pattern Analysis and Machine Intelligence 24, 971–987 (2002)
Ahonen, T., Hadid, A., Pietikäinen, M.: Face description with local binary patterns: Application to face recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence 28(12), 2037–2041 (2006)
Zhao, G., Pietikäinen, M.: Dynamic texture recognition using local binary patterns with an application to facial expressions. IEEE Transactions on Pattern Analysis and Machine Intelligence 29(6), 915–928 (2007)
Freund, Y., Schapire, R.: A decision-theoretic generalization of on-line learning and an application to boosting. Journal of Computer and System Sciences 55(1), 119–139 (1997)
Ojala, T., Pietikäinen, M., Harwood, D.: A comparative study of texture measures with classification based on feature distributions. Pattern Recognition 29, 51–59 (1996)
Rabiner, L.R.: A tutorial on hidden markov models and selected applications in speech recognition. In: Proceedings of the IEEE, vol. 77(2), pp. 257–286. IEEE Computer Society Press, Los Alamitos (1989)
Cock, K., Moor, B.D.: Subspace angles between ARMA models. Systems and Control Letters 46(4), 265–270 (2002)
Hadid, A., Pietikäinen, M.: Selecting models from videos for appearance-based face recognition. In: 17th International Conference on Pattern Recognition, vol. 1, pp. 304–308 (August 2004)
Gross, R., Shi, J.: The CMU Motion of Body (MoBo) database. Technical Report CMU-RI-TR-01-18, Robotics Institute, Carnegie Mellon University (June 2001)
CRIM, http://www.crim.ca/
Krueger, V., Zhou, S.: Exemplar-based face recognition from video. In: European Conf. on Computer Vision, pp. 732–746 (May 2002)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Hadid, A., Pietikäinen, M., Li, S.Z. (2007). Learning Personal Specific Facial Dynamics for Face Recognition from Videos. In: Zhou, S.K., Zhao, W., Tang, X., Gong, S. (eds) Analysis and Modeling of Faces and Gestures. AMFG 2007. Lecture Notes in Computer Science, vol 4778. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-75690-3_1
Download citation
DOI: https://doi.org/10.1007/978-3-540-75690-3_1
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-75689-7
Online ISBN: 978-3-540-75690-3
eBook Packages: Computer ScienceComputer Science (R0)