General Pose Face Recognition Using Frontal Face Model
We present a face recognition system able to identify people from a single non-frontal image in an arbitrary pose. The key component of the system is a novel pose correction technique based on Active Appearance Models (AAMs), which is used to remap probe images into a frontal pose similar to that of gallery images. The method generalises previous pose correction algorithms based on AAMs to multiple axis head rotations. We show that such model can be combined with image warping techniques to increase the textural content of the images synthesised. We also show that bilateral symmetry of faces can be exploited to improve recognition. Experiments on a database of 570 non-frontal test images, which includes 148 different identities, show that the method produces a significant increase in the success rate (up to 77.4%) compared to conventional recognition techniques which do not consider pose correction.
KeywordsFace Recognition Active Appearance Model Face Recognition System View Synthesis Gallery Image
Unable to display preview. Download preview PDF.
- 1.Phillips, P., Grother, P., Micheals, R., Blackburn, D., Tabassi, E., Bone, J.: Face recognition vendor test 2002: Evaluation report (2003)Google Scholar
- 2.Beymer, D.J.: Face recognition under varying pose. In: Proc. IEEE Conference on Computer Vision and Pattern Recognition, pp. 756–761 (1994)Google Scholar
- 3.Pentland, A., Moghaddam, B., Starner, T.: View-based and modular eigenspaces for face recognition. In: Proc. IEEE Conference on Computer Vision and Pattern Recognition, pp. 84–91 (1994)Google Scholar
- 7.Graham, D.B., Allinson, N.M.: Face recognition from unfamiliar views: Subspace methods and pose dependency. In: Proc. IEEE International Conference on Automatic Face and Gesture Recognition, pp. 348–353 (1998)Google Scholar
- 13.Kang, H., Taylor, T.F.C., C.J.: A comparison of face verification algorithms using appearance models. In: Proc. British Machine Vision Conference, vol. 2, pp. 477–486 (2002)Google Scholar
- 15.Blanz, V., Grother, P., Phillips, P.J., Vetter, T.: Face recognition based on frontal views generated from non-frontal images. In: Proc. IEEE Conference on Computer Vision and Pattern Recognition, vol. 2, pp. 454–461 (2005)Google Scholar
- 16.Zhao, W., Chellappa, R.: SFS based view synthesis for robust face recognition. In: Proc. IEEE International Conference on Automatic Face and Gesture Recognition, pp. 285–292 (2000)Google Scholar
- 17.Gonzalez, R.C., Woods, R.E.: Digital Image Processing, 2nd edn. Prentice-Hall, Englewood Cliffs (2002)Google Scholar
- 19.Li, Y.: Linear Discriminant Analysis and its application to Face Identification. PhD thesis, University of Surrey (2000)Google Scholar
- 22.Messer, K., Matas, J., Kittler, J., Luettin, J., Maitre, G.: XM2VTSDB: The extended M2VTS database. In: Proceedings of International Conference on Audio- and VideoBased Biometric Person Authentication (AVBPA), pp. 72–77 (1999)Google Scholar