Abstract
This paper presents a new method for face modeling and face recognition from a pair of calibrated stereo cameras. In a first step, the algorithm builds a stereo reconstruction of the face by adjusting the global transformation parameters and the shape parameters of a 3D morphable face model. The adjustment of the parameters is such that stereo correspondence between both images is established, i.e. such that the 3D-vertices of the model project on similarly colored pixels in both images. In a second step, the texture information is extracted from the image pair and represented in the texture space of the morphable face model. The resulting shape and texture coefficients form a person specific feature vector and face recognition is performed by comparing query vectors with stored vectors. To validate our algorithm, an extensive image database was built. It consists of stereo-pairs of 70 subjects. For recognition testing, the subjects were recorded under 6 different head directions, ranging from a frontal to a profile view. The face recognition results are very good, with 100% recognition on frontal views and 97% recognition on half-profile views.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Bartlett, M.S., Lades, H.M., Sejnowski, T.J.: Independent component representations for face recognition. Proc. of the SPIE Symposium on Electonic Imaging: Science and Technology, pp. 528–539 (1998)
Belhumeur, P.N., Hespanha, J.P., Kriegman, D.J.: Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection. IEEE Trans. PAMI 19(7), 711–720 (1997)
Belhumeur, P., Kriegman, D.: What is the Set of Images of an Object Under All Possible Lighting Conditions? IJCV 28(3), 245–260 (1998)
Beymer, D.: Face recognition under varying pose. Tech. Rep. 1461. MIT AI Lab, Massachusetts Institute of Technology, Cambridge, MA
Beymer, D.: Vectorizing face images by interleaving shape and texture computations. Tech. Rep. 1537, MIT AI Lab, Massachusetts Institute of Technology, Cambridge, MA
Blanz, V., Vetter, T.: A morphable model for the synthesis of 3D faces. In: SIGGRAPH 1999: Proc. of the 26th Annual Conference on Computer Graphics and Interactive Techniques, pp. 187–194 (1999)
Blanz, V., Vetter, T.: Face Recognition Based on Fitting a 3D Morphable Model. IEEE Trans. PAMI 25(9), 1063–1074 (2003)
Cootes, T.F., Taylor, C.J., Cooper, D.H., Graham, J.: Active Shape Models - Their Training and Application. Computer Vision and Image Understanding 61(1), 38–59 (1995)
Dimitrijevic, M., Ilic, S., Fua, P.: Accurate Face Models from Uncalibrated and Ill-Lit Video Sequences. In: IEEE Proc. Int. Conf. CVPR, vol. 2, pp. 1034–1041 (2004)
Lanitis, A., Taylor, C.J., Cootes, T.F.: Automatic Face Identification System Using Flexible Appearance Models. Image Vis. Comput. 13, 393–401 (1995)
Moghaddam, B., Pentland, A.: Probabilistic Visual Learning for Object Representation. IEEE Trans. Pattern Anal. Mach. Intell. 19, 696–710 (1997)
Pentland, A., Moghaddam, B., Starner, T.: View-Based and Modular Eigenspaces for Face Recognition. In: Proc. Int. Conf. Computer Vision and Pattern Recognition, pp. 84–91 (1994)
Shan, Y., Liu, Z., Zhang, Z.: Model-Based Bundle Adjustment with Application to Face Modeling. In: International Conference on Computer Vision, vol. 2, p. 644 (2001)
Turk, M., Pentland, A.: Eigenfaces for Recognition. Journal of Cognitive Neuroscience 3(1) (1991)
Wiskott, L., Fellous, J.-M., Kruger, N., von der Malsburg, C.: Face Recognition by Elastic Bunch Graph Matching. IEEE Trans. PAMI 19(7), 775–779 (1997)
Zhao, W., Chellappa, R., Phillips, P.J., Rosenfeld, A.: Face recognition: A literature survey. ACM Comput. Surv. 35(4), 399–458 (2003)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Fransens, R., Strecha, C., Van Gool, L. (2005). Parametric Stereo for Multi-pose Face Recognition and 3D-Face Modeling. In: Zhao, W., Gong, S., Tang, X. (eds) Analysis and Modelling of Faces and Gestures. AMFG 2005. Lecture Notes in Computer Science, vol 3723. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11564386_10
Download citation
DOI: https://doi.org/10.1007/11564386_10
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-29229-6
Online ISBN: 978-3-540-32074-6
eBook Packages: Computer ScienceComputer Science (R0)