Abstract
We present a fast and robust iterative method for interpreting face images under non-uniform lighting conditions by using a fitting algorithm which utilizes an illumination-based 3D active appearance model in order to fit a face model to an input face image. Our method is based on improving the Jacobian each iteration using the parameters of lighting that have been estimated in preceding iterations. In the training stage, we precalculate a set of synthetic face images of basis reflectances and albedo generated from displacing one at the time, each one of the model parameters, and subsequently, in the fitting stage, we use all these images in combination with lighting parameters for assembling a Jacobian matrix adapted to the illumination estimated in the last iteration. In contrast to other works where an initial pose is required to begin the fit, our approach only uses a simple initialization in translation and scale. At the end of the fitting process, our algorithm obtains a compact set of parameters of albedo, 3D shape, 3D pose and illumination which describe the appearance of the input face image.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Baker, S., Matthews, I.: Equivalence and Efficiency of Image Alignment Algorithms. In: Proceedings IEEE Conf. on Computer Vision and Pattern Recognition (2001)
Blanz, V., Vetter, T.: A Morphable Model for the Synthesis of 3D Faces. In: Siggraph 1999, pp. 187–194 (1999)
Blanz, V., Vetter, T.: Face Recognition Based on Fitting a 3D Morphable Model. IEEE Transaction Pattern Analysis and Machine Intelligence 25, 1063–1074 (2003)
Romdhani, S., Blanz, V., Vetter, T.: Face Identification by Fitting a 3D Morphable Model Using Linear Shape and Texture Error Functions. In: Heyden, A., Sparr, G., Nielsen, M., Johansen, P. (eds.) ECCV 2002. LNCS, vol. 2353, pp. 3–19. Springer, Heidelberg (2002)
Romdhani, S., Pierrard, J.S., Vetter, T.: 3D Morphable Face Model, a Unified Approach for Analysis and Synthesis of Images. In: Face Processing: Advanced Modeling and Methods. Elsevier, Amsterdam (2005)
Romdhani, S., Ho, J., Vetter, T., Kriegman, D.J.: Face Recognition Using 3-D Models: Pose and Illumination. In: Proceedings of the IEEE, vol. 94, pp. 1977–1999 (2006)
Cootes, T.F., Edwards, G.J., Taylor, C.J.: Active Appearance Models. In: Burkhardt, H., Neumann, B. (eds.) ECCV 1998. LNCS, vol. 1407, pp. 484–498. Springer, Heidelberg (1998)
Cootes, T.F., Edwards, G.J., Taylor, C.J.: Active Appearance Models. IEEE Transactions on Pattern Analysis and Machine Intelligence 23, 681–685 (2001)
Xiao, J., Baker, S., Matthews, I., Kanade, T.: Real-Time Combined 2D+3D Active Appearance Models. In: CVPR 2004, vol. 2, pp. 535–542 (2004)
Matthews, I., Baker, S.: Active Appearance Models Revisited. International Journal on Computer Vision 60, 135–164 (2004)
Huang, Y., Lin, S., Li, S.Z., Lu, H., Shum, H.Y.: Face Alignment Under Variable Illumination. In: Proceedings of the FGR 2004, pp. 85–90 (2004)
Le Gallou, S., Breton, G., García, C., Séguier, R.: Distance Maps: A Robust Illumination Preprocessing for Active Appearance Models. In: VISAPP 2006, vol. 2, pp. 35–40 (2006)
Kahraman, F., Gökmen, M., Darkner, S., Larsen, R.: An Active Illumination and Appearance (AIA) Model for Face Alignment. In: CVPR 2007 (2007)
Dornaika, F., Ahlberg, J.: Fast And Reliable Active Appearance Model Search For 3d Face Tracking. In: Proceedings of Mirage 2003, pp. 10–11. INRIA Rocquencourt, France (2003)
Sattar, A., Aidarous, Y., Le Gallou, S., Séguier, R.: Face Alignment by 2.5D Active Appearance Model Optimized by Simplex. In: ICVS 2007, Bielefeld University, Germany (2007)
Basri, R., Jacobs, D.W.: Lambertian Reflectance and Linear Subspaces. IEEE Transactions on Pattern Analysis and Machine Intelligence 25, 218–233 (2003)
Lee, K.C., Ho, J., Kriegman, D.J.: Nine Points of Light: Acquiring Subspaces for Face Recognition under Variable Lighting. In: CVPR 2001, pp. 519–526 (2001)
Belhumeur, P., Kriegman, D.: What is the Set of Images of an Object Under all Possible Illumination Conditions. Int. J. Computer Vision 28, 245–260 (1998)
Georghiades, A.S., Belhumeur, P.N., Kriegman, D.J.: From Few to Many: Illumination Cone Models for Face Recognition Under Variable Lighting and Pose. IEEE Transactions on Pattern Analysis and Machine Intelligence 23, 643–660 (2001)
Ramamoorthi, R., Hanrahan, P.: An Efficient Representation for Irradiance Environment Maps. In: Proc. ACM SIGGRAPH, pp. 497–500 (2001)
Kovesi, P.: Shapelets Correlated with Surface Normals Produce Surfaces. In: ICCV 2005, pp. 994–1001 (2005)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Ayala-Raggi, S.E., Altamirano-Robles, L., Cruz-Enriquez, J. (2009). Interpreting Face Images by Fitting a Fast Illumination-Based 3D Active Appearance Model. In: Gagalowicz, A., Philips, W. (eds) Computer Vision/Computer Graphics CollaborationTechniques. MIRAGE 2009. Lecture Notes in Computer Science, vol 5496. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-01811-4_33
Download citation
DOI: https://doi.org/10.1007/978-3-642-01811-4_33
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-01810-7
Online ISBN: 978-3-642-01811-4
eBook Packages: Computer ScienceComputer Science (R0)