Abstract
We propose a simplified and practical computational technique for estimating directional lighting in uncalibrated images of faces in frontal pose. We show that this inverse problem can be solved using constrained least-squares and class-specific priors on shape and reflectance. For simplicity, the principal illuminant is modeled as a mixture of Lambertian and ambient components. By using a generic 3D face shape and an average 2D albedo we can efficiently compute the directional lighting with surprising accuracy (in real-time and with or without shadows). We then use our lighting direction estimate in a forward rendering step to “relight” arbitrarily-lit input faces to a canonical (diffuse) form as needed for illumination-invariant face verification. Experimental results with the Yale Face Database B as well as real access-control datasets illustrate the advantages over existing pre-processing techniques such as a linear ramp (facet) model commonly used for lighting normalization.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Basri, R., Jacobs, D.: Lambertian reflectance and linear subspaces. In: Int’l Conf. on Computer Vision, vol. 2, pp. 383–390 (2001)
Belhumeur, P., Kriegman, D.: What is the set of images of an object under all possible lighting conditions. Int’l J. Computer Vision 28, 245–260 (1998)
Chen, H., Belhumeur, P., Jacobs, D. In search of illumination invariants. In: Proc. IEEE Conf. on Computer Vision & Pattern Recognition, pp. 1–8 (2000)
DARPA. The HumanID 3D Face Database, courtesy of Prof. Sudeep Sarkar, University of South Florida, Tampa Fl. USA
Georghiades, A., Kriegman, D., Belhumeur, P.: From few to many: Generative models for recognition under variable pose and illumination. IEEE Trans. on Pattern Analysis and Machine Intelligence 40, 643–660 (2001)
Jones, M.J., Viola, P.: Fast multi-view face detection. In: Proc. IEEE Conf. on Computer Vision & Pattern Recognition (2003)
Lee, K.C., Ho, J., Kriegman, D.: Nine points of light: Acquiring subspaces for face recognition under variable lighting. In: Proc. IEEE Conf. on Computer Vision & Pattern Recognition, pp. 519–526 (2001)
Nishino, K., Nayar, S.K.: Eyes for relighting. In: Proceedings of SIGGRAPH (2004)
Phillips, J.: Face Recogntion Vendor Test 2002 report. Technical report, National Institute of Standards and Technology (March 2003)
Phillips, J., Moon, H., Rizvi, S., Rauss, P.: The FERET evaluation methodology for face-recognition algorithms. IEEE Trans. on Pattern Analysis and Machine Intelligence 22(10), 1090–1104 (2000)
Ramamoorthi, R.: Analytic PCA construction for theoretical analysis of lighting variability in images of a lambertian object. IEEE Trans. on Pattern Analysis and Machine Intelligence, 24 (October 2002)
Rammamoorthi, R., Hanrahan, P.: A signal processing framework for inverse rendering. In: Proceedings of SIGGRAPH (2001)
Rowley, H., Kanade, T.: Neural network0based face detection. IEEE Trans. on Pattern Analysis and Machine Intelligence 20(1), 23–38 (1998)
Shashua, A., Riklin-Raviv, T.: The quotient image: Class-based re-rendering and recognition with varying illuminations. IEEE Trans. on Pattern Analysis and Machine Intelligence 23(2), 129–139 (2001)
Wen, Z., Liu, Z., Huang, T.S.: Face relighting with radiance environment maps. In: Proc. IEEE Conf. on Computer Vision & Pattern Recognition (2003)
Zhang, L., Samaras, D.: Face recognition under variable lighting using harmonic image exemplars. In: Proceedings of Computer Vision and Pattern Recognition, pp. 19–25 (2003)
Zhao, W.Y., Chellappa, R.: Symmetric shape-from-shading using self-ratio image. Int’l J. Computer Vision 45(1), 55–75 (2001)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Lee, KC., Moghaddam, B. (2005). A Practical Face Relighting Method for Directional Lighting Normalization. In: Zhao, W., Gong, S., Tang, X. (eds) Analysis and Modelling of Faces and Gestures. AMFG 2005. Lecture Notes in Computer Science, vol 3723. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11564386_13
Download citation
DOI: https://doi.org/10.1007/11564386_13
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-29229-6
Online ISBN: 978-3-540-32074-6
eBook Packages: Computer ScienceComputer Science (R0)