Abstract
Photometric stereo algorithms use a Lambertian reflectance model with a varying albedo field and involve the appearances of only one object. This paper extends photometric stereo algorithms to handle all the appearances of all the objects in a class, in particular the class of human faces. Similarity among all facial appearances motivates a rank constraint on the albedos and surface normals in the class. This leads to a factorization of an observation matrix that consists of exemplar images of different objects under different illuminations, which is beyond what can be analyzed using bilinear analysis. Bilinear analysis requires exemplar images of different objects under same illuminations. To fully recover the class-specific albedos and surface normals, integrability and face symmetry constraints are employed. The proposed linear algorithm takes into account the effects of the varying albedo field by approximating the integrability terms using only the surface normals. As an application, face recognition under illumination variation is presented. The rank constraint enables an algorithm to separate the illumination source from the observed appearance and keep the illuminant-invariant information that is appropriate for recognition. Good recognition results have been obtained using the PIE dataset.
Partially supported by the DARPA/ONR Grant N00014-03-1-0520.
Chapter PDF
Similar content being viewed by others
References
Basri, R., Jacobs, D.: Lambertian reflectance and linear subspaces. IEEE Trans. Pattern Analysis and Machine Intelligence 25(2), 218–233 (2003)
Basri, R., Jacobs, D.: Photometric stereo with general, unknown lighting. In: IEEE Conf. on Computer Vision and Pattern Recognition, pp. 374–381 (2001)
Jacobs, D.: Linear fitting with missing data for structure-from-motion. Computer Vision and Image Understanding 82, 57–81 (2001)
Shashua, A.: On photometric issues in 3D visual recognition from a single 2D image. International Journal of Computer Vision 21(1), 99–122 (1997)
Shashua, A., Raviv, T.R.: The quotient image: Class based re-rendering and recognition with varying illuminations. IEEE Trans. Pattern Analysis and Machine Intelligence 23(2), 129–139 (2001)
Yuille, L., Snow, D., Epstein, R., Belhumeur, P.N.: Determining generative models of objects under varying illumination: Shape and albedo from multiple images using SVD and integrability. International Journal of Computer Vision 35(3), 203–222 (1999)
Zhao, W., Chellappa, R.: Symmetric shape from shading using self-ratio image. International Journal of Computer Vision 45, 55–752 (2001)
Georghiades, A., Belhumeur, P., Kriegman, D.: From few to many: illumination cone models for face recognition under variable lighting and pose. IEEE Trans. Pattern Analysis and Machine Intelligence 23, 643–660 (2001)
Frankot, R.T., Chellappa, R.: A method for enforcing integrability in shape from shading problem. IEEE Trans. Pattern Analysis and Machine Intelligence PAMI-10, 439–451 (1987)
Forsyth, D.: Shape from texture and integrability. In: International Conference on Computer Vision, pp. 447–453 (2001)
Shimshoni, I., Moses, Y., Lindenbaum, M.: Shape reconstruction of 3D bilaterally symmetric surfaces. International Journal of Computer Vision 39, 97–100 (2000)
Sim, T., Baker, S., Bsat, M.: The CMU pose, illuminatin, and expression (PIE) database. In: Prof. Face and Gesture Recognition, pp. 53–58 (2002)
Philipps, P.J., Moon, H., Rauss, P., Rivzi, S.: The FERET evaluation methodology for face-recognition algorithms. IEEE Trans. Pattern Analysis and Machine Intelligence 22, 1090–1104 (2000)
Freeman, W.T., Tenenbaum, J.B.: Learning bilinear models for two-factor problems in vision. In: IEEE Conf. on Computer Vision and Pattern Recognition (1997)
Turk, M., Pentland, A.: Eigenfaces for recognition. Journal of Cognitive Neuroscience 3, 72–86 (1991)
Brand, M.E.: Incremental singular value decomposition of uncertain data with missing values. In: Heyden, A., Sparr, G., Nielsen, M., Johansen, P. (eds.) ECCV 2002. LNCS, vol. 2350, pp. 707–720. Springer, Heidelberg (2002)
Belhumeur, P., Kriegman, D., Yuille, A.: The bas-relief ambiguity. International Journal of Computer Vision 35, 33–44 (1999)
Blanz, V., Vetter, T.: Face recognition based on fitting a 3D morphable model. IEEE Trans. Pattern Analysis and Machine Intelligence 25, 1063–1074 (2003)
Zheng, Q.F., Chellappa, R.: Estimation of illuminant direction, albedo and shape from shading. IEEE Trans. Pattern Analysis and Machine Intelligence PAMI-13, 680–702 (1991)
Shashua, A., Levin, A.: Linear Image Coding for Regression and Classification using the Tensor-rank Principle. In: IEEE Conf. on Computer Vision and Pattern Recognition (2001)
Bregler, C., Hertzmann, A., Biermann, H.: Recovering Non-Rigid 3D Shape from Image Streams. In: IEEE Conf. on Computer Vision and Pattern Recognition (2000)
Vasilescu, M.A.O., Terzopoulos, D.: Multilinear Analysis of Image Ensembles: TensorFaces. In: Heyden, A., Sparr, G., Nielsen, M., Johansen, P. (eds.) ECCV 2002. LNCS, vol. 2350, pp. 447–460. Springer, Heidelberg (2002)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2004 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Zhou, S.K., Chellappa, R., Jacobs, D.W. (2004). Characterization of Human Faces under Illumination Variations Using Rank, Integrability, and Symmetry Constraints. In: Pajdla, T., Matas, J. (eds) Computer Vision - ECCV 2004. ECCV 2004. Lecture Notes in Computer Science, vol 3021. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-24670-1_45
Download citation
DOI: https://doi.org/10.1007/978-3-540-24670-1_45
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-21984-2
Online ISBN: 978-3-540-24670-1
eBook Packages: Springer Book Archive