Illumination Normalization for Color Face Images

  • Faisal R. Al-Osaimi
  • Mohammed Bennamoun
  • Ajmal Mian
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4291)


The performance of appearance based face recognition algorithms is adversely affected by illumination variations. Illumination normalization can greatly improve their performance. We present a novel algorithm for illumination normalization of color face images. Face Albedo is estimated from a single color face image and its co-registered 3D image (pointcloud). Unlike existing approaches, our algorithm takes into account both Lambertian and specular reflections as well as attached and cast shadows. Moreover, our algorithm is invariant to facial pose and expression and can effectively handle the case of multiple extended light sources. The approach is based on Phong’s lighting model. The parameters of the Phong’s model and the number, direction and intensities of the dominant light sources are automatically estimated. Specularities in the face image are used to estimate the directions of the dominant light sources. Next, the 3D face model is ray-casted to find the shadows of every light source. The intensities of the light sources and the parameters of the lighting model are estimated by fitting Phong’s model onto the skin data of the face. Experiments were performed on the challenging FRGC v2.0 data and satisfactory results were achieved (the mean fitting error was 6.3% of the maximum color value).


Face Recognition Face Image Facial Skin Illumination Normalization Specular Component 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Chen, H., Belhumuer, P., Jacobs, D.: In Search of Illumination Invariants. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 254–261 (2000)Google Scholar
  2. 2.
    Adini, Y., Moses, Y., Ullman, S.: Face Recognition: The Problem Of Compensating For Changes In Illumination Direction. IEEE Trans. Pattern Analysis and Machine Intelligence 19(7), 721–732 (1997)CrossRefGoogle Scholar
  3. 3.
    Lowe, D.G.: bject Recognition from Local Scale-invariant Features. In: International Conference on Computer Vision, pp. 1150–1157 (1999)Google Scholar
  4. 4.
    Gao, Y., Leung, M.: Face Recognition Using Line Edge Map. IEEE Transactions on Pattern Analysis and Machine Intelligence Pami 24(6), 764–779 (2002)CrossRefGoogle Scholar
  5. 5.
    Moghaddam, B., Pentland, A.: Probabalistic Visual Learning for Object Representation. IEEE Transactions on Pattern Analysis and Machine Intelligence Pami 19(7), 694–710 (1997)Google Scholar
  6. 6.
    Weiss, Y.: Deriving Intrinsic Images from Sequences. In: Proc. of Int. Conf. Computer Vision (2001)Google Scholar
  7. 7.
    Jacobs, D., Belhumeur, P., Basri, R.: Comparing Images under Variable Illumination. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 610–617 (1998)Google Scholar
  8. 8.
    Liu, C., Wechsler, H.: A Gabor Feature Classifier for Face Recognition. In: Proc. of Int. Conf. Computer Vision (2001)Google Scholar
  9. 9.
    Duc, B., Fischer, S., Bigun, J.: Face authentication with Gabor information on deformable graphs. IEEE Transactions On Image Processing 8(4), 504–516 (1999)CrossRefGoogle Scholar
  10. 10.
    Lyons, M., Budynek, J., Akamatsu, S.: Automatic classification of single facial images. IEEE Transactions on Pattern Analysis and Machine Intelligence Pami 21(12), 1357–1362 (1999)CrossRefGoogle Scholar
  11. 11.
    Georghiades, A., Belhumeur, P., Kriegman, D.: From Few to Many: Illumination Cone Models for Face Recognition under Variable Lighting and Pose. EEE Transactions on Pattern Analysis and Machine Intelligence Pami 23(6), 643–660 (2001)CrossRefGoogle Scholar
  12. 12.
    and, What is the Set of Images of an Object under all Possible Illumination Conditions? International Journal of Computer Vision 28(3), 245–260 (1998)Google Scholar
  13. 13.
    Ramamoorthi, R., Hanrahan, P.: On the relationship between radiance and irradiance: determining the illumination from images of a convex Lambertian object. Journal- Optical Society of America A 18(10), 2448–2459 (2001)CrossRefMathSciNetGoogle Scholar
  14. 14.
    Basri, R., Jacobs, D.: Lambertian Reflectance and Linear Subspaces. IEEE Transactions on Pattern Analysis and Machine Intelligence Pami 25(2), 218–232 (2003)CrossRefGoogle Scholar
  15. 15.
    and, Adaptive Histogram Equalization and its variations. Computer Vision, Graphics, and Image Processing 39(3), 355–368 (1987)Google Scholar
  16. 16.
    Bovik, A.: Handbook of image and video processing. Academic Press, London (2000)zbMATHGoogle Scholar
  17. 17.
    Shan, S., Gao, W., Cao, B., Zhao, D.: Illumination Normalization for Robust Face Recognition Against Varying Lighting Conditions. In: IEEE Workshop on AMFG (2003)Google Scholar
  18. 18.
    Lee, C., Moghaddam, B.: A Practical Face Relighting Method for Directional Light Normalization. In: Zhao, W., Gong, S., Tang, X. (eds.) AMFG 2005. LNCS, vol. 3723, Springer, Heidelberg (2005)Google Scholar
  19. 19.
    Riklin-Raviv, Shashua, A.: The Quotient Image: Class-Based Re-Rendering and Recognition with Varying Illuminations. IEEE Transactions on Pattern Analysis and Machine Intelligence Pami 23(2), 129–139 (2001)CrossRefGoogle Scholar
  20. 20.
    Shafer, S.: Using Color to Separate Reflection Components. COLOR Research and Applications 10(4), 210–218 (1985)CrossRefGoogle Scholar
  21. 21.
    Phong, B.: Illumination for computer generated images. Comm. ACM 18(6), 311–317 (1975)CrossRefGoogle Scholar
  22. 22.
    Foley, J., Dam, A., Feiner, S., Hughes, J.: Computer Graphics: Principles and Practice. Addison-Wesley, Reading (1990)Google Scholar
  23. 23.
    Wang, J., Yang, W., Acharya, R.: Color clustering techniques for color-content-based image retrieval from image databases. IEEE International Conference on Multimedia Computing and Systems, 442–449 (1997)Google Scholar
  24. 24.
    Sobottka, K., Pitas, I.: A Novel Method for Automatic Face Segmentation, Facial Feature Extraction and Tracking. Signal Processing: Image Comm. 12(3), 263–281 (1998)CrossRefGoogle Scholar
  25. 25.
    Phung, S., Bouzerdoum, A., Chai, D.: Skin segmentation using color pixel classification: analysis and comparison. IEEE Transactions on Pattern Analysis and Machine Intelligence Pami 27(1), 148–154 (2005)CrossRefGoogle Scholar
  26. 26.
    Jain, A., Murty, M., Flynn, P.: Data Clustering: A Review. Computing Surveys 31(3), 264–323 (1999)CrossRefGoogle Scholar
  27. 27.
    Phillips, P., Flynn, P., Scruggs, T., Bowyer, K., Chang, J., Hoffman, K., Marques, J., Min, J., Worek, W.: Overview of the Face Recognition Grand Challenge. IEEE Computer Vision and Pattern Recognition 1, 947–954 (2005)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Faisal R. Al-Osaimi
    • 1
  • Mohammed Bennamoun
    • 1
  • Ajmal Mian
    • 1
  1. 1.The University of Western AustraliaCrawleyAustralia

Personalised recommendations