Facial Gender Classification Using Shape from Shading and Weighted Principal Geodesic Analysis

  • Jing Wu
  • W. A. P. Smith
  • Edwin R. Hancock
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5112)


In this paper, we investigate gender classification based on 2.5D facial surface normals (facial needle-maps) which can be recovered from 2D intensity images using a non-lambertian Shape-from-shading (SFS) method. We also describe a weighted principal geodesic analysis (WPGA) method to extract features from facial surface normals. By incorporating the weight matrix into principal geodesic analysis (PGA), we control the obtained principal variance axes to be in the direction of the variance on gender information. For classification, an a posteriori probability based method is adopted. Experimental results confirms that using WPGA increases the gender discriminating power in the leading eigenvectors, and also demonstrates the feasibility of gender classification based on facial shape information.


Weight Matrix Projection Matrix Gender Information Diagonal Weight Matrix Facial Gender 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Blanz, V., Vetter, T.: A Morphable Model for the Synthesis of 3D Faces. In: SIGGRAPH 1999 Conference Proceedings, pp. 187–194 (1999)Google Scholar
  2. 2.
    Bruce, V., Burton, A.M., Hanna, E., Healey, P., Mason, O., Coombes, A., Fright, R., Linney, A.: Sex discrimination: how do we tell the difference between male and female faces? Perception 22, 131–152 (1993)CrossRefGoogle Scholar
  3. 3.
    Burton, A.M., Bruce, V., Dench, N.: What’s the difference between men and women? Evidence from facial measurement. Perception 22, 153–176 (1993)CrossRefGoogle Scholar
  4. 4.
    Buchala, S., Davey, N., Gale, T.M., Frank, R.J.: Principal Component Analysis of Gender, Ethnicity, Age, and Identity of Face Images. In: Proc. IEEE ICMI (2005)Google Scholar
  5. 5.
    Devijver, P., Kittler, J.: Pattern Recognition: A Statistical Approach. Prentice-Hall, Englewood Cliffs (1982)zbMATHGoogle Scholar
  6. 6.
    Fletcher, P.T., Joshi, S., Lu, C., Pizer, S.M.: Principal geodesic analysis for the study of nonlinear statistics of shape. IEEE Transactions on Medical Imaging 23, 995–1005 (2004)CrossRefGoogle Scholar
  7. 7.
    Lyons, M.J., Akamatsu, S., Kamachi, M., Gyoba, J.: Coding Facial Expressions with Gabor Wavelets. In: Proceedings, Third IEEE International Conference on Automatic Face and Gesture Recognition, Nara Japan, April 14-16, 1998, pp. 200–205. IEEE Computer Society, Los Alamitos (1998)CrossRefGoogle Scholar
  8. 8.
    Lyons, M.J., Budynek, J., Akamatsu, S.: Automatic Classification of Single Facial Images. IEEE Transactions on Pattern Analysis and Machine Intelligence 21(12), 1357–1362 (1999)CrossRefGoogle Scholar
  9. 9.
    Lu, X., Chen, H., Jain, A.K.: Multimodal Facial Gender and Ethnicity Identification. In: Zhang, D., Jain, A.K. (eds.) ICB 2005. LNCS, vol. 3832, pp. 554–561. Springer, Heidelberg (2005)CrossRefGoogle Scholar
  10. 10.
    Martinez, A.M., Benavente, R.: The AR Face Database. CVC Technical Report (June 24, 1998)Google Scholar
  11. 11.
    Moghaddam, B., Yang, M.H.: Learning gender with support faces. IEEE Transaction Pattern Analysis and Machine Intelligence 24(5), 707–711 (2002)CrossRefGoogle Scholar
  12. 12.
    Pennec, X.: Probabilities and statistics on riemannian manifolds: A geometric approach. Technical Report RR-5093, INRIA (2004)Google Scholar
  13. 13.
    Saatci, Y., Town, C.P.: Cascaded Classification of Gender and Facial Expression using Active Appearance Models. In: Proc. International Conference on Automatic Face and Gesture Recognition (2006)Google Scholar
  14. 14.
    Sirovich, L.: Turbulence and the dynamics of coherent structures. Quart. Applied Mathematics XLV(3), 561–590 (1987)MathSciNetGoogle Scholar
  15. 15.
    Smith, W.A.P., Hancock, E.R.: A New Framework for Grayscale and Colour Non-Lambertian Shape-from-shading. In: Proc. ACCV, pp. 869–880 (2007)Google Scholar
  16. 16.
    Torrance, K., Sparrow, E.: Theory for off-specular reflection from roughened surfaces. J. Opt. Soc. Am. 57, 1105–1114 (1967)CrossRefGoogle Scholar
  17. 17.
    Troje, N., Bulthoff, H.H.: Face recognition under varying poses: The role of texture and shape. Vision Research 36, 1761–1771 (1996)CrossRefGoogle Scholar
  18. 18.
    Wu, J., Smith, W.A.P., Hancock, E.R.: Learning Mixture Models for Gender Classification based on Facial Surface Normals. In: Martí, J., Benedí, J.M., Mendonça, A.M., Serrat, J. (eds.) IbPRIA 2007. LNCS, vol. 4477, pp. 39–46. Springer, Heidelberg (2007)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2008

Authors and Affiliations

  • Jing Wu
    • 1
  • W. A. P. Smith
    • 1
  • Edwin R. Hancock
    • 1
  1. 1.Department of Computer ScienceThe University of YorkYorkUK

Personalised recommendations