Manifold Learning for Gender Classification from Face Sequences

  • Abdenour Hadid
  • Matti Pietikäinen
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5558)


We propose a novel approach to gender recognition for cases when face sequences are available. Such scenarios are commonly encountered in many applications such as human-computer interaction and visual surveillance in which input data generally consists of video sequences. Instead of treating each facial image as an isolated pattern and then combining the results (at feature, decision or score levels) as generally done in previous works, we propose to exploit the correlation between the face images and look at the problem of gender classification from manifold learning point of view. Our approach consists of first learning and discovering the hidden low-dimensional structure of male and female manifolds using an extension to the Locally Linear Embedding algorithm. Then, a target face sequence is projected into both manifolds for determining the gender of the person in the sequence. The matching is achieved using a new manifold distance measure. Extensive experiments on a large set of face sequences and different image resolutions showed very promising results, outperforming many traditional approaches.


Face Image Local Binary Pattern Locally Linear Embedding Manifold Learn Nonlinear Dimensionality Reduction 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. 1.
    Moghaddam, B., Yang, M.H.: Learning gender with support faces. IEEE Transactions on PAMI 24(5), 707–711 (2002)Google Scholar
  2. 2.
    Baluja, S., Rowley, H.: Boosting sex identification performance. International Journal of Computer Vision 71, 111–119 (2007)Google Scholar
  3. 3.
    Kohonen, T. (ed.): Self-Organizing Maps. Springer, Berlin (1997)Google Scholar
  4. 4.
    Bartholomew, D.J., Knott, M. (eds.): Latent variable models and factor analysis multidimensional scaling. Arnold Publication (1999)Google Scholar
  5. 5.
    Bishop, C.M., Svensen, M., Williams, C.K.I.: GTM: The generative topographic mapping. Neural Computation 10(1), 215–234 (1998)Google Scholar
  6. 6.
    Sammon, J.: A nonlinear mapping for data structure analysis. IEEE Transactions on Computers 18(5), 401–409 (1969)Google Scholar
  7. 7.
    Roweis, S.T., Saul, L.K.: Nonlinear dimensionality reduction by locally linear embedding. Science 290(5500), 2323–2326 (2000)Google Scholar
  8. 8.
    Tenenbaum, J.B., DeSilva, V., Langford, J.C.: A global geometric framework for nonlinear dimensionality reduction. Science 290(5500), 2319–2323 (2000)Google Scholar
  9. 9.
    Belkin, M., Niyogi, P.: Laplacian eigenmaps and spectral techniques for embedding and clustering. In: Dietterich, T.G., Becker, S., Ghahramani, Z. (eds.) Advances in Neural Information Processing Systems 14, pp. 585–591. MIT Press, Cambridge (2002)Google Scholar
  10. 10.
    Kouropteva, O., Okun, O., Pietikäinen, M.: Semisupervised visualization of high-dimensional data. Pattern Recognition and Image Analysis 15(4), 645–648 (2005)Google Scholar
  11. 11.
  12. 12.
    Sanderson, C., Paliwal, K.K.: Noise compensation in a person verification system using face and multiple speech feature. Pattern Recognition 36(2), 293–302 (2003)Google Scholar
  13. 13.
    Kanade, T., Cohn, J.F., Tian, Y.: Comprehensive database for facial expression analysis. In: FG 2000, pp. 46–53 (2000)Google Scholar
  14. 14.
    Ojala, T., Pietikäinen, M., Mäenpää, T.: Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. IEEE TPAMI 24, 971–987 (2002)Google Scholar
  15. 15.
    Hadid, A., Pietikäinen, M.: Combining motion and appearance for gender classification from video sequences. In: Proc. 19th International Conference on Pattern Recognition (ICPR 2008) (2008) (in press)Google Scholar
  16. 16.
    Zhao, G., Pietikäinen, M.: Dynamic texture recognition using local binary patterns with an application to facial expressions. IEEE TPAMI 29(6), 915–928 (2007)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2009

Authors and Affiliations

  • Abdenour Hadid
    • 1
  • Matti Pietikäinen
    • 1
  1. 1.Machine Vision GroupUniversity of OuluFinland

Personalised recommendations