Multimodal Facial Gender and Ethnicity Identification

  • Xiaoguang Lu
  • Hong Chen
  • Anil K. Jain
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3832)


Human faces provide demographic information, such as gender and ethnicity. Different modalities of human faces, e.g., range and intensity, provide different cues for gender and ethnicity identifications. In this paper we exploit the range information of human faces for ethnicity identification using a support vector machine. An integration scheme is also proposed for ethnicity and gender identifications by combining the registered range and intensity images. The experiments are conducted on a database containing 1240 facial scans of 376 subjects. It is demonstrated that the range modality provides competitive discriminative power on ethnicity and gender identifications to the intensity modality. For both gender and ethnicity identifications, the proposed integration scheme outperforms each individual modality.


Support Vector Machine Face Recognition Gesture Recognition Range Image Ethnicity Identification 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. 1.
    Malpass, R., Kravitz, J.: Recognition for faces of own and other race. J. Perc. Soc. Psychol. 13, 330–334 (1969)CrossRefGoogle Scholar
  2. 2.
    Brigham, J., Barkowitz, P.: Do ‘they all look alike?’ the effect of race, sex, experience and attitudes on the ability to recognize faces. J. Appl. Soc. Psychol. 8, 306–318 (1978)CrossRefGoogle Scholar
  3. 3.
    O’Toole, A., Peterson, A., Deffenbacher, K.: An other-race effect for classifying faces by sex. Perception 25, 669–676 (1996)CrossRefGoogle Scholar
  4. 4.
    Golby, A., Gabrieli, J., Chiao, J., Eberhardt, J.: Differential responses in the fusiform region to same-race and other-race faces. Nature Neuroscience 4, 845–850 (2001)CrossRefGoogle Scholar
  5. 5.
    Jain, A.K., Nandakumar, K., Lu, X., Park, U.: Integrating faces, fingerprints, and soft biometric traits for user recognition. In: Maltoni, D., Jain, A.K. (eds.) BioAW 2004. LNCS, vol. 3087, pp. 259–269. Springer, Heidelberg (2004)CrossRefGoogle Scholar
  6. 6.
    Shakhnarovich, G., Viola, P.A., Moghaddam, B.: A unified learning framework for real time face detection and classification. In: Proc. IEEE International Conference on Automatic Face and Gesture Recognition, pp. 14–21 (2002)Google Scholar
  7. 7.
    Farkas, L.: Anthropometry of the Head and Face, 2nd edn. Raven Press (1994)Google Scholar
  8. 8.
    Enlow, D.: Facial Growth, 3rd edn. W.H. Saunders, Philadelphia (1990)Google Scholar
  9. 9.
    Glolomb, B., Lawrence, D., Sejnowski, T.: Sexnet: A neural network identifies sex from human faces. In: Advances in Neural Information Processing Systems (NIPS), vol. 3, pp. 572–577 (1990)Google Scholar
  10. 10.
    O’Toole, A., Vetter, T., Troje, N.F., Bulthoff, H.H.: Sex classification is better with three-dimensional structure than with image intensity information. Perception 26, 75–84 (1997)CrossRefGoogle Scholar
  11. 11.
    Gutta, S., Huang, J., Phillips, P., Wechsler, H.: Mixture of experts for classification of gender, ethnic origin, and pose of human faces. IEEE Trans. Neural Networks 11, 948–960 (2000)CrossRefGoogle Scholar
  12. 12.
    Davis, J., Gao, H.: Gender recognition from walking movements using adaptive three-mode PCA. In: Proc. IEEE Workshop on Articulated and Nonrigid Motion, Washington DC, pp. 9–16 (2001)Google Scholar
  13. 13.
    Moghaddam, B., Yang, M.: Learning gender with support faces. IEEE Trans. Pattern Analysis and Machine Intelligence 24, 707–711 (2002)CrossRefGoogle Scholar
  14. 14.
    Walavalkar, L., Yeasin, M., Narasimhamurthy, A., Sharma, R.: Support vector learning for gender classification using audio and visual cues. International Journal of Pattern Recognition and Artificial Intelligence 17, 417–439 (2003)CrossRefGoogle Scholar
  15. 15.
    Minolta Vivid 910 non-contact 3D laser scanner,
  16. 16.
    Cyberware Inc.,
  17. 17.
    Li, S., Jain, A. (eds.): Handbook of Face Recognition. Springer, Heidelberg (2005)zbMATHGoogle Scholar
  18. 18.
    Shan, S., Chang, Y., Gao, W., Cao, B.: Curse of mis-alignment in face recognition: Problem and a novel mis-alignment learning solution. In: Proc. IEEE International Conference on Automatic Face and Gesture Recognition, Korea, pp. 314–320 (2004)Google Scholar
  19. 19.
    Platt, J.: Probabilistic outputs for support vector machines and comparison to regularized likelihood methods. In: Smola, A., Bartlett, P., Schoelkopf, B., Schuurmans, D. (eds.) Advances in large Margin Classifiers. MIT Press, Cambridge (2000)Google Scholar
  20. 20.
    Kittler, J., Hatef, M., Duin, R., Matas, J.: On combining classifiers. IEEE Trans. Pattern Analysis and Machine Intelligence 20, 226–239 (1998)CrossRefGoogle Scholar
  21. 21.
    Chang, K.I., Bowyer, K.W., Flynn, P.J.: Multi-modal 2D and 3D biometrics for face recognition. In: Proc. IEEE Workshop on Analysis and Modeling of Faces and Gestures, France (2003)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2005

Authors and Affiliations

  • Xiaoguang Lu
    • 1
  • Hong Chen
    • 1
  • Anil K. Jain
    • 1
  1. 1.Michigan State UniversityEast Lansing

Personalised recommendations