Gender Recognition Based on Fusion of Face and Multi-view Gait

  • De Zhang
  • Yunhong Wang
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5558)


In this paper, we consider the problem of gender recognition based on face and multi-view gait cues in the same walking sequence. The gait cues are derived from multiple simultaneous camera views. Meanwhile, the face cues are captured by a camera at front view. According to this setup, we build a database including 32 male subjects and 28 female subjects. Then, for face, we normalize the frame images decomposed from videos and introduce PCA to reduce image dimension. For gait, we extract silhouettes from videos and employ an improved spatio-temporal representation on the silhouettes to obtain gait features. SVM is then used to classify gender with face features and gait features from each view respectively. We employ three fusion approaches involving voting rule, weighted voting rule and Bayes combination rule at the decision level. The effectiveness of various approaches is evaluated on our database. The experimental results of integrating face and multi-view gait show an obvious improvement on the accuracy of gender recognition.


Support Vector Machine Facial Image Principle Component Analysis Canonical Correlation Analysis Gesture Recognition 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. 1.
    Moghaddam, B., Yang, M.: Learning Gender with Support Faces. IEEE Transactions on Pattern Analysis and Machine Intelligence 24(5), 707–711 (2002) Google Scholar
  2. 2.
    Shakhnarovich, G., Viola, P.A., Moghaddam, B.: A Unified Learning Framework for Real Time Face Detection and Classification. In: Proc. of IEEE International Conference on Automatic Face and Gesture Recognition, pp. 14–21 (2002) Google Scholar
  3. 3.
    Lu, H., Lin, H.: Gender Recognition using Adaboosted Feature. In: The 3rd International Conference on Natural Computation, vol. 2, pp. 646–650 (2002) Google Scholar
  4. 4.
    Parris, E.S., Carey, M.J.: Language Independent Gender Identification. In: Proc. of IEEE International Conference on Acoustics, Speech and Signal Processing, vol. 2, pp. 685–688 (1996) Google Scholar
  5. 5.
    Harb, H., Chen, L.: Gender Identification Using a General Audio Classifier. In: Proc. of IEEE International Conference on Multimedia and Expo, vol. 2, pp. 733–736 (2003) Google Scholar
  6. 6.
    Huang, T., Yang, Y., Wu, Z.: Combining MFCC and Pitch to Enhance the Performance of the Gender Recognition. In: Proc. of IEEE International Conference on Signal Processing, vol. 1, pp. 16–20 (2006) Google Scholar
  7. 7.
    Davis, J.W., Gao, H.: An Expressive Three-mode Principle Components Model for Gender Recognition. Journal of Vision 4, 362–377 (2004) Google Scholar
  8. 8.
    Lee, L., Grimson, W.: Gait Analysis for Recognition and Classification. In: Proc. of IEEE International Conference on Automatic Face and Gesture Recognition, pp. 148–155 (2002) Google Scholar
  9. 9.
    Yoo, J., Hwang, D., Nixon, M.S.: Gender Classification in Human Gait with SVM. In: Blanc-Talon, J., Philips, W., Popescu, D.C., Scheunders, P. (eds.) ACIVS 2005. LNCS, vol. 3708, pp. 138–145. Springer, Heidelberg (2005) Google Scholar
  10. 10.
    Shakhnarovich, G., Lee, L., Darrell, T.: Integrated face and gait recognition from multiple views. In: Proc. of IEEE International Conference on Computer Vision and Pattern Recognition, vol. 1, pp. 439–446 (2001) Google Scholar
  11. 11.
    Shakhnarovich, G., Darrell, T.: On probabilistic combination of face and gait cues for identification. In: Proc. of IEEE International Conference on Automatic Face and Gesture Recognition, pp. 169–174 (2002) Google Scholar
  12. 12.
    Zhou, X., Bhanu, B.: Integrating face and gait for human recognition. In: Proc. of IEEE workshop on Computer Vision and Pattern Recognition, pp. 55–62 (2006) Google Scholar
  13. 13.
    Liu, Y., Collins, R., Tsin, Y.: Gait Sequence Analysis using Frieze Patterns. Technical Report CMU-RI-TR-01-38, Robotics Institute, Carnegie Mellon University (2001) Google Scholar
  14. 14.
    Shan, C., Gong, S., McOwan, P.W.: Learning Gender from Human Gaits and Faces. In: IEEE Conference on Advanced Video and Signal Based Surveillance, pp. 505–510 (2007) Google Scholar
  15. 15.
    Center for Biometrics and Security Research, CASIA, Google Scholar
  16. 16.
    Bernard, A., Horst, B.: Combination of Classifiers on the Decision Level for Face Recognition. Tech. Rep. IAM-96-002, IAM, University Bern (1996)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2009

Authors and Affiliations

  • De Zhang
    • 1
  • Yunhong Wang
    • 1
  1. 1.Intelligent Recognition and Image Processing Laboratory, School of Computer Science and EngineeringBeihang UniversityBeijingChina

Personalised recommendations