Real-Time Facial Analysis in Still Images and Videos for Gender and Age Estimation

  • Lionel Prevost
  • Philippe Phothisane
  • Erwan Bigorgne
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9443)


Research has recently focused on human age and gender estimation because they are useful cues in many applications such as human-machine interaction, soft biometrics and demographic studies.

In this paper, we propose a real time face tracking framework that includes a sequential estimation of people’s gender then age. Local binary patterns histograms extracted from facial images. A single gender estimator and several gender-specific age estimators are trained using a boosting scheme. Their decisions are combined to output a gender and an age in years.

The whole process is thoroughly tested on state-of art databases and video sets. Results on the popular FG-NET database are comparable to human perception (overall 70 % correct responses within 5 years tolerance and almost 90 % within 10 years tolerance). The age and gender estimators combined with the face tracker provide real-time estimations at 21 frames per second.


Face analysis LBP Boosting Gender estimation Age estimation 



We provide our test videos including the ground truth measures on request. Please contact us by mail to receive our data. The authors gratefully acknowledge the contribution of the Agence National de la Recherche (CIFRE N°533/2009).


  1. 1.
    Wild, H.A., Barett, S.E., Spence, M.J., O’Toole, A.J., Cheng, Y.D., Brooke, J.: Recognition and sex categorization of adults’ and children’s faces Examining performance in the absence of sex-stereotyped cues. J. Exp. Child Psychol. 77(4), 269–291 (2000). ElsevierCrossRefGoogle Scholar
  2. 2.
    Anastasi, J., Rhodes, M.: An own-age bias in face recognition for children and older adults. Psychon. Bull. Rev. 12(6), 1043–1047 (2005). SpringerCrossRefGoogle Scholar
  3. 3.
    Huang, G.B., Ramesh, M., Berg, T., Learned-Miller, E.: Labeled faces in the wild: A database for studying face recognition in unconstrained environments. University of Massachusetts, Amherst, Technical Report 07–49 (2007)Google Scholar
  4. 4.
    Phothisane, P., Bigorgne, E., Collot, L., Prevost, L.: A robust composite metric for head pose tracking using an accurate face model. In: IEEE International Conference on Automatic Face and Gesture Recognition (FG 2011), pp. 694–699. IEEE (2011)Google Scholar
  5. 5.
    Golomb, B., Lawrence, D., Sejnowski, T.: Sexnet, a neural network identifies sex from human faces. In: NIPS-3 Proceedings of the 1990 Conference on Advances in Neural Information Processing Systems, vol. 3, pp. 572–577 (1991)Google Scholar
  6. 6.
    Cottrell, G., Metclafe, J.: Empath: face, emotion, and gender recognition using holons. In: NIPS-3 Proceedings of the 1990 Conference on Advances in Neural Information Processing Systems, vol. 3, pp. 567–571 (1990)Google Scholar
  7. 7.
    Li, X., Maybank, S., Yan, S., Tao, D., Dacheng, T.: Gait components and their application to gender recognition. IEEE Trans. on SMC-B 38(2), 145–155 (2008). IEEEGoogle Scholar
  8. 8.
    Shan, C., Gong, S., McOwan, P.: Fusing gait and face cues for human gender recognition. Neuro Comput. 71(10–12), 1931–1938 (2008). ElsevierGoogle Scholar
  9. 9.
    Moghaddam, B., Yang, M.: Learning gender with support faces. IEEE Trans. on PAMI 24(5), 707–711 (2002). IEEECrossRefGoogle Scholar
  10. 10.
    Baluja, S., Rowley, H.: Boosting sex identification performance. Int. J. Comput. Vis. 71, 111–119 (2007). Kluwer Academic Publishers HinghamCrossRefGoogle Scholar
  11. 11.
    Shan, C.: Learning local binary patterns for gender classification on real-world face images. Pattern Recogn. Lett. 33(4), 431–437 (2012). ElsevierCrossRefGoogle Scholar
  12. 12.
    Shakhnarovich, G., Viola, P., Moghaddam, B.: A unified learning framework for real time face detection and classification. In: IEEE International Conference on Automatic Face and Gesture Recognition (FG 2002), pp. 14–21. IEEE (2002)Google Scholar
  13. 13.
    Gao, F., Ai, H.: Face age classification on consumer images with gabor feature and fuzzy LDA method. In: Tistarelli, M., Nixon, M.S. (eds.) ICB 2009. LNCS, vol. 5558, pp. 132–141. Springer, Heidelberg (2009)CrossRefGoogle Scholar
  14. 14.
    Kumar, N., Belhumeur, P.N., Nayar, S.K.: FaceTracer: a search engine for large collections of images with faces. In: Forsyth, D., Torr, P., Zisserman, A. (eds.) ECCV 2008, Part IV. LNCS, vol. 5305, pp. 340–353. Springer, Heidelberg (2008)CrossRefGoogle Scholar
  15. 15.
    Makinen, E., Raisamo, R.: An experimental comparison of gender classification methods. Pattern Recogn. Lett. 29(10), 1544–1556 (2008). ElsevierCrossRefGoogle Scholar
  16. 16.
    Hadid, A., Pietikainen, M.: Combining motion and appearance for gender classification from video sequences. In: International Conference on Pattern Recognition (ICPR 2008), pp. 1–4. IEEE (2008)Google Scholar
  17. 17.
    Ramanathan, N., Chellappa, R.: Face verification across age progression. IEEE Trans. Image Proces. 15(11), 3349–3361 (2006). IEEECrossRefGoogle Scholar
  18. 18.
    Fu, Y., Guo, G., Huang, T.: Age synthesis and estimation via faces: A survey. IEEE Trans. PAMI 32(11), 1955–1976 (2010). IEEECrossRefGoogle Scholar
  19. 19.
    Guo, G., Mu, G., Fu, Y., Huang, T.: Human age estimation using bio inspired features. In: IEEE Conference on Computer Vision (CVPR 2009), pp. 112–119. IEEE (2009)Google Scholar
  20. 20.
    Thukral, P., Mitra, K., Chellappa, R.: A hierarchical approach for human age estimation. In: IEEE International Conference on Acoustic, Speech and Signal Processing (ICASSP 2012), pp. 1529–1532. IEEE (2012)Google Scholar
  21. 21.
    Luu, K., Ricanek, K., Bui, T., Suen, C.: Age estimation using active appearance models and support vector machine regression. In: IEEE Conference on Biometrics: Theory, Applications, and Systems (BTAS), pp. 1–5. IEEE (2009)Google Scholar
  22. 22.
    Luu, K., Seshadri, K., Savvides, M., Bui, T.D., Suen, C.: Contourlet appearance model for facial age estimation. In: IEEE International Joint Conference on Biometrics (IJCB 2011), pp. 1–8 (2011)Google Scholar
  23. 23.
    Yan, S., Wang, H., Tang, X., Huang, T.S.: Learning auto-structured regressor from uncertain nonnegative labels. In: International Conference on Computer Vision (ICCV 2007), pp. 1–8 (2007)Google Scholar
  24. 24.
    Lanitis, A., Draganova, C., Christodoulou, C.: Comparing different classiers for automatic age estimation. IEEE Trans. on SMC-B 34(1), 621–628 (2004)Google Scholar
  25. 25.
    Guo, G., Mu, G., Dyer, D., T.S., H.: A study on automatic age estimation using a large database. In: International Conference on Computer Vision (ICCV 2009), pp. 1986–1991 (2009)Google Scholar
  26. 26.
    Ojala, T., Pietikinen, M., Maenpaa, T.: Multi-resolution gray-scale and rotation invariant texture classification with local binary patterns. IEEE Trans. PAMI 24(7), 971–979 (2002)CrossRefGoogle Scholar
  27. 27.
    Zhang, W., Shan, S., Zhang, H., Gao, W., Chen, X.: Multi-resolution histograms of local variation patterns (MHLVP) for robust face recognition. In: Kanade, T., Jain, A., Ratha, N.K. (eds.) AVBPA 2005. LNCS, vol. 3546, pp. 937–944. Springer, Heidelberg (2005)CrossRefGoogle Scholar
  28. 28.
    Liao, S., Zhu, X., Lei, Z., Zhang, L., Li, S.Z.: Learning multi-scale block local binary patterns for face recognition. In: Lee, S.-W., Li, S.Z. (eds.) ICB 2007. LNCS, vol. 4642, pp. 828–837. Springer, Heidelberg (2007)CrossRefGoogle Scholar
  29. 29.
    Freund, Y., Schapire, H.: Experiments with a new boosting algorithm. In: International Conference on Machine Learning (ICML 1996), pp. 148–156. Maurgan Kaufmann (1996)Google Scholar
  30. 30.
    Han, H., Otto, C., Jain, A.: Age estimation from face images: Human vs. machine performance. In: International Conference on Biometrics (ICB 2013), pp. 4–7. IEEE (2013)Google Scholar
  31. 31.
    Dempster, A.P., Laird, N.M., Rubin, D., et al.: Maximum Likelihood from incomplete data via the EM algorithm. J. Royal Stat. Soc. Ser. B (Methodological) 39(1), 1–38 (1977)MathSciNetzbMATHGoogle Scholar

Copyright information

© Springer International Publishing Switzerland 2015

Authors and Affiliations

  • Lionel Prevost
    • 1
  • Philippe Phothisane
    • 2
  • Erwan Bigorgne
    • 2
  1. 1.University of the French West IndiesPointe à PitreGuadeloupe
  2. 2.EikeoParisFrance

Personalised recommendations