The Video-Based Age and Gender Recognition with Convolution Neural Networks

  • Angelina S. KharchevnikovaEmail author
  • Andrey V. Savchenko
Conference paper
Part of the Springer Proceedings in Mathematics & Statistics book series (PROMS, volume 247)


The paper reviews the problem of age and gender recognition methods for video data using modern deep convolutional neural networks. We present the comparative analysis of classifier fusion algorithms to aggregate decisions for individual frames. We implemented the video-based recognition system with several aggregation methods to improve the age and gender identification accuracy. The experimental comparison of the proposed approach with traditional simple voting using IJB-A, Indian Movies, and Kinect datasets is provided. It is demonstrated that the most accurate decisions are obtained using the geometric mean and mathematical expectation of the outputs at softmax layers of the convolutional neural networks for gender recognition and age prediction, respectively.


Age and gender recognition Contextual advertising Convolutional neural networks Classifier fusion 



The paper was prepared within the framework of the Academic Fund Program at the National Research University Higher School of Economics (HSE) in 2017 (grant 17-05-0007) and by the Russian Academic Excellence Project “5–100”. Andrey V. Savchenko is partially supported by Russian Federation President grant no. MD-306.2017.9.


  1. 1.
    Savchenko, A.V.: Search Techniques in Intelligent Classification Systems. Springer International Publishing (2016)Google Scholar
  2. 2.
    Chao, W.L., Liu, J.Z., Ding, J.J.: Facial age estimation based on label-sensitive learning and age-oriented regression. Pattern Recogn. 46(3), 628–641 (2013)CrossRefGoogle Scholar
  3. 3.
    Kittler, J., Alkoot, F.M.: Sum versus vote fusion in multiple classifier systems. IEEE Trans. Pattern Anal. Mach. Intell. 25(1), 110–115 (2003)CrossRefGoogle Scholar
  4. 4.
    Wang, H., Wang, Y., Cao, Y.: Video-based face recognition: a survey. World Acad. Sci. Eng. Technol. Int. J. Comput. Electr. Autom. Control Inf. Eng. 3(12), 2809–2818 (2009)Google Scholar
  5. 5.
    Levi, G., Hassner, T.: Age and gender classification using convolutional neural networks. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, pp. 34–42 (2015)Google Scholar
  6. 6.
    Kwon, Y.H.: Age classification from facial images. In: Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR’94, pp. 762–767. IEEE (1994)Google Scholar
  7. 7.
    Geng, X.: Learning from facial aging patterns for automatic age estimation. In: Proceedings of the 14th ACM International Conference on Multimedia, pp. 307–316. ACM (2006)Google Scholar
  8. 8.
    Guo, G., Mu, G. Fu, Y.: Human age estimation using bio-inspired features. In: IEEE Conference on Computer Vision and Pattern Recognition, CVPR, pp. 112–119. IEEE (2009)Google Scholar
  9. 9.
    Choi, S.E.: Age estimation using a hierarchical classifier based on global and local facial features. Pattern Recogn. 44(6), 1262–1281 (2011)CrossRefGoogle Scholar
  10. 10.
    Makinen, E.: Evaluation of gender classification methods with automatically detected and aligned faces. IEEE Trans. Pattern Anal. Mach. Intell. 30(4), 541547 (2008)Google Scholar
  11. 11.
    Shan, C.: Face recognition and retrieval in video. In: Video Search and Mining, pp. 235–260. Springer, Berlin, Heidelberg (2010)Google Scholar
  12. 12.
    Krizhevsky, A., Sutskever I., Hinton G.E.: Imagenet classification with deep convolutional neural networks. In: Advances in Neural Information Processing Systems, pp. 1097–1105 (2012)Google Scholar
  13. 13.
    Rothe, R., Timofte, R., Van Gool, L.: Deep expectation of apparent age from a single image. In: Proceedings of the IEEE International Conference on Computer Vision Workshops, pp. 10–15 (2015)Google Scholar
  14. 14.
    Ekmek, A.: Convolutional Neural Networks for Age and Gender Classification (2016).
  15. 15.
    Rude Carnie: Age and Gender Deep Learning with TensorFlow.
  16. 16.
    Szegedy, C.: Going deeper with convolutions. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–9 (2015)Google Scholar
  17. 17.
    Lienhart, R., Maydt, J.: An extended set of Haar-like features for rapid object detection. In: Proceedings of International Conference on Image Processing, vol. 1, pp. I–I. IEEE (2002)Google Scholar
  18. 18.
  19. 19.
    Simonyan, K., Zisserman A.: Very Deep Convolutional Networks for Large-Scale Image Recognition (2014). arXiv:1409.1556
  20. 20.
    Rothe, R., Timofte R., Van Gool L. Dex: Deep expectation of apparent age from a single image In: Proceedings of the IEEE International Conference on Computer Vision Workshops, pp. 10–15 (2015)Google Scholar
  21. 21.
    Klare, Brendan F., et al.: Pushing the frontiers of unconstrained face detection and recognition: IARPA Janus Benchmark A. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (2015)Google Scholar
  22. 22.
    Setty, S., et al.: Indian movie face database: a benchmark for face recognition under wide variations. In: Fourth National Conference on Computer Vision, Pattern Recognition, Image Processing and Graphics (NCVPRIPG). IEEE (2013)Google Scholar
  23. 23.
    Min, R., Kose, N., Dugelay J.: KinectFaceDB: a kinect database for face recognition. In: IEEE Transactions on Systems, Man, and Cybernetics: Systems, vol. 44, no. 11, pp. 1534–548, Nov 2014.
  24. 24.
    Rassadin, A.G., Savchenko, A.V.: Compressing deep convolutional neural networks in visual emotion recognition. In: Proceedings of the International conference Information Technology and Nanotechnology (ITNT). Session Image Processing, Geoinformation Technology and Information Security Image Processing (IPGTIS), CEUR-WS, vol. 1901, pp. 207–213 (2017).

Copyright information

© Springer International Publishing AG, part of Springer Nature 2018

Authors and Affiliations

  • Angelina S. Kharchevnikova
    • 1
    Email author
  • Andrey V. Savchenko
    • 1
    • 2
  1. 1.National Research University Higher School of EconomicsNizhniy NovgorodRussia
  2. 2.Laboratory of Algorithms and Technologies for Network AnalysisNational Research University Higher School of EconomicsNizhny NovgorodRussia

Personalised recommendations