Springer Nature is making SARS-CoV-2 and COVID-19 research free. View research | View latest news | Sign up for updates

Ordinal distribution regression for gait-based age estimation

  • 13 Accesses

Abstract

Computer vision researchers prefer to estimate age from face images because facial features provide useful information. However, estimating age from face images becomes challenging when people are distant from the camera or occluded. A person’s gait is a unique biometric feature that can be perceived efficiently even at a distance. Thus, gait can be used to predict age when face images are not available. However, existing gait-based classification or regression methods ignore the ordinal relationship of different ages, which is an important clue for age estimation. This paper proposes an ordinal distribution regression with a global and local convolutional neural network for gait-based age estimation. Specifically, we decompose gait-based age regression into a series of binary classifications to incorporate the ordinal age information. Then, an ordinal distribution loss is proposed to consider the inner relationships among these classifications by penalizing the distribution discrepancy between the estimated value and the ground truth. In addition, our neural network comprises a global and three local sub-networks, and thus, is capable of learning the global structure and local details from the head, body, and feet. Experimental results indicate that the proposed approach outperforms state-of-the-art gait-based age estimation methods on the OULP-Age dataset.

This is a preview of subscription content, log in to check access.

References

  1. 1

    Chang K-Y, Chen C-S, Hung Y-P. Ordinal hyperplanes ranker with cost sensitivities for age estimation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2011. 585–592

  2. 2

    Chen S, Zhang C, Dong M, et al. Using ranking-CNN for age estimation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2017. 5183–5192

  3. 3

    Niu Z, Zhou M, Wang L, et al. Ordinal regression with multiple output CNN for age estimation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2016. 4920–4928

  4. 4

    Pan H, Han H, Shan S, et al. Mean-variance loss for deep age estimation from a face. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2018. 5285–5294

  5. 5

    Shen W, Guo Y, Wang Y, et al. Deep regression forests for age estimation. 2017. ArXiv: 1712.07195

  6. 6

    Han J, Bhanu B. Individual recognition using gait energy image. IEEE Trans Pattern Anal Mach Intell, 2006, 28: 316–322

  7. 7

    Lu J, Tan Y-P. Gait-based human age estimation. IEEE Trans Inform Forensic Secur, 2010, 5: 761–770

  8. 8

    Makihara Y, Okumura M, Iwama H, et al. Gait-based age estimation using a whole-generation gait database. In: Proceedings of International Conference on Biometrics (ICB), 2011. 1–6

  9. 9

    Lu J, Tan Y-P. Ordinary preserving manifold analysis for human age estimation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2010. 90–95

  10. 10

    Lu J, Tan Y-P. Ordinary preserving manifold analysis for human age and head pose estimation. IEEE Trans Human-Mach Syst, 2013, 43: 249–258

  11. 11

    Frank E, Hall M. A simple approach to ordinal classification. In: Proceedings of European Conference on Machine Learning, 2001. 145–156

  12. 12

    Li L, Lin H-T. Ordinal regression by extended binary classification. In: Proceedings of Advances in Neural Information Processing Systems, 2007. 865–872

  13. 13

    Hou L, Yu C-P, Samaras D. Squared earth mover’s distance-based loss for training deep neural networks. 2016. ArXiv: 1611.05916

  14. 14

    Xu C, Makihara Y, Ogi G, et al. The OU-ISIR gait database comprising the large population dataset with age and performance evaluation of age estimation. IPSJ Trans Comput Vis Appl, 2017, 9: 24

  15. 15

    Ricanek K, Tesafaye T. Morph: a longitudinal image database of normal adult age-progression. In: Proceedings of International Conference on Automatic Face and Gesture Recognition (FGR), 2006. 341–345

  16. 16

    Lanitis A, Draganova C, Christodoulou C. Comparing different classifiers for automatic age estimation. IEEE Trans Syst Man Cybern B, 2004, 34: 621–628

  17. 17

    Yang Z, Ai H. Demographic classification with local binary patterns. In: Proceedings of International Conference on Biometrics (ICB), 2007. 464–473

  18. 18

    Fu Y, Huang T S. Human age estimation with regression on discriminative aging manifold. IEEE Trans Multimedia, 2008, 10: 578–584

  19. 19

    Xiao B, Yang X, Zha H, et al. Metric learning for regression problems and human age estimation. In: Proceedings of Pacific-Rim Conference on Multimedia, 2009. 88–99

  20. 20

    Chang K-Y, Chen C-S. A learning framework for age rank estimation based on face images with scattering transform. IEEE Trans Image Process, 2015, 24: 785–798

  21. 21

    Rasmussen C E. Gaussian processes in machine learning. In: Proceedings of Advanced Lectures on Machine Learning, 2004. 63–71

  22. 22

    Wada T, Matsumura Y, Maeda S, et al. Gaussian process regression with dynamic active set and its application to anomaly detection. In: Proceedings of the International Conference on Data Mining, 2013

  23. 23

    Makihara Y, Kimura T, Okura F, et al. Gait collector: an automatic gait data collection system in conjunction with an experience-based long-run exhibition. In: Proceedings of International Conference on Biometrics (ICB), 2016. 1–8

  24. 24

    Li X, Makihara Y, Xu C, et al. Gait-based human age estimation using age group-dependent manifold learning and regression. Multimed Tools Appl, 2018, 77: 28333–28354

  25. 25

    Crammer K, Singer Y. Pranking with ranking. In: Proceedings of Advances in Neural Information Processing Systems, 2002. 641–647

  26. 26

    Herbrich R, Graepel T, Obermayer K. Support vector learning for ordinal regression. In: Proceedings of ICANN, 1999. 97–102

  27. 27

    Shashua A, Levin A. Ranking with large margin principle: two approaches. In: Proceedings of Advances in Neural Information Processing Systems, 2003. 961–968

  28. 28

    Maas A L, Hannun A Y, Ng A Y. Rectifier nonlinearities improve neural network acoustic models. In: Proceedings of the 30th International Conference on Machine Learning, Atlanta, 2013. 1–6

  29. 29

    Srivastava N, Hinton G, Krizhevsky A, et al. Dropout: a simple way to prevent neural networks from overfitting. J Machine Learn Res, 2014, 15: 1929–1958

  30. 30

    Sarkar S, Phillips P J, Liu Z, et al. The humanID gait challenge problem: data sets, performance, and analysis. IEEE Trans Pattern Anal Mach Intell, 2005, 27: 162–177

  31. 31

    Shen W, Guo Y, Wang Y, et al. Deep regression forests for age estimation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2018. 2304–2313

  32. 32

    Parkhi O M, Vedaldi A, Zisserman A, et al. Deep face recognition. In: Proceedings of British Machine Vision Conference (BMVC), 2015. 1: 6

  33. 33

    Simonyan K, Zisserman A. Very deep convolutional networks for large-scale image recognition. 2014. ArXiv: 1409.1556

  34. 34

    Kinga D, Adam J B. A method for stochastic optimization. In: Proceedings of International Conference on Learning Representations, 2015

  35. 35

    Russakovsky O, Deng J, Su H, et al. ImageNet large scale visual recognition challenge. Int J Comput Vis, 2015, 115: 211–252

  36. 36

    Smola A J, Schölkopf B. A tutorial on support vector regression. Stat Comput, 2004, 14: 199–222

  37. 37

    van der Maaten L, Hinton G. Visualizing data using t-SNE. J Machine Learn Res, 2008, 9: 2579–2605

  38. 38

    Rothe R, Timofte R, van Gool L. Deep expectation of real and apparent age from a single image without facial landmarks. Int J Comput Vis, 2018, 126: 144–157

  39. 39

    Shen W, Zhao K, Guo Y L, et al. Label distribution learning forests. In: Proceedings of Advances in Neural Information Processing Systems, 2017. 834–843

  40. 40

    Tan Z C, Wan J, Lei Z, et al. Efficient group-n encoding and decoding for facial age estimation. IEEE Trans Pattern Anal Mach Intell, 2018, 40: 2610–2623

  41. 41

    Li W H, Lu J W, Feng J J, et al. Bridgenet: a continuity-aware probabilistic network for age estimation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2019. 1145–1154

  42. 42

    He Y, Zhang J, Shan H, et al. Multi-task GANs for view-specific feature learning in gait recognition. IEEE Trans Inform Forensic Secur, 2019, 14: 102–113

  43. 43

    Cai S, Wu Z. Camera calibration with coplanar conics: a unified explanation and ambiguity analysis. IPSJ Trans Comput Vis Appl, 2018, 10: 1–14

  44. 44

    Wu Z, Huang Y, Wang L, et al. A comprehensive study on cross-view gait based human identification with deep CNNs. IEEE Trans Pattern Anal Mach Intell, 2017, 39: 209–226

Download references

Acknowledgements

This work was supported in part by National Natural Science Foundation of China (Grant No. 61673118), Shanghai Municipal Science and Technology Major Project (Grant No. 2018SHZDZX01), ZJLab, and Shanghai Pujiang Program (Grant No. 16PJD009). We are grateful to the reviewers and the Associate Editor for their constructive comments.

Author information

Correspondence to Junping Zhang.

Rights and permissions

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Zhu, H., Zhang, Y., Li, G. et al. Ordinal distribution regression for gait-based age estimation. Sci. China Inf. Sci. 63, 120102 (2020). https://doi.org/10.1007/s11432-019-2733-4

Download citation

Keywords

  • computer vision
  • deep learning
  • ordinal distribution regression
  • global and local features
  • gait-based age estimation