Real-time human cross-race aging-related face appearance detection with deep convolution architecture

  • Qing TianEmail author
  • Wenqiang Zhang
  • Junxiang Mao
  • Hujun Yin
Special Issue Paper


Human age estimation (AE) is an emerging research topic in computer vision and machine learning and has attracted increasing amount of research due its wide potential applications. In the process of human aging, facial appearances change from glabrous to crinkly similarly across all races, from European, Hispanic and African to Asian. To specially explore the relationships between aging and facial appearances across races, this paper is devoted to determining the correspondence between facial aging and facial appearances. Specifically, we first extract appearance vector features from facial images with their spatial structure preserved. Then, we propose to select the aging-related features shared by different races to explore their aging-related common facial regions, while removing redundant features. Thirdly, we improve the proposed model by incorporating potential cross-race relationships in an automated learning manner. Additionally, we extend our model with deep convolution architecture. Finally, we evaluate the proposed methodologies on a large face aging database with real-time efficiency.


Human age estimation Cross-race relationships Aging-related facial appearance features Deep convolutional neural networks 



This work was supported partially by the National Natural Science Foundation of China under Grant 61702273, the Natural Science Foundation of Jiangsu Province under Grant BK20170956, the Natural Science Foundation of the Jiangsu Higher Education Institutions of China under Grant 17KJB520022, the Fundamental Research Funds for the Central Universities no. NJ2019010, the Project Funded by the Priority Academic Program Development of Jiangsu Higher Education Institutions, the Priority Academic Program Development of Jiangsu Higher Education Institutions (PAPD) fund, and the Startup Foundation for Talents of Nanjing University of Information Science and Technology.


  1. 1.
    Alnajar, F., Shan, C., Gevers, T., Geusebroek, J.-M.: Learning-based encoding with soft assignment for age estimation under unconstrained imaging conditions. Image Vis. Comput. 30(12), 946–953 (2012)CrossRefGoogle Scholar
  2. 2.
    Beck, A., Teboulle, M.: A fast iterative shrinkage-thresholding algorithm for linear inverse problems. SIAM J. Imaging Sci. 2(1), 183–202 (2009)MathSciNetCrossRefzbMATHGoogle Scholar
  3. 3.
    Bianco, S.: Large age-gap face verification by feature injection in deep networks. Pattern Recognit. Lett. 90, 36–42 (2017)CrossRefGoogle Scholar
  4. 4.
    Cai, D., He, X., Hu, Y., Han, J.: Learning a spatially smooth subspace for face recognition. In: IEEE conference on computer vision and pattern recognition, pp. 1–7. IEEE, Minneapolis (2007)Google Scholar
  5. 5.
    Chang, K.-Y., Chen, C.-S., Hung, Y.-P.: Ordinal hyperplanes ranker with cost sensitivities for age estimation. In: Computer Vision and Pattern Recognition (CVPR), 2011 IEEE Conference on, pp. 585–592. IEEE, Colorado Springs, CO (2011)Google Scholar
  6. 6.
    Chiachia, G.: Learning person-specific representations from faces in the wild. IEEE Trans. Inf. Forensics Secur. 9(12), 2089–2099 (2014)CrossRefGoogle Scholar
  7. 7.
    Fu, Y., Xu, Y., Huang, T.S.: Estimating human age by manifold analysis of face pictures and regression on aging features. In: Multimedia and Expo, 2007 IEEE International Conference on, pp. 1383–1386. IEEE, Beijing (2007)Google Scholar
  8. 8.
    Geng, X., Yin, C., Zhou, Z.-H.: Facial age estimation by learning from label distributions. IEEE Trans. Pattern Anal. Mach. Intell. 35(10), 2401–2412 (2013)CrossRefGoogle Scholar
  9. 9.
    Geng, X., Zhou, Z.-H., Smith-Miles, K.: Automatic age estimation based on facial aging patterns. IEEE Trans. Pattern Anal. Mach. Intell. 29(12), 2234–2240 (2007)CrossRefGoogle Scholar
  10. 10.
    Guo, G., Fu, Y., Dyer, C.R., Huang, T.S.: Image-based human age estimation by manifold learning and locally adjusted robust regression. IEEE Trans. Image Process. 17(7), 1178–1188 (2008)MathSciNetCrossRefGoogle Scholar
  11. 11.
    Guo, G., Fu, Y., Huang, T.S., Dyer, C.R.: Locally adjusted robust regression for human age estimation. In: Applications of Computer Vision, 2008. WACV 2008. IEEE Workshop on, pp. 1–6, IEEE, Copper Mountain, CO (2008)Google Scholar
  12. 12.
    Guo, G., Mu, G.: Human age estimation: what is the influence across race and gender? In: Computer Vision and Pattern Recognition Workshops, pp. 71–78. IEEE, San Francisco, CA (2010)Google Scholar
  13. 13.
    Guo, G., Guowang, M.: A framework for joint estimation of age, gender and ethnicity on a large database. Image Vis. Comput. 32(10), 761–770 (2014)CrossRefGoogle Scholar
  14. 14.
    Günay, A., Nabiyev, V.: A new facial age estimation method using centrally overlapped block based local texture features. Multimedia Tools Appl. 1, 1–27 (2017)Google Scholar
  15. 15.
    Hoerl, A.E., Kannard, R.W., Baldwin, K.F.: Ridge regression: some simulations. Commun. Stat. 4(2), 105–123 (1975)CrossRefzbMATHGoogle Scholar
  16. 16.
    Ketkar, N.: Stochastic gradient descent. In: Deep Learning with Python. Apress, Berkeley, CA (2017)CrossRefGoogle Scholar
  17. 17.
    Kohli, S., Prakash, S., Gupta, P.: Hierarchical age estimation with dissimilarity-based classification. Neurocomputing 120, 164–176 (2013)CrossRefGoogle Scholar
  18. 18.
    Kooti, F., Lerman, K., Aiello, L.M., Grbovic, M., Djuric, N., Radosavljevic, V.: Portrait of an online shopper: nderstanding and predicting consumer behavior. In: Proceedings of The ACM International Conference on Web Search and Data Mining, pp. 205–214. ACM, San Francisco (2016)Google Scholar
  19. 19.
    Lanitis, A., Draganova, C., Christodoulou, C.: Comparing different classifiers for automatic age estimation. IEEE Trans. Syst. Man Cybern. Part B Cybern. 34(1), 621–628 (2004)CrossRefGoogle Scholar
  20. 20.
    Lanitis, A., Taylor, C.J., Cootes, T.F.: Toward automatic simulation of aging effects on face images. IEEE Trans. Pattern Anal. Mach. Intell. 24(4), 442–455 (2002)CrossRefGoogle Scholar
  21. 21.
    Li, C., Liu, Q., Liu, J., Lu, H.: Learning distance metric regression for facial age estimation. In: Pattern Recognition (ICPR), 2012 21st International Conference on, pp. 2327–2330, IEEE (2012)Google Scholar
  22. 22.
    Li, C., Liu, Q., Liu, J., Lu, H.: Learning ordinal discriminative features for age estimation. In: Computer Vision and Pattern Recognition (CVPR), 2012 IEEE Conference on, pp. 2570–2577. IEEE, Providence, Rhode Island (2012)Google Scholar
  23. 23.
    Li, C., Liu, Q., Liu, J., Hanqing, L.: Ordinal distance metric learning for image ranking. IEEE Trans. Neural Netw. Learn. Syst. 26(7), 1551 (2015)MathSciNetCrossRefGoogle Scholar
  24. 24.
    Liu, H., Jiwen, L., Feng, J., Zhou, J.: Label-sensitive deep metric learning for facial age estimation. IEEE Trans. Inf. Forensics Secur. 13, 292–305 (2018)CrossRefGoogle Scholar
  25. 25.
    Liu, M., Zhang, D., Chen, S., Xue, H.: Joint binary classifier learning for ecoc-based multi-class classification. IEEE Trans. Pattern Anal. Mach. Intell. 38(11), 2335–2341 (2016)CrossRefGoogle Scholar
  26. 26.
    Liu, Z., Luo, P., Wang, X., Tang, X.: Deep learning face attributes in the wild. In: Proceedings of The IEEE International Conference on Computer Vision, pp. 3730–3738. IEEE, Santiago (2015)Google Scholar
  27. 27.
    Luu, K., Ricanek, K., Bui, T.D., Suen, C.Y.: Age estimation using active appearance models and support vector machine regression. In: Biometrics: Theory, Applications, and Systems, 2009. BTAS’09. IEEE 3rd International Conference on, pp. 1–5, IEEE (2009)Google Scholar
  28. 28.
    Marchal, S., Jiang, X., State, R., Engel, T.: A big data architecture for large scale security monitoring. In: Proceedings of The IEEE International Congress on Big Data, pp. 56–63 (2014)Google Scholar
  29. 29.
    Meier, L., Van De Geer, S., Bühlmann, P.: The group lasso for logistic regression. J. R. Stat. Soc. 70(1), 53–71 (2008)MathSciNetCrossRefzbMATHGoogle Scholar
  30. 30.
    Moschoglou, S., Papaioannou, A., Sagonas, C., Deng, J., Kotsia, I., Zafeiriou, S.: Agedb: the first manually collected, in-the-wild age database. In: International Conference on Computer Vision and Pattern Recognition Workshops, pp. 1997–2005. IEEE, San Juan, Puerto Rico (2017)Google Scholar
  31. 31.
    Niu, Z., Zhou, M., Wang, L., Gao, X., Hua, G.: Ordinal regression with multiple output CNN for age estimation. In: Computer Vision and Pattern Recognition, pp. 4920–4928. IEEE, Las Vegas, NV (2016)Google Scholar
  32. 32.
    Qi, L., Wang, R., Li, S., He, Q., Xu, X.X., Hu, C.: Time-aware distributed service recommendation with privacy-preservation. Inf. Sci. 480, 354–364 (2019)CrossRefGoogle Scholar
  33. 33.
    Qi, L., Zhang, X., Dou, W., Ni, Q.: A distributed locality-sensitive hashing-based approach for cloud service recommendation from multi-source data. IEEE J. Select. Areas Commun. 35(11), 2616–2624 (2017)CrossRefGoogle Scholar
  34. 34.
    Qi, L., Zhou, Z., Yu, J., Liu, Q.: Data-sparsity tolerant web service recommendation approach based on improved collaborative filtering. IEICE Trans. Inf. Syst. E100.D(9), 2092–2099 (2017)CrossRefGoogle Scholar
  35. 35.
    Ricanek, K., Tesafaye, T.: Morph: a longitudinal image database of normal adult age-progression. In: International Conference on Automatic Face and Gesture Recognition, pp. 341–345. IEEE, Southampton (2006)Google Scholar
  36. 36.
    Sai, P.-K., Wang, J.-G., Teoh, E.-K.: Facial age range estimation with extreme learning machines. Neurocomputing 149, 364–372 (2015)CrossRefGoogle Scholar
  37. 37.
    Scandrett, C.M., Solomon, C.J., Gibson, S.J.: A person-specific, rigorous aging model of the human face. Pattern Recognit. Lett. 27(15), 1776–1787 (2006)CrossRefGoogle Scholar
  38. 38.
    Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition. In: International Conference on Learning Representations, pp. 1–14. IEEE, San Diego, CA (2015)Google Scholar
  39. 39.
    Tian, Q., Cao, M., Ma, T.: Feature relationships learning incorporated age estimation assisted by cumulative attribute encoding. Comput. Mater. Continua 56(3), 467–482 (2018)Google Scholar
  40. 40.
    Tian, Q., Chen, S.: Cross-heterogeneous-database age estimation through correlation representation learning. Neurocomputing 238, 286–295 (2017)CrossRefGoogle Scholar
  41. 41.
    Tian, Q., Chen, S., Tan, X.: Comparative study among three strategies of incorporating spatial structures to ordinal image regression. Neurocomputing 136(8), 152–161 (2014)CrossRefGoogle Scholar
  42. 42.
    Tian, Q., Xue, H., Qiao, L.: Human age estimation by considering both the ordinality and similarity of ages. Neural Process. Lett. 43(2), 505–521 (2016)CrossRefGoogle Scholar
  43. 43.
    Ueki, K., Hayashida, T., Kobayashi, T.: Subspace-based age-group classification using facial images under various lighting conditions. In: 7th International Conference on Automatic Face and Gesture Recognition (FGR06). IEEE, Southampton (2006)Google Scholar
  44. 44.
    Wachter, A., Biegler, L.T.: On the implementation of an interior-point filter line-search algorithm for large-scale nonlinear programming. Math. Programm. 106(1), 25–57 (2006)MathSciNetCrossRefzbMATHGoogle Scholar
  45. 45.
    Xi, X., Sheng, V.S., Sun, B., Wang, L., Fuyuan, H.: An empirical comparison on multi-target regression learning. Comput. Mater. Continua 56(2), 185–198 (2018)Google Scholar
  46. 46.
    Xie, J., Pun, C.: Chronological age estimation under the guidance of age-related facial attributes. IEEE Trans. Inf. Forensics Secur. 14(9), 2500–2511 (2019)CrossRefGoogle Scholar
  47. 47.
    Xing, J., Li, K., Weiming, H., Yuan, C., Ling, H.: Diagnosing deep learning models for high accuracy age estimation from a single image. Pattern Recognit. 66, 106–116 (2017)CrossRefGoogle Scholar
  48. 48.
    Yan, S., Wang, H., Huang, T.S., Yang, Q., Tang, X.: Ranking with uncertain labels. In: Multimedia and Expo, 2007 IEEE International Conference on, pp. 96–99. IEEE, Beijing (2007)Google Scholar
  49. 49.
    Yan, S., Wang, H., Tang, X., Huang, T.S.: Learning auto-structured regressor from uncertain nonnegative labels. In: Computer Vision, 2007. ICCV 2007. IEEE 11th International Conference on, pp. 1–8. IEEE (2007)Google Scholar
  50. 50.
    Yang, X., Gao, B.B., Xing, C., Huo, Z.W.: Deep label distribution learning for apparent age estimation. In: IEEE International Conference on Computer Vision Workshop, pp. 344–350. Amsterdam (2016)Google Scholar
  51. 51.
    Zhang, Y., Yeung, D.Y.: A convex formulation for learning task relationships in multi-task learning. In: The Conference on Uncertainty in Artificial Intelligence, pp. 733–742. Catalina Island, California (2010)Google Scholar
  52. 52.
    Zhang, Y., Wang, Q., Li, Y., Xindong, W.: Sentiment classification based on piecewise pooling convolutional neural network. Comput. Mater. Continua 56(2), 285–297 (2018)Google Scholar
  53. 53.
    Zhou, Z., Wang, Y., Wu, Q.M.J., Yang, C.N., Sun, X.: Effective and efficient global context verification for image copy detection. IEEE Trans. Inf. Forensics Secur. 12(1), 48–63 (2017)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag GmbH Germany, part of Springer Nature 2019

Authors and Affiliations

  • Qing Tian
    • 1
    • 2
    • 3
    • 4
    Email author
  • Wenqiang Zhang
    • 1
  • Junxiang Mao
    • 1
  • Hujun Yin
    • 5
  1. 1.School of Computer and SoftwareNanjing University of Information Science and TechnologyNanjingChina
  2. 2.Collaborative Innovation Center of Atmospheric Environment and Equipment TechnologyNanjing University of Information Science and TechnologyNanjingChina
  3. 3.Jiangsu Engineering Center of Network MonitoringNanjing University of Information Science and TechnologyNanjingChina
  4. 4.MIIT Key Laboratory of Pattern Analysis and Machine IntelligenceNanjing University of Aeronautics and AstronauticsNanjingChina
  5. 5.School of Electrical and Electronic EngineeringThe University of ManchesterManchesterUK

Personalised recommendations