International Conference on Analysis of Images, Social Networks and Texts

Analysis of Images, Social Networks and Texts pp 14-23 | Cite as

Sequential Hierarchical Image Recognition Based on the Pyramid Histograms of Oriented Gradients with Small Samples

  • Andrey V. Savchenko
  • Vladimir R. Milov
  • Natalya S. Belova
Conference paper
Part of the Communications in Computer and Information Science book series (CCIS, volume 542)


In this paper we explore an application of the pyramid HOG (Histograms of Oriented Gradients) features in image recognition problem with small samples. A sequential analysis is used to improve the performance of hierarchical methods. We propose to process the next, more detailed level of pyramid only if the decision at the current level is unreliable. The Chow’s reject option of comparison of the posterior probability with a fixed threshold is used to verify recognition reliability. The posterior probability is estimated for the homogeneity-testing probabilistic neural network classifier on the basis of its relation with the Bayesian decision. Experimental results in face recognition are presented. It is shown that the proposed approach allows to increase the recognition performance in 2–4 times in comparison with conventional classification of pyramid HOGs.


Image recognition Hierarchical recognition Sequential analysis Chow’s reject option Probabilistic neural network HOG (Histograms of oriented Gradients) PHOG (Pyramid HOG) 



Andrey V. Savchenko is supported by RSF (Russian Science Foundation) grant 14-41-00039 in the National Research University Higher School of Economics.


  1. 1.
    Sonka, M., Hlavac, V., Boyle, R.: Image Processing, Analysis, and Machine Vision, 4th edn. Cengage Learning, Boston (2014)Google Scholar
  2. 2.
    Lowe, D.: Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis. 60(2), 91–110 (2004)CrossRefGoogle Scholar
  3. 3.
    Dalal N., Triggs B.: Histograms of oriented gradients for human detection. In: International Conference on Computer Vision and Pattern Recognition, pp. 886–893 (2005)Google Scholar
  4. 4.
    Bay, H., Ess, A., Tuytelaars, T., Van Gool, L.: SURF: speeded up robust features. Comput. Vis. Image Underst. 110(3), 346–359 (2008)CrossRefGoogle Scholar
  5. 5.
    He, K., Zhang, X., Ren, S., Sun, J.: Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification. arXiv:1502.01852 [cs], (2015)
  6. 6.
    Hawkins, J., Blakeslee, S.: On Intelligence. Times Books, New York (2004)Google Scholar
  7. 7.
    Munoz, D., Bagnell, J.A., Hebert, M.: Stacked hierarchical labeling. In: Daniilidis, K., Maragos, P., Paragios, N. (eds.) ECCV 2010, Part VI. LNCS, vol. 6316, pp. 57–70. Springer, Heidelberg (2010)CrossRefGoogle Scholar
  8. 8.
    Bosch, A., Zisserman, A., Munoz, X.: Representing shape with a spatial pyramid kernel. In: 6th ACM International Conference on Image and Video Retrieval CIVR 2007, pp. 401–408 (2007)Google Scholar
  9. 9.
    Zhai, J.-H., Zhang, S.-F., Liu, L.-J.: Image recognition based on wavelet transform and artificial neural networks. In: IEEE International Conference on Machine Learning and Cybernetics, pp. 789–793 (2008)Google Scholar
  10. 10.
    Cireşan, D., Meier, U., Masci, J., Schmidhuber, J.: Multi-column deep neural network for traffic sign classification. Neural Netw. 32, 333–338 (2012)CrossRefGoogle Scholar
  11. 11.
    Savchenko, A.V.: Directed enumeration method in image recognition. Pattern Recogn. 45(8), 2952–2961 (2012)CrossRefGoogle Scholar
  12. 12.
    Chellappa, R., Du, M., Turaga, P., Zhou, S.K.: Face tracking and recognition in video. In: Handbook of Face Recognition, pp. 323–351 (2011)Google Scholar
  13. 13.
    Chow, C.K.: On optimum recognition error and reject trade–off. IEEE Trans. Inf. Theory 16, 41–46 (1970)CrossRefMATHGoogle Scholar
  14. 14.
    Wald, A.: Sequential Analysis. Dover Publications, New York (2013)MATHGoogle Scholar
  15. 15.
    Savchenko, A.V.: Probabilistic neural network with homogeneity testing in recognition of discrete patterns set. Neural Netw. 46, 227–241 (2013)CrossRefMATHGoogle Scholar
  16. 16.
    Theodoridis, S., Koutroumbas, K.: Pattern Recognition, 4th edn. Elsevier Inc., Amsterdam (2009)MATHGoogle Scholar
  17. 17.
    Tan, X., Chen, S., Zhou, Z.H., Zhang, F.: Face recognition from a single image per person: a survey. Pattern Recogn. 39(9), 1725–1745 (2006)CrossRefMATHGoogle Scholar
  18. 18.
    Taigman, Y., Yang, M., Ranzato, M., Wolf, L.: DeepFace: closing the gap to human-level performance in face verification. In: 2014 IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2014), pp. 1701–1708 (2014)Google Scholar
  19. 19.
    Savchenko, A.V.: Nonlinear transformation of the distance function in the nearest neighbor image recognition. In: Zhang, Y.J., Tavares, J.M.R.S. (eds.) CompIMAGE 2014. LNCS, vol. 8641, pp. 261–266. Springer, Heidelberg (2014)Google Scholar
  20. 20.
    Specht, D.F.: Probabilistic neural networks. Neural Netw. 3(1), 109–118 (1990)CrossRefGoogle Scholar
  21. 21.
    Yao, Y.: Granular computing and sequential three-way decisions. In: Lingras, P., Wolski, M., Cornelis, C., Mitra, S., Wasilewski, P. (eds.) RSKT 2013. LNCS, vol. 8171, pp. 16–27. Springer, Heidelberg (2013)CrossRefGoogle Scholar
  22. 22.
    Kullback, S.: Information Theory and Statistics. Dover Publications, New York (1997)MATHGoogle Scholar
  23. 23.
  24. 24.
  25. 25.
    Japanese Female Facial Expression (JAFFE) database.
  26. 26.
    Liao, S., Zhu, X., Lei, Z., Zhang, L., Li, S.Z.: Learning multi-scale block local binary patterns for face recognition. In: Lee, S.-W., Li, S.Z. (eds.) ICB 2007. LNCS, vol. 4642, pp. 828–837. Springer, Heidelberg (2007)CrossRefGoogle Scholar
  27. 27.
    OpenCV library.
  28. 28.
    Degtyarev, N., Seredin, O.: Comparative testing of face detection algorithms. In: Elmoataz, A., Lezoray, O., Nouboud, F., Mammass, D., Meunier, J. (eds.) ICISP 2010. LNCS, vol. 6134, pp. 200–209. Springer, Heidelberg (2010)CrossRefGoogle Scholar

Copyright information

© Springer International Publishing Switzerland 2015

Authors and Affiliations

  • Andrey V. Savchenko
    • 1
  • Vladimir R. Milov
    • 2
  • Natalya S. Belova
    • 3
  1. 1.Laboratory of Algorithms and Technologies for Network AnalysisNational Research University Higher School of EconomicsNizhny NovgorodRussia
  2. 2.Nizhny Novgorod State Technical University n.a. R.E. AlekseevNizhny NovgorodRussia
  3. 3.National Research University Higher School of EconomicsMoscowRussia

Personalised recommendations