Classification Probability Estimation Based Multi-Class Image Retrieval

  • Hongqiao Wang
  • Yanning Cai
  • Shicheng Wang
  • Guangyuan Fu
  • Linlin Li
Conference paper
Part of the Advances in Intelligent Systems and Computing book series (AISC, volume 214)


Aiming at multi-class large-scale image retrieval problem, a new image retrieval method based on classification probability estimation is proposed according to the thinking named “Classification First, Retrieval Later”. According to the method, the image features are effectively fused using a composite kernel method first, and a composite kernel classifier with higher classification precision is designed. The optimal coefficients of the classifier are also obtained utilizing the classification result with small-amount image samples. Second, complete the classification probability estimation for the testing images using the composite machine. Third, realize the image retrieval based on the classification probability estimation values. In the experiments with multi-class large-scale image dataset, it is confirmed that the presented method can achieve better retrieval precision. Moreover, the generalization performance without prior knowledge is also studied.


Composite kernel Multiple kernel learning Support vector classifier Content-based image retrieval 



This work was jointly supported by the National Natural Science Foundation for Young Scientists of China (Grant No: 61202332) and China Postdoctoral Science Foundation (Grant No: 2012M521905).


  1. 1.
    Smeulders A, Worring M, Santini S, Gupta A, Jain R (2000) Content-based image retrieval: the end of the early years. IEEE Trans Pattern Anal Mach Intell 22(12):1349–1380CrossRefGoogle Scholar
  2. 2.
    Datta R, Joshi D, Li J (2008) Image retrieval: ideas, influences, and trends of the new age. ACM Comput Surv 40:1–60 Google Scholar
  3. 3.
    Ravela S, Manmatha R (1997) Image retrieval by appearance. ACM SIGIR Philadephia PA, USA, pp 278–285Google Scholar
  4. 4.
    Serre T, Wolf L, Bileschi S, Riesenhuber M, Poggio T (2007) Object recognition with cortex-like mechanisms. IEEE Trans Pattern Anal Mach Intell 9:411–426CrossRefGoogle Scholar
  5. 5.
    Wang JZ, Li J, Wiederhold G (2001) SIMPLIcity: Semantics-Sensitive Integrated Matching for Picture LIbraries. IEEE Trans Pattern Anal Mach Intell 23(9):947–963CrossRefGoogle Scholar
  6. 6.
    Content based image retrieval/image database search engine.
  7. 7.
    Siggelkow S (2002) Feature histograms for content-based image retrieval. Ph.D.thesis, University of Freiburg, Institute for Computer Science, Freiburg, GermanyGoogle Scholar
  8. 8.
    Bach FR (2008) Consistency of the group Lasso and multiple kernel learning. J Mach Learn Res 9:1179–1225MathSciNetMATHGoogle Scholar
  9. 9.
    Gönen M, Alpaydin E (2011) Regularizing multiple kernel learning using response surface methodology. Pattern Recogn 44:159–171CrossRefMATHGoogle Scholar
  10. 10.
    Gönen M, Alpaydin E (2010) Cost-conscious multiple kernel learning. Pattern Recognit Lett 31:959–965CrossRefGoogle Scholar
  11. 11.
    Wu ZP, Zhang XG (2011) Elastic multiple kernel learning. Acta Automatica Sinica 37(6):693–699MathSciNetMATHGoogle Scholar
  12. 12.
    Lewis DP, Jebara T, Noble WS (2006) Nonstationary kernel combination. In: Proceedings of the 23rd international conference on machine learning. ACM, Pittsburgh, USA, pp 553–560Google Scholar
  13. 13.
    Gönen M, Alpaydin E (2008) Localized multiple kernel learning. In: Proceedings of ICML’08, pp. 352–359Google Scholar
  14. 14.
    Kloft M, Brefeld U, Laskov P, Sonnenburg S (2008) Non-sparse multiple kernel learning. In: Proceedings of the NIPS workshop on kernel learning: automatic selection of optimal kernelsGoogle Scholar
  15. 15.
    Rakotomamonjy A, Bach FR, Canu S, Grandvalet Y (2008) SimpleMKL. J Mach Learn Res 9:2491–2521MathSciNetMATHGoogle Scholar
  16. 16.
    Gehler PV, Nowozin S (2008) Infinite kernel learning. Technical report 178, Max Planck Institute for Biological Cybernetics, GermanyGoogle Scholar
  17. 17.
    Myron F, Harpreet S (1995) Query by images and video content: the QBIR system. IEEE Comput 28(9):23–32CrossRefGoogle Scholar
  18. 18.
    Paolo P, Sandrine A, Eric D, Michel B (2009) Sparse multiscale patches (SMP) for image categorization. In: Proceedings of the 15th international multimedia modeling conference on advances in multimedia modeling, Sophia Antipolis, France (2009)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2014

Authors and Affiliations

  • Hongqiao Wang
    • 1
  • Yanning Cai
    • 1
  • Shicheng Wang
    • 1
  • Guangyuan Fu
    • 1
  • Linlin Li
    • 1
  1. 1.Xi’an Research Institute of Hi-TechShaanxiChina

Personalised recommendations