Advertisement

Hierarchical Hashing for Image Retrieval

  • Cheng YanEmail author
  • Xiao Bai
  • Jun Zhou
  • Yun Liu
Conference paper
Part of the Communications in Computer and Information Science book series (CCIS, volume 772)

Abstract

Hashing has been widely used in large-scale vision problems thanks to its efficiency in both storage and speed. The quality of hashing can be boosted when supervised information is used to learn hash functions. On large-scale hierarchical datasets, hierarchical semantic information reflects the relationship between classes and their children, which however has been ignored by most supervised hashing methods. In this paper, we propose a hierarchical hashing method for image retrieval. This method models and fuses both hierarchical semantic level relationship through taxonomy structure of dataset and feature level relationship of images into an integrated learning objective, then an optimization scheme is developed to solve the learning problem. Experiments are performed on two large-scale datasets: ImageNet ILSVRC 2010 and Animals with Attributes (AWA) dataset. Besides standard evaluation criteria, we also developed hierarchical evaluation criteria for image retrieval and classification tasks. The results show that the proposed method improves the accuracy of supervised hashing in both types of criteria.

References

  1. 1.
    Andoni, A., Indyk, P.: Near-optimal hashing algorithms for approximate nearest neighbor in high dimensions. In: IEEE Symposium on Foundations of Computer Science, pp. 459–468 (2006)Google Scholar
  2. 2.
    Arandjelović, R., Zisserman, A.: Three things everyone should know to improve object retrieval. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 2911–2918 (2012)Google Scholar
  3. 3.
    Berg, A.C., Berg, T.L., Malik, J.: Shape matching and object recognition using low distortion correspondences. In: IEEE Conference on Computer Vision and Pattern Recognition, vol. 1, pp. 26–33 (2005)Google Scholar
  4. 4.
    Charikar, M.S.: Similarity estimation techniques from rounding algorithms. In: ACM Symposium on Theory of Computing, pp. 380–388 (2002)Google Scholar
  5. 5.
    Crammer, K., Singer, Y.: On the algorithmic implementation of multiclass kernel-based vector machines. J. Mach. Learn. Res. 2, 265–292 (2002)zbMATHGoogle Scholar
  6. 6.
    Datar, M., Immorlica, N., Indyk, P., Mirrokni, V.S.: Locality-sensitive hashing scheme based on p-stable distributions. In: Annual Symposium on Computational Geometry, pp. 253–262 (2004)Google Scholar
  7. 7.
    Dekel, O., Keshet, J., Singer, Y.: Large margin hierarchical classification. In: International Conference on Machine Learning, p. 27 (2004)Google Scholar
  8. 8.
    Deng, J., Berg, A.C., Fei-Fei, L.: Hierarchical semantic indexing for large scale image retrieval. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 785–792. IEEE (2011)Google Scholar
  9. 9.
    Deng, J., Dong, W., Socher, R., Li, L.J., Li, K., Fei-Fei, L.: Imagenet: A large-scale hierarchical image database. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 248–255 (2009)Google Scholar
  10. 10.
    Erin Liong, V., Lu, J., Wang, G., Moulin, P., Zhou, J.: Deep hashing for compact binary codes learning. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 2475–2483 (2015)Google Scholar
  11. 11.
    Gong, Y., Lazebnik, S.: Iterative quantization: A procrustean approach to learning binary codes. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 817–824. IEEE (2011)Google Scholar
  12. 12.
    Gong, Y., Pawlowski, M., Yang, F., Brandy, L., Boundev, L., Fergus, R.: Web scale photo hash clustering on a single machine. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 19–27 (2015)Google Scholar
  13. 13.
    Hays, J., Efros, A.A.: Scene completion using millions of photographs. Trans. Graph. 26(3), 4 (2007)CrossRefGoogle Scholar
  14. 14.
    Jain, P., Kulis, B., Grauman, K.: Fast image search for learned metrics. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–8 (2008)Google Scholar
  15. 15.
    Jia, Y.: Caffe: An open source convolutional architecture for fast feature embedding (2013)Google Scholar
  16. 16.
    Koller, D., Sahami, M.: Hierarchically classifying documents using very few words (1997)Google Scholar
  17. 17.
    Krizhevsky, A., Sutskever, I., Hinton, G.E.: Imagenet classification with deep convolutional neural networks. In: Proceedings of the Neural Information Processing Systems Conference, pp. 1097–1105 (2012)Google Scholar
  18. 18.
    Kulis, B., Darrell, T.: Learning to hash with binary reconstructive embeddings. In: Proceedings of the Neural Information Processing Systems Conference, pp. 1042–1050 (2009)Google Scholar
  19. 19.
    Kulis, B., Grauman, K.: Kernelized locality-sensitive hashing for scalable image search. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 2130–2137 (2009)Google Scholar
  20. 20.
    Lampert, C.H., Nickisch, H., Harmeling, S.: Learning to detect unseen object classes by between-class attribute transfer. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 951–958 (2009)Google Scholar
  21. 21.
    Liu, W., Wang, J., Ji, R., Jiang, Y.G., Chang, S.F.: Supervised hashing with kernels. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 2074–2081 (2012)Google Scholar
  22. 22.
    Liu, W., Wang, J., Kumar, S., Chang, S.F.: Hashing with graphs. In: International Conference on Machine Learning, pp. 1–8 (2011)Google Scholar
  23. 23.
    Lowe, D.G.: Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vision 60(2), 91–110 (2004)CrossRefGoogle Scholar
  24. 24.
    Nesterov, Y.: Introductory Lectures on Convex Optimization, vol. 87. Springer Science & Business Media, New York (2004)zbMATHGoogle Scholar
  25. 25.
    Norouzi, M., Blei, D.M.: Minimal loss hashing for compact binary codes. In: International Conference on Machine Learning, pp. 353–360 (2011)Google Scholar
  26. 26.
    Philbin, J., Chum, O., Isard, M., Sivic, J., Zisserman, A.: Object retrieval with large vocabularies and fast spatial matching. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–8 (2007)Google Scholar
  27. 27.
    Raginsky, M., Lazebnik, S.: Locality-sensitive binary codes from shift-invariant kernels. Adv. Neural Inf. Process. Syst. 22, 1509–1517 (2009)Google Scholar
  28. 28.
    Salakhutdinov, R., Hinton, G.: Semantic hashing. Int. J. Approximate Reasoning 50(7), 969–978 (2009)CrossRefGoogle Scholar
  29. 29.
    Shen, F., Shen, C., Liu, W., Shen, H.T.: Supervised discrete hashing. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 37–45 (2015)Google Scholar
  30. 30.
    Strecha, C., Bronstein, A.M., Bronstein, M.M., Fua, P.: LDAHash: Improved matching with smaller descriptors. IEEE Trans. Pattern Anal. Mach. Intell. 34(1), 66–78 (2012)CrossRefGoogle Scholar
  31. 31.
    Torralba, A., Fergus, R., Freeman, W.T.: 80 million tiny images: A large data set for nonparametric object and scene recognition. IEEE Trans. Pattern Anal. Mach. Intell. 30(11), 1958–1970 (2008)CrossRefGoogle Scholar
  32. 32.
    Torralba, A., Fergus, R., Weiss, Y.: Small codes and large image databases for recognition. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–8 (2008)Google Scholar
  33. 33.
    Verma, N., Mahajan, D., Sellamanickam, S., Nair, V.: Learning hierarchical similarity metrics. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 2280–2287 (2012)Google Scholar
  34. 34.
    Wang, J., Kumar, S., Chang, S.F.: Semi-supervised hashing for large-scale search. IEEE Trans. Pattern Anal. Mach. Intell. 34(12), 2393–2406 (2012)CrossRefGoogle Scholar
  35. 35.
    Weiss, Y., Torralba, A., Fergus, R.: Spectral hashing. In: Advances in Neural Information Processing Systems, pp. 1753–1760 (2009)Google Scholar
  36. 36.
    Zhao, B., Xing, E.P.: Hierarchical feature hashing for fast dimensionality reduction. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 2051–2058 (2014)Google Scholar

Copyright information

© Springer Nature Singapore Pte Ltd. 2017

Authors and Affiliations

  • Cheng Yan
    • 1
    • 2
    • 3
    Email author
  • Xiao Bai
    • 1
    • 2
    • 3
  • Jun Zhou
    • 1
    • 2
    • 3
  • Yun Liu
    • 1
    • 2
    • 3
  1. 1.School of Computer Science and TechnologyBeihang UniversityBeijingChina
  2. 2.School of Information and Communication TechnologyGriffith UniversityNathanAustralia
  3. 3.School of Automation Science and Electrical EngineeringBeihang UniversityBeijingChina

Personalised recommendations