Robust and Index-Compatible Deep Hashing for Accurate and Fast Image Retrieval

  • Jing Liu
  • Dayan Wu
  • Wanqian Zhang
  • Bo LiEmail author
  • Weiping Wang
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11165)


Hashing methods have been widely used in large-scale image retrieval. However, the constraints on the hash codes of similar images learned by the previous hashing methods are too strong, which may lead to overfitting and difficult convergence. Besides, the binary codes output by the previous hashing methods are not optimally compatible with the multi-index approach, which is the most effective method for Hamming distance query acceleration. In this paper, we propose a novel Robust and Index-Compatible Deep Hashing (RICH) method to learn compact similarity-preserving binary codes, which focuses on improving the retrieval accuracy and time efficiency simultaneously. With the learned binary codes, we can achieve better results compared with the state-of-the-arts in retrieval accuracy. Meanwhile, remarkable promotions of the retrieval time efficiency have been made in the Hamming distance query process.


Deep hashing Image retrieval Hamming distance query The multi-index approach 


  1. 1.
    Chang, S.F.: Supervised hashing with kernels. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 2074–2081 (2012)Google Scholar
  2. 2.
    Gionis, A., Indyk, P., Motwani, R., et al.: Similarity search in high dimensions via hashing. VLDB 99, 518–529 (1999)Google Scholar
  3. 3.
    Gog, S., Venturini, R.: Fast and compact hamming distance index. In: SIGIR, pp. 285–294. ACM (2016)Google Scholar
  4. 4.
    Gong, Y., Lazebnik, S., Gordo, A., Perronnin, F.: Iterative quantization: a procrustean approach to learning binary codes for large-scale image retrieval. TPAMI 35(12), 2916–2929 (2013)CrossRefGoogle Scholar
  5. 5.
    Greene, D., Parnas, M., Yao, F.: Multi-index hashing for information retrieval. In: Foundations of Computer Science, pp. 722–731. IEEE (1994)Google Scholar
  6. 6.
    Ji, J., Li, J., Yan, S., Zhang, B., Tian, Q.: Super-bit locality-sensitive hashing. In: International Conference on Neural Information Processing Systems, pp. 108–116 (2012)Google Scholar
  7. 7.
    Krizhevsky, A., Sutskever, I., Hinton, G.E.: Imagenet classification with deep convolutional neural networks. In: NIPS, pp. 1097–1105 (2012)Google Scholar
  8. 8.
    Kulis, B., Grauman, K.: Kernelized locality-sensitive hashing for scalable image search 30(2), 1895–1900 (2009)Google Scholar
  9. 9.
    Lai, H., Pan, Y., Liu, Y., Yan, S.: Simultaneous feature learning and hash coding with deep neural networks. In: CVPR, pp. 3270–3278 (2015)Google Scholar
  10. 10.
    Li, W.J., Wang, S., Kang, W.C.: Feature learning based deep supervised hashing with pairwise labels. arXiv preprint arXiv:1511.03855 (2015)
  11. 11.
    Liu, H., Wang, R., Shan, S., Chen, X.: Deep supervised hashing for fast image retrieval. In: CVPR, pp. 2064–2072 (2016)Google Scholar
  12. 12.
    Liu, L., Shao, L., Shen, F., Yu, M.: Discretely coding semantic rank orders for supervised image hashing. In: CVPR, pp. 5140–5149 (2017)Google Scholar
  13. 13.
    Mu, Y., Yan, S.: Non-metric locality-sensitive hashing. In: Twenty-Fourth AAAI Conference on Artificial Intelligence, pp. 539–544 (2010)Google Scholar
  14. 14.
    Norouzi, M., Fleet, D.J.: Minimal loss hashing for compact binary codes. In: ICML, pp. 353–360 (2011)Google Scholar
  15. 15.
    Shen, F., Shen, C., Liu, W., Tao Shen, H.: Supervised discrete hashing. In: CVPR, pp. 37–45 (2015)Google Scholar
  16. 16.
    Weiss, Y., Torralba, A., Fergus, R.: Spectral hashing. In: NIPS, pp. 1753–1760 (2009)Google Scholar
  17. 17.
    Wu, D., Lin, Z., Li, B., Ye, M., Wang, W.: Deep supervised hashing for multi-label and large-scale image retrieval. In: ICMR, pp. 150–158. ACM (2017)Google Scholar
  18. 18.
    Xia, R., Pan, Y., Lai, H., Liu, C., Yan, S.: Supervised hashing for image retrieval via image representation learning. In: AAAI Conference on Artificial Intelligence (2014)Google Scholar
  19. 19.
    Yao, T., Long, F., Mei, T., Rui, Y.: Deep semantic-preserving and ranking-based hashing for image retrieval. In: IJCAI, pp. 3931–3937 (2016)Google Scholar
  20. 20.
    Zhu, H., Long, M., Wang, J., Cao, Y.: Deep hashing network for efficient similarity retrieval. In: AAAI, pp. 2415–2421 (2016)Google Scholar

Copyright information

© Springer Nature Switzerland AG 2018

Authors and Affiliations

  • Jing Liu
    • 1
    • 2
  • Dayan Wu
    • 1
    • 2
  • Wanqian Zhang
    • 1
    • 2
  • Bo Li
    • 2
    Email author
  • Weiping Wang
    • 2
  1. 1.Institute of Information EngineeringChinese Academy of SciencesBeijingChina
  2. 2.School of Cyber SecurityUniversity of Chinese Academy of SciencesBeijingChina

Personalised recommendations