Unsupervised Cross-Modal Hashing with Soft Constraint

  • Yuxuan ZhouEmail author
  • Yaoxian Li
  • Rui Liu
  • Lingyun Hao
  • Yuanliang Sun
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10736)


The booming demands for cross-modal retrieval tasks can often bring in its wake the development of retrieval technologies, as people turn to pursuing a more effective way to improve the performance of search results in both accuracy and efficiency, for example by unsupervised cross-modal hashing. It’s worth noting that most of the cross-modal hashing methods focus on utilizing merely one approach to generate hash codes. However, each approach has its own intrinsic drawback, which would inevitably diminish the quality of hash codes. In this paper, we propose a state-of-the-art model named Soft Constraint Hashing (SCH), using a special soft constraint term defined as an “information tunnel” to achieve the goal that conveys information from one approach to another. In particular, this “tunnel” can eliminate potential data noises to some extent and bridge the gap between two unsupervised discrete hashing allocation approaches to simultaneously reinforce the quality of hash codes. The empirical results on publicly available datasets illustrate that our proposed model outperforms all the existing unsupervised cross-model hashing methods.


Unsupervised hashing Multi-modal data Soft constraint 


  1. 1.
    Wang, J., Zhou, Y., Duan, K., Wang, J.J.-Y., Bensmail, H.: Supervised cross-modal factor analysis for multiple modal data classification. In: 2015 IEEE International Conference on Systems, Man, and Cybernetics, Kowloon Tong, Hong Kong, 9–12 October 2015, pp. 1882–1888 (2015)Google Scholar
  2. 2.
    Gudivada, V.N., Raghavan, V.V.: Content-based image retrieval systems – guest editors’ introduction. IEEE Comput. 28(9), 18–22 (1995)CrossRefGoogle Scholar
  3. 3.
    Liu, L., Lin, Z., Shao, L., Shen, F., Ding, G., Han, J.: Sequential discrete hashing for scalable cross-modality similarity retrieval. IEEE Trans. Image Process. 26(1), 107–118 (2017)MathSciNetCrossRefGoogle Scholar
  4. 4.
    Ding, K., Fan, B., Huo, C., Xiang, S., Pan, C.: Cross-modal hashing via rank-order preserving. IEEE Trans. Multimedia 19(3), 571–585 (2017)CrossRefGoogle Scholar
  5. 5.
    Song, J., Yang, Y., Huang, Z., Shen, H.T., Hong, R.: Multiple feature hashing for real-time large scale near-duplicate video retrieval. In: Proceedings of the 19th International Conference on Multimedia 2011, Scottsdale, AZ, USA, November 28–December 1 2011, pp. 423–432 (2011)Google Scholar
  6. 6.
    Zhang, D., Wang, F., Si, L.: Composite hashing with multiple information sources. In: Proceeding of the 34th International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2011, Beijing, China, 25–29 July 2011, pp. 225–234 (2011)Google Scholar
  7. 7.
    Bronstein, M.M., Bronstein, A.M., Michel, F., Paragios, N.: Data fusion through cross-modality metric learning using similarity-sensitive hashing. In: The Twenty-Third IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2010, San Francisco, CA, USA, 13–18 June 2010, pp. 3594–3601 (2010)Google Scholar
  8. 8.
    Ding, G., Guo, Y., Zhou, J., Gao, Y.: Large-scale cross-modality search via collective matrix factorization hashing. IEEE Trans. Image Process. 25(11), 5427–5440 (2016)MathSciNetCrossRefGoogle Scholar
  9. 9.
    Song, J., Yang, Y., Yang, Y., Huang, Z., Shen, H.T.: Inter-media hashing for large-scale retrieval from heterogeneous data sources. In: Proceedings of the ACM SIGMOD International Conference on Management of Data, SIGMOD 2013, New York, NY, USA, 22–27 June 2013, pp. 785–796 (2013)Google Scholar
  10. 10.
    Kang, W.-C., Li, W.-J., Zhou, Z.-H.: Column sampling based discrete supervised hashing. In: Proceedings of the Thirtieth AAAI Conference on Artificial Intelligence, 12–17 February 2016, Phoenix, Arizona, USA, pp. 1230–1236 (2016)Google Scholar
  11. 11.
    Shen, F., Shen, C., Liu, W., Shen, H.T.: Supervised discrete hashing. In: IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2015, Boston, MA, USA, 7–12 June 2015, pp. 37–45 (2015)Google Scholar
  12. 12.
    Gui, J., Liu, T., Sun, Z., Tao, D., Tan, T.: Fast supervised discrete hashing. IEEE Trans. Pattern Anal. Mach. Intell. 40(2), 490–496 (2017)CrossRefGoogle Scholar
  13. 13.
    Yang, Y., Luo, Y., Chen, W., Shen, F., Shao, J., Shen, H.T.: Zero-shot hashing via transferring supervised knowledge. In: Proceedings of the 2016 ACM Conference on Multimedia Conference, MM 2016, Amsterdam, The Netherlands, 15–19 October 2016, pp. 1286–1295 (2016)Google Scholar
  14. 14.
    Zhu, X., Huang, Z., Shen, H.T., Zhao, X.: Linear cross-modal hashing for efficient multimedia search. In: ACM Multimedia Conference, MM 2013, Barcelona, Spain, 21–25 October 2013, pp. 143–152 (2013)Google Scholar
  15. 15.
    Wu, B., Yang, Q., Zheng, W.-S., Wang, Y., Wang, J.: Quantized correlation hashing for fast cross-modal search. In: Proceedings of the Twenty-Fourth International Joint Conference on Artificial Intelligence, IJCAI 2015, Buenos Aires, Argentina, 25–31 July 2015, pp. 3946–3952 (2015)Google Scholar
  16. 16.
    Liu, J., Ji, S., Ye, J.: SLEP: Sparse learning with efficient projections. Arizona State University (2009)Google Scholar
  17. 17.
    Huiskes, M.J., Lew, M.S.: The MIR flickr retrieval evaluation. In: Proceedings of the 1st ACM SIGMM International Conference on Multimedia Information Retrieval, MIR 2008, Vancouver, British Columbia, Canada, 30–31 October 2008, pp. 39–43 (2008)Google Scholar
  18. 18.
    Russell, B.C., Torralba, A., Murphy, K.P., Freeman, W.T.: LabelMe: a database and web-based tool for image annotation. Int. J. Comput. Vision 77(1–3), 157–173 (2008)CrossRefGoogle Scholar
  19. 19.
    Oliva, A., Torralba, A.: Modeling the shape of the scene: a holistic representation of the spatial envelope. Int. J. Comput. Vision 42(3), 145–175 (2001)CrossRefGoogle Scholar

Copyright information

© Springer International Publishing AG, part of Springer Nature 2018

Authors and Affiliations

  • Yuxuan Zhou
    • 1
    Email author
  • Yaoxian Li
    • 2
  • Rui Liu
    • 1
  • Lingyun Hao
    • 3
  • Yuanliang Sun
    • 4
  1. 1.University of Electronic Science and Technology of ChinaChengduChina
  2. 2.State Key Lab Elect Thin Film and Integrated DeviceUniversity of Electronic Science and Technology of ChinaChengduChina
  3. 3.Xidian UniversityXi’anChina
  4. 4.Southeast UniversityNanjingChina

Personalised recommendations