Learning Query-Dependent Distance Metrics for Interactive Image Retrieval

  • Junwei Han
  • Stephen J. McKenna
  • Ruixuan Wang
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5815)


An approach to target-based image retrieval is described based on on-line rank-based learning. User feedback obtained via interaction with 2D image layouts provides qualitative constraints that are used to adapt distance metrics for retrieval. The user can change the query during a search session in order to speed up the retrieval process. An empirical comparison of online learning methods including ranking-SVM is reported using both simulated and real users.


Image Retrieval Query Image Relevance Feedback User Feedback CBIR System 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Cox, I.J., Miller, M.L., Minka, T.P., Papathomas, T.V., Yianilos, P.N.: The Bayesian image retrieval system, Pichunter: Theory, implementation, and psychophysical experiments. IEEE Trans. on Image Processing 9(1), 20–37 (2000)CrossRefGoogle Scholar
  2. 2.
    Freund, A., Iyer, R., Schapire, R.E., Lozano-Perez, T.: An efficient boosting algorithm for combining preferences. J. Machine Learning Research 4, 939–969 (2003)CrossRefGoogle Scholar
  3. 3.
    Frome, A.: Learning Distance Functions for Examplar-based Object Recognition. PhD thesis, UC Berkeley (2007)Google Scholar
  4. 4.
    He, X., Ma, W.-Y., Zhang, H.-J.: Learning an image manifold for retrieval. In: Proceedings of the 12th Annual ACM international conference on Multimedia, New York, pp. 17–23 (2004)Google Scholar
  5. 5.
    Hu, Y., Li, M., Yu, N.: Multiple-instance ranking: Learning to rank images for image retrieval. In: IEEE Conference on Computer Vision and Pattern Recognition, Anchorage, USA (2008)Google Scholar
  6. 6.
    Huang, J., Ravi Kumar, S., Mitra, M., Zhu, W., Zabih, R.: Spatial color indexing and applications. Int. J. of Computer Vision 35, 245–268 (1999)CrossRefGoogle Scholar
  7. 7.
    Joachims, T.: Optimizing search engines using clickthrough data. In: The Eighth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Alberta, Canada, pp. 133–142 (2002)Google Scholar
  8. 8.
    Lee, J.-E., Jin, R., Jain, A.K.: Rank-based distance metric learning: An application to image retrieval. In: Computer Vision and Pattern Recognition (CVPR), Anchorage, USA (2008)Google Scholar
  9. 9.
    Moghaddam, B., Tian, Q., Lesh, N., Shen, C., Huang, T.S.: Visualization and user-modeling for browsing personal photo libraries. International Journal of Computer Vision 56, 109–130 (2004)CrossRefGoogle Scholar
  10. 10.
    Rodden, K.: Evaluating Similarity-Based Visualisations as Interfaces for Image Browsing. PhD thesis, University of Cambridge (2001)Google Scholar
  11. 11.
    Rui, Y., Huang, T.S., Ortega, M., Mehrotra, S.: Relevance feedback: A power tool in interactive content-based image retrieval. IEEE Trans. on Circuits and Systems for Video Technology 8, 644–655 (1998)CrossRefGoogle Scholar
  12. 12.
    Schultz, M., Joachims, T.: Learning a distance metric from relative comparisons. In: Neural Information Processing Systems (NIPS), Berlin (2003)Google Scholar
  13. 13.
    Smith, J.R., Chang, S.-F.: Automated binary texture feature sets for image retrieval. In: IEEE International Conference on Acoustics, Speech, and Signal Processing, Atlanta, USA, pp. 2239–2242 (1996)Google Scholar
  14. 14.
    Tong, S., Chang, E.: Support vector machine active learning for image retrieval. In: ACM Conference on Multimedia, Ottawa, Canada, pp. 107–118 (2001)Google Scholar
  15. 15.
    Wang, R., McKenna, S.J., Han, J.: High-entropy layouts for content-based browsing and retrieval. In: ACM International Conference on Image and Video Retrieval, Santorini, Greece (2009)Google Scholar
  16. 16.
    Ward, A.A., McKenna, S.J., Buruma, A., Taylor, P., Han, J.: Merging technology and users: applying image browsing to the fashion industry for design inspiration. In: Content-based Multimedia Indexing, London, pp. 288–295 (2008)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2009

Authors and Affiliations

  • Junwei Han
    • 1
  • Stephen J. McKenna
    • 1
  • Ruixuan Wang
    • 1
  1. 1.School of ComputingUniversity of DundeeDundeeUK

Personalised recommendations