Multiple Kernel Learning via Distance Metric Learning for Interactive Image Retrieval

  • Fei Yan
  • Krystian Mikolajczyk
  • Josef Kittler
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6713)


In this paper we formulate multiple kernel learning (MKL) as a distance metric learning (DML) problem. More specifically, we learn a linear combination of a set of base kernels by optimising two objective functions that are commonly used in distance metric learning. We first propose a global version of such an MKL via DML scheme, then a localised version. We argue that the localised version not only yields better performance than the global version, but also fits naturally into the framework of example based retrieval and relevance feedback. Finally the usefulness of the proposed schemes are verified through experiments on two image retrieval datasets.


Image Retrieval Query Image Kernel Weight Relevance Feedback Mean Average Precision 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Shawe-Taylor, J., Cristianini, N.: Kernel Methods for Pattern Analysis. Cambridge University Press, Cambridge (2004)CrossRefzbMATHGoogle Scholar
  2. 2.
    Lanckriet, G., Cristianini, N., Bartlett, P., Ghaoui, L.E., Jordan, M.: Learning the kernel matrix with semidefinite programming. JMLR 5, 27–72 (2004)zbMATHGoogle Scholar
  3. 3.
    Bach, F., Lanckriet, G.: Multiple kernel learning, conic duality, and the smo algorithm. In: ICML (2004)Google Scholar
  4. 4.
    Sonnenburg, S., Ratsch, G., Schafer, C., Scholkopf, B.: Large scale multiple kernel learning. JMLR 7, 1531–1565 (2006)zbMATHGoogle Scholar
  5. 5.
    Xing, E., Ng, A., Jordan, M., Russell, S.: Distance metric learning, with application to clustering with side-information. In: NIPS (2002)Google Scholar
  6. 6.
    Schultz, M., Joachims, T.: Learning a distance metric from relative comparisons. In: NIPS (2004)Google Scholar
  7. 7.
    Weinberger, K., Saul, L.: Distance metric learning for large margin nearest neighbor classification. JMLR 10, 207–244 (2009)zbMATHGoogle Scholar
  8. 8.
    Kloft, M., Brefeld, U., Sonnenburg, S., Zien, A.: Efficient and accurate. In: NIPS (2009)Google Scholar
  9. 9.
    Ye, J., Ji, S., Chen, J.: Multi-class discriminant kernel learning via convex programming. JMLR 9, 719–758 (2008)zbMATHGoogle Scholar
  10. 10.
    Yan, F., Mikolajczyk, K., Barnard, M., Cai, H., Kittler, J.: Lp norm multiple kernel fisher discriminant analysis for object and image categorisation. In: CVPR (2010)Google Scholar
  11. 11.
    Yan, S., Xu, D., Zhang, B., Zhang, H., Yang, Q., Lin, S.: Graph embedding and extensions: A general framework for dimensionality reduction. In: PAMI (2007)Google Scholar
  12. 12.
    Nilsback, M., Zisserman, A.: Automated flower classification over a large number of classes. In: Indian Conference on Computer Vision, Graphics and Image Processing (2008)Google Scholar
  13. 13.
    Fei-Fei, L., Fergus, R., Perona, P.: One-shot learning of object categories. PAMI 28(4), 594–611 (2006)CrossRefGoogle Scholar
  14. 14.
    Sande, K., Gevers, T., Snoek, C.: Evaluation of color descriptors for object and scene recognition. In: CVPR (2008)Google Scholar
  15. 15.
    Grauman, K., Darrell, T.: The pyramid match kernel: Discriminative classification with sets of image features. In: ICCV (2005)Google Scholar
  16. 16.
    Lazebnik, S., Schmid, C., Ponce, J.: Beyond bags of features: Spatial pyramid matching for recognizing natural scene categories. In: CVPR (2006)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2011

Authors and Affiliations

  • Fei Yan
    • 1
  • Krystian Mikolajczyk
    • 1
  • Josef Kittler
    • 1
  1. 1.Centre for Vision, Speech, and Signal ProcessingUniversity of SurreyGuildfordUK

Personalised recommendations