Output Regularized Metric Learning with Side Information
Abstract
Distance metric learning has been widely investigated in machine learning and information retrieval. In this paper, we study a particular content-based image retrieval application of learning distance metrics from historical relevance feedback log data, which leads to a novel scenario called collaborative image retrieval. The log data provide the side information expressed as relevance judgements between image pairs. Exploiting the side information as well as inherent neighborhood structures among examples, we design a convex regularizer upon which a novel distance metric learning approach, named output regularized metric learning, is presented to tackle collaborative image retrieval. Different from previous distance metric methods, the proposed technique integrates synergistic information from both log data and unlabeled data through a regularization framework and pilots the desired metric toward the ideal output that satisfies pairwise constraints revealed by side information. The experiments on image retrieval tasks have been performed to validate the feasibility of the proposed distance metric technique.
Keywords
Distance Metric Learning Side Information Output Regularized Metric Learning Collaborative Image RetrievalReferences
- 1.Hoi, S.C., Lyu, M.R., Jin, R.: A unified log-based relevance feedback scheme for image retrieval. IEEE Trans. Knowledge and Data Engineering 18(4), 509–524 (2006)CrossRefGoogle Scholar
- 2.Fukunaga, K.: Introduction to Statistical Pattern Recognition. Elsevier, Amsterdam (1990)zbMATHGoogle Scholar
- 3.Goldberger, G.H.J., Roweis, S., Salakhutdinov, R.: Neighbourhood components analysis. In: NIPS 17 (2005)Google Scholar
- 4.Globerson, A., Roweis, S.: Metric learning by collapsing classes. In: NIPS 18 (2006)Google Scholar
- 5.Weinberger, K., Blitzer, J., Saul, L.: Distance metric learning for large margin nearest neighbor classification. In: NIPS 18 (2006)Google Scholar
- 6.Yang, L., Jin, R., Sukthankar, R., Liu, Y.: An efficient algorithm for local distance metric learning. In: Proc. AAAI (2006)Google Scholar
- 7.Xing, E.P., Ng, A.Y., Jordan, M.I., Russell, S.: Distance metric learning with application to clustering with side-information. In: NIPS 15 (2003)Google Scholar
- 8.Bar-Hillel, A., Hertz, T., Shental, N., Weinshall, D.: Learning a mahalanobis metric from equivalence constraints. JMLR 6, 937–965 (2005)MathSciNetzbMATHGoogle Scholar
- 9.Hoi, S.C., Liu, W., Lyu, M.R., Ma, W.-Y.: Learning distance metrics with contextual constraints for image retrieval. In: Proc. CVPR (2006)Google Scholar
- 10.Si, L., Jin, R., Hoi, S.C., Lyu, M.R.: Collaborative image retrieval via regularized metric learning. ACM Multimedia Systems Journal 12(1), 34–44 (2006)CrossRefGoogle Scholar
- 11.Smeulders, A.W.M., Worring, M., Santini, S., Gupta, A., Jain, R.: Content-based image retrieval at the end of the early years. IEEE Trans. PAMI 22(12), 1349–1380 (2000)CrossRefGoogle Scholar
- 12.Vapnik, V.N.: Statistical Learning Theory. John Wiley and Sons, Chichester (1998)zbMATHGoogle Scholar
- 13.Goldberg, A., Zhu, X., Wright, S.: Dissimilarity in graph-based semi-supervised classification. In: Proc. Artificial Intelligence and Statistics (2007)Google Scholar
- 14.Boyd, S., Vandenberge, L.: Convex Optimization. Cambridge University Press, Cambridge (2003)Google Scholar
- 15.Manjunath, B., Newsam, P.W.S., Shin, H.: A texture descriptor for browsing and similarity retrieval. Signal Processing Image Communication (2001)Google Scholar
- 16.Davis, J.V., Kulis, B., Jain, P., Sra, S., Dhillon, I.S.: Information-theoretic metric learning. In: Proc. ICML (2007)Google Scholar