Non-linear Metric Learning Using Metric Tensor

  • Liangying Yin
  • Mingtao PeiEmail author
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9489)


Manifold based metric learning methods have become increasingly popular in recent years. In almost all these methods, however, the underlying manifold is approximated by a point cloud, and the matric tensor, which is the most basic concept to describe the manifold, is neglected. In this paper, we propose a non-linear metric learning framework based on metric tensor. We construct a Riemannian manifold and its metric tensor on sample space, and replace the Euclidean metric by the learned Riemannian metric. By doing this, the sample space is twisted to a more suitable form for classification, clustering and other applications. The classification and clustering results on several public datasets show that the learned metric is effective and promising.


Non-linear metric learning Manifold Metric tensor Gaussian mixture model 


  1. 1.
    Feng, Z., Jin, R., Jain, A.: Large-scale image annotation by efficient and Robust Kernel metric learning. In: 2013 IEEE International Conference on Computer Vision (ICCV), pp. 1609–1616. IEEE (2013)Google Scholar
  2. 2.
    Lajugie, R., Bach, F., Arlot, S.: Large-margin metric learning for constrained partitioning problems. In: Proceedings of The 31st International Conference on Machine Learning, pp. 297–305 (2014)Google Scholar
  3. 3.
    Cui, Z., Li, W., Xu, D., et al.: Fusing robust face region descriptors via multiple metric learning for face recognition in the wild. In: 2013 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 3554–3561. IEEE (2013)Google Scholar
  4. 4.
    Xing, E.P., Jordan, M.I., Russell, S., et al.: Distance metric learning with application to clustering with side-information. In: Advances in Neural Information Processing Systems, pp. 505–512 (2002)Google Scholar
  5. 5.
    Weinberger, K.Q., Blitzer, J., Saul, L.K.: Distance metric learning for large margin nearest neighbor classification. In: Advances in Neural Information Processing Systems, 1473–1480 (2005)Google Scholar
  6. 6.
    Davis, J.V., Kulis, B., Jain, P., et al.: Information-theoretic metric learning. In: Proceedings of the 24th International Conference on Machine Learning, pp. 209–216. ACM (2007)Google Scholar
  7. 7.
    Nguyen, H.V., Bai, L.: Cosine similarity metric learning for face verification. In: Kimmel, R., Klette, R., Sugimoto, A. (eds.) ACCV 2010, Part II. LNCS, vol. 6493, pp. 709–720. Springer, Heidelberg (2011)CrossRefGoogle Scholar
  8. 8.
    Yeung, D.Y., Chang, H.: A kernel approach for semisupervised metric learning. IEEE Trans. Neural Netw. 18(1), 141–149 (2007)CrossRefGoogle Scholar
  9. 9.
    Wang, F., Zuo, W., Zhang, L., et al.: A kernel classification framework for metric learning. arXiv preprint arXiv:1309.5823 (2013)
  10. 10.
    Kedem, D., Tyree, S., Sha, F., Lanckriet, G.R., Weinberger, K.Q.: Non-linear metric learning. In: Advances in Neural Information Processing Systems, pp. 2573–2581 (2012)Google Scholar
  11. 11.
    Friedman, J.H.: Greedy function approximation: a gradient boosting machine. Ann. Stat. 1189–1232 (2001)Google Scholar
  12. 12.
    Shi, Y., Bellet, A., Sha, F.: Sparse compositional metric learning. arXiv preprint arXiv:1404.4105 (2014)
  13. 13.
    Ramanan, D., Baker, S.: Local distance functions: A taxonomy, new algorithms, and an evaluation. IEEE Trans. Pattern Anal. Mach. Intell. 33(4), 794–806 (2011)CrossRefGoogle Scholar
  14. 14.
    Hauberg, S., Freifeld, O., Black, M.: A geometric take on metric learning. In: Bartlett, P., Pereira, F., Burges, C., Bottou, L., Weinberger, K. (eds.) Advances in Neural Information Processing Systems (NIPS), vol. 25, pp. 2033–2041. MIT Press, Cambridge (2012)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2015

Authors and Affiliations

  1. 1.Beijing Laboratory of Intelligent Information Technology, School of Computer ScienceBeijing Institute of TechnologyBeijingPeople’s Republic of China

Personalised recommendations