The Leave-One-Out Kernel

  • Koji Tsuda
  • Motoaki Kawanabe
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 2415)


Recently, several attempts have been made for deriving data-dependent kernels from distribution estimates with parametric models (e.g. the Fisher kernel). In this paper, we propose a new kernel derived from any distribution estimators, parametric or nonparametric. This kernel is called the Leave-one-out kernel (i.e. LOO kernel), because the leave-one-out process plays an important role to compute this kernel. We will show that, when applied to a parametric model, the LOO kernel converges to the Fisher kernel asymptotically as the number of samples goes to infinity.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    S. Amari and H. Nagaoka. Methods of Information Geometry, volume 191 of Translations of Mathematical Monographs. American Mathematical Society, 2001.Google Scholar
  2. 2.
    A.J. Izenman. Recent developments in nonparametric density estimation. Journal of the American Statistical Association, 86(413):205–224, 1991.zbMATHCrossRefMathSciNetGoogle Scholar
  3. 3.
    T.S. Jaakkola, M. Diekhans, and D. Haussler. A discriminative framework for detecting remote protein homologies. J. Biol., 7:95–114, 2000.Google Scholar
  4. 4.
    T.S. Jaakkola and D. Haussler. Exploiting generative models in discriminative classifiers. In NIPS 11, pages 487–493. MIT Press, 1999.Google Scholar
  5. 5.
    A.K. Jain and R.C. Dubes. Algorithms for Clustering Data. Prentice Hall, 1988.Google Scholar
  6. 6.
    K.-R. Müller, S. Mika, G. Rätsch, K. Tsuda, and B. Schölkopf. An introduction to kernel-based learning algorithms. IEEE Trans. Neural Networks, 12(2):181–201, 2001.CrossRefGoogle Scholar
  7. 7.
    M. Rattray. A model-based distance for clustering. In Proc. IJCNN’00, 2000.Google Scholar
  8. 8.
    M.E. Tipping. Deriving cluster analytic distance functions from gaussian mixture models. In D. Willshaw and A. Murray, editors, Proceedings of ICANN’99, pages 815–820. IEE Press, 1999.Google Scholar
  9. 9.
    V.N. Vapnik. Statistical Learning Theory. Wiley, New York, 1998.zbMATHGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2002

Authors and Affiliations

  • Koji Tsuda
    • 1
  • Motoaki Kawanabe
    • 2
  1. 1.AIST CBRCJapan
  2. 2.Fraunhofer FIRSTBerlinGermany

Personalised recommendations