Support Kernel Machine-Based Active Learning to Find Labels and a Proper Kernel Simultaneously

  • Yasusi Sinohara
  • Atsuhiro Takasu
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4881)


SVM-based active learning has been successfully applied when a large number of unlabeled samples are available but getting their labels is costly. However, the kernel used in SVM should be fixed properly before the active learning process. If the pre-selected kernel is inadequate for the target data, the learned SVM has poor performance. So, new active learning methods are required which effectively find an adequate kernel for the target data as well as the labels of unknown samples.

In this paper, we propose a two-phased SKM-based active learning method and a sampling strategy for the purpose. By experiments, we show that the proposed SKM-based active learning method has quick response suited to interaction with human experts and can find an appropriate kernel among linear combinations of given multiple kernels. We also show that with the proposed sampling strategy, it converges earlier to the proper combination of kernels than with the popular sampling strategy MARGIN.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Vapnik, V.: Statistical Learning Theory. John Wiley and Sons Inc., Chichester (1998)zbMATHGoogle Scholar
  2. 2.
    Bach, F.R., Lanckriet, G.R.G., Jordan, M.I.: Multiple Kernel Learning, Conic Duality, and the SMO Algorithm. In: Proc. ICML, Banff Canada (2004)Google Scholar
  3. 3.
    Sonnenburg, S., Ratsch, G., Schafer, C.: A general and efficient multiple kernel learning algorithm. In: Advances in Neural Information Processing Systems, vol. 18, MIT Press, Cambridge MA (2006)Google Scholar
  4. 4.
    Bordes, A., Ertekin, S., Weston, J., Bottou, L.: Fast Kernel Classifiers with Online and Active Learning. Journal of Machine Learning Research 6, 1579–161 (2005)Google Scholar
  5. 5.
    Osugi, T., Kun, D., Scott, S.: Balancing Exploration and Exploitation: A New Algorithm for Active Machine Learning. In: Proc. ICDM 2005, pp. 330–337 (2005)Google Scholar
  6. 6.
    Chang, C.-C., Lin, C.-J.: LIBSVM: a library for support vector machines (2001), Software available at

Copyright information

© Springer-Verlag Berlin Heidelberg 2007

Authors and Affiliations

  • Yasusi Sinohara
    • 1
  • Atsuhiro Takasu
    • 2
  1. 1.Central Research Institute of Electric Power Industry, 2-11-1 Iwado-kita, Komae-shi, Tokyo, 201-8511Japan
  2. 2.National Institute of Informatics, 2-1-2 Hitotsubashi, Chiyoda-ku, Tokyo 101-8430Japan

Personalised recommendations