We review the recently proposed method of Kernel Self-organising maps (KSOM) which has been shown to exhibit very fast convergence. We show that this is due to an interaction between the fact that we are working in an overcomplete basis and the fact that we are using a mixture of one-shot and incremental learning. We then review Relevance Vector Machines which is a supervised training method related to Support Vector Machines and apply it to creating the Relevance Self-Organising Map, RSOM. We show results on artificial data and on the iris data set.


Sparse Representation Neighbourhood Function Relevance Vector Machine Kernel Space Winning Neuron 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    D. MacDonald and C. Fyfe. The kernel self-organising map. In R.J. Howlett and L. C. Jain, editors, Fourth International Conference on Knowledge-based Intelligent Engineering Systems and Allied Technologies, KES2000, 2000.Google Scholar
  2. 2.
    D. Michie, D. J. Spiegelhalter, and C. C. Taylor, editors. Machine learning, neural and statistical classification. Ellis Horwood, 1994.Google Scholar
  3. 3.
    B. Schölkopf. The kernel trick for distances. Technical report, Microsoft Research, May 2000.Google Scholar
  4. 4.
    B. Schölkopf, A. Smola, and K.-R. Muller. Nonlinear component analysis as a kernel eigenvalue problem. Neural Computation, 10:1299–1319, 1998.CrossRefGoogle Scholar
  5. 5.
    A. J. Smola, S. Mika, B. Schölkopf, and R. C. Williamson. Regularized principal maniforlds. Machine Learning, pages 1–28, 2000.Google Scholar
  6. 6.
    M. Tipping. The relevance vector machine. In S. A. Solla, T. K. Leen, and K.-R. Muller, editors, Advances in Neural Information Processing Systems, 12. MIT Press, 2000.Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2003

Authors and Affiliations

  • Emilio Corchado
    • 1
  • Colin Fyfe
    • 1
  1. 1.School of Information and Communication TechnologiesThe University of PaisleyScotland

Personalised recommendations