A self-organizing network that can follow non-stationary distributions

  • Bernd Fritzke
Part IV:Signal Processing: Blind Source Separation, Vector Quantization, and Self Organization
Part of the Lecture Notes in Computer Science book series (LNCS, volume 1327)


A new on-line criterion for identifying “useless” neurons of a self-organizing network is proposed. When this criterion is used in the context of the (formerly developed) growing neural gas model to guide deletions of units, the resulting method is able to closely track nonstationary distributions. Slow changes of the distribution are handled by adaptation of existing units. Rapid changes are handled by removal of “useless” neurons and subsequent insertions of new units in other places.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    H. U. Bauer and Th. Villmann. Growing a hypercubical output space in a selforganizing feature map. TR-95-030, International Computer Science Institute, Berkeley, 1995.Google Scholar
  2. 2.
    B. Fritzke. Growing cell structures-a self-organizing network for unsupervised and supervised learning. Neural Networks, 7(9):1441–1460, 1994.Google Scholar
  3. 3.
    B. Fritzke. A growing neural gas network learns topologies. In G. Tesauro, D. S. Touretzky, and T. K. Leen, editors, Advances in Neural Information Processing Systems 7, pages 625–632. MIT Press, Cambridge MA, 1995.Google Scholar
  4. 4.
    B. Fritzke. Growing grid-a self-organizing network with constant neighborhood range and adaptation strength. Neural Processing Letters, 2(5):9–13, 1995.Google Scholar
  5. 5.
    B. Fritzke. The LBG-U method for vector quantization-an improvement over LBG inspired from neural networks. Neural Processing Letters, 5(1):35–45, 1997.Google Scholar
  6. 6.
    T. Kohonen. Analysis of a simple self-organizing process. Biological Cybernetics, 44:135–140, 1982.Google Scholar
  7. 7.
    T. M. Martinetz. Competitive Hebbian learning rule forms perfectly topology preserving maps. In ICANN'93: International Conference on Artificial Neural Networks, pages 427–434, Amsterdam, 1993. Springer.Google Scholar
  8. 8.
    T. M. Martinetz, S. G. Berkovich, and K. J. Schulten. Neural-gas network for vector quantization and its application to time-series prediction. IEEE Transactions on Neural Networks, 4(4):558–569, 1993.Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 1997

Authors and Affiliations

  • Bernd Fritzke
    • 1
  1. 1.Systembiophysik, Institut für NeuroinformatikRuhr-Universität BochumBochumGermany

Personalised recommendations