Online Unsupervised Neural-Gas Learning Method for Infinite Data Streams

  • Mohamed-Rafik Bouguelia
  • Yolande Belaïd
  • Abdel Belaïd
Conference paper
Part of the Advances in Intelligent Systems and Computing book series (AISC, volume 318)

Abstract

We propose an unsupervised online learning method based on the “growing neural gas” algorithm (GNG), for a data-stream configuration where each incoming data is visited only once and used to incrementally update the learned model as soon as it is available. The method maintains a model as a dynamically evolving graph topology of data-representatives that we call neurons. Unlike usual incremental learning methods, it avoids the sensitivity to initialization parameters by using an adaptive parameter-free distance threshold to produce new neurons. Moreover, the proposed method performs a merging process which uses a distance-based probabilistic criterion to eventually merge neurons. This allows the algorithm to preserve a good computational efficiency over infinite time. Experiments on different real datasets, show that the proposed method is competitive with existing algorithms of the same family, while being independent of sensitive parameters and being able to maintain fewer neurons, which makes it convenient for learning from infinite data-streams.

Keywords

Incremental learning Unsupervised neural learning  Online learning Data streams. 

References

  1. 1.
    Fritzke, B.: A growing neural gas network learns topologies. In: Neural Information Processing Systems, pp. 625–632 (1995)Google Scholar
  2. 2.
    Martinetz, T.: Competitive Hebbian learning rule forms perfectly topology preserving maps. In: Proceedings of the International Conference on Artificial Neural Networks, pp. 427–434. Amsterdam, Netherlands (1993)Google Scholar
  3. 3.
    Prudent, Y., Ennaji, A.: An incremental growing neural gas learns topologies. In: International Joint Conference on Neural Networks, pp. 1211–1216 (2005)Google Scholar
  4. 4.
    Hamza, H., Belaid, Y., Belaid, A., Chaudhuri, B.: Incremental classification of invoice documents. In: Proceedings of International Conference on Pattern Recognition, pp. 1–4 (2008)Google Scholar
  5. 5.
    Shen, F., Ogura, T., Hasegawa, O.: An enhanced self-organizing incremental neural network for online unsupervised learning. Neural Netw. 20(8), 893–903 (2007)CrossRefMATHGoogle Scholar
  6. 6.
    Keogh, E., Lonardi, S., Ratanamahatana, C.A.: Towards parameter-free data mining. In: Proceedings of the 10th International Conference on Knowledge Discovery and Data Mining, pp. 206–215 (2004)Google Scholar
  7. 7.
    O’Callaghan, L., Meyerson, A., Motwani, R., Mishra, N., Guha, S.: Streaming-data algorithms for high-quality clustering. In: Proceedings of International Conference on Data Engineering, pp. 685–696. San Francisco (2002)Google Scholar
  8. 8.
    Aggarwal, C.C., Han, J., Wang, J., Yu, P.S.: A framework for clustering evolving data streams. In: Proceedings of the 29th International Conference on Very Large Data Bases, pp. 81–92. Berlin, Germany (2003)Google Scholar
  9. 9.
    Chen, Y., Tu, L.: Density-based clustering for real-time stream data. In: Proceedings of International Conference on Knowledge Discovery and Data Mining, pp. 133–142 (2007)Google Scholar
  10. 10.
    Shindler, M., Wong, A., Meyerson, A.: Fast and accurate k-means for large datasets. In: Neural Information Processing Systems, pp. 2375–2383 (2011)Google Scholar
  11. 11.
    Frank, A., Asuncion, A.: The UCI machine learning repository. http://archive.ics.uci.edu/ml/. (2010)
  12. 12.
    Yann, L., Corinna, C.: MNIST handwritten digit database. http://yann.lecun.com/exdb/mnist/. (2010)
  13. 13.
    Rosenberg, A., Hirschberg, J.: V-measure: a conditional entropy-based external cluster evaluation measure. In: Neural Information Processing Systems, pp. 410–420 (2007)Google Scholar
  14. 14.
    Bouguelia, M-R., Belaid, Y., Belaid, A.: A stream-based semi-supervised active learning approach for document classification. In: International Conference on Document Analysis and Recognition (2013)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2015

Authors and Affiliations

  • Mohamed-Rafik Bouguelia
    • 1
  • Yolande Belaïd
    • 1
  • Abdel Belaïd
    • 1
  1. 1.Université de Lorraine - LORIAVandoeuvre-les-NancyFrance

Personalised recommendations