Flexible Architecture of Self Organizing Maps for Changing Environments
Catastrophic Interference is a well known problem of Artificial Neural Networks (ANN) learning algorithms where the ANN forget useful knowledge while learning from new data. Furthermore the structure of most neural models must be chosen in advance.
In this paper we introduce a hybrid algorithm called Flexible Architecture of Self Organizing Maps (FASOM) that overcomes the Catastrophic Interference and preserves the topology of Clustered data in changing environments. The model consists in K receptive fields of self organizing maps. Each Receptive Field projects high-dimensional data of the input space onto a neuron position in a low-dimensional output space grid by dynamically adapting its structure to a specific region of the input space.
Furthermore the FASOM model automatically finds the number of maps and prototypes needed to successfully adapt to the data. The model has the capability of both growing its structure when novel clusters appears and gradually forgets when the data volume is reduced in its receptive fields.
Finally we show the capabilities of our model with experimental results using synthetic sequential data sets and real world data.
KeywordsCatastrophic Interference Artificial Neural Networks Self Organizing Maps Pattern Recognition
- 1.Ans, B.: Sequential learning in distributed neural networks without catastrophic forgetting: A single and realistic self-refreshing memory can do it. Neural Information Processing - Letters and Reviews 4(2), 27–37 (2004)Google Scholar
- 11.McQueen, J.: Some methods for classification and analysis of multivariate observations. In: Proceedings of the Fifth Berkeley Symposium on Mathematical Statistics and probability, vol. 1, pp. 281–297 (1967)Google Scholar
- 13.Saavedra, C., Allende, H., Moreno, S., Salas, R.: K-dynamical self organizing maps, To appear in Lecture Notes in Computer Science (November 2005)Google Scholar