Hebbian Iterative Method for Unsupervised Clustering with Automatic Detection of the Number of Clusters with Discrete Recurrent Networks
In this paper, two important issues concerning pattern recognition by neural networks are studied: a new model of hebbian learning, as well as the effect of the network capacity when retrieving patterns and performing clustering tasks. Particularly, an explanation of the energy function when the capacity is exceeded: the limitation in pattern storage implies that similar patterns are going to be identified by the network, therefore forming different clusters.
This ability can be translated as an unsupervised learning of pattern clusters, with one major advantage over most clustering algorithms: the number of data classes is automatically learned, as confirmed by the experiments. Two methods to reinforce learning are proposed to improve the quality of the clustering, by enhancing the learning of patterns relationships.
As a related issue, a study on the net capacity, depending on the number of neurons and possible outputs, is presented, and some interesting conclusions are commented.
KeywordsEnergy Function Input Pattern Learning Rule Unsupervised Cluster Recurrent Network
Unable to display preview. Download preview PDF.
- 2.Hebb, D.O.: The Organization of Behavior. Wiley, New York (1949)Google Scholar
- 3.Hertz, J., Krogh, A., Palmer, R.G.: Introduction to the theory of neural computation. Lecture Notes, vol. 1. Addison-Wesley, Reading (1991)Google Scholar
- 4.Hopfield, J.J.: Neural networks and physical systems with emergent collective computational abilities. In: Proc. of National Academy of Sciences USA, vol. 79, pp. 2254–2558 (1982)Google Scholar
- 5.Hopfield, J.J.: Neurons with graded response have collective computational properties like those of two-state neurons. In: Proceedings of the National Academy of Sciences USA, vol. 81, pp. 3088–3092 (1984)Google Scholar
- 6.López-Rodríguez, D., Mérida-Casermeiro, E.: Matrix Bandwidth Minimization: A Neural Approach. ICCMSE 1, 324–327 (2004)Google Scholar
- 7.Mérida Casermeiro, E.: Red Neuronal recurrente multivaluada para el reconocimiento de patrones y la optimización combinatoria, Ph. D. dissertation (in spanish). Univ. Málaga, España (2000)Google Scholar
- 11.Mérida-Casermeiro, E., López-Rodríguez, D.: Multivalued Neural Network for Graph MaxCut Problem. ICCMSE 1, 375–378 (2004)Google Scholar
- 12.Ozturk, Y., Abut, H.: System of associative relationships (SOAR). In: Proceedings of ASILOMAR (1997)Google Scholar