Advertisement

Hebbian Iterative Method for Unsupervised Clustering with Automatic Detection of the Number of Clusters with Discrete Recurrent Networks

  • Enrique Mérida-Casermeiro
  • Domingo López-Rodríguez
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4177)

Abstract

In this paper, two important issues concerning pattern recognition by neural networks are studied: a new model of hebbian learning, as well as the effect of the network capacity when retrieving patterns and performing clustering tasks. Particularly, an explanation of the energy function when the capacity is exceeded: the limitation in pattern storage implies that similar patterns are going to be identified by the network, therefore forming different clusters.

This ability can be translated as an unsupervised learning of pattern clusters, with one major advantage over most clustering algorithms: the number of data classes is automatically learned, as confirmed by the experiments. Two methods to reinforce learning are proposed to improve the quality of the clustering, by enhancing the learning of patterns relationships.

As a related issue, a study on the net capacity, depending on the number of neurons and possible outputs, is presented, and some interesting conclusions are commented.

Keywords

Energy Function Input Pattern Learning Rule Unsupervised Cluster Recurrent Network 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Erdem, M.H., Ozturk, Y.: A New family of Multivalued Networks. Neural Networks 9,6, 979–989 (1996)CrossRefGoogle Scholar
  2. 2.
    Hebb, D.O.: The Organization of Behavior. Wiley, New York (1949)Google Scholar
  3. 3.
    Hertz, J., Krogh, A., Palmer, R.G.: Introduction to the theory of neural computation. Lecture Notes, vol. 1. Addison-Wesley, Reading (1991)Google Scholar
  4. 4.
    Hopfield, J.J.: Neural networks and physical systems with emergent collective computational abilities. In: Proc. of National Academy of Sciences USA, vol. 79, pp. 2254–2558 (1982)Google Scholar
  5. 5.
    Hopfield, J.J.: Neurons with graded response have collective computational properties like those of two-state neurons. In: Proceedings of the National Academy of Sciences USA, vol. 81, pp. 3088–3092 (1984)Google Scholar
  6. 6.
    López-Rodríguez, D., Mérida-Casermeiro, E.: Matrix Bandwidth Minimization: A Neural Approach. ICCMSE 1, 324–327 (2004)Google Scholar
  7. 7.
    Mérida Casermeiro, E.: Red Neuronal recurrente multivaluada para el reconocimiento de patrones y la optimización combinatoria, Ph. D. dissertation (in spanish). Univ. Málaga, España (2000)Google Scholar
  8. 8.
    Mérida Casermeiro, E., Muñoz-Pérez, J.: MREM: An associative autonomous recurrent network. Journal of Intelligent and Fuzzy Systems 12(3-4), 163–173 (2002)MATHGoogle Scholar
  9. 9.
    Mérida Casermeiro, E., Muñoz Pérez, J., Benítez Rochel, R.: A recurrent multivalued neural network for the N-queens problem. In: Mira, J., Prieto, A.G. (eds.) IWANN 2001. LNCS, vol. 2084, pp. 522–529. Springer, Heidelberg (2001)CrossRefGoogle Scholar
  10. 10.
    Mérida Casermeiro, E., Muñoz-Pérez, J., García-Bernal, M.A.: An Associative Multivalued Recurrent Network. In: Garijo, F.J., Riquelme, J.-C., Toro, M. (eds.) IBERAMIA 2002. LNCS (LNAI), vol. 2527, pp. 509–518. Springer, Heidelberg (2002)CrossRefGoogle Scholar
  11. 11.
    Mérida-Casermeiro, E., López-Rodríguez, D.: Multivalued Neural Network for Graph MaxCut Problem. ICCMSE 1, 375–378 (2004)Google Scholar
  12. 12.
    Ozturk, Y., Abut, H.: System of associative relationships (SOAR). In: Proceedings of ASILOMAR (1997)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Enrique Mérida-Casermeiro
    • 1
  • Domingo López-Rodríguez
    • 1
  1. 1.Department of Applied MathematicsUniversity of MálagaMálagaSpain

Personalised recommendations