Journal of Statistical Physics

, Volume 62, Issue 3–4, pp 563–576 | Cite as

Finite-state neural networks. A step toward the simulation of very large systems

  • G. A. Kohring


Neural networks composed of neurons withQ N states and synapses withQ states are studied analytically and numerically. Analytically it is shown that these finite-state networks are much more efficient at information storage than networks with continuous synapses. In order to take the utmost advantage of networks with finite-state elements, a multineuron and multisynapse coding scheme is introduced which allows the simulation of networks having 1.0×109 couplings at a speed of 7.1×109 coupling evaluations per second on asingle processor of the Cray-YMP. A local learning algorithm is also introduced which allows for the efficient training of large networks with finite-state elements.

Key words

Neural networks multi-spin coding replica method finite-state networks learning algorithms 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    D. Amit, H. Gutfreund, and H. Sompolinsky,Ann. Phys. 173:30 (1987); C. M. Newman,Neural Networks 1:223 (1988); T. Kohonen,Self-Organization and Associative Memory, 3rd ed. (Springer-Verlag, Berlin, 1989).Google Scholar
  2. 2.
    D. E. Rumelhart and J. L. McClelland, eds.,Parallel Distributed Processing (MIT Press, Cambridge, 1986); R. Scalettar and A. Zee,Biol. Cybern. 58:193 (1988); K. Hornik, M. Stinchcombe, and H. White,Neural Networks 2:359 (1989); M. Opper, W. Kinzel, J. Kleinz, and R. Nehl, University of Giessen preprint.Google Scholar
  3. 3.
    J. R. Barker, inParallel Processing in Neural Systems and Computers, R. Eckmiller, G. Hartmann, and G. Hauske, eds. (North-Holland, Amsterdam, 1990).Google Scholar
  4. 4.
    D. J. Amit, G. Parisi, and S. Nicolis,Network 1:75 (1990).Google Scholar
  5. 5.
    J. J. Hopfield,Proc. Natl. Acad. Sci. USA 79:2554 (1982); W. A. Little,Math. Biosci. 19:101 (1975).Google Scholar
  6. 6.
    C. M. Marcus, F. R. Waugh, and R. M. Westervelt,Phys. Rev. A 41:3355 (1990), and references therein.Google Scholar
  7. 7.
    M. Abeles, E. Vaadia, and H. Bergman,Network 1:13 (1990).Google Scholar
  8. 8.
    T. J. P. Penna and P. M. C. Oliveira,J. Phys. A 22:L719 (1989).Google Scholar
  9. 9.
    G. A. Kohring,J. Stat. Phys. 59:1077 (1990);J. Phys. A 23:2237 (1990).Google Scholar
  10. 10.
    B. M. Forrest,J. Phys. A 21:245 (1988); J. Krätzschmar and G. A. Kohring,J. Phys. (Paris) 51:223 (1990).Google Scholar
  11. 11.
    P. Peretto and J. J. Niez,Biol. Cybern. 54:53 (1986); C. L. Giles and T. Maxwell,Appl. Opt. 26:4972 (1987); G. A. Kohring,J. Phys. (Paris) 51:145 (1990).Google Scholar
  12. 12.
    T. M. Cover,Proc. IEEE ECI4:326 (1965).Google Scholar
  13. 13.
    E. Gardner,Eur. Phys. Lett. 4:481 (1987);J. Phys. A 21:257 (1988).Google Scholar
  14. 14.
    W. Krauth and M. Mézard,J. Phys. (Paris) 50:3057 (1989).Google Scholar
  15. 15.
    J. L. van Hemmen,Phys. Rev. A 36:1959 (1987); H. Englisch and M. Herrmann,Studia Biophys. 132:145 (1989); D. Bormann,Z. Phys. B 79:307 (1990).Google Scholar
  16. 16.
    I. Kanter,Phys. Rev. A 37:2739 (1988); C. Meunier, D. Hansel, and A. Verga,J. Stat. Phys. 55:859 (1989).Google Scholar
  17. 17.
    B. M. Forrest,J. Phys. (Paris) 50:2003 (1989); see also K. E. Kürten,J. Phys. (Paris) 50:2313 (1989).Google Scholar
  18. 18.
    E. Amaldi and S. Nicolis,J. Phys. (Paris) 50:2333 (1989); H. Köhler, S. Diederich, W. Kinzel, and M. Opper,Z. Phys. B 78:333 (1990).Google Scholar
  19. 19.
    L. F. Abbot,Network 1:105 (1990).Google Scholar
  20. 20.
    K. E. Kürten,J. Phys. (Paris), in press.Google Scholar
  21. 21.
    K. Binder and A. P. Young,Rev. Mod. Phys. 58:801 (1986).Google Scholar
  22. 22.
    K. E. Kürten,Phys. Lett. A 129:157 (1988); A. Canning and E. Gardner,J. Phys. A 21:3275 (1988); E. Koscielny-Bunde,J. Stat. Phys. 58:1257 (1990).Google Scholar
  23. 22a.
    E. Gardner and B. Derrida,J. Phys. A 21:271 (1988).Google Scholar

Copyright information

© Plenum Publishing Corporation 1991

Authors and Affiliations

  • G. A. Kohring
    • 1
  1. 1.Höchstleistungsrechenzentrum an der KFA JülichJülichGermany

Personalised recommendations