Advertisement

Journal of Statistical Physics

, Volume 49, Issue 5–6, pp 993–1009 | Cite as

Learning and forgetting on asymmetric, diluted neural networks

  • B. Derrida
  • J. P. Nadal
Articles

Abstract

It is possible to construct diluted asymmetric models of neural networks for which the dynamics can be calculated exactly. We test several learning schemes, in particular, models for which the values of the synapses remain bounded and depend on the history. Our analytical results on the relative efficiencies of the various learning schemes are qualitatively similar to the corresponding ones obtained numerically on fully connected symmetric networks.

Key words

Dynamics neural networks 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    J. J. Hopfield,Proc. Natl. Acad. Sci USA 79:2554 (1982).Google Scholar
  2. 2.
    W. A. Little,Math. Biosci. 19:101 (1974); W. A. Little and G. L. Shaw,Math. Biosci. 39:281 (1978).Google Scholar
  3. 3.
    D. J. Amit, H. Gutfreund, and H. Sompolinsky,Phys. Rev. Lett. 55:1530 (1985);Ann. Phys. (NY) 173:30 (1987).Google Scholar
  4. 4.
    H. Sompolinsky,Phys. Rev. A 34:2571 (1986).Google Scholar
  5. 5.
    H. Gutfreund and Y. Stein, to be published.Google Scholar
  6. 6.
    W. Kinzel, inProceedings of 1986 Heidelberg Colloquium on Glassy Dynamics and Optimization (Springer, Lecture Notes in Physics).Google Scholar
  7. 7.
    G. Parisi,J. Phys. A 19:L675 (1986).Google Scholar
  8. 8.
    J. A. Hertz, G. Grinstein, and S. A. Solla, preprint (1986); and inProceedings of 1986 Heidelberg Colloquium on Glassy Dynamics and Optimization (Springer, Lecture Notes in Physics).Google Scholar
  9. 9.
    P. Peretto, communication at Journées de Physique Statistique, Paris (1987); and preprint (1987).Google Scholar
  10. 10.
    B. Derrida, E. Gardner, and A. Zippelius,Europhys. Lett. 4:167 (1987).Google Scholar
  11. 11.
    J. P. Nadal, G. Toulouse, J. P. Changeux, and S. Dehaene,Europhys. Lett. 1:535 (1986).Google Scholar
  12. 12.
    M. Mézard, J. P. Nadal, and G. Toulouse,J. Phys. (Paris) 47:1457 (1986).Google Scholar
  13. 13.
    G. Parisi,J. Phys. A 29:L617 (1986).Google Scholar
  14. 14.
    P. Peretto, private communication.Google Scholar
  15. 15.
    T. Geszti and F. Pázmándi, in preparation; M. Gordon, to appear.Google Scholar
  16. 16.
    D. J. Amit, H. Gutfreund, and H. Sompolinsky,Phys. Rev. A (1987), in press.Google Scholar
  17. 17.
    N. Parga and M. A. Virasoro,J. Phys. (Paris) 47:1857 (1986); M. V. Feigel'man and L. B. loffe, Landau Institute preprint (1986); H. Gutfreund, preprint (1987); V. S. Dotsenko,J. Phys. C 18:L1017 (1985).Google Scholar
  18. 18.
    P. Peretto and J. J. Niez, inDisordered Systems and Biological Organization, E. Bienenstock, F. Fogelman, and G. Weibusch, eds. (Springer, Berlin, 1986), pp. 171–185; D. Kleinfield,Proc. Natl. Acad. Sci USA 83:9469 (1986); H. Sompolinsky and I. Kanter,Phys. Rev. Lett. 57:2861 (1986); D. W. Tank and J. J. Hopfield, preprint (1986); J. Buhmann and K. Schulten,Europhys. Lett. 4:1205 (1987); S. Dehaene, J. P. Changeux, and J. P. Nadal,Proc. Natl. Acad. Sci USA 84:2727 (1987).Google Scholar

Copyright information

© Plenum Publishing Corporation 1987

Authors and Affiliations

  • B. Derrida
    • 1
  • J. P. Nadal
    • 2
  1. 1.SPTCEN-SaclayGif sur YvetteFrance
  2. 2.GPSENSParisFrance

Personalised recommendations