Skip to main content
Log in

A biologically constrained learning mechanism in networks of formal neurons

  • Articles
  • Published:
Journal of Statistical Physics Aims and scope Submit manuscript

Abstract

A new learning mechanism is proposed for networks of formal neurons analogous to Ising spin systems; it brings such models substantially closer to biological data in three respects: first, the learning procedure is applied initially to a network with random connections (which may be similar to a spin-glass system), instead of starting from a system void of any knowledge (as in the Hopfield model); second, the resultant couplings are not symmetrical; third, patterns can be stored without changing the sign of the coupling coefficients. It is shown that the storage capacity of such networks is similar to that of the Hopfield network, and that it is not significantly affected by the restriction of keeping the couplings' signs constant throughout the learning phase. Although this approach does not claim to model the central nervous system, it provides new insight on a frontier area between statistical physics, artificial intelligence, and neurobiology.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. W. A. Little,Math. Biosci. 19:101 (1974).

    Google Scholar 

  2. J. J. Hopfield,Proc. Natl. Acad. Sci. U.S.A. 79:2554 (1982).

    Google Scholar 

  3. D. J. Amit, H. Gutfreund, and H. Sompolinsky,Phys. Rev. A 32:1007 (1985);Phys. Rev. Lett. 55:1530 (1985).

    Google Scholar 

  4. P. Peretto,Biol. Cybern. 50:51 (1984).

    Google Scholar 

  5. L. Personnaz, I. Guyon, and G. Dreyfus,J. Phys. Lett. 46:L359 (1985).

    Google Scholar 

  6. W. Kinzel,Z. Phys. B 60:205 (1985).

    Google Scholar 

  7. N. Parga and M. A. Virasoro, to be published.

  8. G. Toulouse, S. Dehaene, and J. P. Changeux,Proc. Natl. Acad. Sci. U.S.A., to be published.

  9. N. Jerne, inThe Neurosciences: A Study Program, G. Quartonet al., eds. (The Rockefeller University Press, New York, 1967).

    Google Scholar 

  10. J. P. Changeux, T. Heidmann, and P. Patte, inThe Biology of Learning, P. Marler and H. Terrace, eds. (Springer-Verlag, New York, 1984).

    Google Scholar 

  11. K. H. Fischer,Phys. Stat. Sol. (B) 116:357 (1983); see also: “Heidelberg Colloquium on Spin Glasses,”Lecture Notes in Physics, No. 192 (Springer-Verlag, New York, 1983).

    Google Scholar 

  12. A. Albert, inRegression and the Moore-Penrose Pseudoinverse (Academic Press, New York, 1972).

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Rights and permissions

Reprints and permissions

About this article

Cite this article

Personnaz, L., Guyon, I., Dreyfus, G. et al. A biologically constrained learning mechanism in networks of formal neurons. J Stat Phys 43, 411–422 (1986). https://doi.org/10.1007/BF01020645

Download citation

  • Received:

  • Revised:

  • Issue Date:

  • DOI: https://doi.org/10.1007/BF01020645

Key words

Navigation