Skip to main content
Log in

The Hopfield Model on a Sparse Erdös-Renyi Graph

  • Published:
Journal of Statistical Physics Aims and scope Submit manuscript

Abstract

We analyze the storage capacity of the Hopfield model on a sparse G(N,p) random graph. We show that it is proportional to αpN in the entire regime where the corresponding random graph is asymptotically connected and for all value of αα c =0.03.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

References

  1. Bovier, A.: Sharp upper bounds on perfect retrieval in the Hopfield model. J. Appl. Probab. 36(3), 941–950 (1999)

    Article  MATH  MathSciNet  Google Scholar 

  2. Bovier, A., Gayrard, V.: Rigorous bounds on the storage capacity of the dilute Hopfield model. J. Stat. Phys. 69(3–4), 597–627 (1992)

    Article  MATH  ADS  MathSciNet  Google Scholar 

  3. Bovier, A., Gayrard, V.: Rigorous results on the thermodynamics of the dilute Hopfield model. J. Stat. Phys. 72(1–2), 79–112 (1993)

    Article  MATH  ADS  MathSciNet  Google Scholar 

  4. Bovier, A., Gayrard, V.: The retrieval phase of the Hopfield model: a rigorous analysis of the overlap distribution. Probab. Theory Relat. Fields 107(1), 61–98 (1997)

    Article  MATH  MathSciNet  Google Scholar 

  5. Bovier, A., Gayrard, V.: Hopfield models as generalized random mean field models. In: Mathematical Aspects of Spin Glasses and Neural Networks. Progr. Probab., vol. 41, pp. 3–89. Birkhäuser, Boston (1998)

    Chapter  Google Scholar 

  6. Dembo, A., Montanari, A.: Gibbs measures and phase transitions on sparse random graphs. Braz. J. Probab. Stat. 24(2), 137–211 (2010)

    Article  MATH  MathSciNet  Google Scholar 

  7. Dembo, A., Montanari, A.: Ising models on locally tree-like graphs. Ann. Appl. Probab. 20(2), 565–592 (2010)

    Article  MATH  MathSciNet  Google Scholar 

  8. Feige, U., Ofek, E.: Spectral techniques applied to sparse random graphs. Random Struct. Algorithms 27(2), 251–275 (2005)

    Article  MATH  MathSciNet  Google Scholar 

  9. Feng, J., Shcherbina, M., Tirozzi, B.: On the critical capacity of the Hopfield model. Commun. Math. Phys. 216(1), 139–177 (2001)

    Article  MATH  ADS  MathSciNet  Google Scholar 

  10. Füredi, Z., Komlós, J.: The eigenvalues of random symmetric matrices. Combinatorica 1(3), 233–241 (1981)

    Article  MATH  MathSciNet  Google Scholar 

  11. Komlós, J., Paturi, R.: Effect of connectivity in an associative memory model. J. Comput. Syst. Sci. 47(2), 350–373 (1993). 29th Annual IEEE Symposium on Foundations of Computer Science (White Plains, NY, 1988)

    Article  MATH  Google Scholar 

  12. Kösters, H.: Fluctuations of the free energy in the diluted SK-model. Stoch. Process. Appl. 116, 1254–1268 (2006)

    Article  MATH  Google Scholar 

  13. Krivelevich, M., Sudakov, B.: The largest eigenvalue of sparse random graphs. Comb. Probab. Comput. 12(1), 61–72 (2003)

    Article  MATH  MathSciNet  Google Scholar 

  14. Loukianova, D.: Lower bounds on the restitution error in the Hopfield model. Probab. Theory Relat. Fields 107(2), 161–176 (1997)

    Article  MATH  MathSciNet  Google Scholar 

  15. Löwe, M.: On the storage capacity of Hopfield models with correlated patterns. Ann. Appl. Probab. 8(4), 1216–1250 (1998)

    Article  MATH  MathSciNet  Google Scholar 

  16. Löwe, M., Vermet, F.: The capacity of q-state Potts neural networks with parallel retrieval dynamics. Stat. Probab. Lett. 77(14), 1505–1514 (2007)

    Article  MATH  Google Scholar 

  17. McEliece, R.J., Posner, E.C., Rodemich, E.R., Venkatesh, S.S.: The capacity of the Hopfield associative memory. IEEE Trans. Inf. Theory 33(4), 461–482 (1987)

    Article  MATH  MathSciNet  Google Scholar 

  18. Newman, C.: Memory capacity in neural networks. Neural Netw. 1, 223–238 (1988)

    Article  Google Scholar 

  19. Parisi, G., Rizzo, T.: Large deviations of the free energy in diluted mean-field spin-glass. J. Phys. A, Math. Theor. 43, 045001 (2010)

    Article  ADS  MathSciNet  Google Scholar 

  20. Talagrand, M.: Rigorous results for the Hopfield model with many patterns. Probab. Theory Relat. Fields 110(2), 177–276 (1998)

    Article  MATH  MathSciNet  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Franck Vermet.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Löwe, M., Vermet, F. The Hopfield Model on a Sparse Erdös-Renyi Graph. J Stat Phys 143, 205–214 (2011). https://doi.org/10.1007/s10955-011-0167-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10955-011-0167-1

Keywords

Navigation