Abstract
We analyze the storage capacity of the Hopfield model on a sparse G(N,p) random graph. We show that it is proportional to αpN in the entire regime where the corresponding random graph is asymptotically connected and for all value of α≤α c =0.03.
References
Bovier, A.: Sharp upper bounds on perfect retrieval in the Hopfield model. J. Appl. Probab. 36(3), 941–950 (1999)
Bovier, A., Gayrard, V.: Rigorous bounds on the storage capacity of the dilute Hopfield model. J. Stat. Phys. 69(3–4), 597–627 (1992)
Bovier, A., Gayrard, V.: Rigorous results on the thermodynamics of the dilute Hopfield model. J. Stat. Phys. 72(1–2), 79–112 (1993)
Bovier, A., Gayrard, V.: The retrieval phase of the Hopfield model: a rigorous analysis of the overlap distribution. Probab. Theory Relat. Fields 107(1), 61–98 (1997)
Bovier, A., Gayrard, V.: Hopfield models as generalized random mean field models. In: Mathematical Aspects of Spin Glasses and Neural Networks. Progr. Probab., vol. 41, pp. 3–89. Birkhäuser, Boston (1998)
Dembo, A., Montanari, A.: Gibbs measures and phase transitions on sparse random graphs. Braz. J. Probab. Stat. 24(2), 137–211 (2010)
Dembo, A., Montanari, A.: Ising models on locally tree-like graphs. Ann. Appl. Probab. 20(2), 565–592 (2010)
Feige, U., Ofek, E.: Spectral techniques applied to sparse random graphs. Random Struct. Algorithms 27(2), 251–275 (2005)
Feng, J., Shcherbina, M., Tirozzi, B.: On the critical capacity of the Hopfield model. Commun. Math. Phys. 216(1), 139–177 (2001)
Füredi, Z., Komlós, J.: The eigenvalues of random symmetric matrices. Combinatorica 1(3), 233–241 (1981)
Komlós, J., Paturi, R.: Effect of connectivity in an associative memory model. J. Comput. Syst. Sci. 47(2), 350–373 (1993). 29th Annual IEEE Symposium on Foundations of Computer Science (White Plains, NY, 1988)
Kösters, H.: Fluctuations of the free energy in the diluted SK-model. Stoch. Process. Appl. 116, 1254–1268 (2006)
Krivelevich, M., Sudakov, B.: The largest eigenvalue of sparse random graphs. Comb. Probab. Comput. 12(1), 61–72 (2003)
Loukianova, D.: Lower bounds on the restitution error in the Hopfield model. Probab. Theory Relat. Fields 107(2), 161–176 (1997)
Löwe, M.: On the storage capacity of Hopfield models with correlated patterns. Ann. Appl. Probab. 8(4), 1216–1250 (1998)
Löwe, M., Vermet, F.: The capacity of q-state Potts neural networks with parallel retrieval dynamics. Stat. Probab. Lett. 77(14), 1505–1514 (2007)
McEliece, R.J., Posner, E.C., Rodemich, E.R., Venkatesh, S.S.: The capacity of the Hopfield associative memory. IEEE Trans. Inf. Theory 33(4), 461–482 (1987)
Newman, C.: Memory capacity in neural networks. Neural Netw. 1, 223–238 (1988)
Parisi, G., Rizzo, T.: Large deviations of the free energy in diluted mean-field spin-glass. J. Phys. A, Math. Theor. 43, 045001 (2010)
Talagrand, M.: Rigorous results for the Hopfield model with many patterns. Probab. Theory Relat. Fields 110(2), 177–276 (1998)
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Löwe, M., Vermet, F. The Hopfield Model on a Sparse Erdös-Renyi Graph. J Stat Phys 143, 205–214 (2011). https://doi.org/10.1007/s10955-011-0167-1
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10955-011-0167-1