Abstract
We give a review on the rigorous results concerning the storage capacity of the Hopfield model. We distinguish between two different concepts of storage both of them guided by the idea that the retrieval dynamics is a Monte Carlo dynamics (possibly at zero temperature). We recall the results of McEliece et al. [MPRV87] as well as those by Newman [N88] for the storage capacity of the Hopfield model with unbiased i.i.d. patterns and comprehend some recent development concerning the Hopfield model with semantically correlated or biased patterns.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
D.J. Amit, G. Gutfreund, and H. Sompolinsky, Statistical mechanics of neural networks near saturation, Ann. Phys. 173, 30–67 (1987).
A. Bovier and V. Gayrard, Rigorous bounds on the storage capacity of the dilute Hopfield model, J. Stat. Phys. 69, 597–627 (1992).
D. Burshtein, Nondirect convergence radius and number of iterations of the Hopfield associative memory, IEEE Trans. Inf. Theor. 40, 838–847, (1994).
L. van Hemmen and R. Kühn, Collective phenomena in neural networks, in Models of Neural Networks, E. Domany, L. V. Hemmen, R. Schulte, eds., Springer, Berlin, 1991.
J.J. Hopfield, Neural networks and physical systems with emergent collective computational abilities, Proc. Nat. Acad. Sci. USA 79, 2554–2558 (1982).
J. Komlos and R. Paturi, Convergence results in an associative memory model, Neural Networks 1, 239–250 (1988).
M. Löwe, On the storage capacity of Hopfield models with weakly correlated patterns, preprint, Universität Bielefeld, submitted (1996).
M. Löwe, On the storage capacity of the Hopfield model with biased patterns, preprint, Universität Bielefeld, submitted (1996).
D. Loukianova, Capacité de mémoire dans le modèle de Hopfield, C.R. Acad. Sci. Paris 318, 157–160 (1994).
R. McEliece, E. Posner, E. Rodemich, and S. Venkatesh, The capacity of the Hopfield associative memory, IEEE Trans. Inf. Theor. 33, 461–482 (1987).
C. Newman, Memory capacity in neural networks, Neural Networks 1, 223–238 (1988).
D. Petritis, Thermodynamic formalism of neural computing, preprint, Université de Rennes I (1995).
M. Talagrand, Rigorous results of the Hopfield model with many patterns, preprint, Paris (1996).
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 1998 Birkhäuser Boston
About this chapter
Cite this chapter
Löwe, M. (1998). On the Storage Capacity of the Hopfield Model. In: Bovier, A., Picco, P. (eds) Mathematical Aspects of Spin Glasses and Neural Networks. Progress in Probability, vol 41. Birkhäuser Boston. https://doi.org/10.1007/978-1-4612-4102-7_5
Download citation
DOI: https://doi.org/10.1007/978-1-4612-4102-7_5
Publisher Name: Birkhäuser Boston
Print ISBN: 978-1-4612-8653-0
Online ISBN: 978-1-4612-4102-7
eBook Packages: Springer Book Archive