Abstract
We study a stochastic neural-network model in which neurons and synapses change with a priori probability p and 1−p, respectively, in the limit p→0. This implies neuron activity competing with fast fluctuations of the synaptic connections—in fact, random oscillations around values given by a learning (for example, Hebb's) rule. The consequences for the system performance of a dynamics constantly checking at random the set of memorized patterns is thus studied both analytically and numerically. We describe various nonequilibrium phase transitions whose nature depends on the properties of fluctuations. We find, in particular, that under rather general conditions locally stable mixture states do not occur, and pattern recognition and retrieval processes are substantially improved for some classes of synaptic fluctuations.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
REFERENCES
J. J. Hopfield, Proc. Natl. Acad. Sci. USA 79:2554 (1982).
J. J. Torres, P. L. Garrido, and J. Marro, J. Phys. A 30:7801 (1997).
C. R. Noback and R. J. Demarest, The Human Nervous System: Basic Principles of Neuro-biology (McGraw-Hill, New York, 1975).
B. Müller and J. Reinhardt, Neural Networks, An Introduction (Springer-Verlag, Berlin, 1990).
P. Peretto, An Introduction to the Modeling of Neural Networks (Cambridge University Press, Cambridge, 1992).
D. Ferster, Science 273:1812 (1996).
N. Otmakhov, A. M. Shirke, and R. Malinow, Neuron 10:1101 (1993).
K. E. Sorra and K. M. Harris, J. Neurosci. 13:3736 (1993).
A. J. Mandell and K. A. Selz, J. Stat. Phys. 70:355 (1993).
C. F. Stevens and Y. Wang, Nature 371:704 (1994).
Y. Goda and C. F. Stevens, Proc. Nat. Acad. Sci. USA 91:12942 (1994).
K. J. Stratford, K. Tarczy-Hornoch, K. A. C. Martin, N. J. Bannister, and J. J. B. Jack, Nature 382:258 (1996).
D. K. Smetters and A. Zador, Current Biology 6:1217 (1996).
F. Moss, Phys. World 10:15 (1997).
J. von Neummann, in Cerebral Mechanics of Behavior, L. A. Jeffres, ed. (Wiley, New York, 1951).
J. Buhmann and K. Schulten, Biol. Cybern. 56:313 (1987).
H. Liljenström and X. B. Wu, Int. J. Neural Systems 6:19 (1995).
W. L. Ditto and F. Moss, short report in APS News 6, No. 5 (May 1997).
J. Marro and R. Dickman, Nonequilibrium Phase Transitions in Lattice Models (Cambridge University Press, Cambridge, 1999).
D. O. Hebb, The Organization of Behavior: A Neurophysiological Theory (Wiley, New York, 1949).
J. Marro, P. L. Garrido, and J. J. Torres, Phys. Rev. Lett. 81:2827 (1998).
D. C. Mattis, Phys. Lett. A 56:421 (1976).
L. Elsgoltz, Ecuaciones Diferenciales y Célculo Variacional (Mir, Moscow, 1977).
D. J. Amit, H. Gutfreund, and M. Sompolinsky, Phys. Rev. A 32:1007 (1985).
B. Derrida, E. Gardner, and A. Zippelius, Europhys. Lett. 4:167 (1987).
H. Gutfreund and M. Mezard, Phys. Rev. Lett. 61:235 (1988).
F. A. Tamarit and E. M. F. Curado, J. Stat. Phys. 62:473 (1991).
D. Horn, Physica A 200:594 (1993).
C. R. Da Silva, F. A. Tamarit, and E. M. F. Curado, Int. J. Mod. Phys. C 7:43 (1996).
A. C. C. Coolen, R. W. Penney, and D. Sherrington, Phys. Rev. B 48:16116 (1993); J. Phys. A 26:3681 (1993).
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Marro, J., Torres, J.J. & Garrido, P.L. Neural Networks in Which Synaptic Patterns Fluctuate with Time. Journal of Statistical Physics 94, 837–858 (1999). https://doi.org/10.1023/A:1004578915784
Issue Date:
DOI: https://doi.org/10.1023/A:1004578915784