Biological Cybernetics

, Volume 56, Issue 5–6, pp 313–327

Influence of noise on the function of a “physiological” neural network

  • J. Buhmann
  • K. Schulten
Article

Abstract

A model neural network with stochastic elements in its millisecond dynamics is investigated. The network consists of neuronal units which are modelled in close analogy to physiological neurons. Dynamical variables of the network are the cellular potentials, axonic currents and synaptic efficacies. The dynamics of the synapses obeys a modified Hebbian rule and, as proposed by v. d. Malsburg (1981, 1985), develop on a time scale of a tenth of a second. In a previous publication (Buhmann and Schulten 1986) we have confirmed that the resulting noiseless autoassociative network is capable of the well-known computational tasks of formal associative networks (Cooper 1973; Kohonen et al. 1984, 1981; Hopfield 1982). In the present paper we demonstrate that random fluctuations of the membrane potential improve the performance of the network. In comparison to a deterministic network a noisy neural network can learn at lower input frequencies and with lower average neural firing rates. The electrical activity of a noisy network is very reminiscent of that observed by physiological recordings. We demonstrate furthermore that associative storage reduces the effective dimension of the phase space in which the electrical activity of the network develops.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Abeles M (1982) Local cortical circuits. Springer, Berlin Heidelberg New YorkGoogle Scholar
  2. Amit, DJ, Gutfreund H, Sompolinsky H (1985a) Spin glass models of neural networks. Phys Rev A 32:1007Google Scholar
  3. Amit DJ, Gutfreund H, Sompolinsky H (1985b) Storing infinite numbers of patterns in a spin glas model of neural networks. Phys Rev Lett 55:1530Google Scholar
  4. Amit DJ, Gutfreund H, Sompolinsky H (1987) Statistical mechanics of neural networks near saturation. Ann Phys 173:30–67Google Scholar
  5. Babloyantz A (1985) Strange attractors in the dynamics of brain activity. In: Haken H (ed) Complex Systems-operational approaches. Springer, Berlin Heidelberg New York, pp 116–122Google Scholar
  6. Babloyantz A, Destexhe A (1986) Low-dimensional chaos in an instance of epilepsy. Proc Natl Acad Sci USA 83:3513–3517Google Scholar
  7. Bienenstock E (1984) Dynamics of central nervous system. In: Beckmann M, Krelle W (eds) Dynamics of macrosystems. Springer, Berlin Heidelberg New York, pp 3–20Google Scholar
  8. Buhmann J (1987) Thesis, Technical University of Munich (in preparation)Google Scholar
  9. Buhmann J, Schulten K (1986) Associative recognition and storage in a model network of physiological neurons. Biol Cybern 54:319–335Google Scholar
  10. Changeux JP, Heidmann T, Patte P (1984) Learning by selection. In: Marler T, Terrace HS (eds) The biology of learning. Springer, Heidelberg Berlin New York, pp 115–133Google Scholar
  11. Cooper LN (1973) Proceedings of the Nobel Symposium on collective properties of physical systems. Academic Press, New York, pp 252–264Google Scholar
  12. Dvorak I, Siska J (1986) On some problems encountered in the estimation of the correlation dimension of the EEG. Phys Lett A 118:63–66Google Scholar
  13. Ebeling W, Feistl R (1986) Physik der Selbstorganisation und Evolution. Akademie Verlag, BerlinGoogle Scholar
  14. Freeman WJ (1977) Spatial properties of an EEG Event in the ollactory bulb and cortex. Electrenc Clin Neurophys 44:586–605Google Scholar
  15. Goel NS, Richter-Dyn N (1974) Stochastic models in biology. Academic Press, New York San Francisco LondonGoogle Scholar
  16. Goelet P, Castellucci VF, Schacher S, Kandel ER (1986) The long and the short of long-term memory—a molecular framework. Nature 322:419–422Google Scholar
  17. Grassberger P, Procaccia I (1983) Measuring the strangeness of strange attractors. Physica 9D:189–208Google Scholar
  18. Grossberg S (1972) Pattern learning by functional-differential neural networks with arbitrary path weights. In: Schmitt K (ed) Delay and functional differential equations and their applications. Academic Press, New York, pp 121–159Google Scholar
  19. Hebb DO (1949) Organisation of behavior. Wiley, New YorkGoogle Scholar
  20. Hinton GE, Sejnowski TJ, Ackley DH (1984) Boltzmann machines: constraint satisfaction networks that learn. Tech Rep No CMU-CS-84-119. Pittsburgh, PA: Carnegie-Mellon UnivGoogle Scholar
  21. Holden AV (1976) Models of the stochastic activity of neurones. Springer, Berlin Heidelberg New YorkGoogle Scholar
  22. Hopfield JJ (1982) Neural networks and physical systems with emergent collective computational abilities. Proc Natl Acad Sci USA 79:2554–2558Google Scholar
  23. Hopfield JJ (1984) Neurons with graded response have collective computational properties like those of two-state neurons. Proc Natl Acad Sci USA 81:3088–3092Google Scholar
  24. Kandel ER, Schwartz JR (1982) Molecular biology of learning: modulation of transmitter release. Science 218:433–443Google Scholar
  25. Kelso SR, Ganong AH, Brown TH (1986) Hebbian synapses inHippocampus. Proc Natl Acad Sci USA 83:5326–5330Google Scholar
  26. Kinzel W (1985) Learning and pattern recognition in spin glass models. Z Phys B — Condensed Matter 60:205–213Google Scholar
  27. Koch C, Marroquin J, Yuille A (1986) Analog “neuronal” networks in early vision. Proc Natl Acad Sci USA 83:4263–4267Google Scholar
  28. Kohonen T (1984) Selforganization and associative memory. Springer, Berlin Heidelberg New YorkGoogle Scholar
  29. Kohonen T, Oja E, Lehtiö P (1981) Storage and processing of information in distributed associative memory systems. In: Hinton G, Anderson JA (eds) Parallel models of associative memory. Lawrence Erlbaum Associatives, Hillsdale, New JerseyGoogle Scholar
  30. Little WA (1974) The existence of persistent States in the brain. Math Biosci 19:101–120Google Scholar
  31. Little WA, Shaw GL (1975) A statistical theory of short and long term memory. Behav Biol 14:115–133Google Scholar
  32. Malsburg Cvd (1981) The correlation theory of brain function. Internal report 81/2, Dept. Neurobiologie, MPI f. Biophysikalische Chemie, GöttingenGoogle Scholar
  33. Malsburg Cvd (1985) Nervous structures with dynamical links. Ber Bunsenges Phys Chemie 6:703–710Google Scholar
  34. Malsburg Cvd, Bienenstock E (1985) Statistical coding and short-term synaptic plasticity: a scheme for knowledge representation in the brain. In: Bienenstock E, Fogelman Soulié F, Weisbuch G (eds) Disordered systems and biological organization. Springer, Berlin Heidelberg New York, pp 247–272Google Scholar
  35. Rumelhart DE, Hinton GE, Williams RJ (1986) Learning representations by back-propagating errors. Nature 323:533–536Google Scholar
  36. Sampath G, Srinivasan SK (1977) Stochastic models for spike trains of single neurons. Springer, Berlin Heidelberg New YorkGoogle Scholar
  37. Schulten K, Schulten Z, Szabo A (1981) Dynamics of reactions involving diffusive barrier crossing. J Chem Phys 74:4426–4432Google Scholar
  38. Shaw G, Vasudevan R (1974) Persistent states of neural networks and the random nature of synaptic transmission. Math Biosci 21:207Google Scholar

Copyright information

© Springer-Verlag 1987

Authors and Affiliations

  • J. Buhmann
    • 1
  • K. Schulten
    • 1
    • 2
  1. 1.Physik-DepartmentTechnische Universität MünchenGarchingGermany
  2. 2.Institute for Theoretical PhysicsUniversity of CaliforniaSanta BarbaraUSA

Personalised recommendations