Biological Cybernetics

, Volume 109, Issue 3, pp 321–332 | Cite as

Continuous neural network with windowed Hebbian learning

Original Paper

Abstract

We introduce an extension of the classical neural field equation where the dynamics of the synaptic kernel satisfies the standard Hebbian type of learning (synaptic plasticity). Here, a continuous network in which changes in the weight kernel occurs in a specified time window is considered. A novelty of this model is that it admits synaptic weight decrease as well as the usual weight increase resulting from correlated activity. The resulting equation leads to a delay-type rate model for which the existence and stability of solutions such as the rest state, bumps, and traveling fronts are investigated. Some relations between the length of the time window and the bump width is derived. In addition, the effect of the delay parameter on the stability of solutions is shown. Also numerical simulations for solutions and their stability are presented.

Keywords

Neural field Continuous network Bump Traveling front Delay equation Existence Stability 

Mathematics Subject Classification

35B35 35C07 45K05 92B20 92C20 

Notes

Acknowledgments

It is pleasure for the authors to thank A. Abbasian for his useful comments about the biological aspects of the problem. This research was in part supported by a grant from IPM (No. 91920410). The third author was also partially supported by National Elites Foundation.

References

  1. 1.
    Abbott LF, Nelson SB (2000) Synaptic plasticity: taming the beast. Nat Neurosci 3:1178–1183CrossRefPubMedGoogle Scholar
  2. 2.
    Amari S (1977) Dynamics of pattern formation in lateral-inhibition type neural fields. Biol Cybern 27:77–87CrossRefPubMedGoogle Scholar
  3. 3.
    Baladron J, Fasoli D, Faugeras OD, Touboul J (2011) Mean field description of and propagation of chaos in recurrent multipopulation networks of Hodgkin–Huxley and Fitzhugh–Nagumo neurons. arXiv:1110.4294
  4. 4.
    Bienenstock EL, Cooper LN, Munro PW (1982) Theory for the development of neuron selectivity: orientation specificity and binocular interaction in visual cortex J Neurosci 2:32–48Google Scholar
  5. 5.
    Bressloff PC (2009) Lectures in mathematical neuroscience. Mathematical biology, IAS/Park City mathematical series 14, pp 293–398Google Scholar
  6. 6.
    Bressloff PC (2012) Spatiotemporal dynamics of continuum neural fields. J Phys A Math Theor 45(3):033001Google Scholar
  7. 7.
    Bressloff PC, Coombes S (2013) Neural bubble dynamics revisited. Cogn Comput 5:281–294Google Scholar
  8. 8.
    Connell L (2007) Representing object colour in language comprehension. Cognition 102(3):476–485Google Scholar
  9. 9.
    Coombes H, Schmidt S, Bojak I (2012) Interface dynamics in planar neural field models. J Math Neurosci 2(1):1–27Google Scholar
  10. 10.
    Coombes P, Beim Graben S, Potthast R (2012b) Tutorial on neural field theory. Springer, BerlinGoogle Scholar
  11. 11.
    Coombes S (2005) Waves, bumps, and patterns in neural field theories. Biol Cybern 93:91–108CrossRefPubMedGoogle Scholar
  12. 12.
    Coombes S, Owen MR (2007) Exotic dynamics in a firing rate model of neural tissue with threshold accommodation. In: Botelho F, Hagen T, Jamison J (eds) Fluids and waves: recent trends in applied analysis, vol 440. AMS Contemporary Mathematics, pp 123–144Google Scholar
  13. 13.
    Dayan P, Abbott LF (2003) Theoretical neuroscience: computational and mathematical modeling of neural systems. J Cogn Neurosci 15(1):154–155Google Scholar
  14. 14.
    Ermentrout GB, Cowan JD (1979) A mathematical theory of visual hallucination patterns. Biol Cybern 34:137–150CrossRefPubMedGoogle Scholar
  15. 15.
    Földiák P (1991) Learning invariance from transformation sequences. Neural Comput 3(2):194–200CrossRefGoogle Scholar
  16. 16.
    Galtier MN, Faugeras OD, Bressloff PC (2011) Hebbian learning of recurrent connections: a geometrical perspective. Neural Comput 24(9):2346–2383Google Scholar
  17. 17.
    Gerstner W, Kistler WK (2002) Mathematical formulations of Hebbian learning. Biol Cybern 87:404–415CrossRefPubMedGoogle Scholar
  18. 18.
    Goldman-Rakic PS (1995) Cellular basis of working memory. Neuron 14:477–485CrossRefPubMedGoogle Scholar
  19. 19.
    Golomb D, Amitai Y (1997) Propagating neuronal discharges in neocortical slices: computational and experimental study. J Neurophysiol 78(3):1199–1211Google Scholar
  20. 20.
    Hebb DO (1949) The organization of behavior; a neuropsychological theoryGoogle Scholar
  21. 21.
    Huang X (2004) Spiral waves in disinhibited mammalian neocortex. J Neurosci 24:9897–9902CrossRefPubMedCentralPubMedGoogle Scholar
  22. 22.
    Itskov D, Hansel V, Tsodyks M (2011) Short-term facilitation may stabilize parametric working memory trace. Front Comput Neurosci 5(40)Google Scholar
  23. 23.
    Lu Y, Sato Y, Amari S (2011) Traveling bumps and their collisions in a two-dimensional neural field. Neural Comput 23:1248–1260CrossRefPubMedGoogle Scholar
  24. 24.
    Miller KD, MacKayt DJC (1994) The role of constraints in Hebbian learning. Neural Comput 6:100–126CrossRefGoogle Scholar
  25. 25.
    Oja E (1982) Simplified neuron model as a principal component analyzer. J Math Biol 15(3):267–273CrossRefPubMedGoogle Scholar
  26. 26.
    Olshausen BA, Field DJ (1997) Sparse coding with an overcomplete basis set: a strategy employed by v1? Vis Res 37(23):3311–3325CrossRefPubMedGoogle Scholar
  27. 27.
    Pinto DJ (2005) Initiation, vitro involve distinct mechanisms. J Neurosci 25:8131–8140CrossRefPubMedGoogle Scholar
  28. 28.
    Pinto DJ, Ermentrout GB (2001) Spatially structured activity in synaptically coupled neuronal networks: I. Traveling fronts and pulses. SIAM J Appl Math 62:206–225CrossRefGoogle Scholar
  29. 29.
    Rao RPN, Sejnowski TJ (2001) Spike-timing-dependent Hebbian plasticity as temporal difference learning. Neural Comput 13(10):2221–2237CrossRefPubMedGoogle Scholar
  30. 30.
    Robinson PA (2011) Neural field theory of synaptic plasticity. J Theor Biol 285:156–163CrossRefPubMedGoogle Scholar
  31. 31.
    Sandstede B (2007) Evans functions and nonlinear stability of traveling waves in neuronal network models. Int J Bifurc Chaos 17:2693–2704CrossRefGoogle Scholar
  32. 32.
    Sejnowski TJ (1977) Statistical constraints on synaptic plasticity. J Theor Biol 69(2):385–389CrossRefPubMedGoogle Scholar
  33. 33.
    Wallis G, Baddeley R (1997) Optimal, unsupervised learning in invariant object recognition. Neural Comput 9:883–894CrossRefPubMedGoogle Scholar
  34. 34.
    Wilson HR, Cowan JD (1972) Excitatory and inhibitory interactions in localized populations of model neurons. Biophys J 12:1–24CrossRefPubMedCentralPubMedGoogle Scholar
  35. 35.
    Wilson HR, Cowan JD (1973) A mathematical theory of the functional dynamics of cortical and thalamic nervous tissue. Kybernetika 13(2):55–80Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2015

Authors and Affiliations

  1. 1.Department of Mathematical SciencesSharif University of TechnologyTehranIran
  2. 2.Department of Mechanical EngineeringSharif University of TechnologyTehranIran
  3. 3.School of MathematicsInstitute for Research in Fundamental Sciences (IPM)TehranIran

Personalised recommendations