Biological Cybernetics

, Volume 90, Issue 6, pp 400–409 | Cite as

A computational framework for cortical learning

Article
First Online:
Received:
Accepted:

Abstract.

Recent physiological findings have revealed that long-term adaptation of the synaptic strengths between cortical pyramidal neurons depends on the temporal order of presynaptic and postsynaptic spikes, which is called spike-timing-dependent plasticity (STDP) or temporally asymmetric Hebbian (TAH) learning. Here I prove by analytical means that a physiologically plausible variant of STDP adapts synaptic strengths such that the presynaptic spikes predict the postsynaptic spikes with minimal error. This prediction error model of STDP implies a mechanism for cortical memory: cortical tissue learns temporal spike patterns if these spike patterns are repeatedly elicited in a set of pyramidal neurons. The trained network finishes these patterns if their beginnings are presented, thereby recalling the memory. Implementations of the proposed algorithms may be useful for applications in voice recognition and computer vision.

Keywords

Prediction Error Error Model Pyramidal Neuron Temporal Order Minimal Error 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
This is a preview of subscription content, log in to check access.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    August DA, Levy WB (1999) Temporal sequence compression by an integrate-and-fire model of hippocampal area CA3. J Comput Neurosci 6(1):71–90Google Scholar
  2. 2.
    Bi GQ, Poo MM (1998) Synaptic modifications in cultured hippocampal neurons: dependence on spike timing, synaptic strength, and postsynaptic cell type. J Neurosci 18(24):10464–10472Google Scholar
  3. 3.
    Debanne D, Gahwiler BH, Thompson SM (1998) Long-term synaptic plasticity between pairs of individual CA3 pyramidal cells in rat hippocampal slice cultures. J Physiol 507:237–247Google Scholar
  4. 4.
    Feldman DE (2000) Timing-based LTP and LTD at vertical inputs to layer II/III pyramidal cells in rat barrel cortex. Neuron 27(1):45–56Google Scholar
  5. 5.
    Froemke RC, Dan Y (2002) Spike timing-dependent synaptic modification induced by natural spike trains. Nature 416(6879):433–438Google Scholar
  6. 6.
    Gerstner W (2001) Coding properties of spiking neurons: reverse and cross-correlations. Neural Netw 14(6–7):599–610Google Scholar
  7. 7.
    Gerstner W, Abbott LF (1997) Learning navigational maps through potentiation and modulation of hippocampal place cells. J Comput Neurosci 4(1):79–94Google Scholar
  8. 8.
    Gerstner W, van Hemmen JL (1992) Associative memory in a network of ‘spiking’ neurons, network. Comput Neural Syst 3:139–164Google Scholar
  9. 9.
    Gerstner W, van Hemmen JL (1994) Coding and information processing in neural networks. In: Domany E, van Hemmen JL, Schulten K (eds) Models of neural networks II. Springer, Berlin Heidelberg New York, pp 1–93Google Scholar
  10. 10.
    Gerstner W, Kistler WM (2002) Mathematical formulations of Hebbian Learning. Biol Cybern 87(5–6):404–415Google Scholar
  11. 11.
    Gerstner W, Kempter R, van Hemmen JL, Wagner H (1996) A neuronal learning rule for sub-millisecond temporal coding. Nature 383:76–78Google Scholar
  12. 12.
    Godfrey KR (1980) Correlation methods. Automatica 16:527–534Google Scholar
  13. 13.
    Gutig R, Aharonov R, Rotter S, Sompolinsky H (2003) Learning input correlations through nonlinear temporally asymmetric Hebbian plasticity. J Neurosci 23(9):3697–3714Google Scholar
  14. 14.
    Hausser M, Major G, Stuart GJ (2001) Differential shunting of EPSPs by action potentials. Science 291(5501):138–141Google Scholar
  15. 15.
    Levy WB (1996) A sequence predicting CA3 is a flexible associator that learns and uses context to solve hippocampal-like tasks. Hippocampus 6(6):579–590Google Scholar
  16. 16.
    Ljung L, Soderstrom TL (1983) Theory and practice of recursive identification. MIT Press, Cambridge, MAGoogle Scholar
  17. 17.
    Markram H, Lubk, J, Frotscher M, Sakmann B (1997) Regulation of synaptic efficacy by coincidence of postsynaptic APs and EPSPs. Science 275(5297):213–215Google Scholar
  18. 18.
    Pfister J-P, Barber D, Gerstner W (2003) Optimal Hebbian learning: a probabilistic point of view. In: Kaynak et al (eds) Proceedings of joint international conference ICANN/ICONIP. Lecture notes in computer science, vol 2714. Springer, Berlin Heidelberg New York, pp 92–98Google Scholar
  19. 19.
    Rao RP, Ballard DH (1997) Dynamic model of visual recognition predicts neural response properties in the visual cortex. Neural Comput 9(4):721–763Google Scholar
  20. 20.
    Rao RP, Sejnowski TJ (2001) Spike-timing-dependent Hebbian plasticity as temporal difference learning. Neural Comput 13(10):2221–2237Google Scholar
  21. 21.
    Roberts PD (1999) Computational consequences of temporally asymmetric learning rules: I. Differential Hebbian learning. J Comput Neurosci 7(3):2235–2346Google Scholar
  22. 22.
    Rubin J, Lee DD, Sompolinsky H (2001) Equilibrium properties of temporally asymmetric Hebbian plasticity. Phys Rev Lett 86(2):364–367Google Scholar
  23. 23.
    Saudargiene A, Porr B, Worgotter F (2004) How the shape of pre- and postsynaptic signals can influence STDP: a biophysical model. Neural Comput 16(3):595–625Google Scholar
  24. 24.
    Sjostrom PJ, Turrigiano GG, Nelson SB (2001) Rate, timing, and cooperativity jointly determine cortical synaptic plasticity. Neuron 20 32(6):1149–1164Google Scholar
  25. 25.
    Skaggs WE, McNaughton BL, Wilson MA, Barnes CA (1996) Theta phase precession in hippocampal neuronal populations and the compression of temporal sequences. Hippocampus6(2):149–172Google Scholar
  26. 26.
    Suri RE (2002) TD models of reward predictive responses in dopamine neurons. Neural Netw 15(4–6):523–533Google Scholar
  27. 27.
    Suri RE, Sejnowski TJ (2002) Spike propagation synchronized by temporally asymmetric Hebbian learning. Biol Cybern 87(5–6):440–445Google Scholar
  28. 28.
    Sutton RS, Barto AG (1981) An adaptive network that constructs and uses an internal model of its world. Cogn Brain Theory 4:217–246Google Scholar
  29. 29.
    Troyer TW, Miller KD (1997) Physiological gain leads to high ISI variability in a simple network of a cortical regular spiking cell. Neural Comput 9(5):971–983Google Scholar
  30. 30.
    Watanabe S, Hoffman DA, Migliore M, Johnston D (2002) Dendritic K+ channels contribute to spike-timing dependent long-term potentiation in hippocampal pyramidal neurons. Proc Natl Acad Sci USA 99:8366–8371Google Scholar
  31. 31.
    Wolpert DM, Ghahramani Z, Jordan MI (1995) An internal model for sensorimotor integration. Science 269:1880–1882Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2004

Authors and Affiliations

  1. 1.3641Los AngelesUSA

Personalised recommendations