Mean-field analysis of selective persistent activity in presence of short-term synaptic depression

  • Sandro Romani
  • Daniel J. Amit
  • Gianluigi MongilloEmail author


Mean-Field theory is extended to recurrent networks of spiking neurons endowed with short-term depression (STD) of synaptic transmission. The extension involves the use of the distribution of interspike intervals of an integrate-and-fire neuron receiving a Gaussian current, with a given mean and variance, in input. This, in turn, is used to obtain an accurate estimate of the resulting postsynaptic current in presence of STD. The stationary states of the network are obtained requiring self-consistency for the currents—those driving the emission processes and those generated by the emitted spikes. The model network stores in the distribution of two-state efficacies of excitatory-to-excitatory synapses, a randomly composed set of external stimuli. The resulting synaptic structure allows the network to exhibit selective persistent activity for each stimulus in the set. Theory predicts the onset of selective persistent, or working memory (WM) activity upon varying the constitutive parameters (e.g. potentiated/depressed long-term efficacy ratio, parameters associated with STD), and provides the average emission rates in the various steady states. Theoretical estimates are in remarkably good agreement with data “recorded” in computer simulations of the microscopic model.


Mean-field analysis Overlapping memories Selective persistent activity Spiking neuron STD 


  1. Abbott LF, Varela JA, Sen K, Nelson SB (1997) Synaptic depression and cortical gain control. Science 275: 220–224.Google Scholar
  2. Amit DJ (1998) Simulation in neurobiology - theory or experiment? TINS 21: 231–237.Google Scholar
  3. Amit DJ, Bernacchia A, Yakovlev V (2003) Multiple working memory - model for behavioral experiment. Cerebral Cortex 13: 435–443.Google Scholar
  4. Amit DJ, Brunel N (1997a) Dynamics of recurrent network of spiking neurons before and following learning. Network 8: 373–404.Google Scholar
  5. Amit DJ, Brunel N (1997b) Model of global spontaneous activity and local structured activity during delay periods in the cerebral cortex. Cereb. Cortex 7: 237–252.Google Scholar
  6. Amit DJ, Mongillo G (2003a) Selective delay activity in the cortex: Phenomena and Interpretation. Cereb. Cortex 13: 1139–1150.Google Scholar
  7. Amit DJ, Mongillo G (2003b) Spike-driven synaptic dynamics generating working memory states. Neural Comp. 15: 565–596.Google Scholar
  8. Amit DJ, Tsodyks MV (1991a) Quantitative study of attractor neural networks retrieving at low spike rates I: Substrate spikes, rates and neurons gain. Network 2: 259–274.Google Scholar
  9. Amit DJ, Tsodyks MV (1991b) Quantitative study of attractor neural networks retrieving at low spike rates. II: Low-rate retrieval in symmetric networks. Network 2: 275–294.Google Scholar
  10. Bibitchkov D, Herrmann JM, Geisel T (2002) Pattern storage and processing in attractor networks with short-time synaptic dynamics. Network 13: 115–129.Google Scholar
  11. Brunel N (2003) Dynamics and plasticity of stimulus-selective persistent activity in cortical network models. Cerebral Cortex 13: 1151–1161.Google Scholar
  12. Brunel N, Carusi F, Fusi S (1998) Slow stochastic hebbian learning of classes of stimuli in a recurrent neural network. Network 9: 123–152.Google Scholar
  13. Brunel N, Hakim V (1999) Fast global oscillations in networks of integrate-and-fire neurons with low firing rates. Neural Computation 11: 1621–1671.Google Scholar
  14. Brunel N, Sergi S (1998) Firing frequency of leaky integrate-and-fire neurons with synaptic currents dynamics. J. Theor. Biol. 195: 87–95.Google Scholar
  15. Brunel N, Wang X-J (2001) Effects of neuromodulation in a cortical network model of object working memory dominated by recurrent inhibition. J. Comput. Neurosci. 11: 63–85.Google Scholar
  16. Compte A, Brunel N, Goldman-Rakic PS, Wang X-J (2000) Synaptic mechanisms and network dynamics underlying spatial working memory in a cortical network model. Cereb. Cortex 10: 910–923.Google Scholar
  17. Compte A, Constantinidis C, Tegner J, Raghavachari S, Chafee MV, Goldman-Rakic PS, Wang X-J (2003) Temporally irregular mnemonic persistent activity in prefrontal neurons of monkeys during a delayed response task. J. Neurophysiol. 90(5): 3441–3454.Google Scholar
  18. Cox D, Miller HD (1977) The Theory of stochastic processes. CRC Press.Google Scholar
  19. Curti E, Mongillo G, La Camera G, Amit DJ (2004) Mean-field and capacity in realistic networks of spiking neurons storing sparsely coded random memories. Neural Comp. 16: 2597–2637.Google Scholar
  20. Erickson CA, Desimone R (1999) Responses of macaque perirhinal neurons during and after visual stimulus association learning. J. Neurosci. 19: 10404–10416.Google Scholar
  21. Fusi S, Annunziato M, Badoni D, Salamon A, Amit DJ (2000) Spike-driven synaptic plasticity: Theory, simulation, VLSI implementation. Neural Comp. 12: 2227–2258.Google Scholar
  22. Galarreta M, Hestrin S (1998) Frequency-dependent synaptic depression and the balance of excitation and inhibition in the neocortex. Nat. Neurosci. 1: 587–594.Google Scholar
  23. Kistler WM, van Hemmen JL (1999) Short-term synaptic plasticity and network behavior. Neural Computation 11: 1579–1594.Google Scholar
  24. Loebel A, Tsodyks M (2002) Computation by ensemble synchronization in recurrent networks with synaptic depression. J. Comput. Neurosci. 13: 111–124.Google Scholar
  25. Markram H, Wang Y, Tsodyks M (1998) Differential signaling via the same axon of neocortical pyramidal neurons. PNAS 95: 5323–5328.Google Scholar
  26. Mongillo G, Amit DJ, Brunel N (2003) Retrospective and prospective persistent activity induced by Hebbian learning in a recurrent cortical network. Eur. J. Neurosci. 18: 2011–2024.Google Scholar
  27. Mongillo G, Curti E, Romani S, Amit DJ (2005) Learning in realistic networks of spiking neurons and spike-driven plastic synapses. Eur. J. Neurosci. 21: 3143–3160.Google Scholar
  28. Moreno-Bote R, Parga N (2004) Role of synaptic filtering on the firing response of simple model neurons. Phys. Rev. Lett. 92: 028102.Google Scholar
  29. Pantic L, Torres JJ, Kappen HJ, Gielen SC (2002) Associative memory with dynamic synapses. Neural Computation 14: 2903–2923.Google Scholar
  30. Patie P (2004) On some First Passage Time Problems Motivated by Financial Applications. PhD thesis, ETH Zurich.Google Scholar
  31. Rao SC, Rainer G, Miller EK (1997) Integration of what and where in the primate prefrontal cortex. Science 276: 821–824.Google Scholar
  32. Rauch A, La Camera G, Luscher H-R, Senn W, Fusi S (2003) Neocortical pyramidal cells respond as integrate-and-fire neurons to in vivo-like input currents. J. Neurophysiol. 90: 1598–1612.Google Scholar
  33. Renart A, Brunel N, Wang X-J (2003) Computational Neuroscience: A Comprehensive Approach, chapter 15. CRC press, pp. 431–490.Google Scholar
  34. Tsodyks MV, Markram H (1997) The neural code between neocortical pyramidal neurons depends on neurotransmitter release probability. PNAS 94: 719–723.Google Scholar
  35. Tsodyks MV, Pawelzik K, Markram H (1998) Neural networks with dynamic synapses. Neural Comp. 10: 821–835.Google Scholar
  36. Tsodyks MV, Uziel A, Markram H (2000) Synchrony generation in recurrent networks with frequency-dependent synapses. J. Neurosci. 20(RC50): 1–5.Google Scholar
  37. Tuckwell HC (1988). Introduction to theoretical neurobiology. Cambridge University Press.Google Scholar
  38. van Vreeswijk CA, Sompolinsky H (1996) Chaos in neural networks with balanced excitatory and inhibitory activity. Science 274: 1724–1726.Google Scholar
  39. Varela JA, Song S, Turrigiano GG, Nelson SB (1999) Differential depression at excitatory and inhibitory synapses in visual cortex. J. Neurosci. 19: 4293–4304.Google Scholar
  40. Wang X-J (1999) Synaptic basis of cortical persistent activity: The importance of NMDA receptors to working memory. J. Neurosci. 19: 9587–9603.Google Scholar

Copyright information

© Springer Science + Business Media, LLC 2006

Authors and Affiliations

  • Sandro Romani
    • 1
  • Daniel J. Amit
    • 2
    • 3
  • Gianluigi Mongillo
    • 4
    • 5
    Email author
  1. 1.Dottorato di Ricerca in Neurofisiologia, Dip. di Fisiologia UmanaUniversità di Roma La SapienzaRomeItaly
  2. 2.INFM, Dip. di FisicaUniversita’ di Roma La SapienzaRomeItaly
  3. 3.Racah Institute of PhysicsHebrew UniversityJerusalemIsrael
  4. 4.Institute of Cognitive ScienceBronFrance
  5. 5.University College LondonLondonUK

Personalised recommendations