Journal of Computational Neuroscience

, Volume 22, Issue 1, pp 81–100 | Cite as

Fast numerical methods for simulating large-scale integrate-and-fire neuronal networks

  • Aaditya V. RanganEmail author
  • David Cai


We discuss numerical methods for simulating large-scale, integrate-and-fire (I&F) neuronal networks. Important elements in our numerical methods are (i) a neurophysiologically inspired integrating factor which casts the solution as a numerically tractable integral equation, and allows us to obtain stable and accurate individual neuronal trajectories (i.e., voltage and conductance time-courses) even when the I&F neuronal equations are stiff, such as in strongly fluctuating, high-conductance states; (ii) an iterated process of spike-spike corrections within groups of strongly coupled neurons to account for spike-spike interactions within a single large numerical time-step; and (iii) a clustering procedure of firing events in the network to take advantage of localized architectures, such as spatial scales of strong local interactions, which are often present in large-scale computational models—for example, those of the primary visual cortex. (We note that the spike-spike corrections in our methods are more involved than the correction of single neuron spike-time via a polynomial interpolation as in the modified Runge-Kutta methods commonly used in simulations of I&F neuronal networks.) Our methods can evolve networks with relatively strong local interactions in an asymptotically optimal way such that each neuron fires approximately once in \(\mathcal{O}(N)\) operations, where N is the number of neurons in the system. We note that quantifications used in computational modeling are often statistical, since measurements in a real experiment to characterize physiological systems are typically statistical, such as firing rate, interspike interval distributions, and spike-triggered voltage distributions. We emphasize that it takes much less computational effort to resolve statistical properties of certain I&F neuronal networks than to fully resolve trajectories of each and every neuron within the system. For networks operating in realistic dynamical regimes, such as strongly fluctuating, high-conductance states, our methods are designed to achieve statistical accuracy when very large time-steps are used. Moreover, our methods can also achieve trajectory-wise accuracy when small time-steps are used.


Numerical algorithm Network architecture 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. Anderson J, Lampl I, Gillespie D, Ferster D (2000) The contribution of noise to contrast invariance of orientation tuning in cat visual cortex. Science, 290: 1968–1972Google Scholar
  2. Angelucci A, Levitt JB, Walton EJ, Hupe JM, Bullier J, Lund JS (2002) Circuits for local and global signal integration in primary visual cortex. J. Neurosci., 22: 8633–8646Google Scholar
  3. Borg-Graham L, Monier C, Fregnac Y (1996) Voltage-clamp measurement of visually-evoked conductances with whole-cell patch recordings in primary visual cortex. J Physiol Paris, 90(3-4): 185–188Google Scholar
  4. Borg-Graham LJ, Monier C, Fregnac Y (1998) Visual input evokes transient and strong shunting inhibition in visual cortical neurons. Nature, 393(6683): 369–373Google Scholar
  5. Bosking WH, Zhang Y, Schofield B, Fitzpatrick D (1997) Orientation selectivity and the arrangement of horizontal connections in tree shrew striate cortex. J. Neurosci., 17: 2112–2127Google Scholar
  6. Brette R (to appear) Exact simulation of integrate-and-fire models with synaptic conductances. Neural ComputGoogle Scholar
  7. Cai D, Rangan AV, McLaughlin DW (2005) Architectural and synaptic mechanisms underlying coherent spontaneous activity in v1. Proc. Nat’l Acad. Sci (USA), 102: 5868–5873Google Scholar
  8. Cai D, Tao L, Shelley M, Mclaughlin DW (2004) An effective representation of fluctuation-driven neuronal networks with application to simple & complex cells in visual cortex. Pro. Nat. Acad. Sci. (USA), 101: 7757–7762Google Scholar
  9. Callaway E (1998) Local circuits in primary visual cortex of the macaque monkey. Ann. Rev. Neurosci., 21: 47–74Google Scholar
  10. Callaway E, Wiser A (1996) Contributions of individual layer 2 to 5 spiny neurons to local circuits in macaque primary visual cortex. Visual Neuroscience, 13: 907–922Google Scholar
  11. Compte A, Sanchez-Vives MV, McCormick DA, Wang X-J (2003) Cellular and network mechanisms of slow oscillatory activity (< 1hz) and wave propagations in a cortical network model. J Neurophysiol., 89: 2707–2725Google Scholar
  12. Destexhe A, Rudolph M, Pare D (2003) The high-conductance state of neocortical nurons in vivo. Nat. Rev., Neurosci, 4: 730–751Google Scholar
  13. Fitzpatrick D, Lund J, Blasdel G (1985) Intrinsic connections of macaque striate cortex Afferent and efferent connections of lamina 4C. Journal of Neuroscience, 5: 3329–3349Google Scholar
  14. Fornberg B (1998) A Practical Guide to Pseudospectral Methods. Cambridge University Press, New York.Google Scholar
  15. Fourcaud-Trocme N, Hansel D, van Vreeswijk C, Brunel N (2003) How spike generation mechanisms determine the neuronal response to fluctuating inputs. J. Neurosci., 23Google Scholar
  16. Frenkel D, Smit B (1996) Understanding Molecular Simulation. Academic Press, New York.Google Scholar
  17. Gear CW (1971) Numerical Initial Value Problems in Ordinary Differential Equations. Prentice Hall, Englewood Cliffs, NJ.Google Scholar
  18. Geisler C, Brunel N, Wang X-J (2005) Contributions of intrinsic membrane dynamics to fast network oscillations with irregular neuronal discharges. J. Neurophysiol., page in press.Google Scholar
  19. Gilbert CD, Wiesel TN (1983) Clustered intrinsic connections in cat visual cortex. J. Neurosci., 3: 1116–1133Google Scholar
  20. Grinvald A, Heildesheim R (2004) VSDI: a new era in functional imaging of cortical dynamics. Nat. Rev. Neurosci., 5: 874–885Google Scholar
  21. Hansel D, Mato G, Meunier C, Neltner L (1998) On numerical simulations of integrate-and-fire neural networks. Neural Comput., 10Google Scholar
  22. Jancke D, Chavance F, Naaman S, Grinvald A (2004) Imaging cortical correlates of illusion in early visual cortex. Nature, 428: 423–426Google Scholar
  23. Kenet T, Bibitchkov D, Tsodyks M, Grinvald A, Arieli A (2003) spontaneously emerging cortical representations of visual attributes. Nature, 425: 954–956Google Scholar
  24. Koch C (1999) Biophysics of Computation. Oxford University Press, Oxford.Google Scholar
  25. Lytton W, Hines ML (2005) Independent variable time-step integration of individual neurons for network simulations. Neural Comput, 17: 903–921Google Scholar
  26. Lund JS (1987) Local circuit neurons of macaque monkey striate cortex: Neurons of laminae 4C and 5A. Journal of Comparative Neurology, 257: 60–92Google Scholar
  27. Makino T (2003) A discrete-even neural network simulator for general neuron models. Neural Comput. and Appl., 11: 210–223Google Scholar
  28. Marino J, Schummers J, Lyon DC, Schwabe L, Beck O, Wiesing P, Obermayer K, Sur M (2005) Invariant computations in local cortical networks with balanced excitation and inhibition. Nat. Neurosci., 8Google Scholar
  29. McLaughlin D, Shapley R, Shelley M, Wielaard J (2000) A neuronal network model of macaque primary visual cortex (V1): Orientation selectivity and dynamics in the input layer 4Cα. Proc. Natl. Acad. Sci. USA, 97: 8087–8092Google Scholar
  30. Morrison A, Mehring C, Geisel T, Aertsen A, Diesmann M (2005) Advancing the boundaries of high-connectivity network simulation with distributed computing. Neural Comput, 17: 1776–1801Google Scholar
  31. Pare D, Shink E, Gaudreau H, Destexhe A, Lang EJ (1998) Impact of spontaneous synaptic activity on the resting properties of cat neocortical pyramidal neurons in vivo. J Neurophysiol, 79: 1450–1460Google Scholar
  32. Rangan AV, Cai D, McLaughlin DW (2005) Modeling the spatiotemporal cortical activity associated with the line-motion illusion in primary visual cortex. Proc. Nat’l Acad. Sci (USA), 102(52): 18793–18800Google Scholar
  33. Rauch A, LaCamera G, Luscher HR, Senn W, Fusi S (2003) Neocortical pyramidal cells respond as integrate-and-fire neurons to in vivo-like input currents. J. Neurophysiol., 90Google Scholar
  34. Rochel O, Martinez D (2003) An event-driven framework for the simulation of networks of spiking neurons. In Proc. 11th European Symposium on Artificial Neural Networks d-side publications, 295–300Google Scholar
  35. Rudolph M, Destexhe A. (2003a) A fast-conducting, stochastic integrative mode for neocortical neurons in vivo. J Neurosci, 23(6): 2466–2476Google Scholar
  36. Rudolph M, Destexhe A (2003b) Characterization of subthreshold voltage fluctuations in neuronal membranes. Neural Comput, 15(11): 2577–2618Google Scholar
  37. Rudolph M, Destexhe A (2003c) The discharge variability of neocortical neurons during high-conductance states. Neuroscience, 119(3): 855–873Google Scholar
  38. Rudolph M, Destexhe A (2003d) Tuning neocortical pyramidal neurons between integrators and coincidence detectors. J Comput Neurosci, 14(3): 239–251Google Scholar
  39. Shadlen MN, Newsome WT (1998) The variable discharge of cortical neurons: Implications for connectivity, computation and information coding. J Neurosci, 18: 3870–3896Google Scholar
  40. Shelley MJ, Tao L (2001) Efficient and accurate time-stepping schemes for integrate-and-fire neuronal networks. J. Comput. Neurosci., 11Google Scholar
  41. Sincich L, Blasdel G (2001) Oriented axon projections in primary visual cortex of the monkey. J. Neurosci., 21: 4416–4426Google Scholar
  42. Somers D, Nelson S, Sur M (1995) An emergent model of orientation selectivity in cat visual cortical simple cells. J. of Neurosci., 15: 5448–5465Google Scholar
  43. Stern EA, Kincaid AE, Wilson CJ (1997) Spontaneous subthreshold membrane potential fluctuations and action potential variability of rat corticostriatal and striatal neurons in vivo. J. Neurophysiol., 77: 1697–1715Google Scholar
  44. Tao L, Shelley M, McLaughlin D, Shapley R (2003) An egalitarian network model for the emergence of simple and complex cells in visual cortex. PNAS.Google Scholar
  45. Troyer T, Krukowski A, Priebe N, Miller K (1998) Contrast invariant orientation tuning in cat visual cortex with feedforward tuning and correlation based intracortical connectivity. J. Neurosci., 18: 5908–5927Google Scholar
  46. Tsodyks M,Kenet T, Grinvald A, Arieli A (1999) Linking spontaneous activity of single cortical neurons and the underlying functional architecture. Science, 286: 1943–1946Google Scholar
  47. Wang X-J (1999) Synaptic basis of cortical persistent activity: The importance of NMDA receptors to working memory. J Neurosci., 19: 9587–9603Google Scholar

Copyright information

© Springer Science + Business Media, LLC 2007

Authors and Affiliations

  1. 1.Courant Institute of Mathematical SciencesNew York UniversityNew YorkUSA

Personalised recommendations