Finite-size and correlation-induced effects in mean-field dynamics Article

First Online: 08 March 2011 Received: 27 August 2010 Revised: 28 January 2011 Accepted: 16 February 2011 DOI :
10.1007/s10827-011-0320-5

Cite this article as: Touboul, J.D. & Ermentrout, G.B. J Comput Neurosci (2011) 31: 453. doi:10.1007/s10827-011-0320-5 Abstract The brain’s activity is characterized by the interaction of a very large number of neurons that are strongly affected by noise. However, signals often arise at macroscopic scales integrating the effect of many neurons into a reliable pattern of activity. In order to study such large neuronal assemblies, one is often led to derive mean-field limits summarizing the effect of the interaction of a large number of neurons into an effective signal. Classical mean-field approaches consider the evolution of a deterministic variable, the mean activity, thus neglecting the stochastic nature of neural behavior. In this article, we build upon two recent approaches that include correlations and higher order moments in mean-field equations, and study how these stochastic effects influence the solutions of the mean-field equations, both in the limit of an infinite number of neurons and for large yet finite networks. We introduce a new model, the infinite model, which arises from both equations by a rescaling of the variables and, which is invertible for finite-size networks, and hence, provides equivalent equations to those previously derived models. The study of this model allows us to understand qualitative behavior of such large-scale networks. We show that, though the solutions of the deterministic mean-field equation constitute uncorrelated solutions of the new mean-field equations, the stability properties of limit cycles are modified by the presence of correlations, and additional non-trivial behaviors including periodic orbits appear when there were none in the mean field. The origin of all these behaviors is then explored in finite-size networks where interesting mesoscopic scale effects appear. This study leads us to show that the infinite-size system appears as a singular limit of the network equations, and for any finite network, the system will differ from the infinite system.

Keywords Neural mass equations Dynamical systems Markov process Master equation Moment equations Bifurcations Wilson and Cowan system Action Editor: Nicolas Brunel

References Abbott, L. F, & Van Vreeswijk, C. A. (1993). Asynchronous states in networks of pulse-coupled neuron.

Physical Review, 48 , 1483–1490.

PubMed CrossRef Google Scholar Amari, S. (1972). Characteristics of random nets of analog neuron-like elements . Syst. Man Cybernet., SMC-2.

Amari, S.-I. (1977). Dynamics of pattern formation in lateral-inhibition type neural fields.

Biological Cybernetics, 27 , 77–87.

PubMed CrossRef Google Scholar Amit, D. J., & Brunel, N. (1997). Model of global spontaneous activity and local structured delay activity during delay periods in the cerebral cortex.

Cerebral Cortex, 7 , 237–252.

PubMed CrossRef Google Scholar Arnold, V.I. (1981). Ordinary differential equations (Chap. 5). MIT Press.

Arnold, L. (1995). Random dynamical systems . Springer.

Beggs, J. M., & Plenz, D. (2004). Neuronal avalanches are diverse and precise activity patterns that are stable for many hours in cortical slice cultures.

Journal of Neuroscience, 24 , 5216–5229.

PubMed CrossRef Google Scholar Benayoun, M., Cowan, J. D., van Drongelen, W., & Wallace, E. (2010). Avalanches in a stochastic model of spiking neurons.

PLoS Computational Biology, 6 (7), e1000846. doi:

10.1371/journal.pcbi.1000846 .

PubMed CrossRef Google Scholar Boland, R. P., Galla, T., & McKane, A. J. (2008). How limit cycles and quasi-cycles are related in systems with intrinsic noise.

Journal of Statistical Mechanics: Theory and Experiment, 9 , P09001.

CrossRef Google Scholar Bressfloff, P. (2010). Stochastic neural field theory and the system-size expansion.

SIAM Journal on Applied Mathematics, 70 , 1488–1521.

CrossRef Google Scholar Bressfloff, P. (2010). Metastable states and quasicycles in a stochastic Wilson–Cowan model.

Physical Review E, 82 , 051903.

CrossRef Google Scholar Brewer, J. (1978). Kronecker products and matrix calculus in system theory. IEEE Transactions on Circuits and Systems , CAS-25.

Brunel, N. (2000). Dynamics of sparsely connected networks of excitatory and inhibitory spiking neurons.

Journal of Computational Neuroscience, 8 , 183–208.

PubMed CrossRef Google Scholar Brunel, N., & Hakim, V. (1999). Fast global oscillations in networks of integrate-and-fire neurons with low firing rates.

Neural Computation, 11 , 1621–1671.

PubMed CrossRef Google Scholar Brunel, N., & Latham, P. (2003). Firing rate of noisy quadratic integrate-and-fire neurons.

Neural Computation, 15 , 2281–2306.

PubMed CrossRef Google Scholar Buice, M. A., & Cowan, J. D. (2007). Field theoretic approach to fluctuation effects for neural networks.

Physical Review E, 75 , 051919.

CrossRef Google Scholar Buice, M. A., Cowan, J. D., & Chow, C. C. (2010). Systematic fluctuation expansion for neural network activity equations.

Neural Computation, 22 , 377–426.

PubMed CrossRef Google Scholar Cai, D., Tao, L., Shelley, M., & McLaughlin, D. W. (2004). An effective kinetic representation of fluctuation-driven neuronal networks with application to simple and complex cells in visual cortex.

Proceedings of the National Academy of Sciences, 101 , 7757–7762.

CrossRef Google Scholar Coombes, S., & Owen, M. R. (2005). Bumps, breathers, and waves in a neural network with spike frequency adaptation.

Physical Review Letters 94 , 148102-1–148102-4.

CrossRef Google Scholar Doob, J. L. (1945). Markoff chains–denumerable case.

Transactions of the American Mathematical Society, 58 , 455–473.

Google Scholar Dykman, M. I., Mori, E., Ross, J., & Hunt, P. M. (1994). Large fluctuations and optimal paths in chemical kinetics.

Journal of Chemical Physics, 100 , 5735–5750.

CrossRef Google Scholar El Boustani, S., & Destexhe, A. (2009). A master equation formalism for macroscopic modeling of asynchronous irregular activity states.

Neural Computation, 21 , 46–100.

PubMed CrossRef Google Scholar El Boustani, S., & Destexhe, A. (2010). Brain dynamics at multiple scales: can one reconcile the apparent low-dimensional chaos of macroscopic variables with the seemingly stochastic behavior of single neurons?

International Journal of Bifurcation and Chaos, 20 , 1–16.

CrossRef Google Scholar Ermentrout, B. (1998). Neural networks as spatio-temporal pattern-forming systems.

Reports on Progress in Physics, 61, 353–430.

CrossRef Google Scholar Ermentrout, B. (2002). Simulating, analyzing, and animating dynamical systems: A guide to XPPAUT for researchers and students . Society for Industrial Mathematics.

Ermentrout, G. B., & Cowan, J.D. (1979). A mathematical theory of visual hallucination patterns.

Biological Cybernetics, 34 , 137–150.

PubMed CrossRef Google Scholar Faugeras, O., Touboul, J., & Cessac, B. (2009). A constructive mean field analysis of multi population neural networks with random synaptic weights and stochastic inputs.

Frontiers in Neuroscience, 3 , 1. doi:

10.3389/neuro.10.001.2009.
Google Scholar Freidlin, M. I., & Wentzell, A. D. (1998). Random perturbations of dynamical systems . Springer Verlag.

Gaspard, P. (2002). Correlation time of mesoscopic chemical clocks.

Journal of Chemical Physics, 117 , 8905–8916.

CrossRef Google Scholar Gillespie, D. T. (1976). A general method for numerically simulating the stochastic time evolution of coupled chemical reactions.

Journal of Computational Physics, 22 , 403–434.

CrossRef Google Scholar Gillespie, D. T. (1977). Exact stochastic simulation of coupled chemical reactions.

The Journal of Physical Chemistry, 81 , 2340–2361.

CrossRef Google Scholar Guckenheimer, J., & Holmes, P. J. (1983). Nonlinear oscillations, dynamical systems and bifurcations of vector fields. Applied mathematical sciences (Vol. 42). Springer.

Horsthemke, W., & Lefever, R. (2006). Noise-induced transitions . Springer.

Kurtz, T. G. (1976). Limit theorems and diffusion approximations for density dependent Markov chains.

Mathematical Programming Studies, 5 , 67.

Google Scholar Kuznetsov, Y. A. (1998). Elements of applied bifurcation theory. Applied Mathematical Sciences (2nd ed.). Springer.

Laing, C. L., Troy, W. C., Gutkin, B., & Ermentrout, G. B. (2002). Multiple bumps in a neuronal model of working memory.

SIAM Journal on Applied Mathematics 63 , 62–97.

CrossRef Google Scholar Levina, A., Herrmann, J. M., & Geisel, T. (2009). Phase transitions towards criticality in a neural system with adaptive interactions.

Physical Review Letters, 102 , 118110-1–118110-4.

CrossRef Google Scholar Ly, C., & Tranchina, D. (2007). Critical analysis of dimension reduction by a moment closure method in a population density approach to neural network modeling.

Neural Computation, 19 , 2032–2092.

PubMed CrossRef Google Scholar McKane, A. J., Nagy, J. D., Newman, T. J., & Stefanini, M. O. (2007). Amplified biochemical oscillations in cellular systems.

Journal of Statistical Physics, 71 , 165.

CrossRef Google Scholar Mattia, M., & Del Giudice, P. (2002). Population dynamics of interacting spiking neurons.

Physical Review E, 66 , 51917.

CrossRef Google Scholar Neudecker, H. (1969). Some theorems on matrix differentiation with special reference to kronecker matrix products.

Journal of the American Statistical Association, 64 , 953–963.

CrossRef Google Scholar Ohira, T., & Cowan, J. D. (1993). Master-equation approach to stochastic neurodynamics.

Physical Review E, 48 (3), 2259–2266.

CrossRef Google Scholar Plesser, H. E. (1999). Aspects of signal processing in noisy neurons . PhD thesis, Georg-August-Universität.

Rodriguez, R., & Tuckwell, H. C. (1996). A dynamical system for the approximate moments of nonlinear stochastic models of spiking neurons and networks.

Mathematical and Computer Modeling, 31 , 175–180.

CrossRef Google Scholar Rodriguez, R., & Tuckwell, H. C. (1998). Noisy spiking neurons and networks: Useful approximations for firing probabilities and global behavior.

Biosystems, 48 , 187–194.

PubMed CrossRef Google Scholar Rolls, E. T., & Deco, G. (2010). The noisy brain: Stochastic dynamics as a principle of brain function . Oxford University Press.

Softky, W. R., & Koch, C. (1993). The highly irregular firing of cortical cells is inconsistent with temporal integration of random epsps.

Journal of Neuroscience, 13 , 334–350.

PubMed Google Scholar Teramae, J., Nakao, H., & Ermentrout, G. B. (2009). Stochastic phase reduction for a general class of noisy limit cycle oscillators.

Physical Review Letters, 102 , 194102.

PubMed CrossRef Google Scholar Touboul, J., & Destexhe, A. (2010). Can power-law scaling and neuronal avalanches arise from stochastic dynamics?

PLoS ONE, 5 , e8982.

CrossRef Google Scholar Touboul, J., & Faugeras, O. (2007). The spikes trains probability distributions: a stochastic calculus approach.

Journal of Physiology, 101 (1–3), 78–98.

PubMed Google Scholar Touboul, J., & Faugeras, O. (2008) First hitting time of double integral processes to curved boundaries.

Advances in Applied Probability, 40 , 501–528.

CrossRef Google Scholar Wainrib, G. (2010). Randomness in neurons: A multiscale probabilistic analysis. PhD thesis, Ecole Polytechnique.

Wilson, H. R., & Cowan, J. D. (1972). Excitatory and inhibitory interactions in localized populations of model neurons.

Biophysical Journal, 12 , 1–24.

PubMed CrossRef Google Scholar Wilson, H. R., & Cowan, J. D. (1973). A mathematical theory of the functional dynamics of cortical and thalamic nervous tissue.

Biological Cybernetics, 13 , 55–80.

Google Scholar © Springer Science+Business Media, LLC 2011

Authors and Affiliations 1. NeuroMathComp Laboratory INRIA/ENS Paris Paris France 2. Department of Mathematics University of Pittsburgh Pittsburgh USA