Journal of Computational Neuroscience

, Volume 31, Issue 3, pp 453–484

Finite-size and correlation-induced effects in mean-field dynamics

Article

Abstract

The brain’s activity is characterized by the interaction of a very large number of neurons that are strongly affected by noise. However, signals often arise at macroscopic scales integrating the effect of many neurons into a reliable pattern of activity. In order to study such large neuronal assemblies, one is often led to derive mean-field limits summarizing the effect of the interaction of a large number of neurons into an effective signal. Classical mean-field approaches consider the evolution of a deterministic variable, the mean activity, thus neglecting the stochastic nature of neural behavior. In this article, we build upon two recent approaches that include correlations and higher order moments in mean-field equations, and study how these stochastic effects influence the solutions of the mean-field equations, both in the limit of an infinite number of neurons and for large yet finite networks. We introduce a new model, the infinite model, which arises from both equations by a rescaling of the variables and, which is invertible for finite-size networks, and hence, provides equivalent equations to those previously derived models. The study of this model allows us to understand qualitative behavior of such large-scale networks. We show that, though the solutions of the deterministic mean-field equation constitute uncorrelated solutions of the new mean-field equations, the stability properties of limit cycles are modified by the presence of correlations, and additional non-trivial behaviors including periodic orbits appear when there were none in the mean field. The origin of all these behaviors is then explored in finite-size networks where interesting mesoscopic scale effects appear. This study leads us to show that the infinite-size system appears as a singular limit of the network equations, and for any finite network, the system will differ from the infinite system.

Keywords

Neural mass equations Dynamical systems Markov process Master equation Moment equations Bifurcations Wilson and Cowan system 

References

  1. Abbott, L. F, & Van Vreeswijk, C. A. (1993). Asynchronous states in networks of pulse-coupled neuron. Physical Review, 48, 1483–1490.PubMedCrossRefGoogle Scholar
  2. Amari, S. (1972). Characteristics of random nets of analog neuron-like elements. Syst. Man Cybernet., SMC-2.Google Scholar
  3. Amari, S.-I. (1977). Dynamics of pattern formation in lateral-inhibition type neural fields. Biological Cybernetics, 27, 77–87.PubMedCrossRefGoogle Scholar
  4. Amit, D. J., & Brunel, N. (1997). Model of global spontaneous activity and local structured delay activity during delay periods in the cerebral cortex. Cerebral Cortex, 7, 237–252.PubMedCrossRefGoogle Scholar
  5. Arnold, V.I. (1981). Ordinary differential equations (Chap. 5). MIT Press.Google Scholar
  6. Arnold, L. (1995). Random dynamical systems. Springer.Google Scholar
  7. Beggs, J. M., & Plenz, D. (2004). Neuronal avalanches are diverse and precise activity patterns that are stable for many hours in cortical slice cultures. Journal of Neuroscience, 24, 5216–5229.PubMedCrossRefGoogle Scholar
  8. Benayoun, M., Cowan, J. D., van Drongelen, W., & Wallace, E. (2010). Avalanches in a stochastic model of spiking neurons. PLoS Computational Biology, 6(7), e1000846. doi:10.1371/journal.pcbi.1000846.PubMedCrossRefGoogle Scholar
  9. Boland, R. P., Galla, T., & McKane, A. J. (2008). How limit cycles and quasi-cycles are related in systems with intrinsic noise. Journal of Statistical Mechanics: Theory and Experiment, 9, P09001.CrossRefGoogle Scholar
  10. Bressfloff, P. (2010). Stochastic neural field theory and the system-size expansion. SIAM Journal on Applied Mathematics, 70, 1488–1521.CrossRefGoogle Scholar
  11. Bressfloff, P. (2010). Metastable states and quasicycles in a stochastic Wilson–Cowan model. Physical Review E, 82, 051903.CrossRefGoogle Scholar
  12. Brewer, J. (1978). Kronecker products and matrix calculus in system theory. IEEE Transactions on Circuits and Systems, CAS-25.Google Scholar
  13. Brunel, N. (2000). Dynamics of sparsely connected networks of excitatory and inhibitory spiking neurons. Journal of Computational Neuroscience, 8, 183–208.PubMedCrossRefGoogle Scholar
  14. Brunel, N., & Hakim, V. (1999). Fast global oscillations in networks of integrate-and-fire neurons with low firing rates. Neural Computation, 11, 1621–1671.PubMedCrossRefGoogle Scholar
  15. Brunel, N., & Latham, P. (2003). Firing rate of noisy quadratic integrate-and-fire neurons. Neural Computation, 15, 2281–2306.PubMedCrossRefGoogle Scholar
  16. Buice, M. A., & Cowan, J. D. (2007). Field theoretic approach to fluctuation effects for neural networks. Physical Review E, 75, 051919.CrossRefGoogle Scholar
  17. Buice, M. A., Cowan, J. D., & Chow, C. C. (2010). Systematic fluctuation expansion for neural network activity equations. Neural Computation, 22, 377–426.PubMedCrossRefGoogle Scholar
  18. Cai, D., Tao, L., Shelley, M., & McLaughlin, D. W. (2004). An effective kinetic representation of fluctuation-driven neuronal networks with application to simple and complex cells in visual cortex. Proceedings of the National Academy of Sciences, 101, 7757–7762.CrossRefGoogle Scholar
  19. Coombes, S., & Owen, M. R. (2005). Bumps, breathers, and waves in a neural network with spike frequency adaptation. Physical Review Letters 94, 148102-1–148102-4.CrossRefGoogle Scholar
  20. Doob, J. L. (1945). Markoff chains–denumerable case. Transactions of the American Mathematical Society, 58, 455–473.Google Scholar
  21. Dykman, M. I., Mori, E., Ross, J., & Hunt, P. M. (1994). Large fluctuations and optimal paths in chemical kinetics. Journal of Chemical Physics, 100, 5735–5750.CrossRefGoogle Scholar
  22. El Boustani, S., & Destexhe, A. (2009). A master equation formalism for macroscopic modeling of asynchronous irregular activity states. Neural Computation, 21, 46–100.PubMedCrossRefGoogle Scholar
  23. El Boustani, S., & Destexhe, A. (2010). Brain dynamics at multiple scales: can one reconcile the apparent low-dimensional chaos of macroscopic variables with the seemingly stochastic behavior of single neurons? International Journal of Bifurcation and Chaos, 20, 1–16.CrossRefGoogle Scholar
  24. Ermentrout, B. (1998). Neural networks as spatio-temporal pattern-forming systems. Reports on Progress in Physics, 61, 353–430.CrossRefGoogle Scholar
  25. Ermentrout, B. (2002). Simulating, analyzing, and animating dynamical systems: A guide to XPPAUT for researchers and students. Society for Industrial Mathematics.Google Scholar
  26. Ermentrout, G. B., & Cowan, J.D. (1979). A mathematical theory of visual hallucination patterns. Biological Cybernetics, 34, 137–150.PubMedCrossRefGoogle Scholar
  27. Faugeras, O., Touboul, J., & Cessac, B. (2009). A constructive mean field analysis of multi population neural networks with random synaptic weights and stochastic inputs. Frontiers in Neuroscience, 3, 1. doi:10.3389/neuro.10.001.2009. Google Scholar
  28. Freidlin, M. I., & Wentzell, A. D. (1998). Random perturbations of dynamical systems. Springer Verlag.Google Scholar
  29. Gaspard, P. (2002). Correlation time of mesoscopic chemical clocks. Journal of Chemical Physics, 117, 8905–8916.CrossRefGoogle Scholar
  30. Gillespie, D. T. (1976). A general method for numerically simulating the stochastic time evolution of coupled chemical reactions. Journal of Computational Physics, 22, 403–434.CrossRefGoogle Scholar
  31. Gillespie, D. T. (1977). Exact stochastic simulation of coupled chemical reactions. The Journal of Physical Chemistry, 81, 2340–2361.CrossRefGoogle Scholar
  32. Guckenheimer, J., & Holmes, P. J. (1983). Nonlinear oscillations, dynamical systems and bifurcations of vector fields. Applied mathematical sciences (Vol. 42). Springer.Google Scholar
  33. Horsthemke, W., & Lefever, R. (2006). Noise-induced transitions. Springer.Google Scholar
  34. Kurtz, T. G. (1976). Limit theorems and diffusion approximations for density dependent Markov chains. Mathematical Programming Studies, 5, 67.Google Scholar
  35. Kuznetsov, Y. A. (1998). Elements of applied bifurcation theory. Applied Mathematical Sciences (2nd ed.). Springer.Google Scholar
  36. Laing, C. L., Troy, W. C., Gutkin, B., & Ermentrout, G. B. (2002). Multiple bumps in a neuronal model of working memory. SIAM Journal on Applied Mathematics 63, 62–97.CrossRefGoogle Scholar
  37. Levina, A., Herrmann, J. M., & Geisel, T. (2009). Phase transitions towards criticality in a neural system with adaptive interactions. Physical Review Letters, 102, 118110-1–118110-4.CrossRefGoogle Scholar
  38. Ly, C., & Tranchina, D. (2007). Critical analysis of dimension reduction by a moment closure method in a population density approach to neural network modeling. Neural Computation, 19, 2032–2092.PubMedCrossRefGoogle Scholar
  39. McKane, A. J., Nagy, J. D., Newman, T. J., & Stefanini, M. O. (2007). Amplified biochemical oscillations in cellular systems. Journal of Statistical Physics, 71, 165.CrossRefGoogle Scholar
  40. Mattia, M., & Del Giudice, P. (2002). Population dynamics of interacting spiking neurons. Physical Review E, 66, 51917.CrossRefGoogle Scholar
  41. Neudecker, H. (1969). Some theorems on matrix differentiation with special reference to kronecker matrix products. Journal of the American Statistical Association, 64, 953–963.CrossRefGoogle Scholar
  42. Ohira, T., & Cowan, J. D. (1993). Master-equation approach to stochastic neurodynamics. Physical Review E, 48(3), 2259–2266.CrossRefGoogle Scholar
  43. Plesser, H. E. (1999). Aspects of signal processing in noisy neurons. PhD thesis, Georg-August-Universität.Google Scholar
  44. Rodriguez, R., & Tuckwell, H. C. (1996). A dynamical system for the approximate moments of nonlinear stochastic models of spiking neurons and networks. Mathematical and Computer Modeling, 31, 175–180.CrossRefGoogle Scholar
  45. Rodriguez, R., & Tuckwell, H. C. (1998). Noisy spiking neurons and networks: Useful approximations for firing probabilities and global behavior. Biosystems, 48, 187–194.PubMedCrossRefGoogle Scholar
  46. Rolls, E. T., & Deco, G. (2010). The noisy brain: Stochastic dynamics as a principle of brain function. Oxford University Press.Google Scholar
  47. Softky, W. R., & Koch, C. (1993). The highly irregular firing of cortical cells is inconsistent with temporal integration of random epsps. Journal of Neuroscience, 13, 334–350.PubMedGoogle Scholar
  48. Teramae, J., Nakao, H., & Ermentrout, G. B. (2009). Stochastic phase reduction for a general class of noisy limit cycle oscillators. Physical Review Letters, 102, 194102.PubMedCrossRefGoogle Scholar
  49. Touboul, J., & Destexhe, A. (2010). Can power-law scaling and neuronal avalanches arise from stochastic dynamics? PLoS ONE, 5, e8982.CrossRefGoogle Scholar
  50. Touboul, J., & Faugeras, O. (2007). The spikes trains probability distributions: a stochastic calculus approach. Journal of Physiology, 101(1–3), 78–98.PubMedGoogle Scholar
  51. Touboul, J., & Faugeras, O. (2008) First hitting time of double integral processes to curved boundaries. Advances in Applied Probability, 40, 501–528.CrossRefGoogle Scholar
  52. Wainrib, G. (2010). Randomness in neurons: A multiscale probabilistic analysis. PhD thesis, Ecole Polytechnique.Google Scholar
  53. Wilson, H. R., & Cowan, J. D. (1972). Excitatory and inhibitory interactions in localized populations of model neurons. Biophysical Journal, 12, 1–24.PubMedCrossRefGoogle Scholar
  54. Wilson, H. R., & Cowan, J. D. (1973). A mathematical theory of the functional dynamics of cortical and thalamic nervous tissue. Biological Cybernetics, 13, 55–80.Google Scholar

Copyright information

© Springer Science+Business Media, LLC 2011

Authors and Affiliations

  1. 1.NeuroMathComp LaboratoryINRIA/ENS ParisParisFrance
  2. 2.Department of MathematicsUniversity of PittsburghPittsburghUSA

Personalised recommendations