Skip to main content
Log in

Bifurcations of large networks of two-dimensional integrate and fire neurons

  • Published:
Journal of Computational Neuroscience Aims and scope Submit manuscript

Abstract

Recently, a class of two-dimensional integrate and fire models has been used to faithfully model spiking neurons. This class includes the Izhikevich model, the adaptive exponential integrate and fire model, and the quartic integrate and fire model. The bifurcation types for the individual neurons have been thoroughly analyzed by Touboul (SIAM J Appl Math 68(4):1045–1079, 2008). However, when the models are coupled together to form networks, the networks can display bifurcations that an uncoupled oscillator cannot. For example, the networks can transition from firing with a constant rate to burst firing. This paper introduces a technique to reduce a full network of this class of neurons to a mean field model, in the form of a system of switching ordinary differential equations. The reduction uses population density methods and a quasi-steady state approximation to arrive at the mean field system. Reduced models are derived for networks with different topologies and different model neurons with biologically derived parameters. The mean field equations are able to qualitatively and quantitatively describe the bifurcations that the full networks display. Extensions and higher order approximations are discussed.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14

Similar content being viewed by others

References

  • Abbott, L.F., & van Vreeswijk, C. (1993). Asynchronous states in networks of pulse-coupled oscillators. Learning and Memory, 48(2), 1483–1490.

    Google Scholar 

  • Apfaltrer, F., Ly, C., Tranchina, D. (2006). Population density methods for stochastic neurons with realistic synaptic kinetics: firing rate dynamics and fast computational methods. Network: Computation in Neural Systems, 17(4), 373–418.

    Article  Google Scholar 

  • di Bernardo, M., Budd, C., Champneys, A., Kowalczyk, P., Nordmark, A., Tost, G., Piiroinen, P. (2008). Bifurcations in non-smooth dynamical systems. SIAM Review, 50(4), 629–701.

    Article  Google Scholar 

  • Brette, R., & Gerstner, W. (2005). Adaptive exponential integrate-and-fire model as an effective description of neuronal activity. Journal of Neurophysiology, 94(5), 3637–3642.

    Article  PubMed  Google Scholar 

  • Casti, A., Omurtag, A., Sornborger, A., Kaplan, E., Knight, B.W., Victor, J., Sirovich, L. (2002). A population study of integrate-and-fire-or-burst neurons. Neural Computation, 14(5), 957–986.

    Article  PubMed  CAS  Google Scholar 

  • Destexhe, A., Mainen, Z., Sejnowski, T. (1998). Kinetic models of synaptic transmission. In C. Koch & I. Segev (Eds.), Methods in neuronal modeling: From synapses to networks (chap. 1). Cambridge, MA: MIT Press.

    Google Scholar 

  • Dhooge, A., Govaerts, W., Kuznetsov, Y.A. (2003). MatCont: a MATLAB package for numerical bifurcation analysis of ODEs. ACM Transactions on Mathematical Software, 29, 141–164.

    Article  Google Scholar 

  • Dur-e-Ahmad, M., Nicola, W., Campbell, S.A., Skinner, F. (2012). Network bursting using experimentally constrained single compartment CA3 hippocampal neuron models with adaptation. Journal of Computational Neuroscience, 33(1), 21–40.

    Article  PubMed  Google Scholar 

  • Ermentrout, G.B., & Terman, D.H. (2010). Mathematical Foundations of Neuroscience. New York, NY: Springer.

    Book  Google Scholar 

  • Fitzhugh, R. (1952). Impulses and phsyiological states in theoretical models of nerve membrane. Biophysical Journal, 1(6), 445–466.

    Article  Google Scholar 

  • Gerstner, W., & Kistler, W. (2002). Spiking Neuron Models. Cambridge, UK: Cambridge University Press.

    Book  Google Scholar 

  • Hines, M.L., Morse, T., Migliore, M., Carnevale, N.T., Shepherd, G.M. (2004). ModelDB: a database to support computational neuroscience. Journal of Computational Neuroscience, 17(1), 7–11.

    Article  PubMed  Google Scholar 

  • Hemond, P., Epstein, D., Boley, A., Migliore, M., Ascoli, G., Jaffe, D. (2008). Distinct classes of pyramidal cells exhibit mutually exclusive firing patterns in hippocampal area CA3b. Hippocampus, 18(4), 411–424.

    Article  PubMed  Google Scholar 

  • Ho, E.C., Zhang, L., Skinner, F.K. (2009). Hippocampus, 19(2), 152–165.

    Article  PubMed  Google Scholar 

  • Izhikevich, E. (2003). Simple model of spiking neurons. Neural Networks, IEEE Transactions, 14(6), 1569–1572.

    Article  CAS  Google Scholar 

  • Knight, B.W. (2000). Dynamics of encoding in neuron populations: some general mathematical features. Neural Computation, 12, 473–518.

    Article  PubMed  CAS  Google Scholar 

  • La, Camera, G., Rauch, A., Luscher, H.R., Senn, W., Fusi, S. (2004). Minimal models of adapted neuronal response to in-vivo like input currents. Neural Computation, 16, 2101–2124.

    Article  PubMed  Google Scholar 

  • La Camera, G., Giugliano, M., Senn, W., Fusi, S. (2008). The response of cortical neurons to in vivo-like input current: theory and experiment. Biological Cybernetics, 99, 279–301.

    Article  PubMed  Google Scholar 

  • Ly, C., & Tranchina, D. (2007). A critical analysis of dimension reduction by a moment closure method in a population density approach to neural network modeling. Neural Computation, 19(8), 2032–2092.

    Article  PubMed  Google Scholar 

  • Markram, H., Toledo-Rodriguez, M., Wang, Y., Gupta, A., Silberberg, G., Wu, C. (2004). Interneurons of the neocortical inhibitory system. Nature Reviews: Neuroscience, 5(10), 793–807.

    Article  PubMed  CAS  Google Scholar 

  • MATLAB (2012). Version 7.10.0 (R2012a). The MathWorks Inc. Massachusetts: Natick.

    Google Scholar 

  • Naud, R., Marcille, N., Clopath, C., Gerstner, W. (2008). Firing patterns in the adaptive exponential integrate-and-fire model. Biological Cybernetics, 99, 335–347.

    Article  PubMed  Google Scholar 

  • Nesse, W., Borisyuk, A., Bressloff, P. (2008). Fluctuation-driven rhythmogenesis in an excitatory neuronal network with slow adaptation. Journal of Computational Neuroscience, 25, 317–333. doi:10.1007/s10827-008-0081-y.

    Article  PubMed  Google Scholar 

  • Nykamp, D., & Tranchina, D. (2000). A population density approach that facilitates large-scale modeling of neural networks: analysis and an application to orientation tuning. Journal of Computational Neuroscience, 8, 19–50.

    Article  PubMed  CAS  Google Scholar 

  • Omurtag, A., Knight, B.W., Sirovich, L. (2000). On the simulation of large populations of neurons. Journal of Computational Neuroscience, 8, 51–63.

    Article  PubMed  CAS  Google Scholar 

  • Sirovich, L., Omurtag, A., Knight, B.W. (2000). Dynamics of neuronal populations: the equilibrium solution. SIAM Journal on Applied Mathematics, 60(6), 2009–2028.

    Article  Google Scholar 

  • Sirovich, L., Omurtag, A., Lubliner, K. (2006). Dynamics of neural populations: stability and synchrony. Network: Computation in Neural Systems, 17, 3–29.

    Article  Google Scholar 

  • Strogatz, S., & Mirollo, R.E. (1991). Stability of incoherence in a population of coupled oscillators. Journal of Statistical Physics, 63, 613–635.

    Article  Google Scholar 

  • Tikhonov, A. (1952). Systems of differential equations containing small parameters in the derivatives (in Russian). Matematicheskii Sbornik (NS), 31(73), 575–586.

    Google Scholar 

  • Touboul, J. (2008). Bifurcation analysis of a general class ofnonlinear integrate-and-fire neurons. SIAM Journal on Applied Mathematics, 68(4), 1045–1079.

    Article  Google Scholar 

  • Treves, A. (1993). Mean-field analysis of neuronal spike dynamics. Network: Computation in Neural Systems, 4(3), 259–284.

    Article  Google Scholar 

  • van Vreeswijk, C. (1996). Partial synchronization in populations of pulse-coupled oscillators. Physical Review E, 54, 5522–5537. doi: 10.1103/PhysRevE.54.5522.

    Article  Google Scholar 

  • van Vreeswijk, C., & Hansel, D. (2001). Patterns of synchrony in neural networks with spike adaptation. Neural Computation, 13(5), 959–992.

    Article  PubMed  Google Scholar 

  • van Vreeswijk, C., Abbott, L.F., Ermentrout, G.B. (1994). When inhibition not excitation synchronizes neural firing. Journal of Computational Neuroscience, 1, 313–321.

    Article  PubMed  Google Scholar 

  • Vladimirski, B.B., Tabak, J., O’Donovan, M.J., Rinzel, J. (2008). Episodic activity in a heterogeneous excitatory network, from spiking neurons to mean field. Journal of Computational Neuroscience, 25, 39–63.

    Article  PubMed  Google Scholar 

  • Wu, Y., Lu, W., Lin, W., Leng, G., Feng, J. (2012). Bifurcations of emergent bursting in a neuronal network. PLoS ONE, 7(6), e38402.

    Article  PubMed  CAS  Google Scholar 

Download references

Acknowledgments

This work benefitted from the support of the Natural Sciences and Engineering Research Council of Canada and the Ontario Graduate Scholarship program. The authors would like to thank F. Skinner for useful discussions. The authors would also like to thank the reviewers for their suggestions which improved the manuscript.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Wilten Nicola.

Additional information

Action Editor: Stefano Fusi

Appendix

Appendix

1.1 Relationship Between the Flux and the Firing Rate

Here we show that in the limit that \(N\rightarrow \infty \), the quantity

$$ j(t) = \frac{1}{N} \sum\limits_{j=1}^N\sum\limits_{t_{j,k}<t}\delta(t-t_{j,k})$$
(81)

converges to the network averaged instantaneous firing rate. We then relate this firing rate to a flux described in Section 2.1. We will think of \(j(t)\) and its limit as distributions.

Note that one needs to be careful in defining a mean or average firing rate, as there are at least three definitions in the literature. See Gerstner and Kistler (2002) for a good discussion of this. To define the appropriate rate for our purposes, we first define the function \(n_{i}(t)\) to be the number of spikes fired by the ith neuron in the time interval \([0,t]\). One can then relate \(j(t)\) to the average of \(\langle n_{i}(t) \rangle \) across the network:

$$\begin{array}{rll}\langle n_{i}(t)\rangle &=& \lim\limits_{N\rightarrow\infty}\frac{1}{N} \sum\limits_{i=1}^N\int_{0}^{t} \sum_{t_{i,k}<t}\delta(x-t_{i,k}) \,dx\\ &=& \lim\limits_{N\rightarrow\infty}\int_{0}^{t} j(x)\,dx. \end{array}$$
(82)

Then we define \(\langle R_{i}(t) \rangle \) as

$$ \langle R_{i}(t)\rangle = \lim\limits_{\Delta t \rightarrow 0}\frac{1}{\Delta t}\lim\limits_{N\rightarrow\infty}\frac{1}{N} \sum\limits_{i=1}^N\frac{n_{i}(t+\Delta t) - n_{i}(t)}{N }.$$
(83)

Thus, the network averaged firing rate in this sense is the limit of the population activity as \(\Delta t \rightarrow 0\). However, rearranging the limits, this may also be written

$$\langle R_{i}(t) \rangle = \lim\limits_{\Delta t\rightarrow 0} \frac{\langle n_{i}(t+\Delta t)\rangle - \langle n_{i}(t)\rangle}{\Delta t} = \frac{d}{dt}\langle n_{i}(t)\rangle.$$
(84)

Thus, in the limit \(N\rightarrow \infty \), we can replace \(j(t)\) in the synaptic coupling equation with \(\langle R_{i}(t)\rangle \).

Now, all that remains is to relate the firing rate to the flux. For the integrate and fire models we are considering, there is a surface \({\mathcal F}=0\) which defines when a neuron has fired. As the flux is a kind of directional flow rate of the proportion of neurons at a particular point in phase space, the firing rate can be computed by integrating the flux vector over this “firing boundary”:

$$\langle R_{i}(t)\rangle = \int_{\mathcal F} \mathbf{J}\cdot \mathbf{n}\ dS,$$

where \(\mathbf {n}\) is the outward normal to the firing boundary. For example, the flux for a system of one dimensional neurons, \(J(v,t)\) is merely the proportion of neurons that flow across the point v in phase space per unit time at time t. Now for a network of linear integrate and fire neurons the firing boundary is the point \(v=v_{t}\) in the v phase space, thus the firing rate is \(J(v_{t},s,t)\), the flux through the threshold. For the class of neurons we are dealing with, however, the firing boundary is given by the line \(v=v_{peak}\) in the \(v,w\) phase space. Thus the surface integral reduces to integrating the v component of the flux, evaluated at \(v=v_{peak}\), over the entire range of w in phase space:

$$\langle R_{i}(t) \rangle = \int_{W} J_V(v_{peak},w,s,t)\,dw.$$
(85)

Rights and permissions

Reprints and permissions

About this article

Cite this article

Nicola, W., Campbell, S.A. Bifurcations of large networks of two-dimensional integrate and fire neurons. J Comput Neurosci 35, 87–108 (2013). https://doi.org/10.1007/s10827-013-0442-z

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10827-013-0442-z

Keywords

Navigation