# Impact of sub and supra-threshold adaptation currents in networks of spiking neurons

- First Online:

- Received:
- Revised:
- Accepted:

DOI: 10.1007/s10827-015-0575-3

- Cite this article as:
- Colliaux, D., Yger, P. & Kaneko, K. J Comput Neurosci (2015) 39: 255. doi:10.1007/s10827-015-0575-3

## Abstract

Neuronal adaptation is the intrinsic capacity of the brain to change, by various mechanisms, its dynamical responses as a function of the context. Such a phenomena, widely observed *in vivo* and *in vitro*, is known to be crucial in homeostatic regulation of the activity and gain control. The effects of adaptation have already been studied at the single-cell level, resulting from either voltage or calcium gated channels both activated by the spiking activity and modulating the dynamical responses of the neurons. In this study, by disentangling those effects into a linear (sub-threshold) and a non-linear (supra-threshold) part, we focus on the the functional role of those two distinct components of adaptation onto the neuronal activity at various scales, starting from single-cell responses up to recurrent networks dynamics, and under stationary or non-stationary stimulations. The effects of slow currents on collective dynamics, like modulation of population oscillation and reliability of spike patterns, is quantified for various types of adaptation in sparse recurrent networks.

### Keywords

Adaptation Neuronal dynamics## 1 Introduction

Most neurons in primary sensory areas tend to change the strength of their dynamical responses over time for sustained and constant inputs, in a so-called adaptation process. The detailed mechanisms of this adaptation are still not clearly understood, and can result from various phenomena that might be combined: homeostasis or intracellular mechanisms (Turrigiano and Nelson 2004; Benda and Herz 2003), short term plasticity (Tsodyks et al. 2000), or even network-wide effect originating from lateral connections (Haider et al. 2010). In this paper, we propose to investigate computationally some effects of neuronal adaptation, from both a single-cell and a network point of view. By using a phenomenological model for neurons based on an integrate-and-fire model with intrinsic adaptation and its macroscopic counterparts, we studied the effects of slow adaptation currents on neuronal dynamics at the network level.

Detailed models of intrinsic plasticity as a source of homeostasis and neuronal adaptation have already been investigated. Such biological models are used to explore the biomechanistic effects of slow ionic channels on the microscopic cortical activity of single cells (Benda and Herz 2003; Gigante et al. 2007). On a more phenomenological level, they can be used to study the firing rates dynamics (Treves 1993) or constrain their distribution (Benucci et al. 2013) in macroscopic models of cortical networks. All those models, however, are mostly based on two types of current involved in slow adaptation and related to the flow of potassium and calcium ions through the membrane. The interaction of the adaptation currents with the neuronal dynamics is complex, impacting both the firing threshold and the behaviour of the cell (Benda et al. 2010). On one hand, voltage-gated potassium currents, like Kv1, are activated by a mild depolarization of the membrane potential and control the propagation of spikes by modulating the spike threshold (Higgs and Spain 2011), a phenomena also referred to as accommodation. On the other hand, calcium-gated potassium currents are activated only at high levels of depolarization and result in after-hyper-polarization (AHP), a drop of the membrane potential and long lasting decrease of excitability after a spike is emitted (Andrade 2011). The time scale of these adaptation mechanisms can expand over a wide range up to minutes (Pozzorini et al. 2013) and are very heterogeneously distributed among cells but especially pronounced in pyramidal cells (Nowak et al. 2003).

Combined all together, those two distinct adaptation mechanisms can prevent the saturation in the spike generation process of a neuron or modulate its synchronization properties, both acting in a different manner as shown in previous experimental (Deemyad et al. 2012) or theoretical works (Ermentrout 1998; Ermentrout et al. 2001; Prescott and Sejnowski 2008; La Camera et al. 2004). The voltage-gated sub threshold current shifts the input threshold for triggering spike depending on the basal activity: it can thus be seen as a good mechanism to explain that some response properties of a neuron are independent of the background inputs. It has also been shown to play a role in the homeostasis after sensory deprivation (Nataraj et al. 2010). Conversely, the calcium-gated current triggered by a spike does not only affect the threshold but also increase the dynamic range of the neuronal response and thus avoids saturation. Based on those observations, we will refer to those two different mechanisms of adaptation as a linear or sub-threshold one (voltage-gated channels) versus a non-linear or supra-threshold one (calcium-gated channels). The role of adaptation in enhancing reliability of spike-timing of neurons stimulated with periodic inputs was also studied in Schreiber et al. (2004). Adaptation could also act functionally as a decorrelation machine (Wang 1998).

The dynamics of cortical networks are considerably enriched with adaptation currents, inducing bursting activity, slow oscillations, and homeostasis (Tabak et al. 2000; Giugliano et al. 2004; Gigante et al. 2007). Rhythmic activity of central pattern generators involved in locomotor behaviour (Grillner 1997), or multi-stable dynamics of cortical networks when ambiguous stimulus is presented (Wilson 2003) were related to slow potassium currents. More recently it has been shown that such currents should be included to explain the rich repertoire of ongoing activity observed *in vivo* (Mattia and Sanchez-Vives 2012) and which could be the microscopic substrate of the resting state activity recorded in fMRI (Gusnard and Raichle 2001). It is therefore crucial to have a better understanding of the effect of this adaptation at a single-cell or at a population level.

In this study, we investigated those physiological observations on adaptation in a model of cortical dynamics simple enough, so that large scale simulations can be performed. To do so, we used an adaptive exponential integrate-and-fire neuron model suited for large-scale simulations of cortical networks (Brette and Gerstner 2005) and known to be complex enough to reproduce all the dynamical repertoire recorded *in vitro* in various cell types (Izhikevich 2001; Brette and Gerstner 2005). Indeed, the dynamics of networks of such units have been recently investigated in Ladenbauer et al. (2014) and Farkhooi et al. (2011) and this model have been successful in capturing more diverse dynamics by generating a slow inhibitory feedback, reflecting the fact that neurons tends to adapt when stimulated with a constant inputs. While a classical model would provide a sustained response, models with adaptation will have response closer to what is observed in biological recordings. By studying the sub-threshold (linear) and the supra-threshold (non-linear) effects of the adaptation on single-cell response or in a neuronal network, we were able to disentangle the functional role of those two components on aspects of the neuronal dynamics, like oscillations or the reliability of spike patterns.

## 2 Materials and methods

**Neuron model**

Simulations of the spiking neurons were performed using a custom version of the NEST simulator (Gewaltig and Diesmann 2007) and the PyNN interface (Davison et al. 2008), with a fixed time step of 0.1ms. In all simulations, we use a planar integrate and fire neuron with exponential non-linearity as introduced in Brette and Gerstner (2005). The dynamics of the membrane potential is composed of a capacitive current \(C_{\mathrm {m}} \frac {dV_{\mathrm {m}}(t)}{dt}\) and a leak current −*g*_{L}(*V*_{m}(*t*)−*E*_{L}), with leak conductance *g*_{L} and leak reversal potential *E*_{L}. The ratio *τ*_{m} = *C*_{m}/*g*_{L} gives the relaxation time constant for the membrane voltage. Spikes are generated quasi-instantaneously by active conductances rendered by an exponential non-linearity for the current \(\psi (V_{\mathrm {m}}(t))={\Delta }_{T} e^{\frac {V_{\mathrm {m}}(t)-V_{T}}{{\Delta }_{T}}}\). Thus, a spike is initiated when the membrane potential *V*_{m} goes over *V*_{T} (with *V*_{T} > *E*_{L}). The spike is cut when the voltage reaches *V*_{spike}, the membrane potential is then reset to *V*_{reset}.

*u*, with timescale

*τ*

_{u}, accounts for the effects of adaptation currents resulting from channels with slow dynamics. The coupling parameter

*a*between

*V*

_{m}and

*u*is a linear approximation of hyper-polarizing (

*a*>0) ionic conductances such as those associated with voltage gated potassium channels. Finally,

*u*is increased by an amount

*b*after each spike, which models the effects of highly non-linear conductances such as those associated with calcium gated potassium channels. This results in the following system for (

*V*

_{m},

*u*):

*V*

_{m}are drawn from a distribution uniform in [

*V*

_{rest},

*V*

_{T}].

Parameters of the adaptive exponential and fire neuron used in all the simulations

Name | Value | Units | Description |
---|---|---|---|

| 0.28 | nF | Membrane capacitance |

| 30 | nS | Total leak conductance |

| 5 | ms | Duration of refractory period |

| −50 | mV | Spike initiation threshold |

| −60 | mV | Resting membrane potential |

Δ | 2 | mV | Slope factor |

| 9.33 | ms | Membrane time constant |

| −60 | mV | Reset potential |

a | 100 (E) 0 (I) | nS | adaptation conductance |

b | 1 (E) 0 (I) | nA | Spike-triggered adaptation current |

| 144 | ms | Adaptation time constant |

| (E) 0 (I) −80 | mV | Synaptic reversal potential |

| −40 | mV | Spike threshold |

**Synapses**

*s*∈{

*exc*,

*inh*}) are the times of the incoming spikes, respectively at excitatory and inhibitory synapses. The dynamics

*g*

_{s∈{exc, inh}}(

*t*) after a spike is described by an alpha-function, from Rall synapse model (Bard Ermentrout and Terman 2010), so that the synaptic inputs may be rewritten as the convolution of the spike trains with kernels

*K*

^{s}with \(K^{s}(t)=[t]_{+} e^{-\frac {t}{\tau _{s}}}/\tau _{s}\), [.]

_{+}representing the Heaviside function. If the maximal conductance for a synapse type

*s*is written \({g_{s}^{m}}\), we have \(g_{s}(t)={\sum }_{k}{g_{s}^{m}} K^{s}(t-{t_{k}^{s}})\), with

*k*running over incoming spikes and

*s*∈{

*exc*,

*inh*}. Figure 1 is illustrating all those concepts, in a condensed form. In all the paper, we took

*τ*

_{exc}= 2ms and

*τ*

_{inh}= 3ms for the synaptic time constants.

**Diffusion approximation**

*ν*

_{exc}is controlled by the total effective conductance input \(\mu =g^{m}_{exc}\nu _{\text {exc}}\tau _{\text {exc}}\). The minimum effective conductance input for spike to be triggered, related to the rheobase current, is the one that brings the membrane potential just above its threshold value and it is defined in the following by \(g^{\text {rheo}}=\frac {g_{L}(V_{T}-E_{L})}{V_{T}}\). The deviation of the membrane potential from the diffusion approximation is measured by the Kullback-Leibler divergence between the simulated membrane potential

*P*

_{mc}and a theoretical Gaussian distribution

*P*

_{th}having mean and variance as predicted from the diffusion approximation:

**Adaptation**

In all the manuscript, we consider the sub-threshold or linear part of the adaptation as the one controlled by the *a* parameter in the equation of the adaptive exponential neuron, and the supra-threshold or non-linear part of the adaptation as the one controlled by the *b* parameter. Therefore, a neuron with only linear adaptation is one with *b* = 0, and one with only non-linear adaptation has *a* = 0. Physiological interpretation of these parameters is discussed in the neuron model description.

**Cortical column**

A column is composed of two populations of excitatory and inhibitory neurons connected in a random manner (Erdös-Renyi wiring) with excitatory and inhibitory weights *g*_{exc} and *g*_{inh}, and receiving external input *ν*_{ext} from spike source generated through Poisson processes with weights *g*_{ext}. This is equivalent to a so-called sparse balanced network (Brunel 2000). Neuron parameters are the same as those described in Table 1. A schematic drawing of the column can be found on Fig. 4a. More precisely, the sizes of the populations are *N*_{exc} = 800, *N*_{inh} = 200 and *N*_{ext} = 200 (a classical 4:1 ratio between excitatory and inhibitory cells). Connections among neurons are drawn randomly with probabilities *p*_{AB}, *A* (and *B*) being populations from which input (and output) neurons are selected (*E* for excitatory, *I* for inhibitory, *ext* for external input). In and out degrees of neurons are thus distributed according to a Poisson law with parameter *p*_{AB}*N*_{A}*N*_{B}. In all the simulations, we use a value of *p*_{EE} = *p*_{EI} = 0.05, *p*_{II} = *p*_{IE} = 0.05 and *p*_{ext} = 0.01. Excitatory weights are fixed to *g*_{exc} = 6nS and inhibitory weights are modified through the control parameter *g* defined by *g*_{inh} = *g*.*g*_{exc}. For external connections, we have *g*_{ext} = *g*_{exc}/6. Delays of the connection are all equal to the simulation time step, i.e. 0.1ms.

**Classification of dynamical regimes**

The column is considered to be in a Synchronous regime if the pairwise spike correlations 〈*CC*(0)〉 are over a 0.026 threshold value. Pairwise spike correlations are computed as the mean Pearson correlation coefficient averaged over *N* = 10000 pairs of randomly chosen cells. The area for saturated regime with Synchronous regular dynamics correspond to an average firing rate over 75 Hz and a mean coefficient of variation for the interspike intervals (CV ISI) less than 0.2. Silent regimes correspond to firing rates lower than 0.2 Hz. Regions of the diagram not detected by these criteria are denoted as the Asynchronous Irregular regime.

**Reliability of responses**

The reliability of the response is assessed by considering repeated input spike trains from a population of 2000 neurons connected with probability *p*_{ext} = 0.01 to the excitatory cells of the column. For inputs as homogeneous Poisson process, we consider spike trains with firing rate, *r*_{cst} = 85*Hz* and for inputs as inhomogeneous Poisson processes, the firing rate is modulated by a sine function, *r*_{var} = *f*_{0}+*f*_{1}*cos*(2*πωt*) with *f*_{0} = 100*Hz*, *f*_{1} = 40*Hz* and *ω* = 5*Hz*. The spiking response and the average membrane voltage is recorded for 40 times and measures are averaged on these 40 repetitions of the same input spike trains.

The reliability of the spiking response is monitored by the pairwise spike correlation averaged over pairs of repetitions. To assess the reliability of membrane potentials, we monitor the Coefficient of Variation (CV) of the mean voltage *V*_{c} of excitatory neurons, that is the standard deviation divided by the mean over the 40 repeated trials, and is unitless. The spike and voltage reliability measures are averaged over 10 different inputs and reported with standard deviations for various values of *a* and *b* in Fig. 9.

**Mean field**

*r*

_{E},

*r*

_{I}) averaged over excitatory and inhibitory populations. The evolution equation for the firing rate dynamics is then reduced to the Wilson-Cowan system:

*w*

_{AB}standing for the effective coupling from the sub-population

*A*to the sub-population

*B*(\(w_{AB}=p_{AB}N_{A} N_{B} {g_{A}^{m}}\),

*p*

_{AB}probability of connection from

*A*to

*B*,

*N*

_{A}number of neurons in population

*A*, \({g_{A}^{m}}\) conductance level at a synaptic contact),

*τ*

_{A}the synaptic time constant of the sub-population

*A*mentionned in the neuron model and

*f*

_{A}the firing rate response of sub-population

*A*. The function

*f*

_{A}(

*I*) is the response curve, that is the mean firing rate of neurons in sub-population

*A*when stimulated by incoming inputs

*I*. These response curves and their approximations are discussed in the results Section 3.1. We are using standard numerical methods of bifurcation theory as implemented in the AUTO library with the python interface PyDSTools (Clewley 2012). The local stability analysis for the fixed points of the dynamical system consists in the study of the set of parameters where some eigenvalues of the Jacobian are zero. Further study of the Jacobian are indicative of the type of instability at these points (Kuznetsov 1998). A fold (or saddle-node) bifurcation curve separates regions with one stable fixed point from bistable regions with two stable fixed points separated by an unstable fixed point. Along those curves, the Jacobian has a zero eigenvalue and a stable fixed point and an unstable fixed point annihilate. When an eigenvalue is non-zero but has a zero real part, there is a Hopf bifurcation curve separating a region with one stable fixed point from a region with a limit cycle. On those curves, eigenvalues of the Jacobian are a pair of pure conjugated numbers. If 2 saddle-node branches collide in the parameter plane, the resulting bifurcation point is a so-called cusp. Other bifurcations points are related to Hopf bifurcations when the linear field cancels (Bogdanov-Takens point) or when the quadratic contribution to the vector field cancels (Bautin point). Note that Bautin points separate the part of the Hopf curve where the limit cycle arising has infinitesimal amplitude from the part where it has finite amplitude. Simulations of the stochastic dynamics where implemented in C++ using the Milstein scheme.

## 3 Results

### 3.1 Dynamics of a single neuron without adaptation

*a*of the model (see Section 2), while “non-linear” (or supra-threshold) adaptation is related to the

*b*parameter. To gain a better understanding of the responses, we consider the spiking activity of the neuron without any adaptation (

*a*= 0,

*b*= 0, see Section 2). Without a loss of generality, we can restrict the analysis to the case where only excitatory inputs are impinging the cell (

*ν*

_{inh}= 0). In this case, the average synaptic input onto the cell for filtered Poisson spike train of rate

*ν*

_{exc}with

*ν*

_{exc}

*τ*

_{exc}>>1 can simply be approximated by a Gaussian process of distribution

*G*

_{exc}=

*N*(

*μ*,

*σ*

^{2}) with a mean

*μ*and a variance

*σ*

^{2}(Papoulis 1965; Ricciardi and Sacerdote 1979; Lánský and Lánská 1987; Richardson and Gerstner 2005; Hertäg et al. 2014) (see Section 2 for the synapse model):

The validity of such a diffusion approximation can be checked by computing the Kullback-Leibler divergence (KL, see Section 2) between the theoretical distribution of the synaptic input conductances (*G*_{exc}) and numerical simulations for various values of the maximal conductance \(g^{m}_{\text {exc}}\) and input firing rate *ν*_{exc}, keeping the total mean effective input \(\mu =g^{m}_{\text {exc}} \tau _{\text {exc}} \nu _{\text {exc}}\) constant. In all the numerical simulations, we use the planar adaptive integrate and fire neuron described in Brette and Gerstner (2005) and further studied in Touboul and Brette (2008).

As we can see from Fig. 1b, in absence of adaptation and for our particular model, this diffusion approximation on *G*_{exc} becomes valid for a synaptic time constant of *τ*_{exc} = 2 *ms*., and for input rates of approximately 1000Hz (KL ≃ 0). This can be seen in the insets by the convergence of the conductance distribution toward a Gaussian distribution, while incoming synaptic conductances are shown as black traces. Similarly, the KL-divergence between the empirically measured distribution of the *V*_{m} and a Gaussian distribution having mean *μ*_{V} and variance \({\sigma _{V}^{2}}\) of the real *V*_{m} distribution (dashed line in Fig. 1b) is converging toward zero. The voltage being filtered with a slower timescale (in the order of *τ*_{m}≈10 *ms*, see Section 2), converges faster than for the conductance distribution. Therefore, this diffusion approximation is valid for a neuron receiving input spikes at realistic rate (1–10Hz) from a population as small a 1000 neurons. A reasonable size of a population from which a mean field model can be used is needed to describe its dynamics and to justify the size of the cortical columns we will use in the following.

*ν*

_{exc}in the diffusion limit, i.e for low values of \(g^{m}_{\text {exc}}\) and approximated by a Gaussian process \(\mathcal {N}(\mu , \sigma ^{2})\), individual fluctuations in

*V*

_{m}are small compared to

*V*

_{T}. Therefore, the synaptic current \(I_{\text {exc}}(t)=G_{\text {exc}}(t)(V_{\mathrm {m}}(t)-E^{exc}_{\text {rev}})\) can also be approximated by a Gaussian process with mean \(\hat {\mu } = \mu (V_{T}-E^{exc}_{\text {rev}})\) and variance \(\hat {\sigma }^{2}=\sigma ^{2} (V_{T}-E^{exc}_{\text {rev}})^{2}\) (Destexhe et al. 2001; Richardson and Gerstner 2005). The dynamics for the exponential integrate-and-fire neuron can be summarized by the adaptive integrate-and-fire Ornstein-Uhlenbeck process defined as follows

*η*(

*t*) is drawn from a Gaussian distribution \(\mathcal {N}(0, 1)\).

*g*

^{rheo}, i.e. the minimum conductance input triggering a spike, is a fixed value that can be compared with estimations obtained from numerical simulations. As we can see on Fig. 2a, for low input firing rate

*ν*

_{exc}, the neuron tends to fire spikes at lower values

*h*

^{rheo}of input threshold than the theoretical one but as the input firing rate is increased, the fluctuations in synaptic inputs vanish and the neuron tends to behave as its deterministic limit

*g*

^{rheo}. From Fig. 2a, we conclude that this deterministic limit, reached at around 5000

*Hz*, is more restrictive than the one given by the diffusion approximation alone, but remains valid for the networks considered in the following.

*g*

_{exc}can be studied while maintaining the mean effective input

*μ*=

*g*

_{exc}

*ν*

_{exc}

*τ*

_{exc}constant. When the maximal conductance is close to \(g^{max}_{\text {exc}}\), response is linear at low inputs rates and saturates to the maximal firing rate imposed by the refractory period, with \(\nu _{\text {out}}=\frac {\nu _{\text {exc}}}{1 + \tau _{\text {ref}} \nu _{\text {exc}}}\) (see green curve on Fig. 2b). On the opposite, in the limit of high firing rates,

*ν*

_{exc}≫1/

*τ*

_{exc}, the sub-threshold dynamics is well approximated by the Ornstein-Uhlenbeck process shown above, and it is known Ricciardi and Sacerdote (1979) and Sacerdote and Giraudo (2013) that the mean first passage time is given by

*Erf*is the error function and other parameters are described in the Methods (see Richardson and Gerstner 2005, Ostojic and Brunel 2011 for a fast method to compute this quantity). The firing rate for the adaptive exponential neuron without adaptation is then simply

*ν*

_{out}= 1/(

*τ*

_{ref}+

*T*

_{OU}) (see red curve on Fig. 2b). Note that in the inset of Fig. 2b firing rate response are plotted as a function of

*g*

_{exc}ranging from 0.05 to 50 nS, color-coded. Response behaves linearly for \(g_{exc} \simeq g^{max}_{\text {exc}}\). Interestingly, for values of

*g*

_{exc}in between, response curves cross almost all in the same region around which the response firing rate is not dependent on the size of post-synaptic potential for a given effective input. This could be interesting for networks including heterogeneities of synaptic weights as their output rate would be similar for identical effective input when input rates are scaled appropriately.

### 3.2 Dynamics of a single neuron with adaptation

*τ*

_{u}= 100ms) is slower than timescales involved in spike generation or membrane relaxation (

*τ*

_{m}= 10ms) so for the analysis of response properties it is possible to assume timescale separation (van Vreeswijk and Hansel 2001; Benda and Herz 2003; Ermentrout 1998). Let us first study the effect of linear (sub-threshold) adaptation current on the response to Poisson input spike train. At slow time scale, the fast membrane dynamics can be averaged so that \(\langle (V_{\mathrm {m}}(t)-E_{L})\rangle =\frac {\hat {\mu }}{g_{L}}\) and injecting this value in the dynamics for the adaptation current gives the stationary current \(u=a \frac {\hat {\mu }}{g_{L}}\) resulting in the effective dynamics for

*V*

_{m}(

*t*)

The effect of linear adaptation is thus to reduce the effective input and the firing rate response for all inputs, shifting the response curve. This negative feedback could be useful to tune the threshold depending on the basal level of computation, and a similar mechanism has been shown to enable contrast invariant computations in the visual system (Carandini and Ferster 1997).

If we now consider the non-linear effect of adaptation, we can notice that between two consecutive spikes *t*_{k+1}−*t*_{k} = *T*, a discrete map describes the dynamics of the adaptation current. At each spike time, we have \(u(t) \rightarrow u(t)e^{-T/\tau _{u}} + b\), so that between 0 and T we have \(u(t)=b(1-e^{-t/\tau _{u}})/(1-e^{-T/\tau _{u}})\). For a high firing rate *ν*_{exc} compared to the adaptation time scale *τ*_{u}, the average adaptation current can therefore be estimated as 〈*u*〉=*τ*_{u}*bν*_{exc}. Figure 2b (red curve) showed that for *ν*_{exc} far below saturation, the response curves of the neuron without adaptation behave linearly. In this linear regime of the response, the firing rate can therefore be described with a linear relationship \(\nu _{\text {out}}=k(\hat {\mu }-\hat {\mu }_{c})\), with \(k, \hat {\mu }_{c}\) being constants and \(\hat {\mu }\) the total current to the membrane \(\hat {\mu }=I_{syn}-u\). By replacing *u*(*t*) by its mean value estimated above, we have \(\nu _{\text {out}}= k (I_{syn}-\hat {\mu }_{c})/(1+kb\tau _{u})\), such that the net effect of non-linear adaptation is to change the slope of the response to slow input variations, as also found in Ermentrout (1998) and Benda and Herz (2003).

*a*= 0,

*b*= 0) to a regime with full adaptation (

*a*,

*b*with standard values as defined in Section 2), one with only linear adaptation (

*b*= 0), and one with only non-linear spike frequency adaptation (

*a*= 0). In Fig. 3b, the firing rate responses as functions of the input

*μ*are plotted for those different adaptation conditions. The effect of linear adaptation is a shift in the spike threshold (see Fig. 3b, the fact that when

*b*= 0 (green curve), the curve is rising for higher values of

*μ*compared to the response curve with no adaptation (in red)). Similarly, the effect of non-linear adaptation (

*a*= 0) is equivalent to a change in the slope of the response curve to slow input variations (see blue curve). Schematically, we can fit with a least square fitting procedure those response curves to sigmoidal functions \(f(\nu _{\text {ext}})=1/(1+e^{-\alpha (\nu _{\text {ext}} -\beta )})\) (see Fig. 3c, top) and quantify this behavior.

Using the sigmoidal fits, we study the variation of the thresholds *β* and the gains *α*, as functions of the adaptation parameters of the neuron, *a* and *b*. We can see on Fig. 3c, middle, that the linear adaptation (controlled by *a*) affects mostly the threshold *β* shifting the response curve to the right with higher values of *a* resulting in higher thresholds *β*. This dependence is linear as expected from the analysis via time scales separation. On the other hand, the non-linear adaptation (controlled by the parameter *b*) affects mostly the gain *α* of the sigmoidal response curve by decreasing the slope of the response function, with higher values of *b* resulting in lower *α* (see Fig. 3c, bottom). Again, as expected from former considerations, this dependence is non-linear. The decrease in gain also results in a wider dynamic range. Note that the change in *α* is necessary to keep the rheobase constant so that non-linear adaptation changes both *α* and *β*. We note that having lower gain, the input range for which linear approximation of the response is valid is increased and this can be summarized by stating that the net effect of non-linear adaptation is to linearize the response curve.

### 3.3 Dynamics of a cortical column with adaptation

*in vivo*activity in sensory cortices. More details could be found in the corresponding section of the Section 2. Schematically, the structure of the network is represented in Fig. 4a. Excitatory weights are fixed to

*g*

_{exc}= 6nS and inhibitory weights are modified through the control parameter

*g*such that

*g*

_{inh}=

*g*.

*g*

_{exc}. Note that on Fig. 4a, insets shows the distribution of the indegree for all the different connections.

In Fig. 4b, we show the phase diagram of such a cortical column without any adaptation when the external rate *ν*_{ext} and the balance *g* between excitation and inhibition are varied. We can see that the dynamics of the cortical column can be maintained in an Asynchronous Irregular regime (AI, Section 2 for details on the classification) with low firing rate when external input is small enough, as already found (Brunel 2000). This large region is termed Asynchronous Irregular because neurons are firing irregularly (high coefficient of variation of their inter spikes intervals), and the network’s firing rate displays no clear oscillations. Similarly, we can see in the diagram a Synchronous Regular (SR) or a Synchronous Irregular (SI) regime. It is commonly assumed that the AI regime is a good candidate for describing cortical dynamics observed *in vivo* and it has been identified as the operating point of the brain with transient perturbation leading to amplified response with fast recovery to the resting operating point (Renart et al. 2010; Stimberg et al. 2009). Canonical raster plots of the three main dynamical regimes identified in the phase diagram are shown in Fig. 4c. In such AI regime, when input is increased, the dynamics of the network depends on the dominant polarity of the synaptic current. For an excitation dominated column, increasing input destabilizes the asynchronous irregular state so activity is amplified to a persistent saturated state with all neurons firing at their maximal frequency. For an inhibition dominated network, the destabilization of the irregular state through increased stimulation leads to oscillatory dynamics with neurons firing synchronously.

### 3.4 Mean field description of the cortical column

*r*

_{E},

*r*

_{I}) averaged over homogeneous excitatory and inhibitory neurons. Using a mean field approach, as in Tabak et al. (2000) and Giugliano et al. (2004), the evolution equation for the firing rate dynamics can be reduced to the Wilson-Cowan system:

*β*and the gain

*α*of the response curves, these parameters are taken as bifurcation parameters in Fig. 6 to study the various possible instabilities.

Figure 6 depicts the distributions and the temporal traces of the activity for the excitatory sub population in the system under stochastic perturbation close to various bifurcation points (see Methods for a description of the numerical tools used for bifurcation analysis). Close to saddle-node points, the distribution is bimodal with a bias toward up or down state depending on which side of the bistable region is considered (low or high *α*). Similar bistability is observed between a limit cycle and a fixed point of high, low or moderate level of activity close to the Hopf curve. A prediction of the model is that if sufficient linear adaptation, affecting the threshold parameter *β* in the coarse-grained model, is at work in the excitatory cell dynamics, a column which would be initially oscillatory or bistable would be silenced to a low activity level in an abrupt fashion. The effect of non-linear adaptation, affecting the gain parameter *α*, is more subtle with possible transitions along the vertical axis from bistable regime in the upper cusp to various oscillatory regimes, changes in the oscillatory pattern or transition from oscillation to fixed point.

From Fig. 6 we see that the crossing of the Hopf curve is reached with a reasonable change of the threshold value *β* (related to linear adaptation) whereas a large change in gain *α* (related to nonlinear adaptation) is necessary to escape from the oscillatory region. This is consistent with previous simulations of spiking neurons where we observed that linear adaptation reduces greatly the synchronous irregular region of the diagram (see Fig. 5).

### 3.5 Dynamical response to external stimuli with or without adaptation

#### 3.5.1 Oscillatory dynamics

*a*= 0,

*b*= 0) and adaptation parameters were then varied from this setting. The measures of the activity of the excitatory sub population (firing rate, coefficient of variation of interspike) depending on those parameters are shown on the phase diagrams of Fig. 7a, b, c when the two components

*a*and

*b*of the adaptation are varied. As expected, when linear or non-linear adaptation is increased the mean firing rate activity is decreased but the effects of adaptation is different on the second order statistics for the dynamics at network level. The pairwise spike correlations in the network drop abruptly when linear adaptation is varied (see panel c) whereas much smoother transition is observed when non-linear adaptation is varied. Furthermore, when

*b*is increased, the average firing rate in the column is oscillating at half the period of the original network. We can see on Fig. 7d, e, f examples of the activity in the three canonical regimes: without adaptation, with only linear adaptation (

*b*= 0), or with only non-linear adaptation (

*a*= 0).

*a*, oscillatory fluctuations first decrease in amplitudes and then for higher values of

*a*the column firing rate also decreases. In contrary, with suprathreshold adaptation

*b*, both oscillatory fluctuations, oscillation frequency and mean firing rate of the columns are decreasing simultaneously.

We showed through theoretical arguments that effects of adaptation on the neuronal dynamics may be related to *α* and *β* parameters in the macroscopic model under the diffusion approximation and slow adaptation. The study of the 2 variables macroscopic model is then useful to interpret some aspects of the dynamics like oscillations. There are aspects of changes induced by adaptation which are not discussed in this way because they would go beyond the 2 variables mean field model we consider to discuss qualitative dynamics. For instance chaotic dynamics where found in a macroscopic model including short term plasticity in Cortes et al. (2013).

#### 3.5.2 Reliability of spike patterns

In previous sections, we analyzed the stationary responses of a neuronal network with adaptation, and we distinguished the linear v.s the non-linear part of that mechanism, either with simulations of spiking neurons or with a macroscopic approximation. Now we consider the dynamical responses of the same cortical column, but when stimulated with a Poisson process at constant rate, or with one with rate modulated in a sinusoidal manner (see Methods). For both scenarios, we observed the effect of adaptation on the reproducibility of the responses, when the exact same realization of the input spike patterns were replayed to the exact same network. At each trial, initial conditions of the network were different (see Methods), and to visualize the mean response of the column, we computed and plotted the mean voltage over all *N* neurons within the column, *l*(*t*)=<*V*_{m}(*t*)>_{N}.

To quantify this increase in reliability between trials, we used two measures. The first one is the CV of the mean voltage averaged over all *N*_{e} neurons within the column. We can see on Fig. 9c that this measure is affected similarly by both adaptation currents in the case of the stimulation at constant rate (dashed lines), while it has a minimum at a finite value of nonlinear adaptation current *b* in the case of a temporally varying stimulation (solid green line). For high values of *a*, the CV is almost 0, meaning that the reliability is very high. To rule out the fact that this will depend on the average activity, we also computed the normalized averaged cross-correlation coefficient within trials and among neurons spike trains as described in Methods (see Fig. 9d). On Fig. 9d, we can see similar trends as for the average membrane potential: the normalized correlation coefficient is close to 1 for high values of linear adaptation (red curves) and there is an optimal value of *b* at which maximal reliability is achieved with time-varying input rate.

## 4 Discussion

In this paper, we analyzed the effects of adaptation in the adaptive exponential integrate-and-fire neuron model, distinguishing linear and non-linear mechanisms, related biologically to voltage-gated and calcium-gated channels. Using mathematical observations and comparisons with simulations, we showed how those two distinct components could lead to different changes of the firing rate response curve for this particular neuron model. In single-cell simulations, we found that linear adaptation affects mostly the threshold at which a neuron starts to fire, while non-linear adaptation tends to lower the slope of the response curve. Extending those observations to cortical networks, we studied the role of adaptation onto the dynamics of a cortical column (a so-called random balanced network) with an activity similar to what can be observed *in vivo*. We found that linear adaptation introduces a switch from cortical oscillations to a fixed point of stationary low firing rate while non-linear adaptation preserves cortical oscillations but shifts their frequency to lower values. These are thus two possible ways to modulate synchrony in a neuronal network.

From a functional point of view, we showed that the dynamic range of the response of a cortical column is increased when non linear adaptation currents are included and that there is a shift of the threshold and response to lower values when linear adaptation current is included. These aspects may be important to understand the contrast invariant computations at the neuronal level and predictive aspects of the neuronal response (Deneve 2008; Boerlin et al. 2013). We also demonstrate that when oscillatory dynamics arise in a cortical column, both adaptation currents attenuate these oscillations but in different manners. Our study thus sheds lights on the possible ways to modulate oscillatory dynamics with slow currents which is of crucial interest for cognitive neuroscience (Buzsáki 2010). Moreover, we found that adaptation was also able to greatly increase the reliability of the neuronal responses and as observed *in vitro* (Mainen and Sejnowski 1995) and *in vivo* (Haider et al. 2010), responses are reliable on a trial-to-trial basis. The linear part of the adaptation mechanism used in the integrate-and-fire model considered here was the one mostly involved in this process. Because this linear adaptation is related to voltage-gated channels, we can establish a link between the temporal precision of the responses and the distribution of those channels in neurons. Interestingly, it is known that the repartition of such channels can also be activity-dependent (Lu et al. 2004), so neurons may have mechanisms to adapt their precision as a function of their inputs.

Adaptation is an ubiquitous phenomena in the brain that can spawn multiple time scales: from time constants of several minutes or even hours, it has been shown to be crucial for homeostasis and stability in neuronal network. In this work, we investigated only adaptation mechanisms in the order of hundreds of milliseconds, so relatively close to the membrane time constant. This form of adaptation is known to rely on the kinetics of the voltage or calcium gated channels, and for a more in depth knowledge, see Marder (2012). Therefore, our study focused only on dynamical responses and equilibrium that could be reached within those time scales. Results are observed for random balanced networks with sparse connectivity (Vogels et al. 2005), and it is likely that differences may be found in denser networks, or when the balance between excitatory and inhibitory conductances is reduced (Vreeswijk et al. 1996; Ostojic 2014). All together, unravelling the effect of adaptation in spiking networks is crucial to understand the computation that can be performed by such dynamical systems. Functionally, one could hypothesize that linear (sub-threshold) adaptation, responsible for a shift in the threshold of the response curve is useful to implement contrast invariant responses, while the change in the slope of the response curve induced by non-linear (supra-threshold) adaptation increases the dynamic range of the neuron and softly modulates the oscillatory dynamics. This findings remains to be tested *in vivo*.

## Acknowledgments

This work is supported by the Japan Society for the Promotion of Science. This work is also supported in part by the Platform for Dynamic Approaches to Living System from the Ministry of Education, Culture, Sports, Science, and Technology of Japan. P.Y was supported by the Fondation pour la Recherche Médicale (FRM).

**Conflict of interests**

The authors declare that they have no conflict of interest.

## Funding information

Funder Name | Grant Number | Funding Note |
---|---|---|

Division of Physics | - Japan Society for the Promotion of Science (JP)
| |

Dynamic Approaches to Living System from the Ministry of Education, Culture, Sports, Science, and Technology of Japan | ||

Fondation pour la Recherche Médicale (FR) |

## Copyright information

**Open Access**This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.