# Application of input to state stability to reservoir models

- 225 Downloads

## Abstract

Reservoir models play an important role in representing fluxes of matter and energy in ecological systems and are the basis of most models in biogeochemistry. These models are commonly used to study the effects of environmental change on the cycling of biogeochemical elements and to predict potential transitions of ecosystems to alternative states. To study critical regime changes of time-dependent, externally forced biogeochemical systems, we analyze the behavior of reservoir models typical for element cycling (e.g., terrestrial carbon cycle) with respect to time-varying signals by applying the mathematical concept of input to state stability (ISS). In particular, we discuss ISS as a generalization of preceding stability notions for non-autonomous, non-linear reservoir models represented by systems of ordinary differential equations explicitly dependent on time and a time-varying input signal. We also show how ISS enhances existing stability concepts, previously only available for linear time variant (LTV) systems, to a tool applicable also in the non-linear case.

### Keywords

Dynamic stability Biogeochemical models Element cycling Soil organic matter dynamics ISS Non-autonomous systems Time-varying inputs## Introduction

### Overview

*stability*analysis (e.g., Guckenheimer and Holmes (1983) and Strogatz (1994)). There is a long history in the ecological sciences concerning the study and use of stability concepts (e.g., May (1973), Holling (1973), Ludwig et al. (1978), and Pimm (1984)), which has lead to considerable confusion about the meaning of the term “stability” itself (Grimm and Wissel 1997). One particular aspect of this confusion can be traced back to the supposed sharp distinction between the concept of stability and that of resilience, which was introduced more than four decades ago by Holling (1973). While we do not want to discuss the complex history of the notion of resilience here, we do want to point out the possible effect of its original definition unduly narrowing the perceived focus of stability analysis as restricted to autonomous systems close to equilibria only. In a recent review, Meyer (2016) discusses the concept of resilience exclusively in the light of autonomous systems. In fact, most of the mathematical tools that have previously been used to study stability in ecological systems rely heavily on restrictions imposed by the assumption of an autonomous system. This raises the following question: Do ecologically meaningful stability concepts even exist if the system is

- 1.
*Non*-autonomous, i.e., explicitly dependent on time - 2.
*Not*in equilibrium, because*continually*disturbed by a time-dependent driving signal**u**(*t*):where$$ \dot{\mathbf{x}} =\mathbf{h}(t,\mathbf{x},\mathbf{u}(t)), $$(1)**x**describes the state of the system and \(\dot {\mathbf {x}}\) its derivative with respect to time expressed by the vector valued function**h**of time*t*, state**x**, and a driving signal**u**(*t*).

*i*th component of

**x**will usually denote the content of pool

*i*. In particular, we will show the following: (a) why a tool able to deal with conditions 1 and 2 is not only useful but essential for many ecological models, (b) what kind of behavior the ISS systems exhibit, (c) how the ISS property can be proved for a non-linear example system, and (d) how ISS naturally generalizes stability notions previously used in ecology for both autonomous non-linear and linear time-varying systems, thereby revealing a large number of implicit applications.

ISS is not the only concept in this area. Alternatives include the mathematically more general theory of non-autonomous systems (Kloeden and Rasmussen 2011) and much more concrete examples and applications like the “compost bomb” (Wieczorek et al. 2011). Probabilistic approaches have also been proposed (Nolting and Abbott 2016). We will be able to point out some connections after ISS has been properly introduced.

To reach ecologists, we discuss concrete examples in a general way. To satisfy the more mathematically oriented, we underpin these claims by proofs. This dichotomy is reflected in the structure. In the paper, we give an overview and try to draw the bigger picture. Many of the detailed definitions, explanations, and actual technical results substantiating it have been included in the appendices.

### Motivation

**p**is a set of parameters assumed to be fixed (Maynard-Smith 1978; Kot 2001; Cushing et al. 2003; Pastor 2008; Soetaert and Herman 2009). These autonomous systems are a proper subset of dynamical systems, their dynamics consisting solely in their ability to capture the influence of

**x**on its own rate of change \(\dot {\mathbf {x}}\). If one looks now for invariant sets such as fixed points and conditions ensuring their stability, one can do so with respect to the dynamic character of

**x**only. Although stability or existence of invariant sets can be discussed in view of changing parameters (e.g., in bifurcation analysis), the theory of autonomous systems does not provide tools to capture the influence of the time-dependent nature (for instance the speed) of such parameter changes. As a remedy, the parameters

**p**in system (2) are sometimes assumed to change extremely slowly in comparison to

**x**. However, although very useful when appropriate (for instance Ludwig et al. (1978)), this quasi-static approximation can be dangerously misleading and hard to justify beforehand, as the following example shows. The system

**0**which is stable for all \(p\in \mathbb {R}\) since the eigenvalues of

**A**(

*p*), given by \(\lambda _{1,2}=\frac {-1\pm i\sqrt {7}}{4}\), have a negative real part. Nevertheless, the solution for the time-dependent

*p*(

*t*) =

*t*given by

*x*

_{1}(0) = 0), but will instead grow exponentially with time. This extremely unstable behavior would remain for any

*k*in \(p(t)=\frac {t}{k}\). To avoid surprises like this, we have to consider stability notions for explicitly time-dependent systems.

*non*-autonomous dynamical systems:

*check*, that it does not occur. For example, systems of form (6) may still have fixed points, but it is no longer enough to show this for (even arbitrarily chosen) fixed times. On the other hand, we do not always expect fixed points, but are instead interested in how the system responds to a time-dependent driving signal

**p**(

*t*) as suggested by Eq. 5.

**p**(

*t*) as a driving signal

**u**(

*t*) and absorb others in the definition of

**h**in Eq. 1. For instance, in discussing effects of time-dependent environmental variability expressed by temperature

*T*(

*t*), precipitation

*P*(

*t*), and photosynthetic carbon fixation

*F*(

*t*) on the carbon stocks

*C*of an ecosystem, we could choose

**p**(

*t*) in Eq. 5 as

**p**(

*t*) = (

*T*(

*t*),

*P*(

*t*),

*F*(

*t*)). We could treat any single term or any combinations of terms {

*T*,

*P*,

*F*} as a driving signal and represent the others by the explicit

*t*dependency of

**h**. As the perhaps simplest concrete example, imagine a single-pool, linear ecosystem model

*k*(

*T*,

*P*) =

*k*

_{0}

*T*

*P*and some possible choices of

**u**. We can choose a three-dimensional driver, for instance

**u**(

*t*) = (

*F*(

*t*) −

*F*

_{0},

*T*(

*t*) −

*T*

_{0},

*P*(

*t*) −

*P*

_{0}) where

*F*

_{0},

*T*

_{0}, and

*P*

_{0}denote some constants. This implies that

*h*(

**u**,

*t*) =

*h*(

**u**) =

*u*

_{1}+

*F*

_{0}+

*k*

_{0}(

*T*

_{0}+

*u*

_{2})(

*P*

_{0}+

*u*

_{3}) depends on

*t*only through

**u**. We could also choose two-dimensional signals, for instance

**u**(

*t*) = (

*T*(

*t*) −

*T*

_{0},

*P*(

*t*) −

*P*

_{0}) resulting in the explicitly time-dependent

*h*(

**u**,

*t*) =

*F*(

*t*) +

*k*

_{0}(

*u*

_{1}+

*T*

_{0})(

*u*

_{2}+

*P*

_{0}). Of course,

**u**(

*t*) = (

*F*(

*t*) −

*F*

_{0},

*P*(

*t*) −

*P*

_{0}), and

**u**(

*t*) = (

*F*(

*t*) −

*F*

_{0},

*T*−

*T*

_{0}) are also possible as well as one-dimensional definitions like

*u*(

*t*) =

*F*(

*t*) −

*F*

_{0}resulting in

*h*(

*u*,

*t*) =

*u*−

*k*

_{0}

*P*(

*t*)

*T*(

*t*), or

*u*(

*t*) =

*T*(

*t*) −

*T*

_{0}, or

*u*(

*t*) =

*P*(

*t*) −

*P*

_{0}.

Another source for driving signals **u** is uncertainty in some parameter. We will see that the ISS framework does not require smoothness of **u**, which makes it possible to include stochastic signals, which are, like Brownian motion, frequently not smooth.

In ecological reservoir systems, so far only special cases of Eq. 1 have been discussed, with very different concepts. For example, Manzoni et al. (2009), although not concerned with stability directly, applied linear input response theory. In control theory, the linear response approach can be seen as a less general predecessor to ISS for linear time invariant (LTI) systems described by an equation of the form (5) with **f** linear in **x**. Rasmussen et al. (2016) consider stability of linear time-varying systems of form (6), but not with respect to a driving signal.

In contrast to this previous work, we will apply the single concept of ISS, which has become important in non-linear control theory in recent years and has also found its way into models of chemical (Chaves 2005) and biological systems (Chaves et al. 2008). We will use a generalized version for time-varying systems. We also show that ISS seamlessly generalizes concepts of stability for LTI and LTV cases.

### Definition of ISS

In the remainder of this section, we will introduce some necessary nomenclature and show how the traditional stability notions for autonomous and non-autonomous dynamical systems are embedded within ISS. Although we decided to present these notions in Appendix 1, a considerable part of our work has been spent to formulate them in a way that especially accommodates their generalization to ISS.

While our derivation in Appendix 1 has concentrated on versions of stability available for autonomous systems and also applicable in the non-autonomous cases, the following text will present extended notions of stability, where fixed points or invariant sets *cannot* be maintained against the driving signal, but act instead as central locations around which the systems move, with amplitudes controlled by the amplitudes of the driving forces, and to which the systems return when the driving forces disappear. This case is the subject of control theory, where we import the concept of input to state stability from. The great utility of ISS will be demonstrated by showing some examples of the multitude of possible equivalent definitions suitable for different applications.

We divide the presentation into two parts distinguishing between levels of time dependency.

#### Some nomenclature

Let \(\mathbb {R}^{+}\) denote the non-negative real numbers, \(\mathbb {R}^{+^{n}}\) the *n*-dimensional, non-negative orthant, and \( |\mathbf {x}|_{\mathcal {A}}=\inf _{\mathbf {y}\in \mathcal {A}}|\mathbf {x}-\mathbf {y}|\) the distance to a set. The disturbances will be measurable locally bounded maps in the space \(\mathcal {U} ={L^{\infty }}\left ([t_{0},\infty );\mathbb {R}^{m} \right )\) with the supremum norm \(\|\mathbf {u}\|_{t_{0},\infty }=\text {ess sup}_{\tau \in [t_{0},t]}|\mathbf {u}(\tau )| \).

**Definition 1** (Forward complete system)

Let **x**(*t*,**x**_{0},*t*_{0},**u**) denote the trajectory of the system (1) corresponding to the initial condition **x**(*t*_{0}) = **x**_{0} and the input function **u**. This solution is uniquely defined on some maximum interval \([t_{0},T_{t_{0},\mathbf {x}_{0},\mathbf {u}})\). If \(T_{t_{0},\mathbf {x}_{0},\mathbf {u}}=\infty \), system (1) is called forward complete.

**Definition 2** (Invariant set and zero-invariant set)

**x**(

*t*,

**x**

_{0},

*t*

_{0},

**u**) will never leave.

We will see examples where the minimal zero-invariant set consists of a single fixed point, although the *t* dependency of Eq. 1 makes this a rather rare case.

**Definition 3** (\(\mathcal {K}_{\infty }\) and \(\mathcal {KL}\) functions)

A class \(\mathcal {K}\) function is a function \(\alpha : \mathbb {R}^{+} \rightarrow \mathbb {R}^{+}\) that is continuous, is strictly increasing, and satisfies *α*(0) = 0.

In our examples, solutions of system (1) will develop in \(\mathcal {X}= \mathbb {R}^{+^{n}}\) and the invariant sets \(\mathcal {A}\) could sometimes touch the boundaries. Therefore, we give an adapted definition of the interior of a set in \(\mathcal {X}\) (Chaves et al. 2008).

**Definition 4** (Interior of a set \(\mathcal {R}\) in \(\mathcal {X}\))

#### Definitions of ISS where the time dependency is restricted to the input signal **u** only

Let \(\mathcal {X}\) denote the domain in which solutions of Eq. 7 develop. (So, by definition, the set \(\mathcal {X}\) is also invariant.) In many standard applications of ISS, \(\mathcal {X}=\mathbb {R}^{n}\) and \(\mathcal {X}\) is not even mentioned. In these cases, the ISS definitions can focus on the smaller set \(\mathcal {A}\), which conceptually is the essential invariant set. But when the state variables—as in our examples—describe inherently non-negative masses or concentrations, \(\mathcal {X}\) becomes a proper subset of \(\mathbb {R}^{n}\), usually \(\mathcal {X}=\mathbb {R}^{+^{n}}\). Therefore, the following definition gets a bit more cumbersome by explicit reference to \(\mathcal {X}\) and its invariance. Readers yet unfamiliar with ISS are asked not to get distracted by this technical necessity, but to focus on the neighborhood of \(\mathcal {A}\) where the typical ISS behavior can be observed.

**Definition 5** (ISS)

**x**

_{0}, and any input \(\mathbf {u}\in \mathcal {U}\).

*a*,

*b*}≤

*a*+

*b*≤ max{2

*a*,2

*b*}, Eq. 8 can be replaced by

*γ*and

*β*. In words: for an ISS system, the distance of any solution to the set \(\mathcal {A}\) depends monotonically on the original distance of the start value \(|\mathbf {x}_{0}|_{\mathcal {A}}\) and the size of the disturbing input signal \(\left \|\mathbf {u}\right \|_{t_{0},\infty }\), where the influence of the start value decreases with time and vanishes asymptotically, so that the distance will be dominated by the input. Remarkably, ISS combines both influences quantitatively.

How the asymptotic behavior of an ISS system depends on start values and inputs is further enlightened by the “non-linear superposition principle” (Sontag et al. 1996); the influences of start value and disturbing signal are “superimposed” as illustrated in Fig. 1. ISS is equivalent to the combination of the following 0-globally asymptotically stable (0-GAS) and “asymptotic gain” (AG) properties:

**Definition 6** (0-GAS)

System (7) is said to be 0-GAS if the input-free system (**u**(*t*) = **0** for all *t*) is GAS, as defined in Appendix 1 for autonomous systems.

**Definition 7** (Asymptotic gain property AG)

**Theorem 1** (ISS is 0-GAS + AG, Sontag et al. (1996))

*A system is ISS if and only if it is 0-GAS and AG.*

The theorem permits an alternative definition of (global) ISS that is important for showing that ISS naturally encompasses the GAS concept known from the analysis of autonomous systems, and generalizes GAS by incorporation of the AG property, which deals with the inputs.Remarks:

Of course, the requirement of *global* asymptotic stability is not essential and could be weakened in the same way as in Definition 5 to a version appropriate for smaller basins of attraction. (Basin of attraction is defined in Definition 14 in Appendix 1.1..)

The definition can be generalized to greatly extend the class of systems for which ISS theory can be applied (Angeli and Efimov 2015). This generalization is, however, far beyond the scope of the present work.

A third definition of ISS, which is useful in proofs, gives a “dissipation characterization” using ISS Lyapunov functions (Sontag 2008). It transfers the tool of Lyapunov functions, used to prove stability of autonomous systems, to the domain of ISS. We will use a generalized version of it later to prove ISS for one of our examples.

**Definition 8** (Storage function)

A continuous function \(V: \mathbb {R}^{n} \rightarrow \mathbb {R}\) is a storage function if it is positive definite (*V* (**0**) = 0 and *V* (**x**) > 0 for *x*≠**0**) and proper (*V* (**x**) →*∞* as |**x**|→*∞*). Equivalently, V is a storage function if there exist \(\bar{\alpha},\bar{\alpha} \in \mathcal{K}_{\infty}\) such that \(\bar {\alpha }(|\mathbf {x}|)\le V(\mathbf {x}) \le \bar {\alpha }(|\mathbf {x}|)\). When **x** represents compartmental contents, the domain of V is \(\mathbb {R}^{+^{n}}\), but since we sometimes use coordinate transformations, this is not always the case.

**Theorem 2** (Sontag and Wang (1995))

*A system is ISS if and only if it admits a smooth ISS Lyapunov function, where an ISS*

*Lyapunov function for*Eq. 7

*is a smooth storage function*V

*for which there exist functions*\(\gamma , \alpha \in \mathcal {K}_{\infty } \)

*such that the following*

*inequality holds:*

Remarks:

The proof of the sufficiency of the existence of an ISS Lyanpunov function in Sontag and Wang (1995) constructs the comparison functions *β* and *γ* from *V* and its estimates. This is important since *β* and *γ* can be used quantitatively. We will not do this for our examples, but want to point out the reference.

We mention, but do not present, further possibilities to define ISS, for instance the concept of “robust stability.” An excellent overview can be found in Sontag (2008).

#### Definitions where the input signal **u** and the remaining part of the system depend on time

The ISS definitions presented so far successfully capture the influence of a time-dependent driving signal on an otherwise time-independent system. From this viewpoint, the choice of **u**(*t*) in Eq. 7 is limited to functions that capture all time dependencies. This is a severe limitation if we want to choose a “driving signal” with a particular ecological meaning. An example of this situation that will be discussed later is a soil organic matter system driven by the input signal **u**_{OM}(*t*) of the mass of organic matter input, but also by functions dependent on weather conditions that modify decomposition rates such as temperature **u**_{T}(*t*) or moisture **u**_{M}(*t*). If we want to separate the influence of one of these drivers, for instance by choosing **u** = **u**_{OM}, the right-hand side of the ODE will depend on time not only through **u**, but also directly through **h**. This is expressed by the *t* in Eq. 1. The specific form of **h** will be a consequence of our choice of the driving signal **u**. The most general mathematical concept addressing this situation is input to state stability for time-varying systems (tvISS).

**Definition 9** (ISS for time-varying systems)

*t*

_{0}, each initial state

**x**

_{0}, each input function

**u**, and all

*t*≥

*t*

_{0}

ISS for time-varying systems can again be characterized by “dissipation”: a forward complete time-varying system is ISS with respect to \(\mathcal {A}\) if and only if it admits an ISS Lyapunov function *V* with respect to \(\mathcal {A}\).

**Definition 10** (ISS Lyapunov function)

*χ*, and a continuous positive definite function

*α*such that

**Theorem 3** (Edwards et al. (2000) Theorem 1)

*A forward complete time-varying system*(1)*is ISS with respect to*\(\mathcal {A}\)*if and only if it admits a smooth ISS Lyapunov function* V *with respect to*\(\mathcal {A}\)*.**In the case when*\(\mathcal {A}\)*is compact, the completeness assumption is redundant.*

These definitions serve different purposes in the rest of the paper. While the “non-linear superposition” (Theorem 1) and the Lyapunov characterization (Definition 2) are mainly intended to show theoretical connections, the time-varying Lyapunov characterization (Definition 10) will be needed in our most general example application. Definition 5, which is based on a comparison function, and its time-dependent variant (Definition 9) will be useful for the connection to linear time invariant and linear time variant systems, respectively.

### Reservoir models

For the purpose of understanding the examples in this paper, it suffices to interpret all state variables as contents of reservoirs. The interpretation easiest to imagine is content measured in units of mass stored in a reservoir defined by its spatial boundaries. However, reservoirs as well as contents can be much more abstract. The concrete example that motivated the present work is the class of general soil organic matter cycling models described in Sierra and Müller (2015), where the reservoirs are defined by their rates of decomposition rather than their spatial boundaries. It generalizes linear as well as non-linear soil models. Linear examples are as follows: Henin and Dupuis (1945), Henin et al. (1959), Andren and Kätterer (1997), Coleman and Jenkinson (1999), Parton et al. (1987), and Fontaine and Barot (2005). Nonlinear models include the following: Schimel and Weintraub (2003), Sinsabaugh and Follstad Shah (2012), Allison et al. (2010), Zelenev et al. (2000), Wang et al. (2013), and Manzoni and Porporato (2007). Reservoir models also generalize models of the global carbon cycle (Luo and Weng 2011; Rasmussen et al. 2016) and are also commonly used in systems biology (Anderson 2013). It is therefore useful to discuss ISS with respect to this general class of models.

It is also worth mentioning that the ISS theory presented here is in no way limited to models where all state variables describe contents of pools. In particular, ISS permits to discuss systems derived from higher order ODEs, where some of the state variables could still describe reservoir contents. We give a detailed discussion about reservoir models and the property of mass balance in Appendix 2.

## Applications

### A non-linear time-varying soil organic matter decomposition model driven by mass influx

*C*

_{1}and

*C*

_{2}are the carbon contents of two unconnected pools, and the bounded periodic functions

*k*

_{1}and

*k*

_{2}with

*k*

_{i}would be called decomposition rates (Olson 1963).

*I*

_{1}and

*I*

_{2}are mass fluxes to the system. The system can have a fixed point

*u*

_{1}(

*t*) and

*u*

_{2}(

*t*) and get

**I**=

**I**

^{0}+

**u**should be read from right to left:

**u**=

**I**−

**I**

^{0}. For an arbitrary given

**I**(

*t*), the choice of

**I**

^{0}(

*t*) implicitly defines

**u**(

*t*). As a consequence, even the most ideal choice of a reference is not artificial at all. It just defines what we call a disturbance. Inside the ISS framework, it is enough to know its size \(\left \|\mathbf {u}\right \|_{t_{0},\infty }\). For instance, imagine that the fluxes are given as time series data. By subtracting a reference

**I**

^{0}(

*t*), one gets a time series for the perturbations

**u**(

*t*) with respect to the reference. \(\left \|\mathbf {u}\right \|_{t_{0},\infty }\) is just the biggest value of the |

**u**| time series. We could also choose a constant reference input:

**u**=

**0**, but a rectangular invariant set

*k*

_{1}rate systems:

*k*

_{2}rate systems:

- 1.The four plots at the top show the disturbances.
- (a)
The upper left shows the absolute value of two different disturbances in different colors as functions of time. The graphs fit into semi-transparent rectangles. The height of the rectangles is given by the infinity norm of the absolute value of the disturbance and is the only relevant information that the ISS statements will refer to.

- (b)
The lower left and upper right plots show the arbitrarily chosen components of

**u**given by functions of the form*u*_{i}(*t*) =*A*_{i}sin(*ω*_{i}*t*). The height of the*u*_{2}rectangle, and the width of the*u*_{1}rectangle are given by the infinity norm of the absolute value of**u**, which is not the smallest possible upper bound, as the picture shows, since the graphs do not fill the whole height or width the rectangle would allow. - (c)
The lower right plot shows how an upper bound of the infinity norm confines trajectories of disturbances in the \(\vec {u}\)-space to disks. The

*y*-axis is shared with the plot for*u*_{2}to the left and the*x*-axis with the plot for*u*_{1}above. Looking at the confined components, suggestively plotted to the left and on top, one expects the regions for the disturbances in the (*u*_{1},*u*_{2})-plane to be rectangles. While this expectation is correct, it is not used in the ISS definition, which refers to the infinity norm of the*vector***u**.

- (a)
- 2.The next four plots in the middle show the effect of these disturbances on the solutions for the system with a fixed point.
- (a)
The upper left plot shows the absolute value of the deviations of solutions from the fixed point as functions of time. We choose two different start positions (

*C*_{1},*C*_{2}) with different distances to the fixed point \((\bar {C_{1}},\bar {C_{2}})\). For every start position, we compute the undisturbed solution, represented by the black graph, and one for each of the two disturbances represented by the same color as the disturbance influencing it. At the beginning, the influence of the start position is clearly discernible, but as time goes on, this influence decreases, and we can predict the distance of the solution to the fixed point to be bounded by a similar rectangle. For an ISS system, the height of this rectangle is a monotone function*γ*of \(\left \|\mathbf {u}\right \|_{t_{0},\infty }\) with*γ*(0) = 0. We can formulate both statements in the reservoir language of our example: A limited disturbance in the mass fluxes will eventually lead to a limited aberration of the pool contents from the equilibrium value. We can predict the (eventual) aberration of the pool sizes to be smaller for the smaller disturbance. The fact that*γ*(0) = 0 means that our system will converge to its fix point if we do not disturb it. - (b)
The lower left and upper right plots show the effect of the disturbances on the components of

**C**. Since |**C**| has to approach a limited region, so too must its components. We also see again that a tight bound on |**C**| is not necessarily tight on the components. - (c)
The lower right plot shows how an upper bound of the norm confines trajectories in the phase space to disks. The

*y*-axis is shared with the plot for*C*_{2}to the left and the*x*-axis with the plot for*C*_{1}above. Looking at the confined components, one again expects the regions to be rectangles, but since ISS does not make any statements about the components, but about the norm of the whole vector, the rectangles we could construct would again only circumscribe the disks, thereby weakening the statement. Translated into reservoir terms, we can expect the reservoir contents with the blue disturbance of the influx to end up in the blue region of the state space. For the bigger green disturbance, we can expect the solution eventually somewhere in the bigger green disk.

- (a)
- 3.The four plots at the bottom show the effect of these disturbances on the solutions for the system, which no longer has a fixed point, but at least a zero-invariant set.
- (a)
The upper left plot shows the absolute value of the deviations of solutions from the invariant set as functions of time. The plot states the same result as its counterpart for the fixed point. The only difference is that the distance to a point is replaced by the distance to a set. This distance is what ISS is concerned with. Eventually, all solutions will end up in the vicinity of the invariant set regardless of the start value. The smaller the disturbance is, the closer to the set they will be.

- (b)
The lower left and upper right plots show the effect of the disturbances on the components of

**C**. Let us first look at the undisturbed (black) solutions only. In our example, the combination of constant mass influxes to both reservoirs and a time dependent decomposition leads to changing pool contents. The plot suggests that the contents of the reservoirs follow the oscillations of the decomposition, and more importantly, they vary only in a certain range. For this simple example, it is straightforward to show that these ranges can be established. We can show that once an unperturbed solution enters the region defined by the ranges, it will never leave it. The region is invariant. The ISS property does not tell us anything about this region, but about the distances of solutions to it. The big green disturbance leads to a big boundary layer around the invariant set. The smaller blue disturbance leads to solutions ending up in the smaller blue boundary layer. All solutions, regardless of their start values, will eventually end up there. - (c)
The lower right plot shows how an upper bound on the norm of the distance confines trajectories in the phase space. The invariant set is a rectangle due to the fact that in our simple example, the reservoir contents are not coupled. In general, the invariant set can have a different shape; the ISS property just ensures that we will eventually find solutions in an area defined by a distance to the set depending monotonically on the size of the disturbance.

- (a)

*V*is smooth, positive definite, and we can easily choose equal lower and upper limiting functions

*V*leads to the piecewise-defined derivative:

*c*= max{

*c*

_{1},⋯ ,

*c*

_{4}} and \(\alpha (|\mathbf {C}|_{\mathcal {A}})=|\mathbf {C}|_{\mathcal {A}}^{2}\). The proof for the fixed point is implicitly included. In this case, \(\bar {C}^{min}_{i}=\bar {C}^{max}_{i}=\bar {C}_{i}\) and

*k*

*i*

*m*

*i*

*n*=

*k*

*i*

*m*

*a*

*x*. Remarks:

It is interesting to ask what we could learn about the examples by classical stability theory for autonomous systems. The first thing we would have to do is to get rid of the time dependency. But it turns out that the rate of change of the state variables in a quasi-static approximation is comparable to the rate of change of the driving signal and the rate of change of the parameters in the compartmental matrix. Consequently, a quasi-static approximation would be misleading and is therefore not an option.

Another thing one could try is to consider averaging with respect to time. Incidentally, the example encourages this through the periodicity of the driving signal and the parameter changes. Of course, this would not help to find out how much the state variables, the contents of the pools, change with time. To get an idea about the amplitude of such changes, one could try to choose minimal and maximal values for input and decomposition rates and observe the behavior of the resulting systems in the phase plane. For the examples and their extremely regular and periodic parameter changes, the results would not be too misleading. This is, however, not always the case as the simple example in the introduction showed. Resonance effects cannot be taken into account in the autonomous view, but could lead to diverging solutions.

Another question is how one would approach the problem from a non-autonomous perspective. Here the stability of a trajectory is a more natural concept than the stability of a point (Kloeden and Rasmussen 2011). In the compartmental model of the example, we do not expect a fixed point but periodic solutions for periodic inputs, caused for instance by seasonal cycles. We could now interpret the input as a control and the whole system following this control. Instead of treating the whole seasonal variation as deviation, we could consider the deviation from the expected solution under the influence of a given uncertainty in the driving input. An ISS system will stay close to the expected solution. ISS was originally developed in control theory to guarantee that a feedback designed to stabilize a system still does so if the feedback is not completely correct, but exhibits a bounded uncertainty. ISS for time-varying systems has been applied to tracking problems (Tsinias and Karafyllis 1999).

### A non-linear influx controlled compartmental model that is not ISS

*S*according to Michaelis-Menten kinetics:

*V*

^{max}is the maximum rate of the reaction and the Michaelis constant

*K*

_{M}is the substrate concentration at which the reaction rate is \(\frac {1}{2}V^{max}\). For a constant

*I*

^{0}<

*V*

^{max}, the equation has a fixed point

*u*

^{0}>

*V*

^{max}−

*I*

^{0},

*S*would increase beyond all bounds. Remarks:

If additional knowledge of the bounds of \(\|u\|_{t_{0},\infty }\) is available (in this example \(\|u\|_{t_{0},\infty } \le \alpha =\min \{V^{max}-I^{0},I^{0}\} \)), one could make the ISS definition more specific by a condition on the size of \(\|u\|_{t_{0},\infty }\). For practical purposes, it might be enough to show that a system is ISS for \(\|u\|_{t_{0},\infty }<\alpha \). For this simple example, this conditional ISS property could be achieved.

In this case, classical bifurcation analysis with respect to the parameter *I*^{0} representing a constant input shows that the fixed point disappears for *I*^{0} > *V*^{max}, which helps to exclude ISS. However, as we have seen in the introduction, classical methods are not sufficient to establish ISS. Note that ISS is a form of stability denoted as bounded input bounded states (BIBS).

**Definition 11** (BIBS stability)

For autonomous compartmental systems, a necessary and sufficient condition for BIBS is the following (Bastin 1999): Let *q*_{i}(**x**) denote the output flux from pool *i* and \(M={\sum }_{i} x_{i}\) the overall mass of the system. Assume that the input **I**(*t*) is bounded \( 0\le I_{i}(t) \le I_{i}^{max} \; \text { for } {t \ge t_{0}} \; i \in {1,\dots ,n}.\) Assume further that the cumulative outflux \({\sum }_{i} q_{i} \) depends on the cumulative mass *M* in such a way that for any *I*^{max}, we can find a mass *M*^{0} such that \( M(\mathbf {x})>M^{0} \implies {\sum }_{i} q_{i}(\mathbf {x})>I^{max}.\) Then the state **x** is bounded and the simplex \( {\Delta }=\{\mathbf {x} \in \mathbb {R}^{+^{n}}:M(\mathbf {x})\le M^{0} \} \) is an invariant set.

In our case, where *M* = *x* = *S*, and \(\lim _{S \rightarrow \infty } q(S)=V^{max}\), this condition is clearly violated and the output flux cannot compensate inputs *I* > *V*^{max} even if *S* →*∞*. Of course, such systems cannot be ISS.

*I*, we look for a control law

*u*(

*x*) such that the influx is compensated. The most intuitive approach is to make the control proportional and opposite in direction to the misfit of the state, \(u=-k(x-\bar {x})\) with

*k*> 0. We write the equilibrium condition in the following way:

### Linear models

#### Linear time variant models

**x**=

**0**. In control theory, linear models are usually written a little bit more general by allowing a linear transformation of the signal:

**B**=

**1**, we will adopt the more general notation here to allow the reader to use another input signal. One can write the solution of Eq. 17 in the form

**#**

**#**Φ

**#**

**#**, defined by

**#**

**#**Φ

**#**

**#**(

*t*,

*t*

_{0})

**x**(

*t*

_{0}) =

**x**(

*t*), is called the state transition matrix. Most interestingly,

**#**

**#**Φ

**#**

**#**can be derived from the input-free system

**u**. We prove the following simple theorem that connects linear control to ISS. Its importance does not consist in its mathematical depth, but in the connection it establishes to a large class of models that we want to study.

Let ∥⋅∥ denote some matrix norm, for instance the Frobenius norm, induced by the Euclidean vector norm. (Due to the equivalence of norms on \(\mathbb {R}^{n}\), any pair of vector norm and induced matrix norm is possible.)

**Theorem 4**

*(sufficient condition for ISS for linear time-varying systems)*

*The linear system*(17)

*is ISS if it is uniformly asymptotically stable and*

**B**(

*t*)

*is bounded, i.e.,*

*Proof*

Remarks:

Up to now, we have referred to the comparison functions *β* and *γ* in a qualitative way only. The very explicit form they take in the last line of the proof presents the opportunity to point out that they are very useful in a quantitative way too: given the start value and the size of the input they confine solutions at any given time.

Uniform asymptotic stability is stronger than ISS. It follows that if we were concerned with linear systems only, we would not need ISS. We present it here since ISS extends familiar notions of stability to the non-linear case. Considering a given non-linear system, it can also be very useful to find a linear system with a weaker stabilizing feedback that is already sufficient for stability. We will use this reasoning for one of our examples.

In applications, it is easy to check Eq. 20. In the case of influx-controlled systems, **B**(*t*) = **1**.

**#**

**#**Φ

**#**

**#**(

*t*,

*t*

_{0}). This is unfortunately not available in general, but some very useful special cases are related to properties of compartmental systems:

- 1.If
**A**is diagonal, so is**#****#**Φ**#****#**:with$$\begin{array}{@{}rcl@{}} \mathbf{A}(t) &=& \left\{\begin{array}{llll} a_1(t) & 0 & {\cdots} & 0\\ 0 & {\ddots} & {\ddots} & \vdots\\ {\vdots} & {\ddots} & {\ddots} & 0\\ 0 & {\ldots} & 0 & a_{n}(t) \end{array}\right\}\\ &\implies& {\Phi}(t,t_{0})= \left\{\begin{array}{llll} {\Phi}(t,t_{0}) & 0 & {\cdots} & 0\\ 0 & {\ddots} & {\ddots} & \vdots\\ {\vdots} & {\ddots} & {\ddots} & 0\\ 0 & {\cdots} & 0 & {\Phi}_{n}(t,t_{0})\\ \end{array}\right\}, \end{array} $$(21)So for parallel linear models, where all the reservoirs of the model have only connections to the environment via inputs and outputs, but not to other reservoirs, Eq. 19 can be checked component-wise for the elements (22), which is a huge simplification. If, for example, one has \(\min _{t>t_{0}} a(t) < -b <0\), Eq. 19 holds.$$ {\Phi}_i(t,t_0)=e^{{\int}_{t_0}^t a_i(\tau)\;d\tau}. $$(22) - 2.If
**A**is triangular so is**#****#**Φ**#****#**:with \({\Phi }_{i,i}(t,t_{0})=e^{{\int }_{t_{0}}^{t} a_{i,i}(\tau )\;d\tau }\) and Φ$$\begin{array}{@{}rcl@{}} \mathbf{A}(t) &=& \left\{\begin{array}{lllll} a_{1,1}(t) & 0 & {\cdots} & 0\\ {\vdots} & {\ddots} & {\ddots} & \vdots\\ {\vdots} & {\ddots} & & 0\\ a_{n,1}(t) & {\cdots} & {\cdots} & a_{n,n}(t) \end{array}\right\}\implies\\ {\Phi}(t,t_{0})&=& \left\{\begin{array}{llll} {\Phi}_{1,1}(t,t_{0}) & 0 & {\cdots} & 0\\ {\vdots} & {\ddots} & {\ddots} & \vdots\\ {\vdots} & {\ddots} & & 0\\ {\Phi}_{n,1}(t,t_{0}) {\cdots} & {\cdots} & {\Phi}_{n,n}(t,t_{0}) \end{array}\right\}, \end{array} $$_{i,j}(*t*,*t*_{0}) for*j*≠*i*by back-substitution into the ODE. The triangular structure of**A**reflects an ordering of reservoirs where content moves only in the direction of pools with increasing indices. Such an ordering can be achieved, for example, if it is known that energy or mass flows only in one direction, leading to a special (linear) cascade (see “Cascades of ISS systems” section). - 3.If there exists some constant matrix
**M**such that**A**=*a*(*t*)**M**, then**#****#**Φ**#****#**is given as the matrix exponential$$\mathbf{\Phi}(t,t_{0})=e^{\left[{\int}_{t_{0}}^{t} a(\tau)\; d\tau \mathbf{M} \right]}. $$

*a*

_{i,j}(

*t*) of the model. The

*a*

_{i,j}(

*t*) may be under restriction by ecological principles and an upper bound might be derived from the expression for

**#**

**#**Φ

**#**

**#**. Even without the knowledge of

**#**

**#**Φ

**#**

**#**, ecologically implied properties of

**A**can be successfully exploited. A very interesting example has recently been proved in Rasmussen et al. (2016), which requires the following definition to state it.

**Definition 12** (Strict diagonal dominance)

*m*×

*m*matrix

**B**(

*t*) is called strictly diagonally dominant if there exists a

*δ*> 0 such that

- 1.
**B**(*t*)_{i,i}< 0 for all*t*and*i*∈{1,…*m*} - 2.
**B**(*t*)_{i,j}≥ 0 for all*t*and*i*≠*j*∈{1,…*m*} - 3.
\({\sum }_{j=1} ^{m} \mathbf {B}(t)_{i,j}\le -\delta \) for all

*t*and*i*∈{1,…*m*}

**A**is a lower triangular block matrix of strictly diagonally dominant blocks (including the case that

**A**is the only block), then there exist constants

*K*≥ 1 and

*γ*> 0 such that

*j*only depend on

*C*

_{j}instead of the whole vector

**C**, which is always the case for linear systems) with strict diagonal dominance (Mulholland and Keener 1974), where the one block version was used to investigate periodic systems. In Appendix 2.2, we show that assuming strict diagonal dominance is justified for soil organic matter (SOM) decomposition models where microbial activity and respiration never stop in any of the pools.

### Linear time invariant models

*A*is Hurwitz (all eigenvalues have negative real parts), ISS follows. Since Eq. 18 is sufficient, but in the general time-dependent case not necessary, it is interesting to see if we can weaken it for LTI systems. For fixed points, it is well known that this is not the case and it is also necessary that the real parts of all eigenvalues are smaller than zero. If we were only interested in ISS with respect to

*equlibria*, we could close this section by a reference to the original proof and avoid the discussion of zero real part eigenvalues completely. It is however interesting to discover the physical meaning of such eigenvalues for compartmental systems (Definition 17 in Appendix 2). This will enable us to imagine invariant sets larger than equilibria. Furthermore, some textbooks (Braun 1993) (correctly) claim stability of LTI systems for cases of eigenvalues with zero real part. The closer look that we are going to take reveals that the definition of stability used there is not adequate for systems with inputs. Therefore, we discuss reservoir models along two lines.

- 1.Cases of invariant sets, the ISS property can be established for
- (a)
A fixed point

- (b)
A linear subspace of the phase space

- (a)
- 2.Cases of the eigenvector structure (represented by the Jordan normal form (JNF)) of
**A**:- (a)
All eigenvalues {

*λ*_{i}} of**A**have negative real part. - (b)
**A**has no eigenvalues with positive real part, but there are eigenvalues with zero real part.- i.The geometric multiplicity of the eigenvalues with zero real part is equal to their algebraic multiplicity.
- A.
The imaginary part is zero for all eigenvalues where the real part is.

- B.
There are eigenvalues with zero real part and non-zero imaginary part.

- A.
- ii.
The geometric multiplicity of the eigenvalues with zero real part is smaller than their algebraic multiplicity.

- i.
- (c)
There are eigenvalues with positive real part.

- (a)

We start our discussion with the combination 1a 2a. Although the result could have been derived from Sontag (1998b), we state and prove it in the ISS context as

**Theorem 5**

*System*(23)*has the ISS property with respect to a* fixed point (of the input-free system) *if and only if all eigenvalues* {*λ*_{i}}*of***A***have negative real part.**Remark:*

*While we consider***u** = **u**(*t*)*for ISS, we mean the fixed point resulting from***u** = **0***.**Since a variable transformation is always possible, this covers any fixed influx***I**_{0}*.*

*Proof*

⇒ (negative real parts imply ISS)

*λ*as the largest real part:

*λ*= max{

*R*(

*λ*

_{i})} and

*γ*= 1.⇐= (negative real parts are implied by ISS)

To show that negative real parts are also necessary for ISS, we first note that the cases under point 2 form a partition. No other cases are possible. We now have to look at the concrete form of \(\mathbf {e}^{(t-t_{0})\mathbf {A}}\) for each of them. From the discussion above, we know that the cases 2c, 2bii, and 2biB do not occur for compartmental systems. For 2bi, the system has at least one trap and the input-free system can have (infinitely many) fixed points (namely the initial values of the pools in the traps), but the integral term in Eq. 18 does not generally vanish for **u**≠**0**. The restriction of \(\mathbf {e}^{(t-t_{0})\mathbf {A}}\) on the subspace, spanned by the eigenvectors for eigenvalue 0, becomes the identity **1** and even for a constant **u**, \(\lim _{t\rightarrow \infty } {\int }_{t_{0}}^{t} \mathbf {1}\;\mathbf {B}\;\mathbf {u}(\tau ) \; d\tau \) will not exist even though \(\left \|\mathbf {u}\right \|_{t_{0},\infty }\) and **B** are bounded (as in our case where ∥**B**∥ = ∥**1**∥ = 1). □

*I*= 0, stable in the sense of Lyapunov for all start values

*C*

_{0}; but of course unstable (in the sense of both Lyapunov and ISS) for all

*I*(

*t*)≠0 since it is a trap that never releases anything that went into it. Let us extend the system to a parallel two-pool model:

*C*

_{1}axis is a fixed point for the input-free system, but none of them is stable with respect to inputs with

*I*

_{1}(

*t*)≠0. So we do not have any control about the

*C*

_{1}values, but we do know that

*C*

_{2}→ 0 as

*t*→

*∞*. The

*C*

_{1}axis is clearly an invariant set for

*I*

_{2}(

*t*) = 0 and it would be possible to show ISS with respect to this set. To further generalize and connect to the eigenvector properties, now consider this system to be the Jordan normal form of an originally given reservoir system like

### General remarks on non-linear influx controlled systems

We have already seen one example of a compartmental model that is not ISS. This is true for many compartmental systems. Even the subclass of systems governed by mass action kinetics provides a lot of unbounded examples (Angeli 2011). Actually, conservation of mass is not such a severe constraint on its own with respect to stability. Under the heading of “Anything can happen” (Theorem 4 Jacquez and Simon (1993)) show that every bounded autonomous *n*-dimensional system can be mapped to a (*n* + 1)-dimensional compartmental system, which means that anything (ranging from GAS, over several equilibria, limit cycles to divergence and chaos) that can happen in a bounded autonomous system can also happen in compartmental systems. On the other hand, our closer look at (uniformly asymptotically stable) linear systems has revealed their remarkable property of a linear negative control feedback that stabilizes the equilibrium. It is easy to imagine non-linear systems that exhibit a similar or even stronger negative feedback. One can then conjecture that these systems are good candidates for ISS. It is usually much harder to prove this though.

We do not know of any general result guaranteeing ISS for influx controlled non-linear compartmental systems, not even for a subclass.

The question arises if there is some assistance in establishing the desired ISS result for a given system. To find an ISS Lyapunov function for our non-linear example (Eq. 10 et seq.), we conjectured that if we find a Lyapunov function for a linear system that exhibits a weaker feedback towards its invariant set than our non-linear system, then this Lyapunov function might still work for the non-linear case.

Accordingly, we derived the Lyapunov function for the linear system by the textbook procedure described below and then checked that the resulting Lyapunov candidate still worked for our non-linear, non-autonomous system.

To understand the approach for autonomous linear systems, let us first assume that the Lyapunov function can be expressed by a (yet unknown) quadratic form: *V* (**x**) = **x**^{T}**P****x**, where **x** is the deviation from the equilibrium. The derivative of *V* along solutions is then given by \( \dot {V}(\mathbf {x}) = \dot {\mathbf {x}}^{T} \mathbf {P}\mathbf {x}+\mathbf {x}^{T}\mathbf {P} \dot {\mathbf {x}} = \mathbf {x}^{T} \mathbf {A}^{T} \mathbf {P}\mathbf {x}+\mathbf {x}^{T}\mathbf {P} \mathbf {A} \mathbf {x}. \) Next, we observe that a positive definite quadratic form **Q** fulfills **x**^{T}**Q****x** ≤ *α*|**x**|^{2} for some *α* > 0. So if **P** solves the Lyapunov equation **A**^{T}**P** + **P****A** −**Q** = 0, this implies \(\dot {V} =\mathbf {x}^{T} \mathbf {A}^{T} \mathbf {P}\mathbf {x}+\mathbf {x}^{T}\mathbf {P} \mathbf {A} \mathbf {x} =-\mathbf {x}^{T}\mathbf {Q}\mathbf {x} \le -\alpha |\mathbf {x}|^{2} \; \text { for all } \mathbf {x}.\) It is well known that such a **P** can be found for any positive definite **Q** if **A** is a Hurwitz matrix. It is also clear that any arbitrarily chosen positive definite **P** implies a positive definite **Q** with its largest eigenvalue *α* > 0. So we can choose **P** = **1** implying *V* = **x**^{2}. This most simple Lyapunov function will work for every stable LTI system. For non-linear systems, this is not certain, but still possible as proved for our first example. Note that *V* = **x**^{2}, or more generally *V* = **x**^{T}**P****x**, is also smooth, which is essential to prove ISS in contrast to GAS where we do not need this property.

Our example can also be seen as an instance of a more general heuristic approach towards a proof of ISS: One can first attempt to prove 0-GAS by means of a smooth Lyapunov function and and then try to reuse it for ISS.

We are therefore particularly interested in systems for which the construction of Lyapunov functions can be alleviated. An example is given by “port-controlled Hamiltonian systems.” Due to their inherent mass balance, compartmental systems can always be written in this form with the total mass replacing the energy as the storage function. The exact translation can be found in Bastin (1999). The procedure to obtain a Lyapunov function described in Maschke et al. (2000) does, however, not succeed automatically. It fails for our example.

There are several more cases of reservoir systems for which 0-GAS can be proved by exploiting more special properties of the systems. For an overview, we point in particular to Jacquez and Simon (1993) and Bastin (1999) particularly the appendix of the later and the references therein. Unfortunately, the Lyapunov candidates are not always suitable for ISS since they are in many cases not smooth. If they are, one can use them as a starting point and check if they fulfill the additional requirements for an ISS Lyapunov function. Concluding, one can say that proving ISS for non-linear systems is difficult to achieve and will require knowledge of special properties that can be exploited. It would be somewhat misleading if we only presented examples where we know what to do.

However, the difficulty of establishing ISS for bigger subclasses of compartmental models with influxes is also revealing: Although the cumulative mass of a compartmental system is a Lyapunov function for the closed system (without influx), it does not remain one for a system with influx since there are clearly trajectories that at least temporarily increase the overall mass. This underlines that ISS is a different property than mass conservation. The input signal in influx controlled systems is of a different dimension (mass per time) than the conserved property. There is actually the related but fundamentally different concept of *integrated* input to state stability, iISS (Sontag 2008; 1998a), that is natural for the integrated influx. Implicitly, we already drew one conclusion from the iISS property: the conservation of mass we assumed from the start. Influx controlled systems that are ISS have to do more: instead of maintaining a bounded state for a bounded integrated influx (mass), they must be able to cope with just a bounded flux (mass per time). Clearly, not all compartmental systems can do this; some fill up.

The general idea behind the construction of Lyapunov functions is to exploit any conserved property (originally energy). In search of an ISS Lyapunov function, one should therefore also look beyond mass. In modeling and controlling continuous stirred tank reactors, entropy or other thermodynamic potentials are used (see for instance Hoang et al. (2011)). To mention an ecological example, we point to Appendix A4 of Bastin (1999), who studies a special conservative Lotka-Volterra system that is also compartmental.

### Zero deficiency networks driven by changes in reaction rates

Up to now, the driving signal has always been the time-dependent change in the influx of mass. We now present an example where the ISS framework can be used to study the effect of time-dependent temperature changes on flux rates. Instead of constructing an example from scratch, we use the opportunity to introduce a more general result (Chaves 2005), which is based on the theory of zero deficiency networks of chemical reactions (Horn and Jackson 1972; Feinberg 1977; 1987). A detailed explanation for the terms deficiency or zero deficiency can be found in Feinberg (1987). To show that it is a property easily checked and interpreted from an application-centered viewpoint (in this case chemical), we give an abbreviated definition.

A reaction network consists of complexes and reaction arrows between them. Not all complexes need to be connected by reaction arrows. A group of connected complexes is called a linkage class. The trajectories describing the evolution of concentrations of the species in the reactions are geometrically confined by stoichiometry. They can only evolve on the stoichiometric manifold. The dimension of this manifold is given by the number of the linear independent stoichiometric reaction vectors. It can be checked immediately by linear algebra after writing down the composition of the complexes with respect to the species in a matrix. Let *n* denote the number of complexes, *l* the number of linkage classes, and *s* the dimension of the stoichiometric manifold. Then the deficiency *d* of the network is given by *d* = *n* − *s* − *l*.

The stability of the system (in this case ISS) can be predicted by checking this essential chemical criterion. It would be extremely interesting to have such criteria based on physical or in our case even ecological properties of systems. When we started to compare compartmental systems with respect to their stability properties, we hoped that the conservation of mass might be such a property. We have already seen that this is not enough, and proving ISS turns out to be much more difficult. Actually, one needs all the help one can get. The result of Chaves (2005) provides such valuable assistance for a special kind of non-linear non-autonomous compartmental systems based on stoichiometry and therefore has potential for ecological applications. It incorporates mass action and Michaelis-Menten kinetics, which occur in ecological soil models (e.g., Wang et al. (2012) and Manzoni and Porporato (2007)). Its main limitation for reservoir models consists in its dependency on the zero deficiency property, which guarantees the existence of a unique non-boundary equilibrium, but is usually lost for reaction networks with mass influx from outside. While this fact renders a lot of applications more difficult, the result is still very general and potentially helpful as a starting point. All the underlying mathematical results, including the appropriately refined definition of ISS for this application and its proof, are developed in Chaves (2005) and are beyond the scope of this paper. However, the basic introduction we have given so far should make the original paper accessible.

*H*

_{2}

*O*to both sides of the first equation (a dilution), we can combine the two equations. The five species

*C*

_{6}

*H*

_{12}

*O*

_{6},

*O*

_{2},

*C*

*O*

_{2},

*H*

_{2}

*O*,and

*C*

*H*

_{4}form the three complexes

*T*is temperature and

*a*

_{i,j}(

*T*) a temperature-dependent rate. If we assume that

*T*is time dependent, the system becomes non-autonomous. Just looking at the definitions in Feinberg (1987), one finds that there are three complexes. The stoichiometric space of this example is of dimension two, the number of linkage classes is one, and the deficiency is equal to zero. Therefore, Feinberg (1987) ensures that a non-boundary equilibrium exists, while Chaves (2005) proves that it is ISS.

It is worth mentioning that the Lyapunov function used by Chaves (2005) and motivated by Sontag (2001) is related to entropy considerations and very different from the examples encountered so far.

### A non-compartmental multi-stable example

In the introduction, we referred to critical regime changes and showed by a simple example that classical stability analysis (for autonomous systems) cannot guarantee stability with respect to time-dependent perturbations at all. If such a result is required, one has to turn to non-autonomous concepts such as ISS.

Since our examples only had one invariant set, the discussion of regime changes could have used ISS only to exclude the possibility of such critical transitions. In contrast to classical stability, which provides a safeguard against perturbations of the state or (by bifurcation analysis) uncertainty with respect to parameters, ISS also excludes regime changes caused by a bounded external forcing.

We also mentioned that the ISS framework can be used to study systems that are known to exhibit critical transitions and pointed to the work of Chaves et al. (2008), where a local version of ISS is developed and used.

*V*(

*x*) = (

*x*− 1)

^{2}(

*x*+ 1)

^{2}for the

*non-compact*set \(\mathcal {S}\). The three-element set \(\mathcal {S}\) is much more interesting because the three distinct equilibria can now be resolved. Furthermore, the numerical experiment (Fig. 4) suggests that the inner equilibrium 0 which was repelling for small perturbations becomes attractive when the size of the perturbation increases.

This example could be prototypical for an ecosystem that can switch into a high perturbation compensation mode that is not visible as long as the perturbations are small.Remark:

We do not explain this behavior, but only show that it is possible for an ISS system. This is not only a different kind of stability, but also a different kind of regime change not predictable by classical stability analysis. It underlines that non-autonomous systems have to be discussed differently.

### Cascades of ISS systems

An interesting corollary (Chapter 4 Sontag (2008)) is that the cascade of a GAS **x** system with an ISS **z** system is GAS. This recommends ISS as a tool to prove GAS for composite ecosystem models.

## Conclusions and outlook

### What ISS offers

We have seen that the ISS concept provides a notion of stability applicable to the situation we naturally find ourselves in when dealing with ecological dynamical systems: driving variables that change with time and a very limited hope to find the system in equilibrium. While the former requirement can be met by the extensions of concepts like stable fixed points or invariant sets to the realm of non-autonomous systems, the latter ability to describe “stability” for non-equilibrium situations sets it apart from the standard concepts. It makes ISS a flexible enough stability concept to describe the ability of the system to return to a normal mode of operation, a property related to the ecological concept of “resilience,” originally introduced as alternative to stability (Holling 1973).

From a conceptual viewpoint, ISS ensures that a system recovers *eventually*. However, the speed of this recovery will also frequently be interesting for the practical analysis of an ecosystem. Although at a first glance ISS as an asymptotic concept seems to ignore recovery speeds, this interesting information is contained in the specific comparison functions *β* and *γ* necessary for the proof. These functions also provide upper boundaries for possible states of the system. These estimates can be sharpened by a careful construction of minimal *β* and *γ*.

### Relation to Sobolev spaces and stochastic approaches

The fact that the ISS definition does not put limits on how fast the input changes connects it to two other approaches. First, it is clear that there is room for other—in terms of their requirements—weaker concepts that guarantee stability only under more specific conditions about the smoothness of the input. It is not difficult to imagine ecological systems that can handle a certain speed of change, but break if the changes occur too rapidly. The related concept of *D*^{k}*I**S**S*, an extension with respect to Sobolev spaces, has not been discussed here, but can be found, (e.g., in Sontag 2008, section 6) or Angeli et al. (2003).

Second, since ISS does not require that **u** is smooth, it can incorporate signals such as Brownian motion. ISS estimates still hold in the case where **u** represents an uncertainty. In this respect, ISS provides deterministic limits of the results of uncertain stochastic inputs.

In another respect, ISS can be extended to stochastic differential equations (SDEs) in particular to the notion of SISS (Liu et al. 2008) where it generalizes the concept of a solution process bounded in probability in the same way the analytic ISS generalizes GAS. Since the discussion of SDEs and their relations to ISS is technically far beyond the scope of this work, we point to Tsinias (1998) and Liu et al. (2008) for an introduction and many further references.

### ISS for compartmental systems

By supplying a counter example (16), we illustrated that ISS is not an automatic result of natural properties of reservoir systems like mass balance, but rather a quite distinguishing feature of systems robustly stabilized by some additional regulating process or principal. Proving ISS for a given arbitrary compartmental system turned out to be very difficult. Our only successful applications to nontrivial examples are either linear or based on zero deficiency. While the linear models could have been discussed completely without ISS from an operator-centered perspective, ISS provides a mapping of these results into the domain of state space techniques dominating the analysis of non-linear systems. We would not have been able to grasp the concept of “region of stability” in any precise way even for linear systems without ISS. We also showed that ISS cascades can be built from ISS subsystems easily for unidirectional fluxes between them. The chances to prove ISS also increase if one chooses an appropriately (large) invariant set, including cases in which ISS might be shown on a quotient space or for a subset of the model equations.

### Outlook

*I*,

*k*

_{1},

*k*

_{2},

*K*

_{M}> 0 and 0 <

*r*< 1 shows (Wang et al. 2013). It is not covered by any of the stability criteria in Jacquez and Simon (1993) or Bastin (1999) for compartmental systems.

## Notes

### Acknowledgments

Open access funding provided by Max Planck Society. We would like to thank H. Metzler very much for repeated conscientious proofreadings and many helpful comments, regarding the language as well as the mathematical content.

### Compliance with Ethical Standards

### Funding

Funding was provided by the Max Planck Society and the German Research Foundation through its Emmy Noether Program (SI 1953/2–1).

### References

- Allison SD, Wallenstein MD, Bradford MA (2010) Soil-carbon response to warming dependent on microbial physiology. Nat Geosci 3(5):336–340. 10.1038/ngeo846CrossRefGoogle Scholar
- Anderson DH (2013) Compartmental modeling and tracer kinetics, vol 50. Springer Science & Business MediaGoogle Scholar
- Andren O, Kätterer T (1997) ICBM: the introductory carbon balance model for exploration of soil carbon balances. Ecol Appl 7(4):1226–1236CrossRefGoogle Scholar
- Angeli D (2004) An almost global notion of input-to-state stability. IEEE Trans Autom Control 49(6):866–874CrossRefGoogle Scholar
- Angeli D (2011) Boundedness analysis for open chemical reaction networks with mass-action kinetics. Nat Comput 10(2):751–774CrossRefGoogle Scholar
- Angeli D, Efimov D (2015) Characterizations of input-to-state stability for systems with multiple invariant sets. IEEE Transactions on Automatic ControlGoogle Scholar
- Angeli D, Sontag E D, Wang Y (2003) Input-to-state stability with respect to inputs and their derivatives. Int J Robust Nonlinear Control 13(11):1035–1056CrossRefGoogle Scholar
- Bastin G (1999) Issues in modelling and control of mass balance systems. In: Stability and stabilization of nonlinear systems, Springer, pp 53–74Google Scholar
- Beisner B, Haydon D, Cuddington K (2003) Alternative stable states in ecology. Front Ecol Environ 1(7):376–382. https://doi.org/10.1890/1540-9295(2003)001[0376:ASSIE]2.0.CO;2 CrossRefGoogle Scholar
- Braun M (1993) Differential equations and their applications, Texts in applied mathematics, vol 11, fourth edition edn. Springer. https://doi.org/10.1007/978-1-4612-4360-1
- Chaves M (2005) Input-to-state stability of rate-controlled biochemical networks. SIAM J Control Optim 44 (2):704–727CrossRefGoogle Scholar
- Chaves M, Eissing T, Allgöwer F (2008) Bistable biological systems: a characterization through local compact input-to-state stability. IEEE Trans Autom Control 53(Special Issue):87–100CrossRefGoogle Scholar
- Coleman K, Jenkinson D (1999) Rothc-26.3 a model for the turnover of carbon in soil: model description and windows user guide (modified 2008). Tech. rep., IACR RothamstedGoogle Scholar
- Cushing J, Constatino R, Dennis B, Desharnais R, Henson S (2003) Chaos in ecology: experimental nonlinear dynamics. Academic Press theoretical ecology series, Academic Press. https://books.google.de/books?id=pzwIFeFZt6sC
- Edwards H A, Lin Y, Wang Y (2000) On input-to-state stability for time varying nonlinear systems. In: Proceedings of the 39th IEEE conference on decision and control, 2000. IEEE, vol 4, pp 3501–3506Google Scholar
- Feinberg M (1977) Mathematical aspects of mass action kinetics. Chemical reactor theory: a review, pp. 1–78Google Scholar
- Feinberg M (1987) Chemical reaction network structure and the stability of complex isothermal reactors—I. The deficiency zero and deficiency one theorems. Chem Eng Sci 42(10):2229–2268CrossRefGoogle Scholar
- Fontaine S, Barot S (2005) Size and functional diversity of microbe populations control plant persistence and long-term soil carbon accumulation. Ecol Lett 8(10):1075–1087. https://doi.org/10.1111/j.1461-0248.2005.00813.x CrossRefGoogle Scholar
- Grimm V, Wissel C (1997) Babel, or the ecological stability discussions: an inventory and analysis of terminology and a guide for avoiding confusion. Oecologia 109(3):323–334. https://doi.org/10.1007/s004420050090 CrossRefPubMedGoogle Scholar
- Guckenheimer J, Holmes P (1983) Nonlinear oscillations, dynamical systems, and bifurcations of vector fields, Applied mathematical sciences, vol 42. Springer. https://doi.org/10.1007/978-1-4612-1140-2
- Hearon J Z (1953) The kinetics of linear systems with special reference to periodic reactions. Bull Math Biophys 15(2):121–141CrossRefGoogle Scholar
- Hearon J Z (1963) Theorems on linear systems. Ann N Y Acad Sci 108(1):36–68CrossRefPubMedGoogle Scholar
- Henin S, Dupuis M (1945) Essai de bilan de la matière organique du sol. Annales Agronomique 15:17–29Google Scholar
- Henin S, Monnier G, Turc L (1959) Un aspect de la dynamique des matieres organiques du soi. Comptes rendus hebdomadaires des séances de l’Académie des sciences 248(1):138–141Google Scholar
- Hoang H, Couenne F, Jallut C, Le Gorrec Y (2011) The port Hamiltonian approach to modeling and control of continuous stirred tank reactors. J Process Control 21(10):1449–1458CrossRefGoogle Scholar
- Holling C S (1973) Resilience and stability of ecological systems. Annu Rev Ecol Syst 4:1–23CrossRefGoogle Scholar
- Horn F, Jackson R (1972) General mass action kinetics. Arch Ration Mech Anal 47(2):81–116CrossRefGoogle Scholar
- Jacquez J A, Simon C P (1993) Qualitative theory of compartmental systems. Siam Review 35(1):43–79CrossRefGoogle Scholar
- Kloeden P, Rasmussen M (2011) Nonautonomous dynamical systems. American Mathematical SocietyGoogle Scholar
- Kot M (2001) Elements of mathematical ecology. Elements of mathematical ecology. Cambridge University Press, Cambridge. https://books.google.de/books?id=7_IRlnNON7oC CrossRefGoogle Scholar
- Lenton TM, Held H, Kriegler E, Hall JW, Lucht W, Rahmstorf S, Schellnhuber HJ (2008) Tipping elements in the Earth’s climate system. Proceedings of the National Academy of Sciences 105(6):1786–1793. https://doi.org/10.1073/pnas.0705414105. http://www.pnas.org/content/105/6/1786.abstract http://www.pnas.org/content/105/6/1786.abstract, http://www.pnas.org/content/105/6/1786.full.pdf+html CrossRefGoogle Scholar
- Liu S-J, Zhang J-F, Jiang Z-P (2008) A notion of stochastic input-to-state stability and its application to stability of cascaded stochastic nonlinear systems. Acta Math Appl Sin Eng Ser 24(1):141–156CrossRefGoogle Scholar
- Ludwig D, Jones DD, Holling CS (1978) Qualitative analysis of insect outbreak systems: the spruce budworm and forest. J Anim Ecol 47(1):315–332. https://doi.org/10.2307/3939 CrossRefGoogle Scholar
- Luo Y, Weng E (2011) Dynamic disequilibrium of the terrestrial carbon cycle under global change. Trends Ecol Evol 26(2):96–104CrossRefPubMedGoogle Scholar
- Luo Y, Keenan TF, Smith M (2015) Predictability of the terrestrial carbon cycle. Glob Chang Biol 21 (5):1737–1751. https://doi.org/10.1111/gcb.12766 CrossRefPubMedGoogle Scholar
- Manzoni S, Porporato A (2007) A theoretical analysis of nonlinearities and feedbacks in soil carbon and nitrogen cycles. Soil Biol Biochem 39(7):1542–1556. https://doi.org/10.1016/j.soilbio.2007.01.006 CrossRefGoogle Scholar
- Manzoni S, Katul G G, Porporato A (2009) Analysis of soil carbon transit times and age distributions using network theories. J Geophys Res Biogeo 114(G4):g04025. https://doi.org/10.1029/2009JG001070 CrossRefGoogle Scholar
- Maschke B, Ortega R, Van Der Schaft A J (2000) Energy-based Lyapunov functions for forced Hamiltonian systems with dissipation. IEEE Trans Autom Control 45(8):1498–1502CrossRefGoogle Scholar
- May RM (1973) Qualitative stability in model ecosystems. Ecology 54(3):638–641. https://doi.org/10.2307/1935352 CrossRefGoogle Scholar
- Maynard-Smith J (1978) Models in ecology. Cambridge University Press, Cambridge. https://books.google.de/books?id=Jgk4AAAAIAAJ Google Scholar
- Meyer K (2016) A mathematical review of resilience in ecology. Nat Resour Model 29(3):339–352CrossRefGoogle Scholar
- Mulholland RJ, Keener MS (1974) Analysis of linear compartment models for ecosystems. J Theor Biol 44 (1):105–116. https://doi.org/10.1016/S0022-5193(74)80031-7 CrossRefPubMedGoogle Scholar
- Nolting BC, Abbott KC (2016) Balls, cups, and quasi-potentials: quantifying stability in stochastic systems. Ecology 97(4):850–864. https://doi.org/10.1890/15-1047.1 PubMedCentralGoogle Scholar
- Olson J S (1963) Energy storage and the balance of producers and decomposers in ecological systems. Ecology 44(2):322–331CrossRefGoogle Scholar
- Parton WJ, Schimel DS, Cole CV, Ojima DS (1987) Analysis of factors controlling soil organic matter levels in great plains grasslands. Soil Sci Soc Am J 51(5):1173–1179. https://www.soils.org/publications/sssaj/abstracts/51/5/1173 CrossRefGoogle Scholar
- Pastor J (2008) Mathematical ecology of populations and ecosystems. Wiley-Blackwell. https://books.google.de/books?id=PzfkRCN4wegC
- Pimm SL (1984) The complexity and stability of ecosystems. Nature 307(5949):321–326. https://dx.doi.org/10.1038/307321a0 CrossRefGoogle Scholar
- Rasmussen M, Hastings A, Smith MJ, Agusto FB, Chen-Charpentier BM, Hoffman FM, Jiang J, Todd-Brown KEO, Wang Y, Wang YP, Luo Y (2016) Transit times and mean ages for nonautonomous and autonomous compartmental systems. J Math Biol 73:1379–1398. https://doi.org/10.1007/s00285-016-0990-8 CrossRefPubMedPubMedCentralGoogle Scholar
- Raupach MR (2013) The exponential eigenmodes of the carbon-climate system, and their implications for ratios of responses to forcings. Earth Syst Dynam 4(1):31–49. https://doi.org/10.5194/esd-4-31-2013 CrossRefGoogle Scholar
- Scheffer M, Carpenter SR (2003) Catastrophic regime shifts in ecosystems: linking theory to observation. Trends Ecol Evol 18(12):648–656. https://doi.org/10.1016/j.tree.2003.09.002. http://www.sciencedirect.com/science/article/pii/S0169534703002787 CrossRefGoogle Scholar
- Scheffer M, Carpenter S, Foley JA, Folke C, Walker B (2001) Catastrophic shifts in ecosystems. Nature 413(6856):591–596. https://doi.org/10.1038/35098000 CrossRefPubMedGoogle Scholar
- Schimel JP, Weintraub MN (2003) The implications of exoenzyme activity on microbial carbon and nitrogen limitation in soil: a theoretical model. Soil Biol Biochem 35(4):549–563. https://doi.org/10.1016/S0038-0717(03)00015-4 CrossRefGoogle Scholar
- Sierra CA, Müller M (2015) A general mathematical framework for representing soil organic matter dynamics. Ecol Monogr 85(4):505–524. https://doi.org/10.1890/15-0361.1 CrossRefGoogle Scholar
- Sinsabaugh RL, Follstad Shah JJ (2012) Ecoenzymatic stoichiometry and ecological theory. Annual Review of Ecology, Evolution, and Systematics. https://doi.org/10.1146/annurev-ecolsys-071112-124414
- Soetaert K, Herman P (2009) A practical guide to ecological modelling. Springer, Netherlands. https://doi.org/10.1007/978-1-4020-8624-3_1 CrossRefGoogle Scholar
- Sontag E (2008) Input to state stability: basic concepts and results. In: Nistri P, Stefani G (eds) Nonlinear and optimal control theory, Lecture notes in mathematics, vol 1932, Springer Berlin Heidelberg, pp 163–220. https://doi.org/10.1007/978-3-540-77653-6_3
- Sontag E D (1989) Smooth stabilization implies coprime factorization. IEEE Trans Autom Control 34(4):435–443CrossRefGoogle Scholar
- Sontag ED (1998a) Comments on integral variants of ISS. Syst Control Lett 34(1):93–100Google Scholar
- Sontag ED (1998b) Mathematical control theory: deterministic finite dimensional systems, Textbooks in applied mathematics, vol 6, 2nd edn. Springer Science & Business MediaGoogle Scholar
- Sontag ED (2001) Structure and stability of certain chemical networks and applications to the kinetic proofreading model of T-cell receptor signal transduction. IEEE Trans Autom Control 46(7):1028–1047CrossRefGoogle Scholar
- Sontag ED, Wang Y (1995) On characterizations of the input-to-state stability property. Syst Control Lett 24(5):351–359CrossRefGoogle Scholar
- Sontag E D, Wang Y et al (1996) New characterizations of input-to-state stability. IEEE Trans Autom Control 41(9):1283–1294CrossRefGoogle Scholar
- Strogatz SH (1994) Nonlinear dynamics and chaos: with applications to physics, biology, chemistry, and engineering. Perseus publishingGoogle Scholar
- Tsinias J (1998) Stochastic input-to-state stability and applications to global feedback stabilization. Int J Control 71(5):907–930CrossRefGoogle Scholar
- Tsinias J, Karafyllis I (1999) ISS property for time-varying systems and application to partial-static feedback stabilization and asymptotic tracking. IEEE Trans Autom Control 44(11):2179–2184CrossRefGoogle Scholar
- Wang G, Post WM, Mayes MA (2012) Development of microbial-enzyme-mediated decomposition model parameters through steady-state and dynamic analyses. Ecol Appl 23(1):255–272. https://doi.org/10.1890/12-0681.1 CrossRefGoogle Scholar
- Wang G, Post WM, Mayes MA (2013) Development of microbial-enzyme-mediated decomposition model parameters through steady-state and dynamic analyses. Ecol Appl 23(1):255–272 . https://doi.org/10.1890/12-0681.1 CrossRefPubMedGoogle Scholar
- Wieczorek S, Ashwin P, Luke CM, Cox PM (2011) Excitability in ramped systems: the compost-bomb instability. Proceedings of the Royal Society of London A: Mathematical, Physical and Engineering Sciences 467 (2129):1243–1269. https://doi.org/10.1098/rspa.2010.0485. http://rspa.royalsocietypublishing.org/content/467/2129/1243, http://rspa.royalsocietypublishing.org/content/467/2129/1243.full.pdf CrossRefGoogle Scholar
- Xia J, Luo Y, Wang YP, Hararuk O (2013) Traceable components of terrestrial carbon storage capacity in biogeochemical models. Glob Chang Biol 19(7):2104–2116. https://doi.org/10.1111/gcb.12172 https://doi.org/10.1111/gcb.12172 CrossRefPubMedGoogle Scholar
- Zelenev V, van Bruggen A, Semenov A (2000) BACWAVE, a spatial–temporal model for traveling waves of bacterial populations in response to a moving carbon source in soil. Microb Ecol 40(3):260–272. https://doi.org/10.1007/s002480000029 PubMedGoogle Scholar

## Copyright information

**Open Access**This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.