Abstract
Motivated by recent progress on the port-Hamiltonian formulation of isothermal chemical reaction networks and of the continuous stirred tank reactor, the present paper aims to develop a port-Hamiltonian formulation of chemical reaction networks in the non-isothermal case, and to exploit this for equilibrium and stability analysis.
Similar content being viewed by others
Avoid common mistakes on your manuscript.
1 Introduction
Modeling of chemical reaction networks has attracted much attention in the last decades due to its wide application in systems biology and chemical engineering. Previous work, such as [8, 14, 15], provides the foundation of a structural theory of isothermal chemical reaction networks governed by mass action kinetics. From then on, a series of papers about the modeling and analysis of mass action kinetics chemical reaction networks appeared (see [1, 16, 29, 35]). In most of these papers, the chemical reaction networks are assumed to take place under isothermal condition. Consequently, the influence of in/outflow of heat can not be taken into account. Hence, non-isothermal chemical reaction networks still pose fundamental challenges.
In this paper, we aim to use the port-Hamiltonian framework for the modeling of non-isothermal mass action kinetics chemical reaction networks. Port-Hamiltonian systems theory (PHS) has been intensively employed in the modeling and passivity-based control of electrical, mechanical and electromechanical systems (see [20, 30, 31]).
In [32, 33], a port-Hamiltonian formulation of isothermal mass action kinetics chemical reaction networks was provided. A first step to non-isothermal chemical reaction networks was taken in [36]. Here, based on the previous works [5, 7, 24, 25], a quasi port-Hamiltonian formulation for non-isothermal chemical reaction networks was developed.
The main contributions of the present paper are as follows. First, based on mass and energy balance equations, a port-Hamiltonian formulation for non-isothermal mass action kinetics chemical reaction networks which are detailed-balanced is developed. This formulation directly extends the port-Hamiltonian formulation of isothermal chemical reaction networks of [32, 33], in contrast with the quasi port-Hamiltonian formulation in [36]. It exhibits the energy balance and the thermodynamic principles in an explicit way. Based on the obtained port-Hamiltonian formulation, we provide a thermodynamic analysis of the existence and characterization of thermodynamic equilibria and their asymptotic stability. Being directly related with the energy and entropy functions, this port-Hamiltonian formulation is easily applicable to chemical and biological systems. The second contribution of this paper is the extension of the port-Hamiltonian formulation and the thermodynamic analysis to non-isothermal chemical reaction networks with external ports.
The structure of the paper is as follows. In Sect. 2, some notation will be introduced which will be used in the remainder of the paper. Section 3 surveys the main elements of non-isothermal chemical reaction networks. Section 4 develops the port-Hamiltonian formulation of non-isothermal chemical reaction networks, and shows how this formulation is in line with the main laws of thermodynamics. In Sect. 5, a thermodynamic analysis will be carried out, including the characterization of equilibria and their asymptotic stability. In Sect. 6, an example—a genetic protein synthesis circuit with internal feedback and cell-to-cell communication—is discussed as an illustration of the developed theory. Section 7 extends the previous results to non-isothermal chemical reaction networks with external ports.
2 Notation
\(\mathbb {R}^m\) denotes the space of m-dimensional real vectors, and \(\mathbb {R}^m_+\) the space of m-dimensional real vectors whose entries are all strictly positive. The element-wise natural logarithm \(\mathrm {Ln}:\mathbb {R}^m_+\rightarrow \mathbb {R}^m\), \(x\mapsto \mathrm {Ln}(x)\), is defined as the mapping whose ith component is given as \((\mathrm {Ln}(x))_i := \ln (x_i)\). Similarly, \(\mathrm {Exp}:\mathbb {R}^m_+\rightarrow \mathbb {R}^m\), \(x\mapsto \mathrm {Exp}(x)\), is the mapping whose ith component is given as \((\mathrm {Exp}(x))_i := \exp (x_i)\). Note that \(\mathrm {Exp}(x+z)=\mathrm {Exp}(x)\mathrm {Exp}(z)\), \(\mathrm {Ln}(xz)=\mathrm {Ln}(x)+\mathrm {Ln}(z)\), and \(\mathrm {Ln}(\frac{x}{z})=\mathrm {Ln}(x)-\mathrm {Ln}(z)\), where \(xz\in \mathbb {R}^m\) is the element-wise product \((xz)_i:=x_iz_i\), \(i=1,\dots ,m\), and \(\frac{x}{z}\in \mathbb {R}^m\) is the element-wise quotient \((\frac{x}{z})_i=\frac{x_i}{z_i}\), \(i=1,\dots ,m\). Also, we define the mapping \(\mathrm {Diag}:\mathbb {R}^m\rightarrow \mathbb {R}^{m\times m}\), \(v\mapsto \mathrm {Diag}(v)\), where \(\mathrm {Diag}(v)\) is the diagonal matrix with \((\mathrm {Diag}(v))_{ii}=v_i\). Finally, the \(i\times i\) identity matrix is denoted as \(\mathrm {I}_i\), the \(i\times i\) zero matrix is denoted as \(\mathbf {0}_{i\times i}\), while the \(i\times 1\) zero vector is denoted as \(\mathbf {0}_i\). The notation \(z^{tr}\) is used to denote the transpose of the vector z.
3 The chemical reaction network structure
In this section, we will survey the basic topological structure of chemical reaction networks which will be used in the following sections. Consider a chemical reaction network composed of r reactions, m species and c complexes, given by the following reversible reaction scheme:
with \(\alpha _{ij}\), \(\beta _{ij}\) being stoichiometric coefficients. The graph-theoretic formulation, according to [9, 11, 15], is to consider the chemical complexes defined by the left-hand and the right-hand sides of the chemical reactions, and to associate to each complex a vertex of a graph, while each reaction from left-hand to right-hand complex corresponds to a directed edge.
The concentrations of the species are denoted as \(x_i\), \(i=1,\dots ,m\), and the total vector of concentrations is denoted as \(x=[x_1,\dots ,x_m]^{tr}\). In order to capture the basic conservation laws of the chemical reactions, we define an \(m\times r\) matrix C, known as the stoichiometric matrix, whose (i, j)th element is the signed stoichiometric coefficient of the ith species in the jth reaction. Similarly, to define the connection between the complexes of each chemical reaction, we define an \(m\times c\) matrix Z, called the complex stoichiometric matrix, whose \(\rho \)th column captures the expression of the \(\rho \)th complex in the ith chemical species. Any directed graph is characterized by an \(c\times r\) matrix B, called the incidence matrix, whose (i, j)th element equals to \(-1\) if vertex i is the tail vertex of edge j and 1 if vertex i is the head vertex of edge j , while 0 otherwise. The relation between these three matrices for the graph of complexes is \(C=ZB\).
The dynamics of the chemical reaction network can now be written as
where v is the r-dimensional vector of reaction rates, whose jth element represents the jth reaction rate of the chemical reaction network. Each reaction is considered to be a combination of a forward reaction with forward rate equation and a reverse reaction with reverse rate equation, both given by mass action kinetics. Thus, the reaction rate of the jth reaction can be written as
where \(Z_i\rho \) is the \((i,\rho )\)th element of the complex stoichiometric matrix Z. Here, \(k_{j}^{f}(T)\), \(k_{j}^{b}(T)\) are the forward/backward rate reaction coefficients of the jth reaction defined by the Arrhenius equation ([4])
where \(E_j^f\), \(E_j^b\) are the activation energies, \(k_j^f\) and \(k_j^b\) the forward and backward rate constants, and R is the Boltzmann constant. Using the element-wise natural logarithm \(\mathrm {Ln}(x)\) defined in Sect. 2, the jth element of rate equation vector can be equivalently written as
where \(Z_{S_j}\) and \(Z_{P_j}\) denote the columns of the complex stoichiometry matrix Z corresponding to the substrate complex \(S_j\) and the product complex \(P_j\) of the jth reaction.
4 The standard form of balanced mass action and balanced energy action for non-isothermal chemical reaction networks
In this paper, we will focus on detailed balanced mass action kinetics chemical reaction networks (see [10, 28, 34]). First, we assume that in the chemical reaction network, the equilibration following any reaction event is much faster that any reaction time scale. Thus, all intensive thermodynamic variables are well defined and equal everywhere in the system. Then, we assume that the chemical reaction network is closed and undergoes an adiabatic process. That means there is no heat or mass transfer between the system and external environment. Moreover, the chemical reaction network is isochoric so that the volume change can be neglected, i.e. \(dV=0\).
The definition of thermodynamic equilibrium for isothermal chemical reaction networks, see e.g. [32], is extended to non-isothermal networks as follows.
Definition 4.1
A vector of concentrations \(x^*\) is called an equilibrium for the dynamics \(\dot{x}=Cv(x,T)\) for a certain temperature T if \(Cv(x^*,T)=0\), and a thermodynamic equilibrium if \(v(x^*,T)=0\). A chemical reaction network \(\dot{x}=Cv(x,T)\) is called detailed-balanced if it admits a thermodynamic equilibrium for every temperature T.
In order to stress the dependence on T, the thermodynamical equilibrium will be denoted by \(x^*(T)\). The conditions for existence of a thermodynamic equilibrium will be discussed in Sect. 5.1. Throughout this section we assume that there exists at least one thermodynamic equilibrium, like in the isothermal case, see e.g. [32, 33]. We will use the existence of this thermodynamic equilibrium to develop a port-Hamiltonian formulation.
4.1 Mass balance equations
Let us recall the mass balance equations of a detailed balanced reaction network according to [32]. Let \(x^*(T)\in \mathbb {R}^m_+\) be a thermodynamic equilibrium for a certain temperature T, i.e.,
Then we define the conductance \(\kappa _j(T)\) of the jth reaction as:
Furthermore the reaction rate of the jth chemical reaction (6) can be rewritten as
Now define the \(r\times r\) diagonal matrix of conductances K(T) as
Collecting all the reaction rates in (9) and employing the incidence matrix B defined in Sect. 3, the rate vector of a detailed balanced non-isothermal reaction network can be written as
Hence the dynamics of a detailed balanced mass action kinetics reaction network can be expanded as
where \(\mu =RT\mathrm {Ln}(\frac{x}{x^*(T)})\) is the vector of chemical potentials and \(L:=BK(T)B^{tr}\) is the weighted Laplacian matrix for the reaction network graph, with weights given by the conductances \(\kappa _1(T),\dots ,\kappa _r(T)\).
Note that the value of the conductances \(\kappa _1(T),\dots ,\kappa _r(T)\) is not only dependent on the temperature T, but also on the choice of the thermodynamic equilibrium \(x^*(T)\). However, if the reaction network graph is connected, then for any other thermodynamical equilibrium \(x^{**}(T)\) for the same temperature T, there exists a positive constant d such that
This property of the matrix K has been proved in [32]. It implies that the dependence on \(x^*(T)\) is minor; choosing another thermodynamical equilibrium only involves a uniform scaling of K, and thus of L. Another well-known property of L is the fact that the matrix L is independent of the orientation of the graph [2].
4.2 Energy balance equations
In this section we will express the energy conservation for a closed chemical reaction network in order to encompass the thermodynamic properties of the system.
Assuming that in the system the variation of the volume may be neglected, i.e. \(dV=0\), Gibbs’ relation reduces to
where U denotes the internal energy, S the entropy, and the conjugated intensive variables are the chemical potential \(\frac{\partial U}{\partial x}=\mu \) and the temperature \(\frac{\partial U}{\partial S}=T\). This implies
Using the Eq. (12), the first term on the right-hand side of (16) also equals
Since the system is considered to be isolated, the energy balance equation is
This implies that the second term in (17) equals
In the next section we will combine these equations with (12) in order to derive a port-Hamiltonian formulation of non-isothermal and isolated reaction networks.
4.3 Port-Hamiltonian formulation
In this section, we show how Sects. 4.1 and 4.2 can be combined into a port-Hamiltonian formulation of the dynamics of detailed-balanced chemical reaction networks. Firstly, we define the state vector \(z=[\begin{array}{cc}x^{tr}&U\end{array}]^{tr}=\left[ \begin{array}{llll}x_{1}&\cdots&x_{m}&U\end{array}\right] ^{tr}\), where x is the vector of concentrations and U the internal energy. Then we define the Hamiltonian function \(H=-S\), where S is the entropy. Note that the Gibbs’ relation (15) can also be written in the entropy formulation
where \(\frac{dS}{dx_i}=-\frac{\mu _i}{T}\) and \(\frac{dS}{dU}=\frac{1}{T}\) are the intensive thermodynamic variables conjugated to \(x_i\) and the internal energy U. This implies that the co-state vector corresponding to \(H=-S\) is
Note that \(\mu \) and T can be expressed as function of the components of this co-state vector. Now define the skew-symmetric matrix
and the symmetric matrix
It follows that the dynamics of the non-isothermal mass action kinetics chemical reaction network (1) given by the mass balance equation (12) and the energy balance equation (18), can be written into quasi port-Hamiltonian form
As we will see in Sect. 4.4, \(T\mu ^{tr}ZL\mathrm {Exp}(\frac{Z^{tr}\mu }{RT})\ge 0\) and thus R is positive semi-definite. The formulation (23) is called ’quasi port-Hamiltonian’, since the structure matrices \(\mathcal {J}\) and \(\mathcal {R}\) depend on the co-state variables \(\frac{\partial H}{\partial z}=\frac{\partial (-S)}{\partial z}=\left[ \begin{array}{llll}\frac{\mu _{1}}{T}&\cdots&\frac{\mu _{m}}{T}&-\frac{1}{T}\end{array}\right] ^{tr}\), instead of on the state variables \(\left[ \begin{array}{llll}x_{1}&\cdots&x_{m}&U\end{array}\right] ^{tr}\) as in a standard port-Hamiltonian formulation. This formulation is comparable to the formulation of the mass balance and energy balance equations such as GENERIC, suggested in [18], or the port-Hamiltonian formulation with generating function being the availability function derived from the entropy function in [12].
4.4 Entropy balance equation
In this section, we shall relate the positive semi-definiteness of the dissipation matrix \(\mathcal {R}\) in (22) with the second law of thermodynamics. With this in mind let us compute the time-derivative of the entropy S
Denote \(\gamma =\frac{Z^{tr}\mu }{RT}\). It has been shown in [28] (using the properties of the Laplacian matrix L) that for any \(\gamma \in \mathbb {R}^c\)
while \(\gamma ^{tr}L\mathrm {Exp}(\gamma )=0\) if and only if \(B^{tr}\gamma =0\). Hence, the entropy balance equation becomes
Here \(\sigma \) is the irreversible entropy source term. Note that in Eq. (26), the time-derivative of the entropy S is deduced from the port-Hamiltonian formulation (23) defined in Sect. 4.3. It is consistent with Eq. (19), which is deduced from the Gibbs’ relation.
Furthermore, note that the positivity of the irreversible entropy source term is equivalent to the positive semi-definiteness of the dissipation matrix \(\mathcal {R}\) in (22). Indeed the only non-zero term of \(\mathcal {R}\) is the \((m+1,m+1)\)th element, denoted as \(\mathcal {R}_{m+1,m+1}\), which is related to the entropy source term as
In summary, the quasi port-Hamiltonian representation of chemical reaction networks given in (21), (22) and (23) represents the mass and energy balance equations. Moreover from its structure, it implies the entropy balance equation. It differs from the expression of energy and entropy balance equations in [23], which are expressed for the non-equilibrium biochemical systems and in [27], where the free energy and entropy balance are considered in an isothermal case when the species are diluted in a solvent, which acts as a thermal bath, while the pressure P is set by the environment. It differs from the quasi port-Hamiltonian representation of the mass and entropy balance equations of chemical reaction networks in [26, 36], by the fact that it is based on the energy balance equation instead of on the entropy balance equation. Note that the description based on the energy balance equation is classical [6], and more easily derived than the description based on the entropy balance equation. Moreover, the quasi-port-Hamiltonian formulation given in (21), (22) and (23) fundamentally differs from the representation of chemical reaction networks as port Hamiltonian systems in [21] as well, by the fact that this quasi port-Hamiltonian representation is established on the whole space of concentration vectors instead of only locally around an equilibrium point, as in [21].
Finally the quasi port-Hamiltonian directly extends the port-Hamiltonian formulation of isothermal chemical reaction networks obtained in [32, 33] by including the energy balance equation.
5 Thermodynamic equilibria and asymptotic stability
The discussion in Sect. 4 is based on the assumption of existence of a thermodynamic equilibrium. Starting from the definition of a thermodynamic equilibrium of non-isothermal chemical reaction networks, we will derive in this section a full characterization of the set of equilibria, analogous to the case of isothermal chemical reaction networks in [32].
Subsequently, for stability analysis, we will use Lyapunov function as an availability function which is directly based on the quasi port-Hamiltonian representation given in (21), (22) and (23). Note that the use of availability functions for stability analysis is classical, see e.g. [12, 13, 19].
5.1 Thermodynamic equilibria
In this section, the existence of a thermodynamic equilibrium will be derived in the following linear-algebraic way [10]. Recall the definition of a thermodynamic equilibrium for non-isothermal chemical reaction networks from Sect. 4. Let \(z^{*}\) be a thermodynamic equilibrium under a certain temperature T, i.e., \(v(z^*)=0\). This implies that for any \(j=1,\dots ,r\),
or equivalently
These equations are referred to as the detailed-balance equations. Denote \(K_j^{eq}(T)=\frac{k_j^f}{k_j^b}\exp (\frac{E_j^b-E_j^f}{RT})\),
Collecting all chemical reactions from 1 to r, and making use of the incidence matrix B, we obtain the following condition for a thermodynamical equilibrium \(x^*(T)\)
where \(K^{eq}\) is the r-dimensional vector with jth element \(K_j^{eq}\), which is dependent on the temperature T. Therefore, for a given temperature T, there exists a thermodynamic equilibrium \(x^*(T)\in \mathbb {R}^m_+\) if and only if \(k_j^f>0\), \(k_j^b>0\) for all \(j=1,\dots ,r\), and
In general, the equilibrium concentration \(x^*(T)\) may not be unique. Let \(x^{**}(T)\) be another thermodynamic equilibrium for the same temperature T. Then
That is to say, for a certain temperature T, once one thermodynamic equilibrium \(x^*(T)\) is given, the whole set of thermodynamic equilibria at the same temperature T can be found. Furthermore, since \(dU=0\), we have \(U^*=U^{**}\). Denote \(z^{*}=(x^{*}(T), U^{*})\) and \(z^{**}(T)=(x^{**}(T), U^{**})\), then it follows that the set of thermodynamic equilibria at the same temperature T can be written as
This directly extends the classical result for isothermal chemical reaction networks, see e.g. [32]. Note that the value of the terms \(\mathrm {Exp}(C^{tr}\mathrm {Ln}(x^*))\) depend on temperature T, while the relation \(\mathrm {Exp}(C^{tr}\mathrm {Ln}(x^{**}))=\mathrm {Exp}(C^{tr}\mathrm {Ln}(x^*))\) is not dependent on temperature T.
Since \(K^{eq}(T)=\mathrm {Exp}(C^{tr}\mathrm {Ln}(x^{*}))\) as a function of T is monotone and injective, it follows that the set of thermodynamic equilibria \({\varSigma }_{T_1}\) is disjoint from \({\varSigma }_{T_2}\), i.e., \({\varSigma }_{T_1}\cap {\varSigma }_{T_2}=\emptyset \) for any \(T_1\ne T_2\).
5.2 Asymptotic stability
For isothermal chemical reaction networks, it was shown in [15, 32, 33], that the Gibbs’ free energy can be used as a Lyapunov function for proving asymptotic stability towards a unique equilibrium depending on the initial condition. In this section we aim at proving a similar result for the non-isothermal case based on the port-Hamiltonian formulation obtained in the previous section, employing the availability function. Note that this is different from [24, 36], where an energy-based availability function was employed.
We define the entropy based availability function as
where \(z^o\) is a reference point taken as a thermodynamic equilibrium, cf. Sect. 4.
Theorem 5.1
Consider a detailed balanced chemical reaction network given by (21), (22) and (23), with \(A:\mathbb {R}^{m+1}_+\rightarrow \mathbb {R}\) given by (31). Then A has a strict minimum at \(z^o\) with \(A(z^o)=0\), while the time-derivative \(\frac{dA}{dt}\) is less than or equal to zero with equality only at \(z^o\).
Proof
For homogeneous mixtures, the entropy function is necessarily concave [3]. Moreover, the entropy is strict concave if at least one global extensive property (such as volume, total mass, or total mole number) is fixed [17]. Recall the assumption that the chemical reaction network is isochoric, i.e. \(dV=0\), so the entropy is strict concave and A has a strict minimum at \(z^o\). Moreover, the time derivative of A(z) is given as
where \(\mu =RT\mathrm {Ln}\frac{x}{x^*}\) is the vector of chemical potentials, \(\mu ^o=RT^o\mathrm {Ln}\frac{x^o}{x^*}\), \(\gamma =\frac{Z^{tr}\mu }{RT}=Z^{tr}\mathrm {Ln}\frac{x}{x^*}\) and \(\gamma ^o=\frac{Z^{tr}\mu ^o}{RT^o}=Z^{tr}\mathrm {Ln}\frac{x^o}{x^*}\). Since \(x^*\) and \(x^o\) are both thermodynamic equilibria, we obtain from Eq. (29)
Recall [28] that since L is a balanced weighted Laplacian matrix, for any \(\gamma \in R^c\), we have \(\gamma ^{tr}L\mathrm {Exp}(\gamma )\ge 0\), while \(\gamma ^{tr}L\mathrm {Exp}(\gamma )=0\) if and only if \(B^{tr}\gamma =0\). Hence
Therefore the time derivative of A(z) satisfies
\(\square \)
Let the system converge to a point denoted as
and denote the equilibrium temperature associated with the equilibrium point \(z^*\) by \(T^*\). We know that at equilibrium the entropy is maximal, implying that
This is a classical statement in Chemical Engineering, and is comparable with the statement in [27], where for isothermal systems the Gibbs’ free energy is minimized. According to Eq. (26), we have
and for an isolated system we have
By using the Eqs. (33) and (34), the equilibrium point \(z^*\) and \(T^*\) can be determined. Then, by using a similar argument as in [11, 32] , the following theorem will imply the asymptotic stability towards the set \({\varSigma }_{T^*}\).
Theorem 5.2
Consider the detailed-balanced chemical reaction network (21), (22) and (23) with \(T\in \mathbb {R}_+\). Then for any \(x_1\in \mathbb {R}^{m+1}_+\), \(T_1\in \mathbb {R}_+\), there exists a unique \(x^*\in \mathbb {R}^{m+1}_+\) and \(T^*\in \mathbb {R}_+\), such that \(x^*-x_1\in \mathrm {im}\,C\), and \(z^*=(x^*,U^*(x^*,T^*))\in {\varSigma }_{T^*}\).
Proof
Let \(W=\mathrm {im}\,C\). Then \(W^\perp =\mathrm {ker}\,C^{tr}\). Let \(z_1(x_1,T_1),z^{**}(x^{**},T^*)\in \mathbb {R}^{m+1}_+\), where \(z^{**}(x^{**},T^*)\in {\varSigma }_{T^*}\) is a thermodynamic equilibrium for temperature \(T^*\). As proved in [11, 32], there exists a unique \(\beta \in \mathrm {ker}\,C^{tr}\) such that \(x^{**}\mathrm {Exp}(\beta )-x_1\in \mathrm {im}\,C\). Define \(z^*(x^*,T^*)\in \mathbb {R}^{m+1}_+\) with \(x^*=x^{**}\mathrm {Exp}(\beta )\). Clearly, \(C^{tr}\beta =C^{tr}\mathrm {Ln}(\frac{x^*}{x^{**}})=0\), which is in line with (29) so that \(z^*(x^*,T^*)\in {\varSigma }_{T^*}\). Moreover, we have \(x^*-x_1=x^{**}\mathrm {Exp}\beta -x_1\in \mathrm {im}\,C\).
Combining with Theorem 4.1, this implies that the equilibrium \(z^*\) is asymptotically stable with respect to all initial conditions in near \(z^*\). Hence the asymptotic stability of the quasi port-Hamiltonian system defined by (21), (22) and (23) is proved. \(\square \)
6 Example: a genetic circuit with internal feedback and cell-to-cell communication
The approach of the previous section will be illustrated on a chemical reaction network, taking place in a very common protein synthesis circuit in the cell of E. Coli in the large intestine of human beings [22]. When the cell of E.Coli receives a ’message’ from the environment (a kind of transcription process from extracellular space into the E. Coli cell), three chemical reactions will take place at the intercellular level:
When the chemical reaction network reaches an equilibrium state, the cell will send out a ‘message’ to the environment (a reversed transcription process). This is a very efficient gene circuit for adjustment of the concentrations on different kind of protein in the E. Coli cell, with internal feedback and cell-to-cell communication.
6.1 Modeling
Let us denote the concentration of the species \(\mathrm {LuxR}\), \(\mathrm {AHL}\), \(\mathrm {LuxR-AHL}\), \(\mathrm {(LuxR-AHL)_2}\), \(\mathrm {DNA}\) and \(\mathrm {DNA-(LuxR-AHL)_2}\) as \(x_1, \dots , x_6\). Hence, the state vector is defined as \(z=[x_1, \dots , x_6, U]^{tr}\) and the gradient vector of Hamiltonian function \(-S\) is given as \(\frac{d(-S)}{dz}=[\frac{\mu _1}{T}, \dots , \frac{\mu _6}{T}, \frac{1}{T}]^{tr}\). With \(m=6\), \(r=3\) and \(c=5\), the stoichiometric matrix \(C\in \mathbb {R}^{6\times 3}\) is written as
The complex stoichiometric matrix \(Z\in \mathbb {R}^{6\times 5}\) becomes
and the incidence matrix \(B\in \mathbb {R}^{5\times 3}\) is
Since the chemical reactions will take place naturally when the cell gets the ‘message’ from the environment, this means that the activation energies in Arrhenius equation are so small that they can be ignored, i.e., \(E_j^f=0, j=1,\dots ,r\) and \(E_j^b=0, j=1,\dots ,r\). Hence, the matrix of conductances K becomes independent of T and takes the form
Therefore, the Laplacian matrix \(L=BKB^{tr}\in \mathbb {R}^{5\times 5}\) is equal to
which is independent of T. Therefore, the port-Hamiltonian formulation (23) for the genetic protein synthesis circuit is
where the matrix \(\mathcal {J}(-\frac{dS}{dz})-\mathcal {R}(-\frac{dS}{dz})\) can be written as
where \(p=[\begin{array}{cccccc}p_1&p_2&p_3&p_4&p_5&p_6\end{array}]^{tr}\), with
and \((*)=(\mu _1+\mu _2)[Tx_3^*(\exp (\frac{\mu _1+\mu _2}{RT})-\exp \frac{\mu _3}{RT}]+\mu _3[-Tx_3^*(\exp (\frac{\mu _1+\mu _2}{RT})-\exp \frac{\mu _3}{RT})+T\frac{x_3^{*2}}{35}(2\exp \frac{\mu _3}{RT}-2\exp \frac{\mu _4}{RT})]+\mu _4[-T\frac{x_3^{*2}}{35}(2\exp \frac{\mu _3}{RT}-2\exp \frac{\mu _4}{RT})+T\frac{x_3^{*2}x_5}{4900}(\exp (\frac{\mu _4+\mu _5}{RT})-\exp \frac{\mu _6}{RT})]+(\mu _5+\mu _6)[T\frac{x_3^{*2}x_5}{4900}(\exp (\frac{\mu _4+\mu _5}{RT})-\exp \frac{\mu _6}{RT})]\)
6.2 Equilibrium and Lyapunov function
At thermodynamic equilibrium \(v(z^*)=0\), it can be verified that the equilibrium set \({\varSigma }_{T}\) is the 3-dimensional set given as
To study its asymptotic stability, we define the availability function as in (31),
where the reference point \(z^o\) is taken to be a thermodynamic equilibrium under the temperature T. We have \(A(z)=0\) at \(z=z^o\), and as discussed in Sect. 5.2, the time derivative of A(z) can be written as
Therefore A(z) is a well-defined Lyapunov candidate. The port-Hamiltonian system (23) for the genetic protein synthesis circuit is asymptotically stable under temperature T.
7 Non-isothermal chemical reaction networks with ports
In many application areas, the chemical reaction networks under consideration are not isolated. That is to say, there exist mass exchange or heat exchange between the chemical reaction network and its environment.
In this section we will extend the port-Hamiltonian formulation for non-isothermal chemical reaction networks to the case of mass and heat exchange. As in the previous work (see [12, 13, 24, 26]) when modeling and control of the Continuous Stirred Tank Reactor (CSTR), we define ‘external ports’ as the inflow/outflow of a mixture. Furthermore, we suppose that the output flow is such that the volume and pressure are constant [4].
Then Eq. (2) can be rewritten as
where the vectors \(F_e\) and \(F_s\) are respectively the input and output concentration flows. The previous formulation (23) can be extended to the non-isothermal chemical reaction network with external ports as
where as before the Hamiltonian function is given as \(H=-S\). The internal energy can be written as
where \(c_{pi}\), \(u_{0i}\) \(T_0\) are respectively the heat capacity at constant pressure, reference molar energy and reference temperature. With constant volume and pressure the balance equation for the internal energy U can be written as
where Q is the heat flux from the environment, and \(F_{ei}\) and \(F_{si}\) are the ith element of \(F_e\) and \(F_s\). Furthermore, \(h_{ei}\) and \(h_{si}\) are respectively the input and output specific enthalpies.
Note that in the port-Hamiltonian formulation for non-isothermal chemical reaction network with ports (38), we still use the thermodynamic equilibrium \(z^*(T)\) for the chemical reaction network without ports under given temperature T, as defined in Sect. 4.
As before, in order to verify the asymptotic stability, we define the availability Eq. (31) as:
It then remains to prove that A(z) is a Lyapunov function. Obviously, we have \(A(z^{o})=0\).
Here, we assume that \({\varDelta }F=F_e-F_s\) is a vector which can be described by mass action kinetics. That is to say, it can be developed as
with \(L'=B'K'(B')^{tr}\) a constant balanced weighted Laplacian matrix corresponding to some incidence matrix \(B'\) and \({\varDelta }U=0\). Note that under this assumption, the external ports added to the network can be considered as another chemical reaction network, with the same complex Z, but with the different incidence matrix \(B'\) and different rate coefficients \(K'\).
Then the time derivative of A(z) becomes
Since
we have \(\frac{dA}{dt}\le 0\), and thus the port-Hamiltonian system for non-isothermal chemical reaction networks with ports is asymptotically stable for temperature T. Let us illustrate this on the following example.
7.1 Example: a genetic circuit with internal feedback and cell-to-cell communication (continued)
Recall the genetic protein synthesis circuit described in Sect. 1. Assume that there exists a port of flows \({\varDelta }F=-ZL'\mathrm {Exp}(Z^{tr}\mathrm {Ln}\frac{x}{x^*})\) with
where \(l_1\), \(l_2\) and \(l_3\) are positive constants. The port-Hamiltonian formulation (23) extends to
where the matrix \(\mathcal {J-R}\) is equal to
where \(p=[\begin{array}{cccccc}p_1&p_2&p_3&p_4&p_5&p_6\end{array}]^{tr}\), with
with \((*)=(\mu _1+\mu _2)[Tx_3^*(\exp (\frac{\mu _1+\mu _2}{RT})-\exp \frac{\mu _3}{RT}]+\mu _3[-Tx_3^*(\exp (\frac{\mu _1+\mu _2}{RT})-\exp \frac{\mu _3}{RT})+T\frac{x_3^{*2}}{35}(2\exp \frac{\mu _3}{RT}-2\exp \frac{\mu _4}{RT})]+\mu _4[-T\frac{x_3^{*2}}{35}(2\exp \frac{\mu _3}{RT}-2\exp \frac{\mu _4}{RT})+T\frac{x_3^{*2}x_5}{4900}(\exp (\frac{\mu _4+\mu _5}{RT})-\exp \frac{\mu _6}{RT})]+(\mu _5+\mu _6)[T\frac{x_3^{*2}x_5}{4900}(\exp (\frac{\mu _4+\mu _5}{RT})-\exp \frac{\mu _6}{RT})]\) , and
Then the availability function (39) can be rewritten as
\(A(z^{o})=0\) and the time derivative of A(z) becomes
Hence A(z) is a well-defined Lyapunov candidate. We conclude that the port-Hamiltonian system for genetic protein synthesis circuit with a specific port \({\varDelta }F\) is asymptotically stable for temperature T.
8 Conclusions and outlook
In this paper, a (quasi) port-Hamiltonian formulation has been developed for non-isothermal mass action kinetics chemical reaction networks. As an extensive result of the port-Hamiltonian formulation for isothermal chemical reaction network, and based on the mass balance and energy balance equations, this port-Hamiltonian formulation provides us a very explicit way to represent the chemical reaction networks and their thermodynamic properties, including the entropy balance and the conditions for the existence of thermodynamic equilibrium. As for the asymptotic stability, a comparable statement with the one in [27] has been found.
Moreover, this (quasi) port-Hamiltonian formulation and its thermodynamic analysis have been extended to non-isothermal chemical reaction networks with external ports. The results have been illustrated on a chemical reaction network in our body: the genetic circuit with internal feedback and cell-to-cell communication.
The focus of future work will be on the extension of current results to the modeling of interconnection of non-isothermal chemical reaction networks. Inspired by Rao and Esposito [27] and Qian and Beard [23], the interconnected port-Hamiltonian formulation will be considered as the combination of two driven (or chemostatted) chemical reaction networks with shared species.
References
N. Balabanian, T.A. Bickart, Linear Network Theory: Analysis, Properties, Design and Synthesis (Matrix Pub, York, 1981)
B. Bollobas, Modern Graph Theory, vol. 184 (Springer, New York, 1998)
H. Callen, Thermodynamics (Wiley, New York, 1960)
F. Couenne, C. Jallut, B. Maschke, P. Breedveld, M. Tayakout, Bond graph modelling for chemical reactors. Math. Comput. Model. Dyn. Syst. 12(2), 159–174 (2006)
D. Eberard, B. Maschke, A.J. Van der Schaft, An extension of pseudo-Hamiltonian systems to the thermodynamic space: towards a geometry of non-equilibrium thermodynamics. Rep. Math. Phys. 60(2), 175–198 (2007)
A. Favache, D. Dochain, M. B, An entropy-based formulation of irreversible processes based on contact structures. Chem. Eng. Sci. 65, 5204–5216 (2010)
A. Favache, V. Dos Santos, B. Maschke, D. Dochain, Some properties of conservative control systems. IEEE Trans. Autom. Control 54(10), 2341–2351 (2009)
M. Feinberg, Complex balancing in general kinetic systems. Arch. Ration. Mech. Anal. 49(3), 187–194 (1972)
M. Feinberg, Chemical reaction network structure and the stability of complex isothermal reactors I. The deficiency zero and deficiency one theorems. Chem. Eng. Sci. 42(10), 2229–2268 (1987)
M. Feinberg, Necessary and sufficient conditions for detailed balancing in mass action systems of arbitrary complexity. Chem. Eng. Sci. 44(9), 1819–1827 (1989)
M. Feinberg, The existence and uniqueness of steady states for a class of chemical reaction networks. Arch. Ration. Mech. Anal. 132(4), 311–370 (1995)
H. Hoang, F. Couenne, C. Jallut, Y.L. Gorrec, The port Hamiltonian approach to modeling and control of continuous stirred tank reactors. J. Process Control 21(10), 1449–1458 (2011). https://doi.org/10.1016/j.jprocont.2011.06.014. (Special Issue: Selected Papers From Two Joint IFAC Conferences: 9th International Symposium on Dynamics and Control of Process Systems and the 11th International Symposium on Computer Applications in Biotechnology, Leuven, Belgium, July 5–9, 2010)
H. Hoang, F. Couenne, C. Jallut, Y.L. Gorrec, Lyapunov-based control of non isothermal continuous stirred tank reactors using irreversible thermodynamics. J. Process Control (2012). https://doi.org/10.1016/j.jprocont.2011.12.007
F. Horn, Necessary and sufficient conditions for complex balancing in chemical kinetics. Arch. Ration. Mech. Anal. 49(3), 172–186 (1972)
F. Horn, R. Jackson, General mass action kinetics. Arch. Ration. Mech. Anal. 47(2), 81–116 (1972)
B. Jayawardhana, S. Rao, A.J. Van der Schaft, Balanced chemical reaction networks governed by general kinetics, in Proceedings of the 20th International Symposium on Mathematical Theory of Networks and Systems, Melbourne, Australia (2012)
K.R. Jillson, B.E. Ydstie, Process networks with decentralized inventory and flow control. J. Process Control 17(5), 399–413 (2007)
R. Jongschaap, H.C. Öttinger, The mathematical representation of driven thermodynamical systems. J. Non Newton. Fluid Mech. 120, 3–9 (2004)
J. Keenan, Availability and irreversibility in thermodynamics. Br. J. Appl. Phys. 2(7), 183 (1951)
B. Maschke, A.J. Van der Schaft, Port-controlled Hamiltonian systems: modelling origins and system theoretic properties, in Nonlinear Control Systems Design, vol. 25 (1992), pp. 359–365
I. Otero-Muras, G. Szederkényi, A. Alonso, K. Hangos, Local dissipative Hamiltonian description of reversible reaction networks. Syst. Control Lett. 57(7), 554–560 (2008)
E. Pico-Marco, Y. Boada, J. Pico, A. Vignoni, Contractivity of a genetic circuit with internal feedback and cell-to-cell communication. IFAC PapersOnLine 49(26), 213–218 (2016)
H. Qian, D.A. Beard, Thermodynamics of stoichiometric biochemical networks in living systems far from equilibrium. Biophys. Chem. 114(2), 213–220 (2005)
H. Ramırez, Y. Le Gorrec, B. Maschke, F. Couenne, Passivity based control of irreversible port Hamiltonian systems. IFAC Proc. Vol. 46(14), 84–89 (2013)
H. Ramirez, B. Maschke, D. Sbarbaro, Irreversible port-Hamiltonian systems: a general formulation of irreversible processes with application to the CSTR. Chem. Eng. Sci. 89, 223–234 (2013)
H. Ramırez, D. Sbárbaro, B. Maschke, Irreversible port-Hamiltonian formulation of chemical reaction networks, in 21st International Symposium on Mathematical Theory of Networks and Systems, Groningen, The Netherlands, 7–11 July 2014
R. Rao, M. Esposito, Nonequilibrium thermodynamics of chemical reaction networks: wisdom from stochastic thermodynamics. Phys. Rev. 6(4), 041064 (2016)
S. Rao, A.J. Van der Schaft, B. Jayawardhana, A graph-theoretical approach for the analysis and model reduction of complex-balanced chemical reaction networks. J. Math. Chem. 51(9), 2401–2422 (2013)
S. Rao, A.J. Van der Schaft, K. Van Eunen, B.M. Bakker, B. Jayawardhana, A model reduction method for biochemical reaction networks. BMC Syst. Biol. 8(1), 1 (2014)
A.J. Van der Schaft, Port-Hamiltonian systems: an introductory survey, in Proceedings of the International Congress of Mathematicians, vol. III (European Mathematical Society Publishing House, 2006), pp. 1339–1365
A.J. Van der Schaft, B. Maschke, The Hamiltonian formulation of energy conserving physical systems with external ports. Arch. Elektron. Übertrag. 49(5–6), 362–371 (1995)
A.J. Van der Schaft, S. Rao, B. Jayawardhana, On the mathematical structure of balanced chemical reaction networks governed by mass action kinetics. SIAM J. Appl. Math. 73(2), 953–973 (2013)
A.J. van der Schaft, S. Rao, B. Jayawardhana, On the network thermodynamics of mass action chemical reaction networks. IFAC Proc. Vol. 46(14), 24–29 (2013)
O.N. Temkin, A.V. Zeigarnik, D.G. Bonchev, Chemical Reaction Networks: A Graph-Theoretical Approach (CRC Press, Boca Raton, 1996)
A.B.O. Varma, Palsson, metabolic flux balancing: basic concepts, scientific and practical use. Biotechnology 12, 994–998 (1994)
L. Wang, B. Maschke, A.J. Van der Schaft, Irreversible port-Hamiltonian approach to modeling and analyzing of non-isothermal chemical reaction networks, in 6th IFAC Conference on Foundations of Systems Biology in Engineering (FOSBE) (2016)
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.
About this article
Cite this article
Wang, L., Maschke, B. & van der Schaft, A. Port-Hamiltonian modeling of non-isothermal chemical reaction networks. J Math Chem 56, 1707–1727 (2018). https://doi.org/10.1007/s10910-018-0882-9
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10910-018-0882-9