Abstract
The Lyapunov exponent is used to quantify the chaos of a dynamical system, by characterizing the exponential sensitivity of an initial point on the dynamical system. However, we cannot directly compute the Lyapunov exponent for a dynamical system without its dynamical equation, although some estimation methods do exist. Information dynamics introduces the entropic chaos degree to measure the strength of chaos of the dynamical system. The entropic chaos degree can be used to compute the strength of chaos with a practical time series. It may seem like a kind of finite space Kolmogorov-Sinai entropy, which then indicates the relation between the entropic chaos degree and the Lyapunov exponent. In this paper, we attempt to extend the definition of the entropic chaos degree on a d-dimensional Euclidean space to improve the ability to measure the stength of chaos of the dynamical system and show several relations between the extended entropic chaos degree and the Lyapunov exponent.
Similar content being viewed by others
Avoid common mistakes on your manuscript.
1 Introduction
A quantification of chaotic behavior is critical to understanding it. Some criteria to measure the strength of chaos of a dynamical system have been proposed such as the Lyapunov exponent, KS-entropy, fractal dimension, and so on. In particular, many researchers use the Lyapunov exponent to define the chaos, characterizing an exponential sensitivity on an initial point for the dynamical system. However, we cannot directly compute it for a dynamical system without its dynamical equation even if we know its time series, such as observation data of an experiment. For that reason, there exist some estimation methods of the Lyapunov exponent for the time series. [1, 9,10,11,12,13]
Information Dynamics (ID) was proposed for synthesizing the dynamics of state change and the complexity of a system, and introduced the entropic chaos degree (CD) [8]. Some trials have been carried out to characterize chaotic dynamics using the CD [2,3,4,5]. CD allows the strength of chaos of a practical time series to be computed. It may seem like a kind of finite space Kolomogorov-Sinai entropy (KS entropy).
In such situations, some authors have recently discussed the relation between CD and the Lyapunov exponent directly, without KS entropy [6]. They showed that in many cases, the CD for asymmetric tent maps takes a larger value than its Lyapunov exponent. Based on investigations of the difference between the CD and the Lyapunov exponent, they introduced an improved CD, which is the CD with an optional term corresponding to the above difference added [7]. They also showed that the improved CD coincides with the Lyapunov exponent for any one-dimensional chaotic maps under typical conditions.
In this paper, we show that an extended CD coincides with the sum of all Lyapunov exponents for any d-dimensional chaotic maps under a typical condition similar to that used for the one-dimensional chaotic maps. We also consider improving the computation algorithm of the extended CD to reduce its computational complexity while maintaining its computation accuracy.
2 Entropic chaos degree
In this section, we briefly review the definition of the entropic chaos degree for a difference equation.
Let \(\mathbf {R}\) be the set of all real numbers and let \(\mathbf {N}\) be the set of all natural numbers. Denote by \(\mathbf {R}^{d}\) the d-dimensional Euclidean space. Let f be a map I to I where
Now we consider a difference equation such that
For an initial point \(x_0\) and finite partitions \(\{A_i\}\) of I such that
the probability distribution \(\left( p_{i,A}^{\left( n \right) } (M)\right) \) of time n and the joint distribution \(\left( p_{{i,j},A}^{\left( n,n+1\right) }(M)\right) \) of time n and time \(n+1\) are given as
where \(1_A\) is the characteristic function of set A.
The entropic chaos degree D of the orbit \(\{x_n\}\) is then defined as in [8]
where \(p_A^{(n)}(j|i)\) is the conditional probability from component \(A_i\) to \(A_j\).
We simplify the denotation of \(D^{(M,n)}(A,f)\) as \(D^{(M)}(A,f)\) if the probability distribution \(\left( p_{i,A}^{(n)} \right) \) is a stationary distribution. Moreover, we simplify the denotation of \(D^{(M)}(A,f)\) as \(D^{(M)}(A)\) if an orbit \(\{x_n\}\) is regarded as a practical stationary time series without f.
3 An extension of the entropic chaos degree
In the following, we set
Let the \(L^d(=N)\)-equipartitions \(\{A_i\}\) of I be
where
for any \(k=1,\ldots , d\).
Further, for any \(A_i, A_j\), \(i,j=0,1,\ldots ,L^d-1\), we divide \(A_j\) into \( \left( S_{i,j} \right) ^d \) -equipartitions \( \left\{ B_{l}^{(i,j)} \right\} _{0\le l \le (S_{i,j})^d -1} \) such that
where
and
for \(k=1,\ldots ,d\).
For each \(B_l^{(i,j)}\), we define a function \(g_{i,j}\) by
For any \(A_i,A_j,\; i \ne j\), we give a function \(R(S_{i,j})\) using \(g_{i,j}\) as
Here, the numerator of \(R(S_{i,j})\) is the number of components of \(\{B_l^{(i,j)}\}\) included in \(A_j \cap f(A_i)\), and the denominator of \(R(S_{i,j})\) is the number of elements of \(\{B_l^{(i,j)}\}\) included in \(A_j\). Thus \(R(S_{i,j})\) becomes the volume rate of \(A_j \cap f(A_i)\) to \(A_j\) under the \(1/S_{i,j}\) scale.
We then define an extended entropic chaos degree as follows.
Definition 1
where \(S=(S_{i,j})_{0 \le i,j \le L^d-1}\).
Remark 1
If we set \(S_{i,j}=1\;(i,j=0,1,\ldots ,L^d-1)\), then the extended chaos degree \(D_S\) becomes the chaos degree D, or
where \(1=(1)_{0 \le i,j \le L^d-1}\).
Remark 2
To give an interpretation to the extension for the entropic chaos degree, we consider the information quantity of \(f(A_i)\) included in \(A_j\).
The entropic chaos degree D includes an information quantity as
Then the volume of \(A_j \cap f(A_i)\) is treated as \(m(A_j)\) where m is the Lebesgue measure on \(\mathbf {R}^d\).
On the other hand, we treat the volume of \(A_j \cap (A_i)\) as \(m(A_j)R(S_{i,j})\) under the scale \(1/S_{i,j}\). Thus, under the scale \(1/S_{i,j}\), we use
instead of Eq. (4). Because Eq. (5) can take a negative value, Eq. (5) is no longer any information quantities.
We regard the extended entropic chaos degree \(D_S\) as the entropic chaos degree D under the scale \(1/S_{i,j}\).
Then we have the following theorem.
Theorem 1
Let L, M be sufficiently large natural numbers. If a map f is stable periodic with period T, then we have
Proof
Let the number M of orbit points be a sufficiently large natural number. If f is stable periodic with period T, then there exist \(i_k \;(k=1,\ldots ,T)\) such that
For the same reason, there exist \(j_k\) for \(i_k=1,\ldots ,T\) such that
From Eq. (8), we obtain
We also have
for any \(A_j\) under the scale \(1/S_{i,j}\).
From Eqs. (9) and (10), we get
Substituting Eqs. (7) and (11) into Eq. (3), we finally have
\(\square \)
Remark 3
Theorem 1 means that the extended entropic chaos degree takes a quite small negative value if f is stable periodic, i.e., from Eq. (6), we have
for any stable periodic orbits.
Thus, the extended entropic chaos degree \(D_S^{(M,n)}(A,f) \) takes a smaller value as the scale \(1/S_{i_k,j_k}\) decreases.
Now we consider the relationship between the extended entropic chaos degree and the Lyapunov exponent. For any \(\mathbf {x}=(x_1,x_2,\ldots ,x_d)^t\), \(\mathbf {y}=(y_1,y_2,\ldots ,y_d)^t\) \(\in A_i\), we define an approximate Jacobian matrix \(\widehat{J}\) by
Further, we set that \(r_k(\mathbf {x},\mathbf {y}), \;k=1,2,\ldots ,d\), is an eigenvalue of matrix \(\sqrt{{\widehat{J}}^t(\mathbf {x},\mathbf {y}) \widehat{J}(\mathbf {x},\mathbf {y})}\). Then we introduce the following assumption.
Assumption 1
For sufficiently large natural numbers L, M, we assume that the following conditions are satisfied.
-
(1)
Points in \(A_i\) are uniformly distributed over the entirety of \(A_i\).
-
(2)
We have \(r_k(\mathbf {x},\mathbf {y}) = r_{k}^{(i)},\;k=1,2,\ldots ,d\) for any \(\mathbf {x},\mathbf {y} \in A_i\) where there exists at least one \(r_{j}^{(i)}\) for any \(A_i\) such that \(r_{j}^{(i)} \ge 1\).
Remark 4
If we assume Assumption 1, then we have
or
where m is the Lebesgue measure on \(\mathbf {R}^d\).
Then we have the following theorem.
Theorem 2
For any \(A_i, \;i=0,1,\ldots , L^d-1\), we assume Assumption 1. Then we have
where
and \(\{\lambda _1, \ldots ,\lambda _d\}\) is the Lyapunov spectrum of a map f.
Proof
\(p^{(n)}(j | i)(M)\) is the rate of the number of points of \(A_{j} \cap f(A_i)\) to the number of points of \(f(A_i)\), i.e.,
From Assumption 1, for sufficiently large natural numbers L, M, we have
where \(\mu \) is the invariant measure of f.
Now let \(c_k \) be
Then the volume of \(A_{i}\) is
where m is the Lebesgue measure on \(R^d\).
From Assumption 1, the volume of \(f(A_i)\) becomes
Under Assumption 1, we have
Using Eqs. (14), (15), (17), and (18), we obtain
On the other hand, for sufficiently large natural numbers L, M, from Eqs. (13) and (16), we have
Thus from Eqs. (19) and (20), we obtain
Finally, for sufficiently large natural numbers L, M, from Eqs. (3) and (21), we have
Here, \(\rho (\mathbf {x},\mathbf {y})\) is the density function of \((\mathbf {x},\mathbf {y})\), and \(\{\lambda _1,\lambda _2,\ldots ,\lambda _d\}\) is the Lyapunov spectrum of f. \(\square \)
4 An improvement of the numerical calculation method for the extended entropic chaos degree
Theorem 2 implies that under Assumption 1, the extended entropic chaos degree \(D_{S}\) for a map f goes to the sum of all Lyapunov exponents for the map f as L, M, and \(S_{i,j}\) go to \(\infty \). However, we must treat M and L as finite natural numbers in the numeric calculation of the entropic chaos degree.
Now, for any \(A_i,A_j, \;i,j=0,1,\ldots ,L^d-1\), we define
Using \(S_{i,j}^\mathrm{{max}}\), we compute the extended entropic chaos degree \(D_{S^\mathrm{{max}}}\) as follows.
where
In the definition of the extended entropic chaos degree \(D_S\) (Eq. 3), from Eq. (21), we have
if all of \(S_{i,j}\;(i,j=0,1,\ldots ,L^d-1)\) are sufficiently large natural numbers. Noticing that h(i, j) does not depend on j, we introduce a simplified form \(\overline{D}_{S^\mathrm{{max}}}\) of the extended entropic chaos degree \(D_{S^\mathrm{{max}}}\) by
where \(j_\mathrm{{max}}\) is the number \(j \in \{0,1,\ldots ,L^d-1\}\) such that
That means that the simplified form \(\overline{D}_{S^\mathrm{{max}}}\) uses \(h(i,j_\mathrm{{max}})\) instead of the average of h(i, j) in the definition of the extended entropic chaos degree \(D_{S^\mathrm{{max}}}\).
Then we have the following relation.
5 Numerical computation results
In this section, we attempt to numerically compute the extended entropic chaos degree for a typical two-dimensional chaotic map. We set \(M=1,000,000\), \(L = \left\lfloor \sqrt{M} \right\rfloor \) to satisfy that \(L^2<M\).
5.1 Two-dimensional chaotic map
We consider the Hénon map as a typical two-dimensional chaotic map.
The Hénon map \(f_{a,b}\) is given as
where \(\mathbf {x}=(x_1,x_2)^t \in [a_1,b_1] \times [a_2,b_2]\).
For \(a=1.4, 0 < b \le 0.3\), we have
Then the Jacobi matrix \(Df_{a,b}(\mathbf {x})\) of the map \(f_{a,b}\) becomes
Thus \(Df_{a,b}(\mathbf {x})\) depends on \(\mathbf {x}\) and the parameter b. We also cannot keep the orthonormal system with the map f.
In the following, we simplify the denotation of \(f_{1.4,b}\) as \(f_b\) .
5.2 Extended entropic chaos degree for a two-dimensional chaotic map
First, we show the computation results of the entropic chaos degree D for the Hénon map \(f_b\) in Fig. 1. The entropic chaos degree D for any map always takes a non-negative value. Therefore, if the sum \(\lambda _1+\lambda _2\) is negative, then the entropic chaos degree D for \(f_b\) takes a different amount from the sum \(\lambda _1+\lambda _2\) of all Lyapunov exponents for \(f_b\).
Secondly, we show the computation results of the extended entropic chaos degree \(D_{S^\mathrm{{max}}}\) for \(f_b\) in Fig. 2. The extended entropic chaos degree \(D_{S^\mathrm{{max}}}\) for \(f_{b}\) has almost the same change on b in (0, 0.3] as the sum \(\lambda _1+\lambda _2\) of all Lyapunov exponents for \(f_b\). That is, the extended entropic chaos degree \(D_{S^\mathrm{{max}}}\) for \(f_{b}\) takes nearly the same value at most points on b in (0, 0.3] as the sum \(\lambda _1+\lambda _2\) of all Lyapunov exponents for \(f_b\). However, there exist some points on b such that the extended entropic chaos degree \(D_{S^\mathrm{{max}}}\) for \(f_{b}\) takes a quite small amount relative to \(\lambda _1+\lambda _2\) for \(f_b\).
Now we show the bifurcation diagram of the Hénon map and the computation results of Lyapunov exponents \(\lambda _1\) and \(\lambda _2\) for \(f_b\) in Figs. 3 and 4, respectively.
At many bifurcation points of the Hénon map, the Lyapunov exponents diverge to negative infinity, or do not exist, while the sum of its Lyapunov exponents is always \(\log b\). The extended CD and the Lyapunov exponents also do not work well at many bifurcation points of the Hénon map.
The above implies the following. (1) For any chaotic map f, the extended entropic chaos degree \(D_{S^\mathrm{{max}}}\) takes almost the same value as the sum of all of its Lyapunov exponents. (2) However, for any stable periodic map, the extended entropic chaos degree \(D_{S}^\mathrm{max}\) does not work well because it takes a finite negative value as a numerical finiteness of an infinitely negative amount.
Finally, we show the computation results of the simplified form \(\overline{D}_{S^\mathrm{{max}}}\) of the extended entropic chaos degree \(D_{S^\mathrm{{max}}}\) in Fig. 5.
One finds that the simplified form \(\overline{D}_{S^\mathrm{{max}}}\) takes almost the same value as the extended entropic chaos degree \(D_{S^\mathrm{{max}}}\). Therefore, the simplified form \(\overline{D}_{S^\mathrm{{max}}}\) can reduce the computation time, while maintaining nearly the same computation accuracy as the extended entropic chaos degree \(D_{S^\mathrm{{max}}}\) .
Though only dissipative systems are directly considered in this paper, the extended CD can be computed for any discrete dynamics, including conservative systems, if the dynamics satisfies the conditions of Assumption 1. For dynamics that do not satisfy Assumption 1, an appropriate setting for computing the extended CD is necessary and will be discussed in future works.
6 Conclusion
In this paper, we introduced an extended chaos degree \(D_S\) for a d-dimensional map f, where f maps from I to I. Firstly, we showed that the extended chaos degree \(D_S\) for a stable periodic orbit takes a quite small value. Secondly, we showed that under a typical condition, the extended entropic chaos degree \(D_{\infty }\) for a chaotic map f becomes the sum of all Lyapunov exponents of map f where M, L, and \(S_{i,j}\) for \(i,j,=1,2,\ldots ,L^d-1\) are infinite. Here, M is the number of mapped points, L is the number of partitions on each orthogonal axis, and \(1/S_{i,j}\) is the scale of \(A_j \cap f(A_i)\) for the components \(A_i\), \(A_j\) of the finite partitions \( \{A_i\}\) of I.
However, we must treat M, L, \(S_{i,j}\) as finite numbers in the computation of the extended entropic chaos degree \(D_S\). Thus we introduced the extended entropic chaos degree \(D_{S^\mathrm{{max}}}\) rather than \(D_{\infty }\). We confirmed that the extended entropic chaos degree \(D_{S^\mathrm{{max}}}\) for the Hénon map \(f_{b}\), which is a typical two-dimensional chaotic map, takes almost the same value as the sum of all Lyapunov exponents for \(f_b\). On the other hand, the extended entropic chaos degree \(D_{S^\mathrm{max}}\) for the Hénon map \(f_b\) takes a quite small value at some points on b. For any stable periodic map, the extended entropic chaos degree \(D_{S}^\mathrm{max}\) does not work well because it takes a finite negative value as a numerical finiteness of an infinitely negative amount.
Further, we introduced the simplified form \(\overline{D}_{S^\mathrm{{max}}}\) of \(D_{S^\mathrm{{max}}}\). The simplified form \(\overline{D}_{S^\mathrm{{max}}}\) can reduce the computation time while maintaining the computation accuracy of the approximate form \(D_{S^\mathrm{{max}}}\).
References
Eckmann, J.P., Kamphorst, S.O., Ruelle, D., Ciliberto, S.: Lyapunov exponents from time series. Phys. Rev. A 34(9), 4971–4979 (1986)
Inoue, K., Ohya, M., Sato, K.: Application of chaos degree to some dynamical systems. Chaos Soliton. Fract. 11, 1377–1385 (2000)
Inoue, K., Ohya, M., Volovich, I.: Semiclassical properties and chaos degree for the quantum baker’s map. J. Math. Phys. 43(2), 734–755 (2002)
Inoue, K., Ohya, M., Volovich, I.: On a combined quantum baker’s map and its characterization by entropic chaos degree. Open. Syst. Inf. Dyn. 16(2&3), 179–194 (2009)
Kimizawa, T., Hara, T., Ohya, M.: On relations among the entropic chaos degree, the Kolmogorov-Sinai entropy and the Lyapunov exponent. J. Math. Phys. 55, 032702 (2014)
Mao, T., Okutomi, H., Umeno, K.: Investigation of the difference between Chaos Degree and Lyapunov exponent for asymmetric tent maps. JSIAM Letters 11, 61–64 (2019)
Mao, T., Okutomi, H., Umeno, K.: Proposal of improved chaos degree based on interpretation of the difference between chaos degree and Lyapunov exponent. Trans. JSIAM 29(4), 383–394 (2019). (in Japanese)
Ohya, M.: Complexities and their applications to characterization of chaos. Int. J. Theo. Phys. 37(1), 495–505 (1998)
Rosenstein, M.T., Collins, J.J., De Luca, C.J.: A practical method for calculating largest Lyapunov exponents from small data sets. Physica D 65(1–2), 117–134 (1993)
Sato, S., Sano, M., Sawada, Y.: Partical methods of measuring the generalized dimension and the largest Lyanpunov exponent in high dimensional chaotic systems. Prog. Theor. Phys. 77(1), 1–5 (1987)
Sano, M., Sawada, Y.: Measurement of the Lyapunov spectrum from a chaotic time series. Phys. Let. A 209, 327–332 (1995)
Wright, J.: Method for calculating a Lyapunov exponent. Phys. Rev. A 29(5), 2924–2927 (1984)
Wolf, A., Swift, J.B., Swinney, H.L., Vastano, J.A.: Determining Lyapunov exponents from a time series. Physica 16D, 285–317 (1985)
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
This article is published under an open access license. Please check the 'Copyright Information' section either on this page or in the PDF for details of this license and what re-use is permitted. If your intended use exceeds what is permitted by the license or if you are unable to locate the licence and re-use information, please contact the Rights and Permissions team.
About this article
Cite this article
Inoue, K., Mao, T., Okutomi, H. et al. An extension of the entropic chaos degree and its positive effect. Japan J. Indust. Appl. Math. 38, 611–624 (2021). https://doi.org/10.1007/s13160-020-00453-9
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s13160-020-00453-9