Abstract
On the example of the famous Lorenz system, the difficulties and opportunities of reliable numerical analysis of chaotic dynamical systems are discussed in this article. For the Lorenz system, the boundaries of global stability are estimated and the difficulties of numerically studying the birth of self-excited and hidden attractors, caused by the loss of global stability, are discussed. The problem of reliable numerical computation of the finite-time Lyapunov dimension along the trajectories over large time intervals is discussed. Estimating the Lyapunov dimension of attractors via the Pyragas time-delayed feedback control technique and the Leonov method is demonstrated. Taking into account the problems of reliable numerical experiments in the context of the shadowing and hyperbolicity theories, experiments are carried out on small time intervals and for trajectories on a grid of initial points in the attractor’s basin of attraction.
Similar content being viewed by others
Avoid common mistakes on your manuscript.
1 Introduction
In 1963, meteorologist Edward Lorenz suggested an approximate mathematical model (the Lorenz system) for the Rayleigh–Bénard convection and discovered numerically a chaotic attractor in this model [76]. This discovery stimulated rapid development of the chaos theory, numerical methods for attractor investigation, and still attracts much attention of scientists from different fieldsFootnote 1 (see, e.g., [26, 89, 96, 102, 104]). The aim of this work is to discuss the estimates of the global stability and the difficulties of numerically studying the birth of self-excited and hidden attractors, caused by the loss of global stability.
Consider the classical Lorenz system
with physically sound parameters \(\sigma , r > 0\), \(b \in (0,4]\) [76].
An important task in both qualitative and quantitative investigation of dynamical systems is the study of limiting behavior of a system after a transient process, i.e., the problem of revealing and analysis of all possible limiting oscillations. In a theoretical perspective, this problem relates to a generalization [44, 63] of the second part of the celebrated Hilbert’s 16th problem [34] on the number and mutual disposition of attractors and repellers in the chaotic multidimensional dynamical systems, and, in particular, their dependence on the degree of polynomials in the model (see also corresponding discussion, e.g., in [99, 113]). Remark that 16th Hilbert problem is far from complete solution even for two-dimensional polynomial quadratic systems admitting only periodic attractors (see, e.g., [42, 62]).
A limiting oscillation (or a set of oscillations) is called an attractor, if the initial data from its open neighborhood in the phase space (with the exception of a minor set of points) lead to a long-term behavior that approaches it, and its attracting set is called the basin of attraction (i.e., a set of initial data for which the trajectories tend to the attractor).
The examination of all limiting oscillations could be facilitated if for a system it is possible to prove the dissipativeness in the sense of Levinson (or D-property) ([74], see also [67])—the existence of a bounded convex globally absorbing set containing all such oscillations. The Lorenz system (1) is dissipative in the sense of Levinson, and one can consider, e.g., the following absorbing set [60, 61]:
This implies that all solutions of (1) exist for \(t \in [0,+\infty )\) and, thus, system (1) generates a dynamical system. For considered assumptions on parameters, if \(r~<~1\), then system (1) has a unique equilibrium \(S_0 = (0,0,0)\), and if \(r > 1\), then system (1) has three equilibria: \(S_0 = (0,0,0)\) and two symmetric equilibria:
For a system that is dissipative in the sense of Levinson, further study of existence of oscillations is usually connected with the stability of a stationary set. If any trajectory of a system tends to the stationary set, then the system is called globally stable.Footnote 2 In this definition, the stationary set can contain both stable (trivial oscillations) and unstable equilibrium states, i.e., the local stability of all equilibria is not requiredFootnote 3. Various analytical methods, based on the Lyapunov ideas, have been developed (see survey, e.g., [47]) for the study of global stability and estimates of its boundaries in the space of parameters.
Farther, the birth of nontrivial oscillations in a system can be observed when crossing the global stability boundary in the space of parameters. In the simplest case, this is due to the loss of stability of the stationary set. Within this framework, it is naturally to classify oscillations in systems as self-excited or hidden [39, 62, 67, 68]. Basin of attraction of a hidden oscillation in the phase space does not intersect with small neighborhoods of any equilibria, whereas a self-excited oscillation is excited from an unstable equilibrium. A self-excited oscillation is a nontrivial one if it does not approach the stationary states (i.e., \(\omega \)-limit set of corresponding trajectory does not consist of equilibria).
In the general case, when the boundaries of global stability are violated, the birth of oscillations can occur due to local bifurcations in the vicinity of the stationary set (trivial boundary of the global stability)Footnote 4 or nonlocal bifurcations (hidden boundary of the global stability). If an attractor is born via such a nonlocal bifurcation of the loss of global stability, then the attractor is a hidden one since the basin of its attraction is separated from the locally attractive stationary set.
In practice, only problem of the birth of new nontrivial attractors is of interest because there are round-off and truncation errors in numerical experiments and there is noise in physical experiments. That is, if the model has a global bounded convex absorbing set, then over time, the state of the system, observed experimentally, will be attracted to the local attractor contained in the absorbing set. This problem can be considered as a practical interpretation of the problem of determining the boundary of global stability.
2 Inner estimation: the global stability and trivial attractors
For the Lorenz system (1), using several approaches based on the construction of Lyapunov functions it is possible to obtain the following result.
Theorem 1
(criterion for the absence of self-excited and hidden oscillations) If for parameters of system (1) one of the following cases holds:
then there are no nontrivial self-excited and hidden oscillations in the phase space of system (1), and any of its solution (x(t), y(t), z(t)) tends to the stationary set as \(t \rightarrow +\infty \).
Proof
Let us present the sketch of the proof (see [58, 63, 65, 73]) and consider the following three cases.
-
(1)
For \(r \le 1\), system (1) has the unique equilibrium \(S_0\). Thus, the absence of self-excited oscillations follows from the Routh–Hurwitz criterion on local stability for the equilibrium \(S_0\). The absence of hidden oscillations can be obtained by Barbashin–Krasovskii theorem (see, e.g., [7, 47]) and the Lyapunov function \(V(x,y,z) = \frac{1}{2}\big (\frac{x^2}{\sigma } + y^2 + z^2\big )\). For \(r \le 1\), this function satisfies the following relation on the derivative with respect to system (1):
$$\begin{aligned}&\dot{V} (x(t),y(t),z(t)) = -\big (x(t) - \tfrac{r+1}{2}y(t)\big )^2\nonumber \\&\quad - \big (1 {-} \tfrac{(r+1)^2}{4}\big ) y(t)^2 {-} b z(t)^2 {<} 0, \quad \forall x,y,z \ne 0. \end{aligned}$$Also, \(V(x,y,z) \ge 0\), \(V(0,0,0) = 0\) and \(V(x,y,z) \rightarrow \infty \) as \(|(x,y,z)| \rightarrow \infty \); thus, all conditions of Barbashin–Krasovskii theorem are satisfied implying global stability of the unique equilibrium \(S_0\).
For \(r > 1\), system (1) has three equilibria: the saddle equilibrium \(S_0\) and the equilibria \(S_{\pm }\), whose stability depends on the parameters r, \(\sigma \), b. Thus, here the Barbashin–Krasovskii theorem is not applicable. In this case, system (1) may possess nontrivial self-excited oscillations with respect to unstable equilibria and also hidden oscillations.
-
(2)
For \(r > 1\) and \(2 \sigma < b\), the absence of nontrivial oscillations (and, thus, the global stability of the stationary set \(\{S_0, S_\pm \}\)) can be demonstrated (see, e.g., [59]) by the LaSalle principal [54]. For that by the time and coordinate transformations
$$\begin{aligned} \begin{array}{l} t \rightarrow \tau , \quad \psi : (x,y,z) \rightarrow (\chi , \vartheta , \upsilon ), \\ \tau = t \sqrt{\sigma (r-1)}, \quad \chi = \tfrac{x}{\sqrt{b(r-1)}}, \\ \vartheta = \tfrac{\sqrt{\sigma }(y-x)}{\sqrt{b}(r-1)}, \quad \upsilon = \tfrac{b z- x^2}{b (r-1)} \end{array} \end{aligned}$$we transform system (1) to the system
$$\begin{aligned} {\left\{ \begin{array}{ll} \dot{\chi } = \frac{\mathrm{d} \chi }{ \mathrm{d} \tau } = \vartheta , \\ \dot{\vartheta } = \frac{\mathrm{d} \vartheta }{ \mathrm{d} \tau } = - \lambda \vartheta - \chi \upsilon + \chi - \chi ^3, \\ \dot{\upsilon }= \frac{\mathrm{d} \upsilon }{ \mathrm{d} \tau } = -\alpha \upsilon - \beta \chi \vartheta , \end{array}\right. } \end{aligned}$$(4)with \(\lambda =\tfrac{(\sigma +1)}{\sqrt{\sigma (r-1)}}\), \(\alpha =\tfrac{b}{\sqrt{\sigma (r-1)}} > 0\), \(\beta =\tfrac{2\sigma -b}{\sigma } < 0\), and consider the following Lyapunov function:
$$\begin{aligned} V(\chi ,\vartheta ,\upsilon ) = \vartheta ^2 - \frac{\upsilon ^2}{\beta } - \chi ^2 + \frac{\chi ^4}{2}. \end{aligned}$$(5)
\(\square \)
Note that the LaSalle principle requires the compactness of the set, where the Lyapunov function V is defined to show its boundedness from below. In our case, one can show that the inequality \(V(\chi ,\vartheta ,\upsilon ) > -\frac{1}{2}\) is valid for any \((\chi ,\vartheta ,\upsilon ) \in \mathbb {R}^3\). Since \(\beta < 0\), function (5) satisfies the following relation on the derivative with respect to system (4):
From the relation \(\dot{V}(\chi , \vartheta , \upsilon ) = 0\), it follows that the largest invariant set \(M \subset \{(\chi , \vartheta , \upsilon ) \in \mathbb {R}^3 \, \big | \, \dot{V}(\chi , \vartheta , \upsilon ) = 0\}\) consists of the equilibrium points of system (4). Then, according to LaSalle principle any solution of system (4) (and thus system (1)) tends to an equilibrium state as \(\tau \rightarrow +\infty \). The level lines of Lyapunov function (5) surrounding the stationary set are presented in Fig. 1.
For \(2\sigma = b\) and \(\beta = 0\), the third equation in (4) yields \(\upsilon (t) = \upsilon _0 \exp (-\alpha t)\) and thus any trajectory approaches an equilibrium as \(\tau \rightarrow +\infty \).
(3) For \(r > 1\), \(2\sigma >b\), the previous approach with Lyapunov function (5) does not work, and we use a special analytical method based on [40, 41, 56, 95]. The main idea behind this method is choosing a specific nonsingular \((3 \times 3)\) matrix S and differentiable scalar function \(V: \, U \subseteq \mathbb {R}^3 \rightarrow \mathbb {R}^1\), to satisfy the following condition:
where \(\lambda _1(u_0,S)> \lambda _2(u_0,S) > \lambda _3(u_0,S)\) are the eigenvalues of the following symmetrized matrix:
and
is the \(3 \times 3\) Jacobian matrix of system (1).
Condition (6) yields the inequality \(1 < r \le \frac{(\sigma + b) (b + 1)}{\sigma }\) in (3).
(3.1) For \(b \in [0, 2]\) or \(b \in [2, 4]\) and \(1< r < r_0 = \frac{2 (\sigma + b) (b + 1)}{\sigma (1 + l^2)}\), we consider \(S = \left( \begin{array}{ccc} \sqrt{\frac{r}{\sigma }} &{}\quad 0 &{}\quad 0 \\ 0 &{}\quad 1 &{}\quad 0 \\ 0 &{}\quad 0 &{}\quad 1 \end{array} \right) \) and \(V \equiv 0\). Then, condition (6) is equivalent to the following relation:
where \(\mu = -{{\,\mathrm{Tr}\,}}J(u_0) = \sigma +b+1 > 0\). Condition (7) means that all leading principal minors \(\Delta _{1,2,3}\) of the corresponding matrix are positive. For the chosen matrix S, we have \(\Delta _1 = -\sigma + \mu > 0\), \(\Delta _2 = \tfrac{\Delta _3}{(-b + \mu )} + \big (\Delta _3^{''}\big )^2\) and relation (7) can be expressed in the following way:
where \(\Delta _3^{'} = \sqrt{r \sigma } - \frac{z}{2}\sqrt{\frac{\sigma }{r}}\), \(\Delta _3^{''} = \frac{y}{2}\sqrt{\frac{\sigma }{r}}\). Condition (8) can be rewritten as follows:
For the solutions of system (1), the following relation is known [60, 61]:
Using relations (9) and (10), we conclude that inequality (6) is true, when
which matches the initial conditions on parameter b and r.
(3.2) For \(b \in [2, 4]\) and \(r_0 \le r \le \frac{(\sigma + b) (b + 1)}{\sigma }\), we consider \(S = \left( \begin{array}{ccc} -A^{-1} &{} 0 &{} 0 \\ -\tfrac{(b - 1)}{\sigma } &{} 1 &{} 0 \\ 0 &{} 0 &{} 1 \end{array} \right) \) and \(V(x,y,z)=\frac{V_1 (x,y,z)}{[(\sigma -1)^2+4\sigma r]^{1/2}}\), where \(A = \frac{\sigma }{\sqrt{\sigma r + (\sigma -b)(b-1)}}\) and
If \(2\sigma \ge b\), then it is known [60, 61] the following relation for the solutions of system (1):
Using this relation, one can obtain the following estimation for all \(z \ge \tfrac{x^2}{2\sigma }\):
The matrix Q has the following eigenvalues:
for which relation \(\lambda _1(u, S)> \lambda _2(u, S) > \lambda _3(u, S)\) holds.
Then, condition (6) takes the following form:
If \(\gamma _1 \ge \frac{A^2}{8b}+\gamma _3(\frac{2\sigma }{b}+1)\), then using (12), one gets the following estimation:
where
The later inequality \(B_1x^2+B_2xy+B_3y^2 \le 0\) holds for any x, y, if
If one considers the following coefficients (see, e.g., [58]):
then conditions (14) are equivalent to the following conditions:
which are satisfied for \(b \in [2, 4]\) and \(r \ge r_0\).
Thus, for these values condition (6) takes the following form:
which yields estimation \(r < \frac{(\sigma + b) (b + 1)}{\sigma }\) in (3).
This completes the proof. \(\square \)
The case corresponding to conditions (3) of Theorem 1, when all trajectories tend to the stationary set, however, not all equilibria of the stationary set are locally stable, is illustrated in Fig. 2.
Beyond the estimate (3) in Theorem 1, the analysis of global stability and the birth of nontrivial attractors can be performed numerically. It is further known that the separatrix of saddle \(S_{0}\) can form a homoclinic loop from which unstable cycles can arise and violate the global stability (however, a set of measure zero does not affect the global attraction on a stationary set from a practical point of view). Using the Fishing principle [57, 67, 71] for the Lorenz system (1), it is possible to prove the following:
Theorem 2
For \(\sigma \) and b fixed, there exists \(r = r_\mathrm{h}\in (1,+\infty )\) corresponding to the homoclinic orbit of the saddle equilibrium \(S_0\) if and only if \(3\sigma > 2 b + 1\).
For instance, for the classical values of parameters \(\sigma = 10\), \(b = 8/3\) of system (1), it is possible to find numerically the approximate value of such homoclinic bifurcation \(r_\mathrm{h} \approx 13.926\), when two symmetric homoclinic orbits appear forming a homoclinic butterfly (Fig. 3). A further increase in the parameter r leads to the birth of two saddle periodic orbits from each homoclinic orbit [93].
3 Outer estimation: the absence of trivial attractors
For systems with a global absorbing set and an unstable stationary set, the existence of self-excited attractors is obvious. From a computational point of view, this allows one to use a standard computational procedure, in which after a transient process, a trajectory, starting from a point of unstable manifold in a neighborhood of equilibrium, reaches a state of oscillation; therefore, one can easily identify it.
System (1) possesses the absorbing set \(\mathcal {B}\) (defined by Eq. (2)) and for \(\sigma > b~+~1\), \(r > r_\mathrm{cr} = \sigma (\tfrac{\sigma + b + 3}{\sigma - b - 1})\) all equilibria are unstable. Thus, in this case, system (1) has a nontrivial self-excited attractor. If we consider classical values of parameters \(\sigma = 10\), \(b = 8/3\), then for \(r > r_\mathrm{cr}\), e.g., for \(r = 28\), it is possible to observe the self-excited chaotic attractor with respect to all three equilibria \(S_0\), \(S_\pm \) (Fig. 4). This gives an outer estimation of the practical global stability.
In this manner, Lorenz had discovered numerically in the phase space of system (1) the existence of the celebrated chaotic Lorenz attractor from a vicinity of unstable zero equilibrium.
4 The boundary of practical stability and absence of nontrivial attractors
The presence of an absorbing set (Fig. 5) implies the existence of a globally attractor \(\mathcal {A}_\mathrm{glob}\), which contains all local self-excited and hidden attractors, and a stationary set.
Thus, inside the set \(\mathcal {B}\) it is possible to study numerically the presence of nontrivial self-excited and hidden attractors for parameters r, \(\sigma \), b not satisfying conditions (3) of global stability, i.e., by fixing \(\sigma \) and b and by decreasing r from \(r_\mathrm{cr}\). For \(\sigma = 10\), \(b = 8/3\), this gives us the following region \(r \in (r_\mathrm{gs}, r_\mathrm{cr})\), where \(r_\mathrm{gs} \approx 4.64\), \(r_\mathrm{cr} \approx 24.74\).
A nontrivial self-exited attractor can be observed numerically for \(24.06 \lessapprox r < r_\mathrm{cr} \approx 24.74\) (see, e.g., [96]). In this case of nontrivial multistability, system (1) possesses a local chaotic attractor \(\mathcal {A}\) which is self-excited with respect to equilibrium \(S_0\) and coexists with the trivial attractors \(S_\pm \) (Fig. 6).
4.1 Hidden attractor or hidden transient chaotic sets?
For the Lorenz system (1), it is still an open question [39, p. 14], whether for some parameters there exists a hidden chaotic attractor, i.e., whether it is possible by changing parameters to disconnect the basin of attraction from equilibria \(S_0\), \(S_\pm \) (e.g., for the parameters \(\sigma = 10\), \(b = \tfrac{8}{3}\): if \(r = 28\), then attractor is connected with \(S_0\), \(S_\pm \); if \(r = 24.5\), then attractor is connected with only \(S_0\)). The current results on the existence of the hidden attractors in the Lorenz system are the following. Recently reported hidden attractors in the Lorenz system with \(r < r_\mathrm{cr}\) and locally stable equilibria \(S_\pm \) turn out to be a transient chaotic set (a set in the phase space, which can persist for a long time, but after all collapses), but not a sustained hidden chaotic attractor [79, 112].
Since in a numerical computation of a trajectory over a finite-time interval it is difficult to distinguish a sustained chaos from a transient chaos [30, 52], it is reasonable to give a similar classification for transient chaotic sets [14, 18]. A transient chaotic set is called a hidden transient chaotic set if it does not involve and attract trajectories from a small neighborhood of equilibria; otherwise, it is called self-excited.
For an arbitrary system possessing a transient chaotic set, the time of transient process depends strongly on the choice of initial data in the phase space and also on the parameters of numerical solvers to integrate a trajectory (e.g., order of the method, step of integration, relative and absolute tolerances). This complicates the task of distinguishing a transient chaotic set from a sustained chaotic set (attractor) in numerical experiments.
For the Lorenz system (1), suppose that \(\sigma = 10\), \(b = \tfrac{8}{3}\) are fixed and r varies. Near the point \(r \approx 24.06\), it is possible to observe a long living transient chaotic set, which is hidden since its basin of attraction does not intersect with the small vicinities of equilibrium \(S_0\). For example, for \(r = 24\) a hidden transient chaotic set can be visualized [112] from the initial point (2, 2, 2) (Fig. 7). In [79], hidden transient chaotic set was obtained in system (1) with \(r = 29\), \(\sigma = 4\), \(b = 2\).
In our experiments, consider system (1) with \(r = 24\). For a trajectory with a certain initial point, which is computed by a certain solver with specific parameters, we estimate the moment of the end of transient behavior as the moment of time when the trajectory falls into a small vicinity of one of the stable equilibria \(S_\pm \). Using MATLAB’s standard procedure ode45 with default parameters (relative tolerance \(10^{-3}\), absolute tolerance \(10^{-6}\)) for system (1) with parameters \(r = 24\), \(\sigma = 10\), \(b = 8/3\) and for initial point \(u_0 = (20,20,20)\), a transient chaotic behavior is observed on the time interval \([0, \, 1.8 \times 10^{4}]\), for initial point \(u_0 = (-7,8,22)\)—on the time interval \([0,\,7.2 \times 10^{4}]\), for initial point \(u_0 = (2,2,2)\)—on the time interval \([0,\,2.26 \times 10^{5}]\), and for initial point \(u_0 = (0, -0.5, 0.5)\) a transient chaotic behavior continues over a time interval of more than \([0,\,10^{7}]\). Remark that, if we consider the same initial points, but use MATLAB’s procedure ode45 with relative tolerance \(10^{-6}\), for all these initial points the chaotic transient behavior will last over a time interval of more than \([0,\, 10^6]\), and corresponding transient chaotic sets will not collapse. As a conclusion from this numerical study of transient chaotic behavior, we may suggest to specify precisely numerical solver, its parameters, initial data and time interval, along which the transient behavior continues.
4.2 The study of existence of the hidden transient chaotic sets and hidden attractors via the continuation method
In [79, 112], the study of existence of the hidden transient chaotic sets and hidden attractors in the Lorenz system was done by the numerical study of basins of attraction on some 2d cross sections. Next, we demonstrate an approach based on the extension of the parameter space and the numerical continuation method (see “Appendix A”).
Consider the following generalization of the classical Lorenz system [76]:
with parameters \(\sigma , r, b > 0\) and parameter \(a = 0\).
Consider
For the following linear transformation (see, e.g., [60]):
system (1) is transformed to the Glukhovsky–Dolzhansky system [27]:
where
The Glukhovsky–Dolzhansky system describes the convective fluid motion inside a rotating ellipsoidal cavity.
If we set
then after the linear transformation (see, e.g., [60]):
with positive \(\nu _1,\nu _2,h\), we obtain the Rabinovich system [83, 87], describing the interaction of three resonantly coupled waves, two of which being parametrically excited:
where
Following [14], let us briefly describe the experiment, which allows to organize the transition from the hidden attractors in Glukhovsky–Dolzhansky and Rabinovich systems to the hidden transient chaotic set in the Lorenz system.
In this experiment for system (15), we consider three sets of parameters: \(P_\mathrm{GD} \,\big (r = 346, \, a = 0.01, \, \sigma = 4, \, b = 1\big )\) (for the Glukhovsky–Dolzhansky system — GD), \(P_\mathrm{L}\, \big (r = 24, \, a = 0, \, \sigma = 10, \, b = 8/3\big )\) (for the Lorenz system — L), and \(P_\mathrm{R} \,\big (r = 24, \, a = -1 / r - 0.01, \, \sigma = -ar, \, b = b_\mathrm{cr} + 0.14 \big )\) (for the Rabinovich system — R). Here, in contrast to the case of classical Lorenz system considered in previous section, we change the parameters in such a way that hidden Glukhovsky–Dolzhansky and Rabinovich attractors are located not too close to the unstable zero equilibrium so as to avoid a situation that numerically integrated trajectory persists for a long time and then falls on an unstable manifold of the unstable zero equilibrium, then leaves the transient chaotic set, and finally tends to one of the stable equilibria.
Hidden chaotic attractors in the Glukhovsky–Dolzhansky system with \(P_\mathrm{GD} \,\big (r = 346, \, a = 0.01, \, \sigma = 4, \, b = 1\big )\) [66, 67] and in the Rabinovich system with \(P_\mathrm{R} \,\big (r = 24, \, a = -1 / r - 0.01, \, \sigma = -ar, \, b = b_\mathrm{cr} + 0.14 \big )\) [44] could be obtained from the corresponding self-excited attractors by the numerical continuation method (see “Appendix A”).
These sets of parameters define three points, \(P_\mathrm{GD}\), \(P_\mathrm{L}\), and \(P_\mathrm{R}\), in the 4D parameter space \((r, \, a, \, \sigma , \,b)\). Consider two line segments, \(P_\mathrm{GD} \rightarrow P_\mathrm{L}\) and \(P_\mathrm{L} \rightarrow P_\mathrm{R}\), defining two parts of the path in the continuation procedure. Choose the partition of the line segments into \(N_\mathrm{st} = 10\) parts and define intermediate values of parameters as follows: \(P_\mathrm{GD \rightarrow L}^i = P_\mathrm{GD} + \frac{i}{N_\mathrm{st}} (P_\mathrm{L} - P_\mathrm{GD})\) and \(P_\mathrm{L \rightarrow R}^i = P_\mathrm{L} + \frac{i}{N_\mathrm{st}} (P_\mathrm{R} - P_\mathrm{L})\), where \(i = 1, \ldots , N_\mathrm{st}\). Initial points for trajectories of system (15) that define hidden chaotic sets are presented in Table 1. At each iteration of the procedure, a chaotic set defined by the trajectory in the phase space of system (15) is computed using MATLAB’s procedure ode45 with relative and absolute tolerances equal to \(10^{-8}\). The last computed point of the trajectory at the previous step is used as the initial point for computation at the next step.
Thus, using numerical continuation procedure and starting from the hidden attractor in the Glukhovsky–Dolzhansky system (18), it is possible to organize a transition and localize numerically the hidden transient chaotic sets in both Lorenz (1) and Rabinovich (21) systems. One can ensure that in all three cases the trajectories (including separatrices), starting in small neighborhoods of the unstable equilibrium \(S_0 = (0,0,0)\), are not attracted by the computed chaotic set, but tend to the symmetric stable equilibria \(S_\pm \).
5 Exact and finite-time Lyapunov dimension & Lyapunov exponents: global attractor, local attractors, and transient chaotic sets
In this section, we will demonstrate the difficulties in the reliable numerical computation of the finite-time Lyapunov exponents (FTLE) and finite-time Lyapunov dimension (FTLD)Footnote 5, as well as distinguishing with their help an attractor from a transition set.
Before proceeding to the description and discussion of these numerical experiments, let us remark that investigations of the numerical reliability of computer-generated chaotic trajectories have been extensively performed in the context of the shadowing theory and hyperbolicity breakdown (see, e.g., [29, 33, 81, 84, 92]). A computer-generated chaotic trajectory shadows a “true” chaotic trajectory if the former stays uniformly close to the latter and vice versa. Under this assumption, the shadowing of numerical trajectories for a reasonable time span would be a minimum requirement for a meaningful computer simulation of a dynamical system. The obstructions to shadowability vary from mild to severe. For example, hyperbolic chaotic systems have been proved by Anosov to be shadowable for an infinite period of time [3]. However, if non-hyperbolic behavior is caused by manifold tangencies, it has been proved that computer-generated chaotic trajectories shadow “true” trajectories for a finite period of time [91]. Finally, strongly non-hyperbolic systems, like those with unstable dimension variability [38], can be shown to be practically nonshadowable since the shadowing time may be very small. In particular, the existence of fluctuations of the FTLE is a numerical fingerprint of shadowability breakdown via unstable dimension variability (see, e.g., [90, 105,106,107]).
Since the classical Lorenz system (1) has a property of singular hyperbolicity (or quasi-hyperbolicity), only finite shadowability is possible for it (see, e.g., [4, 16]). Taking into account these problems, the experiments are carried out on small time intervals and for trajectories on a grid of initial points in the attractor’s basin of attraction.
5.1 The problem of choosing a time interval: attractor vs transient set
Consider system (1) with parameters \(r = 24\), \(\sigma = 10\), \(b = 8/3\) and integrate numerically the trajectory with initial data \(u_{0} = (20,\,20,\,20)\) using MATLAB’s standard procedure ode45 with default parameters (relative tolerance \(10^{-3}\), absolute tolerance \(10^{-6}\)). We numerically approximate the finite-time Lyapunov exponents and finite-time Lyapunov dimension, using the algorithm from [44]. Integration with \(t > T_1 \approx 18082\) leads to the collapse of the “attractor,” i.e., the “attractor” turns out to be a transient chaotic set. However, on the time interval \(t \in [0,~T_3 \approx 6.9 \times 10^5]\) we have \({{\,\mathrm{LE}\,}}_1(t, \, u_0) > 0\) and, thus, may conclude that the behavior is chaotic, and for the time interval \(t \in [0,~T_2 \approx 3.443 \times 10^5]\) we have \(\dim _\mathrm{L}(t, u_0) > 2\). Thus, the estimation of duration of the transient behavior by analyzing the sign of the largest Lyapunov exponent could lead to the wrong conclusion.
This numerical phenomenon can be explained due to the fact that the finite-time Lyapunov exponents and Lyapunov dimension are averaged during computation over the considered time interval. Since the “lifetime” of a transient chaotic process can be extremely long and in view of the limitations of reliable integration of chaotic ODEs (which we will discuss in the next subsection), even longtime computation of the finite-time Lyapunov exponents and the finite-time Lyapunov dimension does not guarantee a relevant approximation of the Lyapunov exponents and the Lyapunov dimension.
Remark that, if we choose the same initial point \(u_0 = (20,20,20)\), as in the previous experiment, but use MATLAB’s procedure ode45 with relative tolerance \(10^{-6}\), the chaotic transient process will last over a time interval of more than \([0,\, 10^6]\), and the transient chaotic set will not collapse. If now we choose a new initial point \(u_0 = (10,10,10)\), it would be possible to observe a chaotic transient process over the time interval \([0, T_1 \approx 6.85 \times 10^5]\), while \({{\,\mathrm{LE}\,}}_1(t, \, u_0) > 0\) and \(\dim _\mathrm{L}(t, u_0) > 2\) would be satisfied on the time intervals \(t \in [0,~T_{2,3}]\), where \(T_{2,3} \gg 10^6\).
5.2 The problem of choosing the time interval and initial data: attractor and embedded unstable periodic orbits
Consider the challenges of the finite-time Lyapunov dimension computation along the trajectories over large time intervals (see, e.g., [48,49,50,51]), which is connected with the existence of unstable periodic orbits (UPOs) embedded in chaotic attractor. The “skeleton” of a chaotic attractor comprises embedded unstable periodic orbits (UPOs) (see, e.g., [1, 6, 17]), and one of the effective methods among others for the computation of UPOs is the delayed feedback control (DFC) approach, suggested by K. Pyragas [85] (see also discussions in [15, 45, 55]). This approach allows Pyragas and his progeny to stabilize and study UPOs in various chaotic dynamical systems. Nevertheless, some general analytical results have been obtained [35], showing that DFC has a certain limitation, called the odd number limitation (ONL), which is connected with an odd number of real Floquet multipliers larger than unity. In order to overcome ONL, later Pyragas suggested a modification of the classical DFC technique, which was called the unstable delayed feedback control (UDFC) [86].
Rewrite system (1) in a general form
Let \(u^\mathrm{upo}(t,u^\mathrm{upo_1}_0)\) be its UPO with period \(\tau > 0\), \(u^\mathrm{upo}(t - \tau ,u^\mathrm{upo_1}_0) = u^\mathrm{upo}(t,u^\mathrm{upo_1}_0)\), and initial condition \(u^\mathrm{upo_1}_0=u^\mathrm{upo}(0,u^\mathrm{upo_1}_0)\). To compute the UPO and overcome ONL, we add the UDFC in the following form:
where \(0 \le R < 1\) is an extended DFC parameter, \(N = 1,2,\ldots ,\infty \) defines the number of previous states involved in delayed feedback function \(F_N(t)\), \(\lambda _c^0 > 0\), and \(\lambda _c^\infty < 0\) are additional unstable degree of freedom parameters, B, C are vectors and \(K > 0\) is a feedback gain. For initial condition \(u^\mathrm{upo_1}_0\) and \(T = \tau \), we have
and, thus, the solution of system (24) coincides with the periodic solution of initial system (23).
For the Lorenz system (1) with parameters \(r = 28\), \(\sigma = 10\), \(b = 8/3\) using (24) with \(B^* = \left( 0, 1, 0\right) \), \(C^* = \left( 0, 1, 0\right) \), \(R = 0.7\), \(N =100\), \(K = 3.5\), \(\lambda ^0_c = 0.1\), \(\lambda ^\infty _c = -2\), one can stabilize a period-1 UPO \(u^\mathrm{upo_1}(t,u_0)\) with period \(\tau _1 = 1.5586...\) from the initial point \(u_0 = (1, 1, 1)\), \(w_0 = 0\) (Fig. 12). Results of this experiment could be repeated using various other numerical approaches (see, e.g., [13, 82, 110]) and are in agreement with similar results on the existence of UPOs embedded in the Lorenz attractor [8, 25]. However, the Pyragas procedure, in general, is more convenient for UPOs numerical visualization and finds widespread application in a rich variety of chaos control problems (see, e.g., [12, 23, 94]).
For the initial point \(u^\mathrm{upo_1}_0 \approx (-6.2262, -11.0027, 13.0515)\) on the UPO \(u^\mathrm{upo_{1}}(t) = u(t, u^\mathrm{upo_1}_0)\), we numerically compute the trajectory of system (24) without the stabilization (i.e., with \(K = 0\)) on the time interval \([0,T=100]\) (Fig. 12b). We denote it by \(\tilde{u}(t, u^\mathrm{upo_1}_0)\) to distinguish this pseudo-trajectory from the periodic orbit \(u(t, u^\mathrm{upo_1}_0)\). One can see that on the initial small time interval \([0,T_1 \approx 11]\), even without the control, the obtained trajectory \(\tilde{u}(t, u^\mathrm{upo_1}_0)\) traces approximately the “true” periodic orbit \(u(t, u^\mathrm{upo_1}_0)\). But for \(t > T_1\), without a control, the trajectory \(\tilde{u}(t, u^\mathrm{upo_1}_0)\) diverges from \(u^\mathrm{upo_1}(t, u^\mathrm{upo_1}_0)\) and visualizes a local chaotic attractor \(\mathcal {A}\).
We use the adaptive algorithm for the computation of the finite-time Lyapunov dimension and exponents for trajectories on the local attractor \(\mathcal {A}\) [44]. In order to distinguish the corresponding values for the stabilized UPO \(u(t,u^\mathrm{upo_1}_0)\) and for the pseudo-trajectory \({\tilde{u}}(t, u^\mathrm{upo_1}_0)\) computed without Pyragas stabilization in our experiment, we use the following notations for finite-time Lyapunov dimensions: \(\dim _\mathrm{L}(u(t, \cdot ), u^\mathrm{upo_1}_0)\) and \(\dim _\mathrm{L}({\tilde{u}}(t, \cdot ), u^\mathrm{upo_1}_0)\), respectively.
The comparison of the obtained values of finite-time Lyapunov dimensions computed along the stabilized UPO and the trajectory without stabilization gives us the following results. On the initial small part of the time interval, one can observe the coincidence of these values with a sufficiently high accuracy. For the UPO and for the unstabilized trajectory, the finite-time local Lyapunov dimensions \(\dim _\mathrm{L}(u(t, \cdot ), u^\mathrm{upo_1}_0)\) and \(\dim _\mathrm{L}({\tilde{u}}(t, \cdot ), u^\mathrm{upo_1}_0)\) coincide up to the 4th decimal place inclusive on the interval \([0,t_m^1 \approx 7\tau _1]\). After \(t > t_m^1\), the difference in values becomes significant and the corresponding graphics diverge in such a way that the part of the graph corresponding to the unstabilized trajectory is lower than the part of the graph corresponding to the UPO (see Figs. 13b, 14).
The Jacobi matrix at the saddle-foci equilibria \(S_\pm \) has simple eigenvalues, which give the following: \(\dim _\mathrm{L} S_\pm = 2.0136\). The UPO \(u^\mathrm{upo_1}\) with period \(\tau _1 = 1.5586\) has the following Floquet multipliers: \(\rho _1 = 4.7127\), \(\rho _2~=~1\), \(\rho _3 = -1.19 \times 10^{-10}\) and corresponding Lyapunov exponents: \(\{ \frac{1}{\tau _1} \log \rho _i \}_{i=1}^3\). Thus, for the local Lyapunov dimension of this UPO, we obtain: \(\dim _\mathrm{L} u^\mathrm{upo_1} = 2.0678 \lessapprox 2.0679 = \dim _\mathrm{L}(u(100, \cdot ), u^\mathrm{upo_1}_0)\).
Also remark that system (1) has the analytical solution \(u(t) = (0, 0, z_0 \exp (-b t))\) which tends to the equilibrium \(S_0 = (0,0,0)\) from any initial point \((0, 0, z_0) \in \mathbb {R}^3\). In general, the existence of such solutions in the phase space complicates the procedure of visualization of a chaotic attractor (pseudo-attractor) by one pseudo-trajectory with arbitrary initial data computed for a sufficiently large time interval (see, e.g., [79, 97]). In particular, the numerical computation of finite-time local Lyapunov exponents along this trajectory during for any time interval does not lead to averaging of these values across the attractor, but to tending of these values to the finite-time local Lyapunov exponents of \(S_0\).
5.3 Rigorous analytical computation for the global attractor
Using an effective analytical technique, proposed by Leonov [40, 56], it is possible to obtain [65, 70] the exact formula of the Lyapunov dimension for the global attractor \(\mathcal {A}_\mathrm{glob}\) of the Lorenz system (1):
for the case, when conditions (3) of the Theorem 1 are not satisfied.
For the Lorenz system (1) with classical values of parameters \(r = 28\), \(\sigma = 10\), \(b = 8/3\), we have the following relations:
Here, since the global Lorenz attractor contains a period-1 UPO: \(\mathcal {A}_\mathrm{glob} \supset u^\mathrm{upo_1}\), we have the following lower-bound estimate for the Lyapunov dimension: \(\dim _\mathrm{L} \mathcal {A}_\mathrm{glob} \ge 2.0678 = \dim _\mathrm{L} {u}^\mathrm{upo_1}\). Similar experiment and results for the Rössler system [88] are presented in [48, 50].
Concerning the time of integration, remark that while the time series obtained from a physical experiment are assumed to be reliable on the whole considered time interval, the time series produced by the integration of mathematical dynamical model can be reliable on a limited time interval only due to computational errors (caused by finite precision arithmetic and numerical integration of ODE). Thus, in general, the closeness of the real trajectory \(u(t,u_0)\) and the corresponding pseudo-trajectory \({\tilde{u}}(t,u_0)\) calculated numerically can be guaranteed on a limited short time interval only.
In our experiment, if we continue computation over a long time interval [0, 10000] of FTLD along the stabilized UPO and the pseudo-trajectory obtained without Pyragas stabilization, as a result, completely different values will be obtained (Fig. 14). Evolution of \(\dim _\mathrm{L}(u(t, \cdot ), u^\mathrm{upo_1}_0)\) along the stabilized UPO will tend to the analytical value \(\dim _\mathrm{L} {u}^\mathrm{upo_1} = 2.0678\), computed via Floquet multipliers, while evolution of \(\dim _\mathrm{L}(\tilde{u}(t, \cdot ), u^\mathrm{upo_1}_0)\) along the pseudo-trajectory will converge to the value 2.0622Footnote 6. These results are in good agreement with the rigorous analysis of the time interval choices for reliable numerical computation of trajectories for the Lorenz system. The time interval for reliable computation with 16 significant digits and error \(10^{-4}\) is estimated as [0, 36], with error \(10^{-8}\) is estimated as [0, 26] (see [36, 37]), and reliable computation for a longer time interval, e.g., [0, 10000] in [75], is a challenging task that requires a significant increase in the precision of the floating-point representation and the use of supercomputers.
6 Conclusion
In this work, for the classical Lorenz system, the boundaries of practical global stability are estimated and the difficulties of numerically studying the birth of self-excited and hidden attractors, caused by the loss of global stability, are discussed. Difficulties in localization and numerical analysis of hidden transient chaotic sets in the Lorenz system are emphasized in the experiments on computation of the largest finite-time Lyapunov exponent and finite-time Lyapunov dimension along trajectories with different initial data and large time intervals. The classical self-excited Lorenz attractor is considered, and the applications of the Pyragas time-delayed feedback control technique and Leonov analytical method are demonstrated for the Lyapunov dimension estimation, as well as for the verification of the famous Eden’s conjecture on the maximum value of this characteristic that could be achieved on the attractor. The problem of reliable numerical computation of the finite-time Lyapunov dimension along the trajectories over large time intervals is discussed.
Notes
The original celebrated work by Lorenz [76] has gained more than 21,500 citations according to Google Scholar.
We use the term “global stability” for simplicity of further discussion, while in the literature there are used different terms like “globally asymptotically stable” [108, p. 137], [31, p. 144], “gradient-like” [72, p. 2], [111, p. 56], “quasi-gradient-like” [72, p. 2], [111, p. 56] and others, reflecting the features of the stationary set and the convergence of trajectories to it.
This can be demonstrated on the example suggested by Vinograd [109] (see also [32, p. 191]): \(\dot{x} = \tfrac{x^2 (y - x) + y^5}{(x^2 + y^2)(1 + (x^2 + y^2)^2)}\), \(\dot{y} = \tfrac{y^2 (y - 2 x)}{(x^2 + y^2)(1 + (x^2 + y^2)^2)}\). Here, a planar system with a unique globally attractive equilibrium of the saddle type has a family of homoclinic orbits. Also, global stability in the presence of locally unstable equilibria is a typical case for systems describing pendulums, PLLs [11, 21, 46, 69], and electric machines [64].
See corresponding definitions in “Appendix B.”
The following results on the dimension of the Lorenz attractor with parameters \(r=28\), \(\sigma =10\), \(b=8/3\) can be found in the literature. In [28, p. 193] and [10, p. 3529], the fractal (box counting, capacity) dimension is estimated as \(\mathbf {2.06 \pm 0.01}\). For the correlation dimension, the following results are known: \(\mathbf {2.05 \pm 0.01}\) in [28, p. 193] and [103, p. 456]; \(\mathbf {2.06 \pm 0.03}\) in [78, p. 47]; \(\mathbf {2.049 \pm 0.096}\) in [100, p. 1874]; \(\mathbf {2.05}\) in [24, p. 80]. For the Lyapunov dimension, the following values have been computed: \(\mathbf {2.063}\) in [77, p. 92] and [80, p. 1957]; \(\mathbf {2.05}\) in [19, p. 267]; \(\mathbf {2.062}\) in [100, p. 1874], [97, p. 115] and [53, p. 53]; \(\mathbf {2.06215}\) [98, p. 033124-3] and [24, p. 83]. Also, let us mention estimates for the global attractor: \(2.401 \le \dim _\mathrm{L} \mathcal {A_\mathrm{glob}} \le 2.409\) [22, p. 170] and \(\dim _\mathrm{L} \mathcal {A_\mathrm{glob}} \approx 2.401...\) in [19, p. 267].
In the simplest case, when \(d = 1\), the path is a line segment.
Symbol \(^*\) denotes the transposition of matrix.
References
Afraımovic, V., Bykov, V., Silnikov, L.: On the origin and structure of the Lorenz attractor. Dokl. Akad. Nauk SSSR 234(2), 336–339 (1977)
Andronov, A., Vitt, E., Khaikin, S.: Theory of Oscillators. Pergamon Press, Oxford (1966)
Anosov, D.: Geodesic flows on closed Riemannian manifolds of negative curvature. Proc. Steklov Inst. Math. 90(1) (1967)
Araujo, V., Pacifico, M., Pujals, E., Viana, M.: Singular-hyperbolic attractors are chaotic. Trans. Am. Math. Soc. 361(5), 2431–2485 (2009)
Arnold, V., Afraimovich, V., Ilyashenko, Y., Shilnikov, L.: Dynamical Systems V: Bifurcation Theory and Catastrophe Theory. Encyclopaedia of Mathematical Sciences, Vol. 5, p. 274, Springer, Berlin (1994). https://doi.org/10.1007/978-3-642-57884-7
Auerbach, D., Cvitanović, P., Eckmann, J.P., Gunaratne, G., Procaccia, I.: Exploring chaotic motion through periodic orbits. Phys. Rev. Lett. 58(23), 2387 (1987)
Barbashin, E., Krasovsky, N.: On the stability of a motion in the large. Dokl. Akad. Nauk SSSR 86(3), 453–456 (1952). (In Russian)
Barrio, R., Dena, A., Tucker, W.: A database of rigorous and high-precision periodic orbits of the Lorenz model. Comput. Phys. Commun. 194, 76–83 (2015)
Bautin, N.: The Behaviour of Dynamical Systems close to the Boundaries of a Stability Domain. Gostekhizdat (in Russian), Leningrad (1949)
Benzi, R., Paladin, G., Parisi, G., Vulpiani, A.: On the multifractal nature of fully developed turbulence and chaotic systems. J. Phys. A Math. Gen. 17(18), 3521 (1984)
Best, R., Kuznetsov, N., Leonov, G., Yuldashev, M., Yuldashev, R.: Tutorial on dynamic analysis of the Costas loop. IFAC Annu. Rev. Control 42, 27–49 (2016). https://doi.org/10.1016/j.arcontrol.2016.08.003
Boccaletti, S., Grebogi, C., Lai, Y.C., Mancini, H., Maza, D.: The control of chaos: theory and applications. Phys. Rep. 329(3), 103–197 (2000)
Budanov, V.: Undefined frequencies method. Fundam. Prikl. Mat. 22, 59–71 (2018). (in Russian)
Chen, G., Kuznetsov, N., Leonov, G., Mokaev, T.: Hidden attractors on one path: Glukhovsky–Dolzhansky, Lorenz, and Rabinovich systems. Int. J. Bifurc. Chaos Appl. Sci. Eng. 27(8), 1750115 (2017)
Chen, G., Yu, X.: On time-delayed feedback control of chaotic systems. IEEE Trans. Circuits Syst. I Fundam. Theory Appl. 46(6), 767–772 (1999)
Coomes, B., Kocak, H., Palmer, K.: Rigorous computational shadowing of orbits of ordinary differential equations. Numer. Math. 69(4), 401–421 (1995)
Cvitanović, P.: Periodic orbits as the skeleton of classical and quantum chaos. Phys. D Nonlinear Phenom. 51(1–3), 138–151 (1991)
Danca, M.F., Kuznetsov, N.: Hidden chaotic sets in a Hopfield neural system. Chaos Solitons Fractals 103, 144–150 (2017). https://doi.org/10.1016/j.chaos.2017.06.002
Doering, C.R., Gibbon, J.: On the shape and dimension of the Lorenz attractor. Dyn. Stab. Syst. 10(3), 255–268 (1995)
Douady, A., Oesterle, J.: Dimension de Hausdorff des attracteurs. C.R. Acad. Sci. Paris, Ser. A. (in French) 290(24), 1135–1138 (1980)
Dudkowski, D., Jafari, S., Kapitaniak, T., Kuznetsov, N., Leonov, G., Prasad, A.: Hidden attractors in dynamical systems. Phys. Rep. 637, 1–50 (2016). https://doi.org/10.1016/j.physrep.2016.05.002
Eden, A., Foias, C., Temam, R.: Local and global Lyapunov exponents. J. Dyn. Differ. Equ. 3(1), 133–177 (1991). https://doi.org/10.1007/BF01049491. [Preprint No. 8804, The Institute for Applied Mathematics and Scientific Computing, Indiana University, 1988]
Fradkov, A., Evans, R.: Control of chaos: methods and applications in engineering. Annu. Rev. Control 29(1), 33–56 (2005)
Fuchs, A.: Nonlinear Dynamics in Complex Systems. Springer, Berlin (2013)
Galias, Z., Tucker, W.: Short periodic orbits for the Lorenz system. In: 2008 International Conference on Signals and Electronic Systems, pp. 285–288. IEEE (2008)
Galias, Z., Zgliczyński, P.: Computer assisted proof of chaos in the Lorenz equations. Phys. D 115, 165–188 (1998)
Glukhovsky, A.B., Dolzhansky, F.V.: Three component models of convection in a rotating fluid. Izv. Acad. Sci. USSR, Atmos. Oceanic Phys. 16, 311–318 (1980)
Grassberger, P., Procaccia, I.: Measuring the strangeness of strange attractors. Phys. D Nonlinear Phenom. 9(1–2), 189–208 (1983)
Grebogi, C., Hammel, S., Yorke, J., Sauer, T.: Shadowing of physical trajectories in chaotic dynamics: containment and refinement. Phys. Rev. Lett. 65(13), 1527 (1990)
Grebogi, C., Ott, E., Yorke, J.: Fractal basin boundaries, long-lived chaotic transients, and unstable-unstable pair bifurcation. Phys. Rev. Lett. 50(13), 935–938 (1983)
Haddad, W., Chellaboina, V.: Nonlinear Dynamical Systems and Control: A Lyapunov-Based Approach. Princeton University Press, Princeton (2011)
Hahn, W.: Stability of Motion. Springer, Berlin (1967)
Hammel, S., Yorke, J., Grebogi, C.: Numerical orbits of chaotic processes represent true orbits. Bull. Am. Math. Soc. 19(2), 465–469 (1988)
Hilbert, D.: Mathematical problems. Bull. Am. Math. Soc. 8, 437–479 (1902)
Hooton, E., Amann, A.: Analytical limitation for time-delayed feedback control in autonomous systems. Phys. Rev. Lett. 109, 101–154 (2012)
Kehlet, B., Logg, A.: Quantifying the computability of the Lorenz system using a posteriori analysis. In: Proceedings of the VI International Conference on Adaptive Modeling and Simulation (ADMOS 2013) (2013)
Kehlet, B., Logg, A.: A posteriori error analysis of round-off errors in the numerical solution of ordinary differential equations. Numer. Algorithms 76(1), 191–210 (2017)
Kostelich, E., Kan, I., Grebogi, C., Ott, E., Yorke, J.: Unstable dimension variability: a source of nonhyperbolicity in chaotic systems. Phys. D Nonlinear Phenom. 109(1–2), 81–90 (1997)
Kuznetsov, N.: Hidden attractors in fundamental problems and engineering models. A short survey. Lecture Notes in Electrical Engineering 371, 13–25 (2016). (Plenary lecture at International Conference on Advanced Engineering Theory and Applications 2015). https://doi.org/10.1007/978-3-319-27247-4_2
Kuznetsov, N.: The Lyapunov dimension and its estimation via the Leonov method. Phys. Lett. A 380, 25–26 (2016). https://doi.org/10.1016/j.physleta.2016.04.036
Kuznetsov, N., Alexeeva, T., Leonov, G.: Invariance of Lyapunov exponents and Lyapunov dimension for regular and irregular linearizations. Nonlinear Dyn. 85(1), 195–201 (2016). https://doi.org/10.1007/s11071-016-2678-4
Kuznetsov, N., Kuznetsova, O., Leonov, G.: Visualization of four normal size limit cycles in two-dimensional polynomial quadratic system. Differ. Equ. Dyn. Syst. 21(1–2), 29–34 (2013). https://doi.org/10.1007/s12591-012-0118-6
Kuznetsov, N., Kuznetsova, O., Leonov, G., Mokaev, T., Stankevich, N.: Hidden attractors localization in Chua circuit via the describing function method. IFAC-PapersOnLine 50(1), 2651–2656 (2017)
Kuznetsov, N., Leonov, G., Mokaev, T., Prasad, A., Shrimali, M.: Finite-time Lyapunov dimension and hidden attractor of the Rabinovich system. Nonlinear Dyn. 92(2), 267–285 (2018). https://doi.org/10.1007/s11071-018-4054-z
Kuznetsov, N., Leonov, G., Shumafov, M.: A short survey on Pyragas time-delay feedback stabilization and odd number limitation. IFAC-PapersOnLine 48(11), 706–709 (2015). https://doi.org/10.1016/j.ifacol.2015.09.271
Kuznetsov, N., Leonov, G., Yuldashev, M., Yuldashev, R.: Hidden attractors in dynamical models of phase-locked loop circuits: limitations of simulation in MATLAB and SPICE. Commun. Nonlinear Sci. Numer. Simul. 51, 39–49 (2017). https://doi.org/10.1016/j.cnsns.2017.03.010
Kuznetsov, N., Lobachev, M., Yuldashev, M., Yuldashev, R., Kudryashova, E., Kuznetsova, O., Rosenwasser, E., Abramovich, S.: The birth of the global stability theory and the theory of hidden oscillations. In: 2020 European Control Conference Proceedings, pp. 769–774 (2020)
Kuznetsov, N., Mokaev, T.: Numerical analysis of dynamical systems: unstable periodic orbits, hidden transient chaotic sets, hidden attractors, and finite-time Lyapunov dimension. J. Phys. Conf. Ser. (2019). https://doi.org/10.1088/1742-6596/1205/1/012034
Kuznetsov, N., Mokaev, T., Alexeeva, T.: On lower-bound estimates of the Lyapunov dimension and topological entropy via Pyragas control. In: International Conference “Stability, Control, Differential Games” devoted to the 95th anniversary of Academician N.N. Krasovskii (Yekaterinburg), pp. 425–428 (2019)
Kuznetsov, N., Mokaev, T., Kudryashova, E., Kuznetsova, O., Danca, M.F.: On lower-bound estimates of the Lyapunov dimension and topological entropy for the Rossler systems. IFAC-PapersOnLine pp. 97–102 (2019). (15th IFAC Workshop on Time Delay Systems)
Kuznetsov, N., Mokaev, T., Mokaev, R., Kuznetsova, O., Kudryashova, E.: A lower-bound estimate of the Lyapunov dimension for the global attractor of the Lorenz system. arXiv preprint arXiv:1910.08740 (2019)
Lai, Y., Tel, T.: Transient Chaos: Complex Dynamics on Finite Time Scales. Springer, New York (2011)
Lappa, M.: Thermal Convection: Patterns, Evolution and Stability. Wiley, Hoboken (2009)
LaSalle, J.: Some extensions of Liapunov’s second method. IRE Trans. Circuit Theory 7(4), 520–527 (1960)
Lehnert, J., Hövel, P., Flunkert, V., Guzenko, P., Fradkov, A., Schöll, E.: Adaptive tuning of feedback gain in time-delayed feedback control. Chaos Interdiscip. J. Nonlinear Sci. 21(4), 43–111 (2011)
Leonov, G.: On estimations of Hausdorff dimension of attractors. Vestnik St. Petersburg University: Mathematics 24(3), 38–41 (1991). [Transl. from Russian: Vestnik Leningradskogo Universiteta. Mathematika, 24(3), 1991, pp. 41-44]
Leonov, G.: Shilnikov chaos in Lorenz-like systems. Int. J. Bifurc. Chaos (2013). https://doi.org/10.1142/S0218127413500582
Leonov, G.: Lyapunov functions in the global analysis of chaotic systems. Ukr. Mat. J. 70(1), 40–62 (2018). (in Russian)
Leonov, G., Andrievskiy, B., Mokaev, R.: Asymptotic behavior of solutions of Lorenz-like systems: Analytical results and computer error structures. Vestnik St. Petersburg University. Mathematics 50(1), 15–23 (2017)
Leonov, G., Boichenko, V.: Lyapunov’s direct method in the estimation of the Hausdorff dimension of attractors. Acta Applicandae Math. 26(1), 1–60 (1992)
Leonov, G., Bunin, A., Koksch, N.: Attraktorlokalisierung des Lorenz-systems. ZAMM J. Appl. Math. Mech. Zeitschrift fur Angewandte Mathematik und Mechanik 67(12), 649–656 (1987)
Leonov, G., Kuznetsov, N.: Hidden attractors in dynamical systems from hidden oscillations in Hilbert-Kolmogorov, Aizerman, and Kalman problems to hidden chaotic attractors in Chua circuits. Int. J. Bifurc. Chaos Appl. Sci. Eng.23(1) (2013). https://doi.org/10.1142/S0218127413300024. art. no. 1330002
Leonov, G., Kuznetsov, N.: On differences and similarities in the analysis of Lorenz, Chen, and Lu systems. Appl. Math. Comput. 256, 334–343 (2015). https://doi.org/10.1016/j.amc.2014.12.132
Leonov, G., Kuznetsov, N., Kiseleva, M., Solovyeva, E., Zaretskiy, A.: Hidden oscillations in mathematical model of drilling system actuated by induction motor with a wound rotor. Nonlinear Dyn. 77(1–2), 277–288 (2014). https://doi.org/10.1007/s11071-014-1292-6
Leonov, G., Kuznetsov, N., Korzhemanova, N., Kusakin, D.: Lyapunov dimension formula for the global attractor of the Lorenz system. Commun. Nonlinear Sci. Numer. Simul. 41, 84–103 (2016). https://doi.org/10.1016/j.cnsns.2016.04.032
Leonov, G., Kuznetsov, N., Mokaev, T.: Hidden attractor and homoclinic orbit in Lorenz-like system describing convective fluid motion in rotating cavity. Commun. Nonlinear Sci. Numer. Simul. 28, 166–174 (2015). https://doi.org/10.1016/j.cnsns.2015.04.007
Leonov, G., Kuznetsov, N., Mokaev, T.: Homoclinic orbits, and self-excited and hidden attractors in a Lorenz-like system describing convective fluid motion. Eur. Phys. J. Spec. Top. 224(8), 1421–1458 (2015). https://doi.org/10.1140/epjst/e2015-02470-3
Leonov, G., Kuznetsov, N., Vagaitsev, V.: Localization of hidden Chua’s attractors. Phys. Lett. A 375(23), 2230–2233 (2011). https://doi.org/10.1016/j.physleta.2011.04.037
Leonov, G., Kuznetsov, N., Yuldashev, M., Yuldashev, R.: Hold-in, pull-in, and lock-in ranges of PLL circuits: rigorous mathematical definitions and limitations of classical theory. IEEE Trans. Circuits Syst. I Regul. Papers 62(10), 2454–2464 (2015). https://doi.org/10.1109/TCSI.2015.2476295
Leonov, G., Lyashko, S.: Eden’s hypothesis for a Lorenz system. Vestnik St. Petersburg University: Mathematics 26(3), 15–18 (1993). [Transl. from Russian: Vestnik Sankt-Peterburgskogo Universiteta. Ser 1. Matematika, 26(3), 14-16]
Leonov, G., Mokaev, R., Kuznetsov, N., Mokaev, T.: Homoclinic bifurcations and chaos in the Fishing principle for the Lorenz-like systems. Int. J. Bifurc. Chaos 30(8), (2020). https://doi.org/10.1142/S0218127420501242
Leonov, G., Reitmann, V., Smirnova, V.: Nonlocal Methods for Pendulum-like Feedback Systems. Teubner, Stuttgart-Leipzig (1992)
Leonov, G.A.: Lyapunov functions in the attractors dimension theory. J. Appl. Math. Mech. 76(2), 129–141 (2012)
Levinson, N.: Transformation theory of non-linear differential equations of the second order. Ann. Math. 723–737 (1944)
Liao, S., Wang, P.: On the mathematically reliable long-term simulation of chaotic solutions of Lorenz equation in the interval [0,10000]. Sci. China Phys. Mech. Astron. 57(2), 330–335 (2014)
Lorenz, E.: Deterministic nonperiodic flow. J. Atmos. Sci. 20(2), 130–141 (1963)
Lorenz, E.: The local structure of a chaotic attractor in four dimensions. Phys. D Nonlinear Phenom. 13(1–2), 90–104 (1984)
Malinetskii, G., Potapov, A.: On calculating the dimension of strange attractors. USSR Comput. Math. Math. Phys. 28(4), 39–49 (1988)
Munmuangsaen, B., Srisuchinwong, B.: A hidden chaotic attractor in the classical Lorenz system. Chaos Solitons Fractals 107, 61–66 (2018)
Nese, J., Dutton, J., Wells, R.: Calculated attractor dimensions for low-order spectral models. J. Atmos. Sci. 44(15), 1950–1972 (1987)
Palmer, K.: Shadowing in Dynamical Systems: Theory and Applications, vol. 501. Springer, Berlin (2013)
Pchelintsev, A., Polunovskiy, A., Yukhanova, I.: The harmonic balance method for finding approximate periodic solutions of the Lorenz system. Tambov University Reports. Series: Natural and Technical Sciences 24, 187–203 (2019). (in Russian)
Pikovski, A., Rabinovich, M., Trakhtengerts, V.: Onset of stochasticity in decay confinement of parametric instability. Sov. Phys. JETP 47, 715–719 (1978)
Pilyugin, S.: Theory of shadowing of pseudotrajectories in dynamical systems. Differencialnie Uravnenia i Protsesy Upravlenia (Differential Equations and Control Processes) 4, 96–112 (2011)
Pyragas, K.: Continuous control of chaos by self-controlling feedback. Phys. Lett. A 170(6), 421–428 (1992)
Pyragas, K.: Control of chaos via an unstable delayed feedback controller. Phys. Rev. Lett. 86, 2265–2268 (2001)
Rabinovich, M.I.: Stochastic self-oscillations and turbulence. Soviet Physics Uspekhi 21(5), 443–469 (1978)
Rössler, O.: An equation for continuous chaos. Phys. Lett. A 57(5), 397–398 (1976)
Ruelle, D.: The Lorenz attractor and the problem of turbulence. In: Turbulence and Navier Stokes Equations, pp. 146–158. Springer, Berlin (1976)
Sauer, T.: Shadowing breakdown and large errors in dynamical simulations of physical systems. Phys. Rev. E 65(3), 036220 (2002)
Sauer, T., Grebogi, C., Yorke, J.: How long do numerical chaotic solutions remain valid? Phys. Rev. Lett. 79(1), 59 (1997)
Sauer, T., Yorke, J.: Rigorous verification of trajectories for the computer simulation of dynamical systems. Nonlinearity 4(3), 961 (1991)
Shilnikov, L.P., Shilnikov, A.L., Turaev, D.V., Chua, L.: Methods of Qualitative Theory in Nonlinear Dynamics: Part 2. World Scientific, Singapore (2001)
Shinbrot, T., Grebogi, C., Ott, E., Yorke, J.: Using small perturbations to control chaos. Nature 363, 411–417 (1993)
Smith, R.: Some application of Hausdorff dimension inequalities for ordinary differential equation. Proc. R. Soc. Edinburg 104A, 235–259 (1986)
Sparrow, C.: The Lorenz Equations: Bifurcations, Chaos, and Strange Attractors. Applied Mathematical Sciences. Springer, New York (1982)
Sprott, J.: Chaos and Time-Series Analysis. Oxford University Press, Oxford (2003)
Sprott, J.: Maximally complex simple attractors. Chaos Interdiscip. J. Nonlinear Sci. 17(3), 033124 (2007)
Sprott, J., Jafari, S., Khalaf, A., Kapitaniak, T.: Megastability: coexistence of a countable infinity of nested attractors in a periodically-forced oscillator with spatially-periodic damping. Eur. Phys. J. Spec. Top. 226(9), 1979–1985 (2017)
Sprott, J., Rowlands, G.: Improved correlation dimension calculation. Int. J. Bifurc. Chaos 11(07), 1865–1880 (2001)
Stankevich, N., Kuznetsov, N., Leonov, G., Chua, L.: Scenario of the birth of hidden attractors in the Chua circuit. Int. J. Bifurc. Chaos Appl. Sci. Eng. 27(12), 1730038 (2017)
Stewart, I.: Mathematics: the Lorenz attractor exists. Nature 406(6799), 948–949 (2000)
Strogatz, H.: Nonlinear Dynamics and Chaos. With Applications to Physics, Biology, Chemistry, and Engineering. Westview Press, Boulder (1994)
Tucker, W.: The Lorenz attractor exists. Comptes Rendus de l’Academie des Sciences - Series I - Mathematics 328(12), 1197–1202 (1999)
Viana, R., Grebogi, C.: Unstable dimension variability and synchronization of chaotic systems. Phys. Rev. E 62(1), 462 (2000)
Viana, R., Pinto, S.D.S., Barbosa, J., Grebogi, C.: Pseudo-deterministic chaotic systems. Int. J. Bifurc. Chaos 13(11), 3235–3253 (2003)
Viana, R., Pinto, S.D.S., Grebogi, C.: Chaotic bursting at the onset of unstable dimension variability. Phys. Rev. E 66(4), 046213 (2002)
Vidyasagar, M.: Nonlinear Systems Analysis. Prentice-Hall, Englewood Cliffs (1978)
Vinograd, R.: The inadequacy of the method of characteristic exponents for the study of nonlinear differential equations. Dokl. Akad. Nauk SSSR (In Russian) 114(2), 239–240 (1957)
Viswanath, D.: The Lindstedt–Poincaré technique as an algorithm for computing periodic orbits. SIAM Rev. 43(3), 478–495 (2001)
Yakubovich, V., Leonov, G., Gelig, A.: Stability of Stationary Sets in Control Systems with Discontinuous Nonlinearities. World Scientific, Singapure (2004). [Transl from Russian: A.Kh. Gelig and G.A. Leonov and V.A. Yakubovich, Nauka, 1978]
Yuan, Q., Yang, F.Y., Wang, L.: A note on hidden transient chaos in the Lorenz system. Int. J. Nonlinear Sci. Numer. Simul. 18(5), 427–434 (2017)
Zhang, X., Chen, G.: Constructing an autonomous system with infinitely many chaotic attractors. Chaos Interdiscip. J. Nonlinear Sci. 27(7), 071101 (2017)
Acknowledgements
Open access funding provided by University of Jyväskylä (JYU). The authors declare that they have no conflict of interest. We dedicate this paper to the memory of Gennady A. Leonov (1947–2018), with whom we began this work in 2018. This study was partially funded by the Russian Science Foundation (Project 19-41-02002).
Author information
Authors and Affiliations
Corresponding author
Additional information
Dedicated to the memory of Gennady A. Leonov.
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Appendices
Appendix A: Hidden attractors localization via numerical continuation method
One of the effective methods for numerical localization of hidden attractors in multidimensional dynamical systems is based on the homotopy and numerical continuation method (NCM). The idea is to construct a sequence of similar systems such that for the first (starting) system the initial point for numerical computation of oscillating solution (starting oscillation) can be obtained analytically. Thus, it is often possible to consider the starting system with self-excited starting oscillation; then, the transformation of this starting oscillation in the phase space is tracked numerically while passing from one system to another; the last system corresponds to the system in which a hidden attractor is searched.
For studying the scenario of transition to chaos, we consider system (23) with \(f(u) = f(u, \lambda )\), where \(\lambda \in \Lambda \subset \mathbb {R}^d\) is a vector of parameters, whose variation in the parameter space \(\Lambda \) determines the scenario. Let \(\lambda _\mathrm{end} \in \Lambda \) define a point corresponding to the system, where a hidden attractor is searched. Choose a point \(\lambda _\mathrm{begin} \in \Lambda \) such that we can analytically or numerically localize a certain nontrivial (oscillating) attractor \(\mathcal {A}^1\) in system (23) with \(\lambda = \lambda _\mathrm{begin}\) (e.g., one can consider an initial self-excited attractor defined by a trajectory \({u}^1(t)\) numerically integrated on a sufficiently large time interval \(t \in [0, T]\) with initial point \({u}^1(0)\) in the vicinity of an unstable equilibrium). Consider a pathFootnote 7 in the parameter space \(\Lambda \) , i.e., a continuous function \(\gamma ~:~ [0,\,1] \rightarrow \Lambda \), for which \(\gamma (0) = \lambda _\mathrm{begin}\) and \(\gamma (1) = \lambda _\mathrm{end}\), and a sequence of points \(\{\lambda ^j\}_{j=1}^k\) on the path, where \(\lambda ^1 = \lambda _\mathrm{begin}\), \(\lambda ^k = \lambda _\mathrm{end}\), such that the distance between \(\lambda ^j\) and \(\lambda ^{j+1}\) is sufficiently small. On each next step of the procedure, the initial point for a trajectory to be integrated is chosen as the last point of the trajectory integrated on the previous step: \({u}^{j+1}(0) = {u}^{j}(T)\). Following this procedure and sequentially increasing j, two alternatives are possible: the point of \(\mathcal {A}^j\) are in the basin of attraction of attractor \(\mathcal {A}^{j+1}\), or while passing from system (23) with \(\lambda = \lambda ^j\) to system (23) with \(\lambda = \lambda ^{j+1}\), a loss of stability bifurcation is observed and attractor \(\mathcal {A}^j\) vanishes. If, while changing \(\lambda \) from \(\lambda _\mathrm{begin}\) to \(\lambda _\mathrm{end}\), there is no loss of stability bifurcation of the considered attractors, then a hidden attractor for \(\lambda ^k = \lambda _\mathrm{end}\) (at the end of the procedure) is localized.
Appendix B: Finite-time and limit values of Lyapunov exponents and Lyapunov dimension
Following [40, 44], let us outline the concept of the finite-time Lyapunov dimension, which is convenient for carrying out numerical experiments with finite time.
For a fixed \(t\ge 0\), let us consider the map \(u(t,\cdot ): \mathbb {R}^3 \rightarrow \mathbb {R}^3\) defined by the shift operator along the solutions of system (1): \(u(t,u_0)\), \(u_0 \in \mathbb {R}^3\). Since system (1) possesses an absorbing set, the existence and uniqueness of solutions of system (1) for \(t \in [0,+\infty )\) take place and, therefore, the system generates a dynamical system \(\big (\{u(t,\cdot )\}_{t\ge 0}, (\mathbb {R}^3, |\cdot |)\big )\).
Consider linearization of system (1) along the solution \(u(t,u_0)\) and its \(3\!\times \!3\) fundamental matrix of solutions \(\Phi (t,u_0)\): \(\dot{\Phi }(t,u_0) = Df(u(t,u_0)) \Phi (t,u_0)\), where \(\Phi (0,u_0)~=~I\) is a unit \(3\!\times \!3\) matrix. Denote by \(\sigma _i(t,u_0) = \sigma _i(\Phi (t,u_0))\), \(i = 1,2,3\), the singular values of \(\Phi (t,u_0)\) (i.e., the square roots of the eigenvalues of the symmetric matrix \(\Phi (t,u_0)^*\Phi (t,u_0)\) with respect to their algebraic multiplicity)Footnote 8, ordered so that \(\sigma _1(t,u_0) \ge \sigma _2(t,u_0) \ge \sigma _3(t,u_0) > 0\) for any \(u_0 \in \mathbb {R}^3\) and \(t > 0\).
Consider a set of finite-time Lyapunov exponents at the point \(u_0\):
Here, the set \(\{{{\,\mathrm{LE}\,}}_i(t,u_0)\}_{i=1}^3\) is ordered by decreasing (i.e., \({{\,\mathrm{LE}\,}}_1(t,u_0) \ge {{\,\mathrm{LE}\,}}_2(t,u_0) \ge {{\,\mathrm{LE}\,}}_3(t,u_0)\) for all \(t>0\)). The finite-time local Lyapunov dimension [40, 44] can be defined via an analog of the Kaplan–Yorke formula with respect to the set of ordered finite-time Lyapunov exponents \(\{{{\,\mathrm{LE}\,}}_i(t,u_0)\}_{i=1}^3\):
where \(j(t,u_0) = \max \{m: \sum _{i=1}^{m}{{\,\mathrm{LE}\,}}_i(t,u_0) \ge 0\}\). Then, the finite-time Lyapunov dimension of dynamical system with respect to a set \(\mathcal {A}\) is defined as:
The Douady–Oesterlé theorem [20] implies that for any fixed \(t > 0\) the finite-time Lyapunov dimension on a compact invariant set \(\mathcal {A}\), defined by (28), is an upper estimate of the Hausdorff dimension: \(\dim _\mathrm{H} \mathcal {A} \le \dim _\mathrm{L}(t, \mathcal {A})\). The best estimation is called the Lyapunov dimension [40]
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Kuznetsov, N.V., Mokaev, T.N., Kuznetsova, O.A. et al. The Lorenz system: hidden boundary of practical stability and the Lyapunov dimension. Nonlinear Dyn 102, 713–732 (2020). https://doi.org/10.1007/s11071-020-05856-4
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11071-020-05856-4