Skip to main content

Basic Concepts of Chaos Theory and Nonlinear Time-Series Analysis

  • Chapter
  • First Online:
Deep Learning in Multi-step Prediction of Chaotic Dynamics

Abstract

We introduce the basic concepts and methods to formalize and analyze deterministic chaos, with links to fractal geometry. A chaotic dynamic is produced by several kinds of deterministic nonlinear systems. We introduce the class of discrete-time autonomous systems so that an output time series can directly represent data measurements in a real system. The two basic concepts defining chaos are that of attractor—a bounded subset of the state space attracting trajectories that originate in a larger region—and that of sensitivity to initial conditions—the exponential divergence of two nearby trajectories within the attractor. The latter is what makes chaotic dynamics unpredictable beyond a characteristic time scale. This is quantified by the well-known Lyapunov exponents, which measure the average exponential rates of divergence (if positive) or convergence (if negative) of a perturbation of a reference trajectory along independent directions. When a model is not available, an attractor can be estimated in the space of delayed outputs, that is, using a finite moving window on the data time series as state vector along the trajectory.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 44.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 59.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Alligood, K. T., Sauer, T. D., & Yorke, J. A. (1996). Chaos. Springer.

    Google Scholar 

  2. Boeing, G. (2016). Visual analysis of nonlinear dynamical systems: Chaos, fractals, self-similarity and the limits of prediction. Systems, 4.4, 37.

    Google Scholar 

  3. Briggs, K. (1990). An improved method for estimating Liapunov exponents of chaotic time series. Physics Letters A, 151.1-2, 27–32.

    Google Scholar 

  4. Brown, R., Bryant, P., & Abarbanel, H. D. (1991). Computing the Lyapunov spectrum of a dynamical system from an observed time series. Physical Review A, 43.6, 2787.

    Google Scholar 

  5. Dercole, F., Sangiorgio, M., & Schmirander, Y. (2020). An empirical assessment of the universality of ANNs to predict oscillatory time series. IFAC-PapersOnLine, 53.2, 1255–1260.

    Google Scholar 

  6. Ellner, S., et al. (1991). Convergence rates and data requirements for Jacobian-based estimates of Lyapunov exponents from data. Physics Letters A, 153.6-7, 357–363.

    Google Scholar 

  7. Ellner, S., & Turchin, P. (1995). Chaos in a noisy world: New methods and evidence from time-series analysis. The American Naturalist, 145.3, 343–375.

    Google Scholar 

  8. Farmer, J. D., Ott, E., & Yorke, J. A. (1983). The dimension of chaotic attractors. Physica D: Nonlinear Phenomena, 7.1-3, 153–180.

    Google Scholar 

  9. Frederickson, P., et al. (1983). The Liapunov dimension of strange attractors. Journal of Differential Equations, 49.2, 185–207.

    Google Scholar 

  10. Guckenheimer, J., & Holmes, P. (2013). Nonlinear oscillations, dynamical systems, and bifurcations of vector fields. (Vol. 42). Springer Science and Business Media.

    Google Scholar 

  11. Kennel, M. B., Brown, R., & Abarbanel, H. D. (1992). Determining embedding dimension for phase-space reconstruction using a geometrical construction. Physical Review A, 45.6, 3403.

    Google Scholar 

  12. Nepomuceno, E. G., et al. (2019). Soft computing simulations of chaotic systems. International Journal of Bifurcation and Chaos, 29.08, 1950112.

    Google Scholar 

  13. Ott, E. (2002). Chaos in dynamical systems. Cambridge University Press.

    Google Scholar 

  14. Pathak, J., et al. (2018). Model-free prediction of large spatiotemporally chaotic systems from data: A reservoir computing approach. Physical Review Letters, 120.2, 024102.

    Google Scholar 

  15. Ramasubramanian, K., & Sriram, M. S. (2000). A comparative study of computation of Lyapunov spectra with different algorithms. Physica D: Nonlinear Phenomena, 139.1-2, 72–86.

    Google Scholar 

  16. Rosenstein, M. T., Collins, J. J., & De Luca, C. J. (1993). A practical method for calculating largest Lyapunov exponents from small data sets. Physica D: Nonlinear Phenomena, 65.1-2, 117–134.

    Google Scholar 

  17. Sangiorgio, M. (2021). Deep learning in multi-step forecasting of chaotic dynamics. Ph.D. thesis. Department of Electronics, Information and Bioengineering, Politecnico di Milano.

    Google Scholar 

  18. Sangiorgio, M., & Dercole, F. (2020). Robustness of LSTM neural networks for multi-step forecasting of chaotic time series. Chaos, Solitons and Fractals, 139, 110045.

    Google Scholar 

  19. Sano, M., & Sawada, Y. (1985). Measurement of the Lyapunov spectrum from a chaotic time series. Physical Review Letters, 55.10, 1082.

    Google Scholar 

  20. Takens, F. (1981). Detecting strange attractors in turbulence. In: Dynamical systems and turbulence, Warwick 1980 (pp. 366–381). Springer.

    Google Scholar 

  21. Ushio, T., & Hsu, C. (1987). Chaotic rounding error in digital control systems. IEEE Transactions on Circuits and Systems, 34.2, 133–139.

    Google Scholar 

  22. Vlachas, P. R., et al. (2020). Backpropagation algorithms and Reservoir Computing in Recurrent Neural Networks for the forecasting of complex spatiotemporal dynamics. Neural Networks, 126, 191–217.

    Google Scholar 

  23. Wolf, A., et al. (1985). Determining Lyapunov exponents from a time series. Physica D: Nonlinear Phenomena, 16.3, 285–317.

    Google Scholar 

  24. Wright, J. (1984). Method for calculating a Lyapunov exponent. Physical Review A, 29.5, 2924.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Matteo Sangiorgio .

Rights and permissions

Reprints and permissions

Copyright information

© 2021 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Sangiorgio, M., Dercole, F., Guariso, G. (2021). Basic Concepts of Chaos Theory and Nonlinear Time-Series Analysis. In: Deep Learning in Multi-step Prediction of Chaotic Dynamics. SpringerBriefs in Applied Sciences and Technology(). Springer, Cham. https://doi.org/10.1007/978-3-030-94482-7_2

Download citation

Publish with us

Policies and ethics