What Is This All About?

  • José María AmigóEmail author
Part of the Springer Series in Synergetics book series (SSSYN)

This introductory chapter is meant as a tour of the main topics in this book: patterns, ordinal relations, complexity, and entropy. The approach is mostly informal; for the technicalities behind the different notions met on the way, the reader is referred to Annex A and Annex B.


Cellular Automaton Periodic Point Topological Entropy Symbolic Dynamic Permutation Entropy 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 6.
    J.M. Amigó, J. Szczepanski, E. Wajnryb, and M.V. Sanchez-Vives, Estimating the entropy of spike trains via Lempel-Ziv complexity, Neural Computation 16 (2004) 717–736.zbMATHCrossRefGoogle Scholar
  2. 9.
    J.M. Amigó and M.B. Kennel, Variance estimators for the Lempel-Ziv entropy rate estimators, Chaos 16 (2006) 043102.CrossRefMathSciNetADSGoogle Scholar
  3. 22.
    R.B. Ash, Information Theory. Dover Publications, New York, 1990.Google Scholar
  4. 28.
    C. Bandt and B. Pompe, Permutation entropy: A natural complexity measure for time series, Physical Review Letters 88 (2002) 174102.CrossRefADSGoogle Scholar
  5. 29.
    C. Bandt, G. Keller, and B. Pompe, Entropy of interval maps via permutations. Nonlinearity 15 (2002) 1595–1602.zbMATHCrossRefMathSciNetADSGoogle Scholar
  6. 39.
    A.A. Brudno, Entropy and complexity of trajectories of a dynamical system. Transactions of the Moscow Mathematical Society 44 (1983) 127–151.Google Scholar
  7. 48.
    K. Cattell and J.C. Muzio, Synthesis of one-dimensional linear hybrid cellular automata, IEEE Transactions on Computer-Aided Design of Integrated circuits and Systems 15 (1996) 325–335.CrossRefGoogle Scholar
  8. 59.
    T.M. Cover and J.A. Thomas, Elements of Information Theory, 2nd edition. New York, John Wiley & Sons, 2006.zbMATHGoogle Scholar
  9. 62.
    M. D’amico, G. Manzini, and L. Margara, On computing the entropy of cellular automata, Theoretical Computer Science 290 (2003) 1629–1646.zbMATHCrossRefMathSciNetGoogle Scholar
  10. 67.
    M. Denker and W.A. Woyczynski, Introductory Statistics and Random Phenomena. Birkhäuser, Boston, 1998.Google Scholar
  11. 69.
    R.L. Devaney, Chaotic Dynamical Systems (2nd edition). Westview Press, Boulder, 2003.zbMATHGoogle Scholar
  12. 72.
    J.P. Eckmann and D. Ruelle, Ergodic theory of chaos and strange attractors, Review of Modern Physics 57 (1985) 617–656.Google Scholar
  13. 77.
    R. Érdi, Complexity Explained. Springer Verlag, Berlin, 2007.Google Scholar
  14. 79.
    J. Ford, G. Mantica, and G.H. Ristow, The Arnold’s cat: Failure of the correspondence principle, Physica D. Nonlinear Phenomena 50 (1991) 493–520.zbMATHCrossRefMathSciNetADSGoogle Scholar
  15. 84.
    M. Gardner, The fantastic combinations of John Conway’s new solitaire game “life”, Scientific American 223 (1970) 120–123.CrossRefGoogle Scholar
  16. 91.
    B. Hasselbaltt and A. Katok, A First Course in Dynamics. Cambridge University Press, Cambridge, 2003.Google Scholar
  17. 92.
    G.A. Hedlund, Endomorphisms and automorphisms of the shift dynamical system, Mathematical Systems Theory 3 (1969) 320–375.zbMATHCrossRefMathSciNetGoogle Scholar
  18. 101.
    L.P. Hurd, J. Kari, and K. Culik, The topological entropy of cellular automata is uncomputable, Ergodic Theory and Dynamical Systems 12 (1992) 255–265.zbMATHCrossRefMathSciNetGoogle Scholar
  19. 123.
    B.P. Kitchens, Symbolic Dynamics. Springer Verlag, Berlin, 1998.Google Scholar
  20. 133.
    J.C. Lagarias, Pseudorandom numbers, Statistical Science 8 (1993) 31–39.CrossRefGoogle Scholar
  21. 137.
    A. Lempel and J. Ziv, On the complexity of an individual sequence, IEEE Transactions on Information Theory IT-22 (1976) 75–78.CrossRefMathSciNetGoogle Scholar
  22. 139.
    D. Lind and B. Marcus, Symbolic Dynamics and Coding. Cambridge University Press, Cambridge, 2003.Google Scholar
  23. 138.
    M. Li and P. Vitányi, An Introduction to Kolmogorov Complexity and Its Applications. Springer Verlag, New York, 1997.Google Scholar
  24. 149.
    W. Meier and O. Staffelbach, The self-shrinking generator. In: Proc. of Eurocrypt’94, Lecture Notes in Computer Science. vol. 950, pp. 205–214. Springer Verlag, Berlin, 1994.Google Scholar
  25. 151.
    A.J. Menezes, P.C. van Oorschoot, and S.A. Vanstone, Handbook of Applied Cryptography. CRC Press, Boca Raton, 1997.Google Scholar
  26. 158.
    M. Mitchell, Complexity –-A Guided Tour. Oxford University Press, New York, 2009.Google Scholar
  27. 160.
    M. Morse and G.A. Hedlund, Symbolic Dynamics, American Journal of Mathematics 60 (1938) 815–866.CrossRefMathSciNetGoogle Scholar
  28. 161.
    J. von Neumann, The general and logical theory of automata. In: L.A. Jeffress (Ed.), Cerebral Mechanisms in Behavior. Wiley, New York, 1951.Google Scholar
  29. 167.
    L. Paninski, Estimation of entropy and mutual information, Neural Computation 15 (2003) 1191–1253.zbMATHCrossRefGoogle Scholar
  30. 198.
    T. Toffoli and N. Margolus, Cellular Automata Machines. The MIT Press, Cambridge MA, 1987.Google Scholar
  31. 199.
    S. Ulam, Random process and transformations, Proceedings of the International Congress of Mathematicians 2 (1952), 264–275.Google Scholar
  32. 201.
    S.B. Volchan, What is a Random Sequence, The American Mathematical Monthly 109 (2002) 46–63.zbMATHCrossRefMathSciNetGoogle Scholar
  33. 202.
    P. Walters, An Introduction to Ergodic Theory. Springer Verlag, New York, 2000.Google Scholar
  34. 207.
    S. Wolfram, A New Kind of Science. Wolfram Media, Champaign, 2002.Google Scholar
  35. 211.
    J. Ziv and A. Lempel, Compression of individual sequences via variable-rate coding IEEE Transactions on Information Theory IT-24 (1978) 530–536.CrossRefMathSciNetGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2010

Authors and Affiliations

  1. 1.Centro de Investigacion OperativaUniversidad Miguel HernandezElcheSpain

Personalised recommendations