Skip to main content
SpringerLink
Log in

Entropy in deterministic and random systems

  • Conference paper
Beyond Quasicrystals

Part of the book series: Centre de Physique des Houches ((LHWINTER,volume 3))

Abstract

The purpose of this course is to introduce some notions of entropy: entropy in information theory, entropy of a curve and topological and measure-theoretic entropies. For these last two notions, we will consider in particular dynamical symbolical systems in order to present some measures of disorder for sequences. We will allude then to the problem of classification of sequences with respect to their spectral properties thanks to the entropy. For this purpose, we will introduce the sequence of block entropies for sequences taking their values in a finite alphabet: we will then compute explicitely the block frequencies (or in other words, the measure of the associated dynamical system) for some examples of automatic sequences (Prouhet-Thue-Morse, paperfolding and Rudin-Shapiro sequences) and for Sturmian sequences (these are the sequences with minimal complexity among all non-ultimately periodic sequences; in particular, we will consider some generalized Fibonacci sequences). But, in order to understand the intuitive meaning of the notions of topological and measure-theoretic entropies, we will begin by defining the Shannon entropy of an experiment.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Aczél J. and Daróczy Z., On measures of information and their characterizations (Mathematics in science and engineering, Academic Press 115, 1975 ).

    Google Scholar 

  2. Adler R. L., Konheim A. G. and McAndrew M. H., Topological entropy, Trans. Amer. Math. Soc. 114 (1965) 309–319.

    Article  MathSciNet  MATH  Google Scholar 

  3. Allouche J.-P., Sur la complexité des suites infinies, Bull. Belg. Math. Soc. 1 (1994) 133–143.

    MathSciNet  MATH  Google Scholar 

  4. Allouche J.-P. and Mendès France M., this volume.

    Google Scholar 

  5. Allouche J.-P. and Liardet P., Generalized Rudin-Shapiro sequences, Acta Arith. 60 (1991) 1–27.

    MathSciNet  MATH  Google Scholar 

  6. Allouche J.-P. and Shallit J., Complexité des suites de Rudin-Shapiro généralisées, Journal de Théorie des Nombres de Bordeaux 5 (1993) 283–302.

    Article  MathSciNet  MATH  Google Scholar 

  7. Arnoux P. and Rauzy G., Représentation géométrique de suites de complexité 2n + 1, Bull. Soc. math. France 119 (1991) 199–215.

    MathSciNet  MATH  Google Scholar 

  8. Berthé V., Fonctions de Carlitz et automates. Entropies conditionnelles (Thèse, Univ. Bordeaux I, 1994 ).

    Google Scholar 

  9. Berthé V., Conditional entropy of some automatic sequences, J. Phys. A: Math. Gen. 27 (1994) 7993–8006.

    Article  ADS  MATH  Google Scholar 

  10. Berthé V., Fréquences des facteurs des suites sturmiennes, Preprint 94.37 Laboratoire de Mathématiques discrètes.

    Google Scholar 

  11. Billingsley P., Ergodic theory and information ( John Wiley and Sons, New York, 1965 ).

    MATH  Google Scholar 

  12. Broglio A., Prédiction par automates (Thèse, Aix-Marseille I, 1991 ).

    Google Scholar 

  13. Broglio A. and Liardet P., Predictions with automata, Contemporary Mathematics, Amer. Math. Soc. 135 (1992).

    Google Scholar 

  14. Burrows B. L. and Sulston K. W., Measures of disorder in non-periodic sequences, J. Phys. A: Math. Gen. 24 (1991) 3979–3987.

    Article  MathSciNet  ADS  MATH  Google Scholar 

  15. Dekking F. M., On the Prouhet-Thue-Morse Measure, Acta Universitatis Carolinae, Mathematica et Physica 33 (1992) 35–40.

    MathSciNet  MATH  Google Scholar 

  16. Dekking F. M., this volume.

    Google Scholar 

  17. Halmos P. R. and Von Neumann J., Operator methods in classical mechanics II, Ann. Math. 43 (1942) 332–350.

    Article  MATH  Google Scholar 

  18. Hartley R. V., Transmission of Information, Bell System Tech. J. 7 (1928) 535–563.

    Google Scholar 

  19. Keane M., “Ergodic theory and subshifts of finte type”, Ergodic Theory, Symbolic Dynamics and Hyperbolic Spaces, T. Bedford, M. Keane, C. Series (Eds) (Oxford University Press, 1991 ) pp. 35–70.

    Google Scholar 

  20. Kolmogorov A.N., New metric invariants of transitive dynamical systems and automorphisms of Lebesgue spaces, Dokl. Akad. Nauk SSSR 119 (1958) 861–864.

    MathSciNet  MATH  Google Scholar 

  21. Krieger W., On entropy and generators of measure-preserving transformations, Trans. Amer. Math. Soc. 149 (1970) 453–464, Erratum: 168 (1972) 519.

    MathSciNet  MATH  Google Scholar 

  22. Mendès France M., “Chaotic curves”, Rythms in Biology and Other Fields of Applications, Proc. Journ. Soc. Math. France, Luminy 1981 (Lecture Notes in Biomathematics 49, Springer Verlag, 1983 ) pp. 352–367.

    Google Scholar 

  23. Mendès France M., “Dimension and entropy of regular curves”, Fractals, non-integral dimensions and applications, G. Cherbit Ed. (John Wiley and Sons, 1990 ) pp. 222–230.

    Google Scholar 

  24. Mendès France M., Folding paper and thermodynamics, Phys. Rep. 103 (1984) 161–172.

    Article  MathSciNet  ADS  MATH  Google Scholar 

  25. Mendès France M., Opacity of an automaton. Application to the inhomogeneous Ising chain, Comm. Math. Phys. 139 (1991) 341–352.

    Article  MathSciNet  ADS  MATH  Google Scholar 

  26. Mendès France M., “The Planck constant of a curve”, Fractal geometry and Analysis, J. Bélair and S. Dubucs Eds. (1991) pp. 325–366.

    Google Scholar 

  27. Misiurewicz M., “ A short proof of the variational principle for a 7Z7 action on a compact space”, Int. Conf. Dyn. Systems in Math. Physics, Société Mathématique de France, Astérisque 40 (1976) 147–158.

    MathSciNet  Google Scholar 

  28. Morse M. and Hedlund G. A., Symbolic dynamics, Amer. J. Math. 60 (1938) 815–866.

    Article  MathSciNet  Google Scholar 

  29. Morse M. and Hedlund G. A., Symbolic dynamics II: Sturmian trajectories, Amer. J. Math. 62 (1940) 1–42.

    Article  MathSciNet  Google Scholar 

  30. Ornstein D. S., Bernoulli shifts with the same entropy are isomorphic, Adv. in Math. 4 (1970) 337–352.

    Article  MathSciNet  MATH  Google Scholar 

  31. Parry W., Topics in ergodic theory (Cambridge University Press, 1981).

    Google Scholar 

  32. Petersen K., Ergodic theory (Cambridge studies in advanced mathematics; 2, 1991).

    Google Scholar 

  33. Queffélec M., Substitution dynamical systems. Spectral analysis (Lecture Notes in Mathematics 1294, Springer-Verlag, 1987 ).

    Google Scholar 

  34. Queffélec M., this volume.

    Google Scholar 

  35. Rauzy G., Nombres normaux et processus déterministes, Acta Arithmetica 14 (1976) 211–225.

    MathSciNet  Google Scholar 

  36. Rauzy G., Suites à termes dans un alphabet fini, Sém. de Théorie des Nombres de Bordeaux (1983) 25–01–25–16.

    Google Scholar 

  37. Roman S., Coding and information theory (Springer-Verlag, 1992).

    Google Scholar 

  38. Shannon C. E., A mathematical theory of communication, Bell System Tech. J. 27 (1948) 379–423, 623–656.

    MathSciNet  Google Scholar 

  39. Sinai Ya. S., Flows with finite entropy, Dokl. Akad. Nauk SSSR 125 (1959) 1200–1202.

    Google Scholar 

  40. Slater N. B., Gaps and steps for the sequence n9 mod 1, Proc. Cambridge Phil. Soc. 63 (1967) 1115–1123.

    Article  MathSciNet  ADS  MATH  Google Scholar 

  41. A. A. Süt6, this volume.

    Google Scholar 

  42. Wiener N. Cybernetics, or Control and Communication in the Animal and the Machine (Hermann, Paris; Technology Press MIT, Cambridge, Massachussets; Wiley, New York, 1948 ).

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Laboratoire de Mathématiques discrètes, CNRS-UPR 9016, Case 930, 163 avenue de Luminy, F-13288, Marseille Cedex 9, France

    V. Berthé

Authors
  1. V. Berthé
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Université Paris VII-Denis Diderot, France

    Françoise Axel

  2. CECN-CNRS, Vitry, France

    Denis Gratias

Rights and permissions

Reprints and permissions

Copyright information

© 1995 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Berthé, V. (1995). Entropy in deterministic and random systems. In: Axel, F., Gratias, D. (eds) Beyond Quasicrystals. Centre de Physique des Houches, vol 3. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-662-03130-8_15

Download citation

  • DOI: https://doi.org/10.1007/978-3-662-03130-8_15

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-59251-8

  • Online ISBN: 978-3-662-03130-8

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics

Search

Navigation