Skip to main content
Log in

Information Meaning of Entropy of Nonergodic Measures

  • Ordinary Differential Equation
  • Published:
Differential Equations Aims and scope Submit manuscript

Abstract

The limit frequency properties of trajectories of the simplest dynamical system generated by the left shift on the space of sequences of letters from a finite alphabet are studied. The following modification of the Shannon-McMillan-Breiman theorem is proved: for any invariant (not necessarily ergodic) probability measure μ on the sequence space, the logarithm of the cardinality of the set of all μ-typical sequences of length n is equivalent to nh(μ), where h(μ) is the entropy of the measure μ. Here a typical finite sequence of letters is understood as a sequence such that the empirical measure generated by it is close to μ (in the weak topology).

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. Billingsley, P., Ergodic Theory and Information, New York: Wiley, 1965.

    MATH  Google Scholar 

  2. Walters, P., A variational principle for the pressure of continuous transformations, Amer. J. Math., 1975, vol. 97, no. 4, pp. 937–971.

    Article  MathSciNet  MATH  Google Scholar 

  3. Bowen, R., Equilibrium States and the Ergodic Theory of Anosov Diffeomorphisms, in Lecture Notes in Math., Berlin: Springer, 1975, Vol. 470.

    Book  MATH  Google Scholar 

  4. Brin, M. and Stuck, G., Introduction to Dynamical Systems, Cambridge: Cambridge Univ., 2002.

    Book  MATH  Google Scholar 

  5. Ruelle, D., Thermodynamic Formalism. The Mathematical Structures of Classical Equilibrium Statistical Mechanics, Reading: Addison-Wesley, 1978.

    MATH  Google Scholar 

  6. Bishop, E. and Phelps, R.R., The support functionals of a convex set, Proc. Sympos. Pure Math., 1963, vol. 7, pp. 27–35.

    Article  MathSciNet  MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to V. I. Bakhtin.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Bakhtin, V.I. Information Meaning of Entropy of Nonergodic Measures. Diff Equat 55, 294–302 (2019). https://doi.org/10.1134/S0012266119030029

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1134/S0012266119030029

Navigation