Abstract
The limit frequency properties of trajectories of the simplest dynamical system generated by the left shift on the space of sequences of letters from a finite alphabet are studied. The following modification of the Shannon-McMillan-Breiman theorem is proved: for any invariant (not necessarily ergodic) probability measure μ on the sequence space, the logarithm of the cardinality of the set of all μ-typical sequences of length n is equivalent to nh(μ), where h(μ) is the entropy of the measure μ. Here a typical finite sequence of letters is understood as a sequence such that the empirical measure generated by it is close to μ (in the weak topology).
Similar content being viewed by others
References
Billingsley, P., Ergodic Theory and Information, New York: Wiley, 1965.
Walters, P., A variational principle for the pressure of continuous transformations, Amer. J. Math., 1975, vol. 97, no. 4, pp. 937–971.
Bowen, R., Equilibrium States and the Ergodic Theory of Anosov Diffeomorphisms, in Lecture Notes in Math., Berlin: Springer, 1975, Vol. 470.
Brin, M. and Stuck, G., Introduction to Dynamical Systems, Cambridge: Cambridge Univ., 2002.
Ruelle, D., Thermodynamic Formalism. The Mathematical Structures of Classical Equilibrium Statistical Mechanics, Reading: Addison-Wesley, 1978.
Bishop, E. and Phelps, R.R., The support functionals of a convex set, Proc. Sympos. Pure Math., 1963, vol. 7, pp. 27–35.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Bakhtin, V.I. Information Meaning of Entropy of Nonergodic Measures. Diff Equat 55, 294–302 (2019). https://doi.org/10.1134/S0012266119030029
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1134/S0012266119030029