Abstract
Information functionals such as entropy and divergence are discussed with respect to the relations between these notions and are applied to the convergence of convolution products of probability measure on the real line and on a compact group, to the Liouville property for harmonic functions related to a random walk in an arbitrary locally compact group, and to the study of sufficient kernels between general measure spaces.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Barron, A. R. 1986. Entropy and the central limit theorem. Annals of Probability 14: 336–42.
Csiszár, I. 1962. Informationstheoretiscbe Konvergenzbegriffe im Raum der Wahrscheinlichkeits-verteilungen. Magyar Tud Akad Mat Kutató International Közl 7: 137–58.
Csiszár, I. 1963. Eine informationstheoretische Ungleichung und ihre Anwendung auf den Beweis der Ergodizität von Markoff-Ketten. Magyar Tud Akad Mat Kutató International Közl 8: 85–108.
Csiszár, I. 1965. A note on limiting distributions on topological groups. Magyar Tud Akad Mat Kutató International Közl 9: 595–99.
Csiszár, I. 1966. A note on Jensens’s inequality. Studia Scientiarum Mathematicarum Hungarica 1: 185–88.
Csiszár, I. 1967a. Information-type measures of divergence of probability distributions I, II (in Hungarian with English summary). Magyar Tud. Akad, Mat. Fiz. Oszt. Közl 17: 123–49, 267–91.
Csiszár, I. 1967b. Information-type measures of difference of probability distributions and indirect observations. Studia Scientiarum Mathematicarum Hungarica 2: 299–318.
Csiszár, I. 1967c. On topological properties of f -divergence. Studia Scientiarum Mathematicarum Hungarica 2: 329–39.
Csiszár, I. 1969. On generalized entropy. Studia Scientiarum Mathematicarum Hungarica 4: 401–19.
Csiszár, I., and J. Körner. 1981. Information theory: Coding theorems for discrete memory-less systems. New York, NY: Academic Press.
Derriennic, Y. 1986. Entropie, théorème limite et marches aléatoires. In Probability measures on groups VIII, 241–84. Springer Lecture Notes in Mathematics 1210. Berlin-Heidelberg-New York, NY: Springer-Verlag.
Derriennic, Y. 1976. Lois “zéro ou deux” pour les processes de Markov. Annales de l’Institut Henir Poincaré, Section B 12: 111–29.
Derriennic, Y. 1987. Entropy and boundary for random variables on locally compact groups. Transactions of the 10th Prague Conference on Information Theory, Statistical Decision Functions, Random Processes, vol. A, 269–75.
Elie, L. 1979. Fonctions harmoniques positives sur le groupe affine. In Probability measures on groups, 96–110. Springer Lecture Notes in Mathematics 706. Berlin-Heidelberg-New York, NY: Springer-Verlag.
Fürstenberg, H. 1963. Noncommuting random products. Transactions of the American Mathematical Society 108: 377–428. doi:10.1090/S0002-9947-1963-0163345-0.
Heyer, H. 1977. Probability measures on locally compact groups. New York, NY: Springer-Verlag.
Heyer, H. 1982. Theory of statistical experiments. Springer series in statistics. Berlin-Heidelberg-New York, NY: Springer-Verlag.
Johnson, O. 2004. Information theory and central limit theorems. London, UK: Imperial College Press.
Johnson, O., and Y. Suhov. 2000. Entropy and convergence on compact groups. Journal of Theoretical Probability 13: 843–57. doi:10.1023/A:1007818830500.
Kaimanovich, V. A., and A. M. Vershik. 1983. Random walks on discrete groups: Boundary and entropy. Annals of Probability 11 (3): 457–90. doi:10.1214/aop/1176993497.
Kakihara, Y. 1999. Abstract methods in information theory. Hackensack, NJ: World Scientific.
Kullback, S. 1959. Information theory and statistics. New York, NY: Wiley and Sons.
Kullback, S. 1967. A lower bound for discrimination information in terms of variation (Corresp.). IEEE Transactions on Information Theory 13: 126–27. doi:10.1109/TIT.1967.1053968.
Linnik, Y. V. 1959. An information-theoretic proof of the central limit theorem with the Lindeberg condition. Theory of Probability and Its Applications IV(3): 288–99. doi:10.1137/1104028.
Major, P., and S. B. Shlosman. 1979. A local limit theorem for the convolution of probability measures on a compact connected group. Zeitschrift für Wahrscheinlichkeitstheorie und verwandte Gebiete 50: 137–48. doi:10.1007/BF00533635.
Pinsker, M. S. 1963. Arbeiten zur Informationstheorie V: Information und Informationsstabilität zufàlliger Grössen und Prozesse. Berlin, Germany: VEB Verlag der Wissenschaften.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Heyer, H. Information functionals with applications to random walk and statistics. J Stat Theory Pract 9, 896–933 (2015). https://doi.org/10.1080/15598608.2015.1053638
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1080/15598608.2015.1053638