Abstract
We consider the Maximum Entropy principle for non-ordered data in a non-probabilistic setting. The main goal of this paper is to deduce asymptotic relations for the frequencies of the energy levels in a non-ordered sequence ω N=[ω 1,...,ω N ] from the assumption of maximality of the Kolmogorov complexity K(ω N) given a constraint \(\sum\limits_{i=1}^N f(\omega_i)=N E\), where E is a number and f is a numerical function.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Cover, T.M., Thomas, J.A.: Elements of Information Theory. Wiley, Chichester (1991)
Gács, P., Tromp, J., Vitanyi, P.: Algorithmic Statistics. IEEE Trans. Inform. Theory 20(5), 1–21 (2001)
Jaynes, E.T.: Papers on Probability, Statistics and Statistical Physics, 2nd edn. Kluwer Academic Publisher, Dordrecht (1989)
Kolmogorov, A.N.: Three Approaches to the Quantitative Definition of Information. Problems Inform. Transmission 1(1), 4–7 (1965)
Kolmogorov, A.N.: The Logical Basis for Information Theory and Probability Theory. IEEE Trans. Inf. Theory 14, 662–664 (1968)
Kolmogorov, A.N.: Combinatorial Basis of Information Theory and Probability Theory. Russ. Math. Surveys. 38, 29–40 (1983)
Kolmogorov, A.N., Uspensky, V.A.: Algorithms and Randomness. Theory Probab. Applic. 32, 389–412 (1987)
Landau, L.D., Lifschits, E.M.: Statisticheskaia phisika. In: Chast’ 1 (Statistical Physics. Part 1), Moscow: Nauka (1984)
Li, M., Vitányi, P.: An Introduction to Kolmogorov Complexity and Its Applications, 2nd edn. Springer, New York (1997)
Shiryaev, A.N.: Probability. Springer, Berlin (1984)
Stratonovich, R.L.: Teoriya informatsii (Information Theory). Sovetskoe radio, Moscow (1975)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2004 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Maslov, V., V’yugin, V. (2004). Maximum Entropy Principle in Non-ordered Setting. In: Ben-David, S., Case, J., Maruoka, A. (eds) Algorithmic Learning Theory. ALT 2004. Lecture Notes in Computer Science(), vol 3244. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-30215-5_18
Download citation
DOI: https://doi.org/10.1007/978-3-540-30215-5_18
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-23356-5
Online ISBN: 978-3-540-30215-5
eBook Packages: Springer Book Archive