Advertisement

Asymptotic results about the value of information. Third asymptotic theorem

  • Roman V. Belavkin
  • Panos M. Pardalos
  • Jose C. Principe
Chapter

Abstract

The fact about asymptotic equivalence of the values of various types of information (Hartley’s, Boltzmann’s or Shannon’s information amounts) should be regarded as the main asymptotic result concerning the value of information, which holds true under very broad assumptions, such as the requirement of information stability. This fact cannot be reduced to the fact of asymptotically errorless information transmission through a noisy channel stated by the Shannon’s theorem (Chapter  7), but it is an independent and no less significant fact.

References

  1. 1.
    Bellman, R.E.: Dynamic Programming. Princeton University Press, Princeton (1957)zbMATHGoogle Scholar
  2. 2.
    Bellman, R.E.: Dynamic Programming (Translation to Russian). Inostrannaya Literatura, Moscow (1960)Google Scholar
  3. 6.
    Dobrushin, R.L.: The general formulation of the fundamental theorem of Shannon in the theory of information. Usp. Mat. Nauk 14(6) (1959, in Russian)Google Scholar
  4. 17.
    Grishanin, B.A., Stratonovich, R.L.: The value of information and sufficient statistics when observing a stochastic process. Izv. USSR Acad. Sci. Tech. Cybern. 6, 4–12 (1966, in Russian)Google Scholar
  5. 24.
    Jahnke, E., Emde, F.: Tables of Functions with Formulae and Curves. Dover Publications, New York (1945)zbMATHGoogle Scholar
  6. 25.
    Jahnke, E., Emde, F.: Tables of Functions with Formulae and Curves (Translation from German to Russian). Gostekhizdat, Moscow (1949)Google Scholar
  7. 26.
    Kolmogorov, A.N.: Theory of transmission of information. In: USSR Academy of Sciences Session on Scientific Problems Related to Production Automation. USSR Academy of Sciences, Moscow (1957, in Russian)Google Scholar
  8. 27.
    Kolmogorov, A.N.: Theory of transmission of information (translation from Russian). Am. Math. Soc. Translat. Ser. 2(33) (1963)Google Scholar
  9. 36.
    Ryzhik, J.M., Gradstein, I.S.: Tables of Series, Products and Integrals. Gostekhizdat, Moscow (1951, in Russian)Google Scholar
  10. 37.
    Ryzhik, J.M., Gradstein, I.S.: Tables of Series, Products and Integrals (Translation from Russian). Academic, New York (1965)Google Scholar
  11. 41.
    Shannon, C.E.: Coding theorems for a discrete source with a fidelity criterion. IRE Nat. Conv. Rec. 4(1), 142–163 (1959)Google Scholar
  12. 43.
    Shannon, C.E.: Coding theorems for a discrete source with a fidelity criterion (translation to Russian). In: R.L. Dobrushin, O.B. Lupanov (eds.) Works on Information Theory and Cybernetics. Inostrannaya Literatura, Moscow (1963)Google Scholar
  13. 47.
    Stratonovich, R.L.: On the value of information (in Russian). Izv. USSR Acad. Sci. Tech. Cybern. 5, 3–12 (1965)zbMATHGoogle Scholar
  14. 49.
    Stratonovich, R.L.: The value of information when observing a stochastic process in systems containing finite automata. Izv. USSR Acad. Sci. Tech. Cybern. 5, 3–13 (1966, in Russian)Google Scholar
  15. 51.
    Stratonovich, R.L.: Extremal problems of information theory and dynamic programming. Izv. USSR Acad. Sci. Tech. Cybern. 5, 63–77 (1967, in Russian)Google Scholar
  16. 55.
    Stratonovich, R.L., Grishanin, B.A.: The value of information when a direct observation of an estimated random variable is impossible. Izv. USSR Acad. Sci. Tech. Cybern. 3, 3–15 (1966, in Russian)Google Scholar
  17. 56.
    Stratonovich, R.L., Grishanin, B.A.: Game problems with constraints of an informational type. Izv. USSR Acad. Sci. Tech. Cybern. 1, 3–12 (1968, in Russian)Google Scholar

Copyright information

© Springer Nature Switzerland AG 2020

Authors and Affiliations

  • Roman V. Belavkin
    • 1
  • Panos M. Pardalos
    • 2
  • Jose C. Principe
    • 3
  1. 1.Faculty of Science and TechnologyMiddlesex UniversityLondonUK
  2. 2.Industrial and Systems EngineeringUniversity of FloridaGainesvilleUSA
  3. 3.Electrical & Computer EngineeringUniversity of FloridaGainesvilleUSA

Personalised recommendations