Advertisement

Definition of information and entropy in the absence of noise

  • Roman V. Belavkin
  • Panos M. Pardalos
  • Jose C. Principe
Chapter

Abstract

In modern science, engineering and public life, a big role is played by information and operations associated with it: information reception, information transmission, information processing, storing information and so on. The significance of information has seemingly outgrown the significance of the other important factor, which used to play a dominant role in the previous century, namely, energy.

References

  1. 9.
    Fano, R.M.: Transmission of Information: A Statistical Theory of Communications, 1st edn. MIT Press, Cambridge (1961)Google Scholar
  2. 10.
    Fano, R.M.: Transmission of Information: A Statistical Theory of Communications (Translation to Russian). Mir, Moscow (1965)Google Scholar
  3. 11.
    Feinstein, A.: Foundations of Information Theory. McGraw-Hill, New York (1958)CrossRefGoogle Scholar
  4. 12.
    Feinstein, A.: Foundations of Information Theory (Translation to Russian). Inostrannaya Literatura, Moscow (1960)Google Scholar
  5. 13.
    Gnedenko, B.V.: The Course of the Theory of Probability. Fizmatgiz, Moscow (1961, in Russian)Google Scholar
  6. 14.
    Gnedenko, B.V.: The Theory of Probability (Translation from Russian). Chelsea, New York (1962)Google Scholar
  7. 15.
    Goldman, S.: Information Theory. Prentice Hall, Englewood Cliffs (1953)Google Scholar
  8. 16.
    Goldman, S.: Information Theory (Translation to Russian). Inostrannaya Literatura, Moscow (1957)Google Scholar
  9. 18.
    Hartley, R.V.L.: Transmission of information. Bell Syst. Tech. J. 7(3) (1928)CrossRefGoogle Scholar
  10. 19.
    Hartley, R.V.L.: Transmission of information (Translation to Russian). In: A. Harkevich (ed.) Theory of Information and Its Applications. Fizmatgiz, Moscow (1959)Google Scholar
  11. 29.
    Kullback, S.: Information Theory and Statistics. Wiley, New York (1959)zbMATHGoogle Scholar
  12. 30.
    Kullback, S.: Information Theory and Statistics (Translation to Russian). Nauka, Moscow (1967)zbMATHGoogle Scholar
  13. 34.
    Rao, C.R.: Linear Statistical Inference and Its Applications. Wiley, New York (1965)zbMATHGoogle Scholar
  14. 35.
    Rao, C.R.: Linear Statistical Inference and Its Applications (Translation to Russian). Inostrannaya Literatura, Moscow (1968)Google Scholar
  15. 38.
    Shannon, C.E.: A mathematical theory of communication. Bell Syst. Tech. J. 27 (1948)MathSciNetCrossRefGoogle Scholar
  16. 39.
    Shannon, C.E.: Communication in the presence of noise. Proc. IRE 37(1), 10–21 (1949)MathSciNetCrossRefGoogle Scholar
  17. 44.
    Shannon, C.E.: Communication in the presence of noise (translation to Russian). In: R.L. Dobrushin, O.B. Lupanov (eds.) Works on Information Theory and Cybernetics. Inostrannaya Literatura, Moscow (1963)Google Scholar
  18. 45.
    Shannon, C.E.: A mathematical theory of communication (translation to Russian). In: R.L. Dobrushin, O.B. Lupanov (eds.) Works on Information Theory and Cybernetics. Inostrannaya Literatura, Moscow (1963)Google Scholar

Copyright information

© Springer Nature Switzerland AG 2020

Authors and Affiliations

  • Roman V. Belavkin
    • 1
  • Panos M. Pardalos
    • 2
  • Jose C. Principe
    • 3
  1. 1.Faculty of Science and TechnologyMiddlesex UniversityLondonUK
  2. 2.Industrial and Systems EngineeringUniversity of FloridaGainesvilleUSA
  3. 3.Electrical & Computer EngineeringUniversity of FloridaGainesvilleUSA

Personalised recommendations