Skip to main content
Log in

On the notions of entropy and information

  • Review Article
  • Published:
Journal of Statistical Physics Aims and scope Submit manuscript

Abstract

In this review article we look for some of the historical reasons for the “identification” of the information-theoretical and thermodynamic entropy concepts. We also discuss the Baron-Jauch entropy concept and explicitly show that, for classical systems in thermodynamic equilibrium, there exists a very simple connection between this general definition and the ordinary experimental entropy.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. M. Dutta, A hundred years of entropy, Physics Today1968 (January).

  2. J. G. Baron and J. M. Jauch, Entropy, information and Szilard's paradox,Helv. Phys. Acta 45:220 (1972).

    Google Scholar 

  3. W. Rudin,Real and Complex Analysis, McGraw-Hill, New York (1970).

    Google Scholar 

  4. B. Skagerstam, On the mathematical definition of entropy,Z. Naturforsch.29a(9) (1974).

    Google Scholar 

  5. R. S. Ingarden, Generalized irreversible thermodynamics and its applications to lasers,Acta Phys. Polon. 43:3 (1973).

    Google Scholar 

  6. D. Ruelle,Statistical Mechanics, W. A. Benjamin, New York (1969).

    Google Scholar 

  7. A. Kossakowski, On quantum statistical mechanics of non-Hamiltonian systems,Rep. Math. Phys. 3(4):247 (1972).

    Google Scholar 

  8. R. S. Ingarden and A. Kossakowski, On the connection of non-equilibrium information thermodynamics with non-Hamiltonian quantum mechanics of open systems,Ann. Phys. (N.Y.) 89:451 (1975).

    Google Scholar 

  9. J. L. Lebowitz and O. Penrose, Modern ergodic theory, Physics Today1973 (February).

  10. M. Tribus and E. C. McIrvine, Energy and information, Sci. Am.1969 (September).

  11. W. Ehrenberg, Maxwell's demon, Sci. Am.1967 (November).

  12. J. M. Jauch, On a new foundation of equilibrium thermodynamics,Found Phys. 2(4):271 (1972); see also R. Hermann,Lectures in Mathematical Physics, Vol. II. Chapter VI, W. A. Benjamin, New York (1972).

    Google Scholar 

  13. D. ter Haar,Elements of Thermostatistics, Holt, Rinehard and Winston, New York (1966).

    Google Scholar 

  14. D. H. Frisch, The microscopic interpretation of entropy,Am. J. Phys. 34:1171 (1966).

    Google Scholar 

  15. L. Boltzmann,Wien Ber. 66:275 (1872).

    Google Scholar 

  16. J. M. Blatt, An alternative approach to the ergodic problem,Prog. Theor. Phys. 22:745 (1959).

    Google Scholar 

  17. E. L. Hahn,Phys. Rev. 80:580 (1950).

    Google Scholar 

  18. B. Gal-Or, Modern Developments in Thermodynamics, Israel University Press (1974).

  19. A. Hobson, Irreversibility in simple systems,Am. J. Phys. 34:411 (1966).

    Google Scholar 

  20. H. Grad, The many faces of entropy,Commun. Pure Appl. Math. 14:323 (1961).

    Google Scholar 

  21. J. von Neumann,Die Matematischen Grundlagen der Quantenmechanik, Springer-Verlag, Berlin (1932).

    Google Scholar 

  22. C. L. Shannon, The mathematical theory of communication, reprinted inThe Mathematical Theory of Communication, E. Shannon and W. Weaver (eds.), Urbana, Illinois (1949).

    Google Scholar 

  23. A. I. Khinchin,Mathematical Foundations of Information Theory, Dover, New York (1957).

    Google Scholar 

  24. E. T. Jaynes, Information theory and statistical mechanics, inStatistical Physics, 1962 Brandeis Lectures, Vol. 3, K. W. Ford (ed.), W. A. Benjamin, New York (1963).

    Google Scholar 

  25. B. Skagerstam, Time-evolution induced by contractive semi-groups, Institute Report No. 74-20, Gothenburg (1974).

Download references

Author information

Authors and Affiliations

Authors

Rights and permissions

Reprints and permissions

About this article

Cite this article

Skagerstam, BS.K. On the notions of entropy and information. J Stat Phys 12, 449–462 (1975). https://doi.org/10.1007/BF01025833

Download citation

  • Received:

  • Issue Date:

  • DOI: https://doi.org/10.1007/BF01025833

Key words

Navigation