Abstract
In this review article we look for some of the historical reasons for the “identification” of the information-theoretical and thermodynamic entropy concepts. We also discuss the Baron-Jauch entropy concept and explicitly show that, for classical systems in thermodynamic equilibrium, there exists a very simple connection between this general definition and the ordinary experimental entropy.
Similar content being viewed by others
References
M. Dutta, A hundred years of entropy, Physics Today1968 (January).
J. G. Baron and J. M. Jauch, Entropy, information and Szilard's paradox,Helv. Phys. Acta 45:220 (1972).
W. Rudin,Real and Complex Analysis, McGraw-Hill, New York (1970).
B. Skagerstam, On the mathematical definition of entropy,Z. Naturforsch.29a(9) (1974).
R. S. Ingarden, Generalized irreversible thermodynamics and its applications to lasers,Acta Phys. Polon. 43:3 (1973).
D. Ruelle,Statistical Mechanics, W. A. Benjamin, New York (1969).
A. Kossakowski, On quantum statistical mechanics of non-Hamiltonian systems,Rep. Math. Phys. 3(4):247 (1972).
R. S. Ingarden and A. Kossakowski, On the connection of non-equilibrium information thermodynamics with non-Hamiltonian quantum mechanics of open systems,Ann. Phys. (N.Y.) 89:451 (1975).
J. L. Lebowitz and O. Penrose, Modern ergodic theory, Physics Today1973 (February).
M. Tribus and E. C. McIrvine, Energy and information, Sci. Am.1969 (September).
W. Ehrenberg, Maxwell's demon, Sci. Am.1967 (November).
J. M. Jauch, On a new foundation of equilibrium thermodynamics,Found Phys. 2(4):271 (1972); see also R. Hermann,Lectures in Mathematical Physics, Vol. II. Chapter VI, W. A. Benjamin, New York (1972).
D. ter Haar,Elements of Thermostatistics, Holt, Rinehard and Winston, New York (1966).
D. H. Frisch, The microscopic interpretation of entropy,Am. J. Phys. 34:1171 (1966).
L. Boltzmann,Wien Ber. 66:275 (1872).
J. M. Blatt, An alternative approach to the ergodic problem,Prog. Theor. Phys. 22:745 (1959).
E. L. Hahn,Phys. Rev. 80:580 (1950).
B. Gal-Or, Modern Developments in Thermodynamics, Israel University Press (1974).
A. Hobson, Irreversibility in simple systems,Am. J. Phys. 34:411 (1966).
H. Grad, The many faces of entropy,Commun. Pure Appl. Math. 14:323 (1961).
J. von Neumann,Die Matematischen Grundlagen der Quantenmechanik, Springer-Verlag, Berlin (1932).
C. L. Shannon, The mathematical theory of communication, reprinted inThe Mathematical Theory of Communication, E. Shannon and W. Weaver (eds.), Urbana, Illinois (1949).
A. I. Khinchin,Mathematical Foundations of Information Theory, Dover, New York (1957).
E. T. Jaynes, Information theory and statistical mechanics, inStatistical Physics, 1962 Brandeis Lectures, Vol. 3, K. W. Ford (ed.), W. A. Benjamin, New York (1963).
B. Skagerstam, Time-evolution induced by contractive semi-groups, Institute Report No. 74-20, Gothenburg (1974).
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Skagerstam, BS.K. On the notions of entropy and information. J Stat Phys 12, 449–462 (1975). https://doi.org/10.1007/BF01025833
Received:
Issue Date:
DOI: https://doi.org/10.1007/BF01025833