Skip to main content
Log in

The entropy of a continuous distribution

  • Published:
The bulletin of mathematical biophysics Aims and scope Submit manuscript

Abstract

C. Shannon's definition (Bell System Technical Journal,27, 379–423, 1948) of the entropy of a continuous distribution is dimensionally incorrect and does not have the same significance as the corresponding definition in the discrete case. A new definition is proposed: this modified entropy is more like the entropy of a discrete distribution in one way, in another more like Shannon's “transmission rate.” The ideas are illustrated by reference to Wright's study of the hereditary influence on the coat pattern of the guinea pig.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

Literature

  • Brillouin, Leon. 1962.Science and Information Theory. Second edition. New York: Academic Press.

    MATH  Google Scholar 

  • Rashevsky, N. 1960. “Life, Information Theory, Probability and Physics.”Bull. Math. Biophysics,22, 351–364.

    Article  MathSciNet  Google Scholar 

  • Shannon, Claude. 1948. “The Mathematical Theory of Communication.”Bell System Technical Journal,27, 379–423; 623–656. Reprinted, 1949, by the University of Illinois Press.

    MATH  MathSciNet  Google Scholar 

  • Wright, Sewall. 1920. “The Relative Importance of Heredity and Environment in Determining the Piebald pattern of Guinea-Pigs.”Proc. Nat. Acad. Sci.,6, 320–332.

    Article  Google Scholar 

  • Yockey, H. P. (ed.). 1958.Symposium on Information Theory in Biology. New York: Pergamon Press.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Rights and permissions

Reprints and permissions

About this article

Cite this article

White, H. The entropy of a continuous distribution. Bulletin of Mathematical Biophysics 27 (Suppl 1), 135–143 (1965). https://doi.org/10.1007/BF02477270

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1007/BF02477270

Keywords

Navigation