Abstract
C. Shannon's definition (Bell System Technical Journal,27, 379–423, 1948) of the entropy of a continuous distribution is dimensionally incorrect and does not have the same significance as the corresponding definition in the discrete case. A new definition is proposed: this modified entropy is more like the entropy of a discrete distribution in one way, in another more like Shannon's “transmission rate.” The ideas are illustrated by reference to Wright's study of the hereditary influence on the coat pattern of the guinea pig.
Similar content being viewed by others
Literature
Brillouin, Leon. 1962.Science and Information Theory. Second edition. New York: Academic Press.
Rashevsky, N. 1960. “Life, Information Theory, Probability and Physics.”Bull. Math. Biophysics,22, 351–364.
Shannon, Claude. 1948. “The Mathematical Theory of Communication.”Bell System Technical Journal,27, 379–423; 623–656. Reprinted, 1949, by the University of Illinois Press.
Wright, Sewall. 1920. “The Relative Importance of Heredity and Environment in Determining the Piebald pattern of Guinea-Pigs.”Proc. Nat. Acad. Sci.,6, 320–332.
Yockey, H. P. (ed.). 1958.Symposium on Information Theory in Biology. New York: Pergamon Press.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
White, H. The entropy of a continuous distribution. Bulletin of Mathematical Biophysics 27 (Suppl 1), 135–143 (1965). https://doi.org/10.1007/BF02477270
Issue Date:
DOI: https://doi.org/10.1007/BF02477270