Abstract
This paper is made up of two parts. In the first one a brief review of discrete entropy and continuous entropy is given, which shows how, to a large extent, the latter is a more suitable measure of uncertainty than the former is in some instances. Based on this remark, the second part proposes a slight modification of the axiomatic derivation of the discrete entropy so that it exhibits properties similar to those of the continuous entropy. Some consequences of this unified approach are examined.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Aczel, J.; Daroczy, Z.; On measure of Information and their Caracterization, Academic Press, N.Y., 1975.
Aczel, J.; Daroczy, Z.; A Mixed Theory of Information. I. Symmetric, Recursive and Measurable Entropies of Randomized Systems of Events, RAIRO Theoretical Computer Sciences Vol. 12, No. 2, pp. 149–155, 1978.
Faddeev, D. K.; On the Concept of Entropy of a Finite Probabilistic Scheme (Russian). Uspehi Nat. Nauk. (N.S) 11, No. 1, (67), pp. 227–131, 1956.
Hatori, H.; A note on the Entropy of a Continuous Distribution. Kodai Math. Sem. Rep., Vol. 10, pp. 172–176, 1958.
Jaynes, E. T.; Information Theory and Statistical Mechanics I and II. Physical Review, Vol. 106, pp. 620-630, Vol. 108, pp. 171–190, 1957.
Jumarie, G.; Further Advances on the General Thermodynamics of Open Systems via Information Theory. Effective Entropy, Negative Information. Int. J. Syst. Sc., Vol. 6, No. 3, pp. 249–268, 1975.
Jumarie, G.; Subjectivity, Information, Systems. Introduction to a Theory of Relativistic Cybernetics. Gordon and Breach, N.Y., 1985.
Linnik, V. Ya.; An Information Theoretic Proof of the Central Limit Theorem with the Lindeberg Condition. Theory of Probability and its Applications, Vol. 4, No. 3, pp. 288–299, 1959.
Nicolis, J.S.; The Role of Chaos in Reliable Information Processing J. of the Franklin Institute, Vol. 317, No. 5, pp. 289–307, 1984.
Shore, J.E.; Johnson, R.W.; Axiomatic Derivation of the Principle of Maximum Entropy and the Principle of Minimum Cross-Entropy. IEEE Trans. Information Theory, Vol. IT-26, No. 1, pp. 26–37, 1980.
Thom, R.; Structural Stability and Morphogenesis. Benjamin, Reading, 1972.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 1986 D. Reidel Publishing Company
About this chapter
Cite this chapter
Jumarie, G. (1986). Total Entropy. A Unified Approach to Discrete Entropy and Continuous Entropy. In: Trappl, R. (eds) Cybernetics and Systems ’86. Springer, Dordrecht. https://doi.org/10.1007/978-94-009-4634-7_18
Download citation
DOI: https://doi.org/10.1007/978-94-009-4634-7_18
Publisher Name: Springer, Dordrecht
Print ISBN: 978-94-010-8560-1
Online ISBN: 978-94-009-4634-7
eBook Packages: Springer Book Archive