Abstract
In the preceding chapter, we summarized the basic elements of information theory, and we now proceed to examine and analyze the main characteristics of this theory. The term “critical” in the title of the chapter implies simply that we shall present a review of the main features for and against the theory. To support the theory in its present form, one can mention Shannon results on the capacity of a channel, the Boltzmann equation, and the fact that one can prove the central limit theorem in probability by using the properties of entropy only. Against the present form of the theory we have the apparent discrepancy between discrete entropy and continuous entropy, the absence of a concept of negative information to describe information lost, and the fact that the model does not take explicitly into account syntax and semantics. In the present chapter, we shall review these features and one of our conclusions will be as follows: Contrary to what some scientists are inclined to believe, we maintain that the continuous entropy is soundly defined, and that it merely remains to exhibit the differences in physical nature between discrete entropy and continuous entropy.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Thom, R.: Structural Stability and Morphogenesis ( Benjamin, New York 1975 )
Jumarie. G.: Subjectivity, Information, Systems. Introduction to a Theory of Relativistic Cybernetics ( Gordon and Breach, New York 1986 )
Faddeev, D. K.: Uspehi Mat. NAUKA 11, 227 (1956)
Feinstein, A.: Foundation of Information Theory ( McGraw-Hill, New York 1958 )
Kullback, S.: Information Theory and Statistics ( Wiley, New York 1959 )
Brillouin, L.: Science and Information Theory ( Academic, New York 1956 )
Lindeberg, J. W.: Math. Zeit. 15, 211(1922)
Linnik, Yu. V.: Theory of Prob, and Applications 4, 288 (1959)
Feller, W.: An Introduction to Probability Theory and its Application ( Wiley, New York 1950 )
Jaynes, E.T.: Phys. Rev. 106, 620; 108, 171 (1957)
Jumarie, G.: J. of Math. Phys. 26, 1173 (1985)
Shore, J. E., Johnson, R. W.: IEEE Trans. Inform. Theory IT 26, 26 (1980)
Weaver, W., Shannon, C. E.: The Mathematical Theory of Communication ( Univ. of Illinois Press, Urbana 1949 )
Bar Hillel, Y.: Language and Information ( Addison Wesley, Reading 1964 )
Ryan, J. P.: J. Theoretical Biology 84, 31 (1980)
Haken, H. “Towards a Dynamic Information Theory” in Thermodynamics and Regulation of Biological Processes, ed. by I. Lamprecht and A. I. Zotin ( Walter de Gruyter, Berlin 1984 ) pp. 93–104
Author information
Authors and Affiliations
Rights and permissions
Copyright information
© 1990 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Jumarie, G. (1990). A Critical Review of Shannon Information Theory. In: Relative Information. Springer Series in Synergetics, vol 47. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-84017-3_3
Download citation
DOI: https://doi.org/10.1007/978-3-642-84017-3_3
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-84019-7
Online ISBN: 978-3-642-84017-3
eBook Packages: Springer Book Archive