Abstract
The purpose of this chapter is to summarize the new foundations for information theory presented in the book and to point out work yet to be done on the topic. The claim is that logical information theory fills the gap left by the Shannon theory of giving a definition of information as being about distinctions, differences, distinguishability, and diversity (as opposed to “uncertainty” etc.) with logical entropy as its direct measure—and with Shannon entropy as its requantification for the purposes of coding and communications theory. Shannon himself said that the “information theory” bandwagon created by the science press and popularizers had gone far beyond the actual accomplishments of communications theory—so the mathematical theory of logical entropy should not be seen as contrary to Shannon’s claims about his concept of entropy. The linearization methodology showed how to extend the ‘classical’ logical information theory to the quantum version where it was shown that quantum logical entropy is naturally related to ‘measuring’ quantum measurement and to providing a distance measure between quantum states. Finally, it is emphasized that the surface has only been scratched to relate logical entropy to all the fields that touch on information theory.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
In that year of 1961, the author and a number of other MIT freshman had lunch and a discussion with Professor Shannon as part of the program to introduce new students to famous MIT professors and thus to the MIT scientific culture in general. Hence Shannon’s theory always had a special significance for me.
References
Bateson, Gregory. 1979. Mind and nature: A necessary unity. New York: Dutton.
Birkhoff, Garrett, and John Von Neumann. 1936. The Logic of Quantum Mechanics. Annals of Mathematics 37: 823–43.
Brillouin, Leon. 1962. Science and Information Theory. New York: Academic Press.
Ellerman, David. 2018. The quantum logic of direct-sum decompositions: the dual to the quantum logic of subspaces. Logic Journal of the IGPL 26: 1–13. https://doi.org/10.1093/jigpal/jzx026.
Manfredi, Giovanni, and M. R. Feix. 2000. Entropy and Wigner Functions. Physical Review E 62: 4665–4674. https://doi.org/10.1103/PhysRevE.62.4665.
Ramshaw, John D. 2018. The Statistical Foundations of Entropy. Singapore: World Scientific Publishing.
Rao, C. R. 2010. Quadratic Entropy and Analysis of Diversity. Sankhyā: The Indian Journal of Statistics 72-A: 70–80.
Shannon, Claude E. 1948. A Mathematical Theory of Communication. Bell System Technical Journal 27: 379–423; 623–56.
Shannon, Claude E. 1993. Some Topics in Information Theory. In Claude E. Shannon: Collected Papers, ed. N. J. A. Sloane and Aaron D. Wyner, 458–459. Piscataway NJ: IEEE Press.
Shannon, Claude E. 1993. The Bandwagon. In Claude E. Shannon: Collected Papers, ed. N. J. A. Sloane and Aaron D. Wyner, 462. Piscataway NJ: IEEE Press.
Shannon, Claude E. and Warren Weaver 1964. The Mathematical Theory of Communication. Urbana: University of Illinois Press.
Tamir, Boaz, and Eliahu Cohen. 2014. Logical Entropy for Quantum States. ArXiv.org. http://de.arxiv.org/abs/1412.0616v2.
Tamir, Boaz, and Eliahu Cohen. 2015. A Holevo-type bound for a Hilbert Schmidt distance measure. Journal of Quantum Information Science 5: 127–133. https://doi.org/10.4236/jqis.2015.54015.
Tribus, Myron. 1978. Thirty Years of Information Theory. In The Maximum Entropy Formalism, ed. Raphael D. Levine and Myron Tribus, 1–14. Cambridge MA: MIT.
Author information
Authors and Affiliations
Rights and permissions
Copyright information
© 2021 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this chapter
Cite this chapter
Ellerman, D. (2021). Conclusion. In: New Foundations for Information Theory. SpringerBriefs in Philosophy. Springer, Cham. https://doi.org/10.1007/978-3-030-86552-8_6
Download citation
DOI: https://doi.org/10.1007/978-3-030-86552-8_6
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-86551-1
Online ISBN: 978-3-030-86552-8
eBook Packages: Mathematics and StatisticsMathematics and Statistics (R0)