Skip to main content

Conclusion

  • Chapter
  • First Online:
New Foundations for Information Theory

Part of the book series: SpringerBriefs in Philosophy ((BRIEFSPHILOSOPH))

  • 536 Accesses

Abstract

The purpose of this chapter is to summarize the new foundations for information theory presented in the book and to point out work yet to be done on the topic. The claim is that logical information theory fills the gap left by the Shannon theory of giving a definition of information as being about distinctions, differences, distinguishability, and diversity (as opposed to “uncertainty” etc.) with logical entropy as its direct measure—and with Shannon entropy as its requantification for the purposes of coding and communications theory. Shannon himself said that the “information theory” bandwagon created by the science press and popularizers had gone far beyond the actual accomplishments of communications theory—so the mathematical theory of logical entropy should not be seen as contrary to Shannon’s claims about his concept of entropy. The linearization methodology showed how to extend the ‘classical’ logical information theory to the quantum version where it was shown that quantum logical entropy is naturally related to ‘measuring’ quantum measurement and to providing a distance measure between quantum states. Finally, it is emphasized that the surface has only been scratched to relate logical entropy to all the fields that touch on information theory.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

eBook
USD 16.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 16.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    In that year of 1961, the author and a number of other MIT freshman had lunch and a discussion with Professor Shannon as part of the program to introduce new students to famous MIT professors and thus to the MIT scientific culture in general. Hence Shannon’s theory always had a special significance for me.

References

  1. Bateson, Gregory. 1979. Mind and nature: A necessary unity. New York: Dutton.

    Google Scholar 

  2. Birkhoff, Garrett, and John Von Neumann. 1936. The Logic of Quantum Mechanics. Annals of Mathematics 37: 823–43.

    Article  Google Scholar 

  3. Brillouin, Leon. 1962. Science and Information Theory. New York: Academic Press.

    Book  Google Scholar 

  4. Ellerman, David. 2018. The quantum logic of direct-sum decompositions: the dual to the quantum logic of subspaces. Logic Journal of the IGPL 26: 1–13. https://doi.org/10.1093/jigpal/jzx026.

    Article  Google Scholar 

  5. Manfredi, Giovanni, and M. R. Feix. 2000. Entropy and Wigner Functions. Physical Review E 62: 4665–4674. https://doi.org/10.1103/PhysRevE.62.4665.

  6. Ramshaw, John D. 2018. The Statistical Foundations of Entropy. Singapore: World Scientific Publishing.

    Book  Google Scholar 

  7. Rao, C. R. 2010. Quadratic Entropy and Analysis of Diversity. Sankhyā: The Indian Journal of Statistics 72-A: 70–80.

    Article  Google Scholar 

  8. Shannon, Claude E. 1948. A Mathematical Theory of Communication. Bell System Technical Journal 27: 379–423; 623–56.

    Article  Google Scholar 

  9. Shannon, Claude E. 1993. Some Topics in Information Theory. In Claude E. Shannon: Collected Papers, ed. N. J. A. Sloane and Aaron D. Wyner, 458–459. Piscataway NJ: IEEE Press.

    Google Scholar 

  10. Shannon, Claude E. 1993. The Bandwagon. In Claude E. Shannon: Collected Papers, ed. N. J. A. Sloane and Aaron D. Wyner, 462. Piscataway NJ: IEEE Press.

    Google Scholar 

  11. Shannon, Claude E. and Warren Weaver 1964. The Mathematical Theory of Communication. Urbana: University of Illinois Press.

    Google Scholar 

  12. Tamir, Boaz, and Eliahu Cohen. 2014. Logical Entropy for Quantum States. ArXiv.org. http://de.arxiv.org/abs/1412.0616v2.

  13. Tamir, Boaz, and Eliahu Cohen. 2015. A Holevo-type bound for a Hilbert Schmidt distance measure. Journal of Quantum Information Science 5: 127–133. https://doi.org/10.4236/jqis.2015.54015.

    Article  Google Scholar 

  14. Tribus, Myron. 1978. Thirty Years of Information Theory. In The Maximum Entropy Formalism, ed. Raphael D. Levine and Myron Tribus, 1–14. Cambridge MA: MIT.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Rights and permissions

Reprints and permissions

Copyright information

© 2021 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Ellerman, D. (2021). Conclusion. In: New Foundations for Information Theory. SpringerBriefs in Philosophy. Springer, Cham. https://doi.org/10.1007/978-3-030-86552-8_6

Download citation

Publish with us

Policies and ethics