Skip to main content
SpringerLink
Log in

Information I: Communication, Transmission, and Information Theory

  • Chapter
  • First Online:
Energy, Information, Feedback, Adaptation, and Self-organization

Part of the book series: Intelligent Systems, Control and Automation: Science and Engineering ((ISCA,volume 90))

  • 1344 Accesses

Abstract

Information is a basic element of life and society involved in all areas of human, scientific, technological, economic, and developmental activity. Information storage, flow, and processing are inherent processes in nature and living organisms. Information transmission and communication/networking techniques are contributing to the development of modern society, including social, economic, business, scientific, and technological operations and activities. This chapter covers at a conceptual level the following issues of information: definition, historical landmarks of its manifestations, communication models, modulation/demodulation, computer networks, multimedia, informatics/telematics, Shannon’s information entropy, source and channel coding/decoding, and theorems of information theory. The above set of information/communication models, techniques, and technologies are affecting, and will continue to increasingly affect the social, economic/business, and developmental activities of people in the short-term and long-term future.

The importance of information is directly proportional to its improbability.

Jeremia Eugene Pournelle

Intelligence is not information alone but also judgment, the manner in which information is collected and used.

Carl Sagan

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Institutional subscriptions

References

  1. R. Capurro, Information: A Contribution to the Foundation of the Concept of Information Based on Its Etymology and in the History of Ideas (Saur, Munich, 1978). http://www.capurro.de/info.html

  2. R. Capurro, B. Hjorland, The concept of information. Ann. Rev. Inf. Sci. Technol. 37, 343–411 (2003). (B. Cronin, ed., Chap. 8)

    Article  Google Scholar 

  3. R.J. Bogdan, Ground for Cognition: How Goal-Guided Behavior Shapes the Mind (Lawrence Earlbaum, Hillsdale, N.J., 1994)

    Google Scholar 

  4. G. Ropohl, The concept of information in the framework of the culturalist struggle. Ethik und Sozialwissenschaften 1, 1–12 (2001)

    Google Scholar 

  5. W. Hofkirchner (ed.), The quest for a unified theory of information, in Proceedings, 2nd International Conference on the Foundations of Information Science (Gordon and Breach, Amsterdam, 1999)

    Google Scholar 

  6. F. Machlup, U. Mansfield (eds.), The Study of Information: Interdisciplinary Messages (Wiley, New York, 1983)

    Google Scholar 

  7. R. Capurro, On the genealogy of information, in Information: New Questions to a Multidisciplinary Concept, ed. by K. Kornwachs, K. Jacoby (Akademie Verlag, Berlin, 1996), http://www.capurro.de/cottinf.hbm

  8. R.V.L. Hartley, Transmission of Information. Bell Syst. Tech. J. 7, 535–563 (1928)

    Article  Google Scholar 

  9. C. Shannon, A mathematical theory of communication. Bell System Tech. J. 27, 379–423, 623–656 (1948)

    Google Scholar 

  10. C. Shannon, W. Weaver, The Mathematical Theory of Communication (The University of Illinois Press, Urbana, IL, 1949) (also 1972)

    Google Scholar 

  11. H. Titze, Is Information a Principle? (Ist Information ein Prinzip?) (Hain, Meisenheim, 1971)

    Google Scholar 

  12. T. Stonier, Towards a new theory of information. J. Inf. Sci. 17, 257–263 (1991)

    Article  Google Scholar 

  13. T. Stonier, Information as a basic property of the universe. Biosystems 38, 135–140 (1997)

    Article  Google Scholar 

  14. P.T. de Chardin, The Future of Man (Harper and Row, New York, 1964) (originally published in 1959)

    Google Scholar 

  15. S. Augarten, BIT by BIT: An Illustrated History of Computers (Ticknor and Fields, New York, 1984)

    Google Scholar 

  16. R. Moreau, The Computer Comes of Age: The People, the Hardware, and the Software (Trans. by J. Howlett) (MIT Press, 1984)

    Google Scholar 

  17. J.G. Butler, Information Technology History-Outline, http://www.tcf.ua.edu/AZ/ITHistory.Outline.htm

  18. The Antikythera Mechanism Research Project, www.antikythera-mechanism.gr/project/general/the-project.html

  19. Information Theory, http://www.eoht.info/page/information+theory

  20. History of Information Theory, http://en.wikipedia.org/wiki/History_of_information_theory

  21. L. Szilard, On the decrease in entropy in a thermodynamic system by the intervention of intelligent beings. Z. Angew. Phys. 53, 840–856 (1929)

    Google Scholar 

  22. L. Brillouin, Science and Information Theory (Academic Press, New York, 1956)

    MATH  Google Scholar 

  23. R.M. Fano, Transmission of Information (MIT Press, Cambridge, MA, 1949)

    MATH  Google Scholar 

  24. E.T. Jaynes, Information theory and statistical mechanics: (I). Phys. Rev. 106, 620 (1957); (II), ibid., 108, 171 (1957)

    Google Scholar 

  25. M. Tribus, Thermostatics and Thermodynamics: An Introduction to Energy, Information, and States of Matter (Van Nostrand Reinhold, New York, 1961)

    Google Scholar 

  26. E.T. Jaynes, On the rationale of maximum entropy methods. Proc. IEEE 70(9), 939–952 (1982)

    Article  Google Scholar 

  27. G.N. Saridis, Entropy Formulation for Optimal and Adaptive Control. IEEE Trans. Autom. Control 33(8), 713–721 (1988)

    Article  MathSciNet  MATH  Google Scholar 

  28. G.N. Saridis, Entropy in Control Engineering (World Scientific, London, 2001)

    Book  MATH  Google Scholar 

  29. G.J. Klir, Uncertainty and Information: Foundations of Generalized Information Theory (Wiley-Interscience, Hoboken, NJ, 2006)

    MATH  Google Scholar 

  30. A. Ben-Naim, Farewell to Entropy: Statistical Thermodynamics Based on Information (World Scientific, London, 2007)

    MATH  Google Scholar 

  31. Wikipedia: Timeline of Information Theory, http://en.wikipedia.org/wiki/Timeline_of_information_theory

  32. History of Computer Networks (Hammed Haddadi). http://www.ee.ucl.ac.uk/~hamed/transfer/thesis/node10.html

  33. Computer Networking History-Networking Computer Tips, http://www.onlinecomputertips.com

  34. Internet World Stats, http://www.internetworldstats.com/stats.htm

  35. R. Albarino, Goldstein’s Light Works at Southampton, Variety 213(12) (1966) (Aug 10)

    Google Scholar 

  36. D. Marshall, History of multimedia systems, http://www.cs.cf.ac.uk/Dave/Multimedia/node8.html

  37. History of Multimedia (Calgary University) http://www.acs.ucalgary.ca/~edtech/688/hist.html

  38. S. Nora, A. Minc, The Computerization of Society. A Report to the President of France (MIT Press, Cambridge, MA, 1980) (translation of L’ Informatisation de la Société. Rapport à M. le Président de la Republique, La Documentation Francaise, Paris, 1978)

    Google Scholar 

  39. The History of Telematics. Telematique, http://www.telematique.eu/telematics/

  40. Telematics Valley, http://telematicsvalley.org/

  41. C.D. Mortensen, Communication: The Study of Human Communication (McGraw-Hill, New York, 1972)

    Google Scholar 

  42. J.R. Barry, E.A. Lee, D.G. Messerschmidt, Digital Communication (Kluwer, Boston, 2004)

    Book  Google Scholar 

  43. D.K. Berlo, The Process of Communication (Holt Rinehart and Winston, New York, 1960)

    Google Scholar 

  44. W. Schramm, How Communication Works, in The Process and Effects of Communication, ed. by W. Schramm, (University of Illinois Press, Urbana, Illinois, 1954)

    Google Scholar 

  45. Communication models, http://www.shkaminski.com

  46. B.G. Korenev, Bessel Functions and their Applications (CRC Press, Boca Raton, FL, 2002)

    MATH  Google Scholar 

  47. E. Weisstein, Bessel Function of the First Kind, Wolfram Research, http://mathworld.wolfram.com/BesselFunctionoftheFirstKind.html

  48. D.E. Foster, S.W. Sceley, Automatic tuning, simplified circuits, and design practice. Proc. IRE 25(3), 289–313 (1937) (part 1)

    Google Scholar 

  49. FM Detectors (Discriminators), http://www.ycars.org/EFRA/Module%20B/fmdet.htm

  50. Amplitude, Frequency and Phase Modulation, http://www.aubraux.com/dsp/dsp-modulation-all.php

  51. A. Schwope, Modulation, http://www.andreas-schwope.de/ASIC_s/Schnittstellen/Data_Lines/body_modulation.html

  52. J. Proakis, M. Salehi, Digital Communications (Mc Graw-Hill, New York, 2007)

    Google Scholar 

  53. H.L. Resnikoff, The Illusion of Reality (Springer, Berlin, 1989)

    Book  MATH  Google Scholar 

  54. W.W. Reterson, E.J. Weldon Jr., Error Correcting Codes, 2nd edn. (The MIT Press, Cambridge, MA, 1972)

    Google Scholar 

  55. V. Press, Introduction to the Theory of Error-Correcting Codes, 3rd edn. (Wiley, New York, 1998)

    Google Scholar 

  56. W. Huffman, V. Pless, Fundamentals of Error-Correcting Codes (Cambridge University Press, Cambridge, 2003)

    Book  MATH  Google Scholar 

  57. J.H. Van Lint, Introduction to Coding Theory (Springer, Berlin, 1981)

    MATH  Google Scholar 

  58. N.J.A. Sloane, A Short Course on Error Correcting Codes, vol. 188, CISM Courses and Lectures (Springer, Berlin, 1975)

    Book  MATH  Google Scholar 

  59. A.M. Michelson, A.H. Levesque, Error Control Techniques for Digital Communication (Willey, New York, 1985)

    Google Scholar 

  60. C. Schlegel, L. Perez, Trellis Coding (IEEE Press, New York, 1997)

    MATH  Google Scholar 

  61. Error Correcting Codes, http://www.eie.polyu.edu.hk/~enmzwang/adc/1-notes/node3.html

  62. C. Langton (ed.), Convolution Codes, http://www.complextoreal.com/convo.htm

  63. Y.S. Han, Introduction to Binary Convolution Codes, Graduate Institute of Communication Engineering, National Taipei University, Taiwan. http://web.ntpu.ed.tw/~shan/intro_in_cod.pdf

  64. C. Fleming, A Tutorial on Convolutional Coding with Viterbi Decoding. http://home.netcom.com/~chip.f/viterbi/tutorial.html

  65. F.J. Mc Williams, N.J.A. Sloane, The Theory of Error-Correcting Codes (North-Holland, Amsterdam, 1977)

    Google Scholar 

  66. R. Yates, A Coding Theory Tutorial, http://www.digitalsignallabs.com/tutorial.pdf

  67. H. Nyquist, Certain topics in telegraph transmission theory. Trans. AIEE 47, 617 (1928)

    Google Scholar 

  68. C. Shannon, Communication in the presence of noise. Proc. IRE 37(1), 10–21 (1949). http://www.stanford.edu/class/ee104/shannonpaper.pdf

  69. R. Wang, Shannon’s source coding theorem (Dec 10, 2009). http://fourier.eng.hmc.edu/e161/lectures/compression/node7.html

  70. B. Aazhang, Shannon’s Noisy Channel Coding Theorem (May 19, 2004). http://cnx.org/content/m10180/latest/

  71. Nyquist-Shannon Sampling Theorem Signal Frequency Mhz, http://www.economicexpert.com/a/Nyquist:Shannon:sampling:theorem.htm

Download references

Author information

Authors and Affiliations

  1. School of Electrical and Computer Engineering, National Technical University of Athens, Athens, Greece

    Spyros G. Tzafestas

Authors
  1. Spyros G. Tzafestas
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Spyros G. Tzafestas .

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer International Publishing AG

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Tzafestas, S.G. (2018). Information I: Communication, Transmission, and Information Theory. In: Energy, Information, Feedback, Adaptation, and Self-organization. Intelligent Systems, Control and Automation: Science and Engineering, vol 90. Springer, Cham. https://doi.org/10.1007/978-3-319-66999-1_4

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-66999-1_4

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-66998-4

  • Online ISBN: 978-3-319-66999-1

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics

Search

Navigation