Limits of Communication

  • John R. Barry
  • Edward A. Lee
  • David G. Messerschmitt


In the late 1940’s, Claude Shannon of Bell Laboratories developed a mathematical theory of information that profoundly altered our basic thinking about communication, and stimulated considerable intellectual activity, both practical and theoretical. This theory, among other things, gives us some fundamental boundaries within which communication can take place. Often we can gain considerable insight by comparing the performance of a digital communication system design with these limits


Mutual Information Channel Capacity Conditional Entropy Additive Gaussian Noise Gaussian Channel 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    T. Berger, Rate Distortion Theory, Prentice-Hall, Englewood Cliffs, NJ, 1971.Google Scholar
  2. 2.
    G. Ungerboeck, “Channel Coding with Multilevel/Phase Signals,” IEEE Trans, on Information Theory, vol. IT-28, No. 1, Jan. 1982.Google Scholar
  3. 3.
    N. Abramson, Information Theory and Coding, McGraw-Hill Book Co., New York, 1963.Google Scholar
  4. 4.
    R. Gallager, Information Theory and Reliable Communication, John Wiley and Sons, Inc., New York, 1968.MATHGoogle Scholar
  5. 5.
    R. J. McEliece, The Theory of Information and Coding, Addison Wesley Pub. Co., 1977.MATHGoogle Scholar
  6. 6.
    T. M. Cover and J. A. Thomas, Elements of Information Theory, Wiley, New York, 1991.MATHCrossRefGoogle Scholar
  7. 7.
    R. E. Blahut, Principles and Practice of Information Theory, Addison-Wesley, New York, 1987.MATHGoogle Scholar
  8. 8.
    D. Slepian (editor), Key Papers in the Development of Information Theory, IEEE Press, New York, 1974.MATHGoogle Scholar
  9. 9.
    C. E. Shannon, “A Mathematical Theory of Communication,” Bell System Technical Journal, Oct. 1948.Google Scholar
  10. 10.
    C. E. Shannon and W. Weaver, The Mathematical Theory of Communication, University of Illinois Press, Urbana, Illinois, 1963.MATHGoogle Scholar
  11. 11.
    A. J. Viterbi and J. K. Omura, Principles of Digital Communication and Coding, McGraw-Hill, 1979.MATHGoogle Scholar
  12. 12.
    J. Wolfowitz, The Coding Theorems of Information Theory, 3d ed., Springer-Verlag, Berlin, 1978.CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media New York 2004

Authors and Affiliations

  • John R. Barry
    • 1
  • Edward A. Lee
    • 2
  • David G. Messerschmitt
    • 2
  1. 1.Georgia Institute of TechnologyUSA
  2. 2.University of California at BerkeleyUSA

Personalised recommendations