In the late 1940’s, Claude Shannon of Bell Laboratories developed a mathematical theory of information that profoundly altered our basic thinking about communication, and stimulated considerable intellectual activity, both practical and theoretical. This theory, among other things, gives us some fundamental boundaries within which communication can take place. Often we can gain considerable insight by comparing the performance of a digital communication system design with these limits
KeywordsMutual Information Channel Capacity Conditional Entropy Additive Gaussian Noise Gaussian Channel
Unable to display preview. Download preview PDF.
- 1.T. Berger, Rate Distortion Theory, Prentice-Hall, Englewood Cliffs, NJ, 1971.Google Scholar
- 2.G. Ungerboeck, “Channel Coding with Multilevel/Phase Signals,” IEEE Trans, on Information Theory, vol. IT-28, No. 1, Jan. 1982.Google Scholar
- 3.N. Abramson, Information Theory and Coding, McGraw-Hill Book Co., New York, 1963.Google Scholar
- 9.C. E. Shannon, “A Mathematical Theory of Communication,” Bell System Technical Journal, Oct. 1948.Google Scholar