A mathematical theory of communication; Shannon theory
Information theory is above all a branch of communication theory. According to Claude Shannon : “The fundamental problem of communication is that of reproducing at one point either exactly or approximately a message selected at another point.” These two points may be separated in time and/or in space. Information theory addresses this problem and tells us what the ultimate rate of communication is over a noisy channel. Information theory also tells us what the ultimate data compression rate is. In general, information theory is concerned with stating what can and cannot be done in various communication settings. The theory also suggests schemes to achieve those limits and analyses the performance of those schemes. The insight and principles embodied in the theory form the foundation for virtually all modern communication systems.
The enormous influence of information theory on manmade communication systems...
- 1.Shannon CE (1948) A mathematical theory of communication. Bell Syst Tech J 27:379–423, 623–656Google Scholar
- 3.Rieke F, Warland D, de Ruyter van Stevenink R, Bialek W (1997) Spikes: exploring the neural code. MIT Press, Cambridge, MAGoogle Scholar
- 7.Tock Y (2004) Information theoretic analysis of the muscle spindle system, PhD thesis. Technion – Israel Institute of Technology, Haifa, IsraelGoogle Scholar
- 9.Gallager RG (1968) Information theory and reliable communication. Wiley, New YorkGoogle Scholar
- 10.Cover TM, Thomas JA (1990) Elements of information theory, Wiley, New YorkGoogle Scholar