This chapter introduces the concept of a transition probability and the problem of guessing the input of an information channel from observing its output. It gives a first idea on the classical results of Shannon, without introducing the technicalities of stationary stochastic processes and the proof of Shanny’s Theorem. This material is provided in the next three chapters. Since it is not necessary for the understanding of Parts IV, V, and VI, one can move directly to Part IV after this chapter.
Error Probability Channel Capacity Information Channel Channel Output Bayesian Probability
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
This is a preview of subscription content, log in to check access.
Bauer, H. (1972). Probability theory and elements of measure theory. New York: Holt, Rinehart and Winston.Google Scholar
Fano, RM. (1961). Transmission of Information: A Statistical Theory of Communication. Wiley, New YorkGoogle Scholar