Abstract
Let
e denote the set of distributions of all stationary, ergodic, aperiodic processes with a given finite state space, and let the metric\(\bar d\) on
e be Ornstein's process distance. Suppose ℳ is a subset of
e which is a
δ in the weak topology and for which\(\bar d\)(µ n ,ℳ)→0 whenever {μ n } is a sequence from
e converging weakly to a positive entropy measure in ℳ. It is shown that ifX is a stationary ergodic aperiodic process with entropy rate less than the entropy of one of the distributions in ℳ, thenX is isomorphic to a process whose distribution lies in ℳ. As special cases, one obtains the invulnerable source coding theorem of information theory and also the Grillenberger-Krengel theorem on the existence of a generator whose process has a desired marginal distribution.
Similar content being viewed by others
References
Gray, R., Ornstein, D., Dobrushin, R.: Block synchronization, slidingblock coding, invulnerable sources, and zero error codes for discrete noisy channels. Ann. Prob.8, 639–674 (1980).
Grillenberger, C., Krengel, U.: On marginal distributions and isomorphisms of stationary processes. Math. Z.149, 131–154 (1976).
Kieffer, J.: On coding a stationary process to achieve a given marginal distribution. Ann. Prob.8, 131–141 (1980).
Kieffer, J.: Zero-error stationary coding over stationary channels. Z. Wahrscheinlichkeitsth. verw. Geb.56, 113–126 (1981).
Kieffer, J.: A method for proving multiterminal source coding theorems. IEEE Trans. Inf. Th.27, 565–570 (1981).
Kieffer, J.: Sliding-block coding for weakly continuous channels. IEEE Trans. Inf. Th.28, 2–10 (1982).
Kieffer, J.: Characterizations of\(\bar d\)-total boundedness for classes ofB sources. IEEE Trans. Inf. Th.28, 26–35 (1982).
Ornstein, D.: Bernoulli shifts with the same entropy are isomorphic. Adv. Math.4, 337–352 (1970).
Ornstein, D.: An application of probability theory to ergodic theory. Ann. Prob.1, 43–65 (1973).
Shields, P.: The Theory of Bernoulli Shifts. Chicago: Univ. Press. 1973.
Author information
Authors and Affiliations
Additional information
Research of author supported by NSF Grant ECS-78-21335.
Rights and permissions
About this article
Cite this article
Kieffer, J.C. On obtaining a stationary process isomorphic to a given process with a desired distribution. Monatshefte für Mathematik 96, 183–193 (1983). https://doi.org/10.1007/BF01605487
Received:
Revised:
Issue Date:
DOI: https://doi.org/10.1007/BF01605487