Skip to main content
Log in

On obtaining a stationary process isomorphic to a given process with a desired distribution

  • Published:
Monatshefte für Mathematik Aims and scope Submit manuscript

Abstract

Let

e denote the set of distributions of all stationary, ergodic, aperiodic processes with a given finite state space, and let the metric\(\bar d\) on

e be Ornstein's process distance. Suppose ℳ is a subset of

e which is a

δ in the weak topology and for which\(\bar d\) n ,ℳ)→0 whenever {μ n } is a sequence from

e converging weakly to a positive entropy measure in ℳ. It is shown that ifX is a stationary ergodic aperiodic process with entropy rate less than the entropy of one of the distributions in ℳ, thenX is isomorphic to a process whose distribution lies in ℳ. As special cases, one obtains the invulnerable source coding theorem of information theory and also the Grillenberger-Krengel theorem on the existence of a generator whose process has a desired marginal distribution.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. Gray, R., Ornstein, D., Dobrushin, R.: Block synchronization, slidingblock coding, invulnerable sources, and zero error codes for discrete noisy channels. Ann. Prob.8, 639–674 (1980).

    Google Scholar 

  2. Grillenberger, C., Krengel, U.: On marginal distributions and isomorphisms of stationary processes. Math. Z.149, 131–154 (1976).

    Google Scholar 

  3. Kieffer, J.: On coding a stationary process to achieve a given marginal distribution. Ann. Prob.8, 131–141 (1980).

    Google Scholar 

  4. Kieffer, J.: Zero-error stationary coding over stationary channels. Z. Wahrscheinlichkeitsth. verw. Geb.56, 113–126 (1981).

    Google Scholar 

  5. Kieffer, J.: A method for proving multiterminal source coding theorems. IEEE Trans. Inf. Th.27, 565–570 (1981).

    Google Scholar 

  6. Kieffer, J.: Sliding-block coding for weakly continuous channels. IEEE Trans. Inf. Th.28, 2–10 (1982).

    Google Scholar 

  7. Kieffer, J.: Characterizations of\(\bar d\)-total boundedness for classes ofB sources. IEEE Trans. Inf. Th.28, 26–35 (1982).

    Google Scholar 

  8. Ornstein, D.: Bernoulli shifts with the same entropy are isomorphic. Adv. Math.4, 337–352 (1970).

    Google Scholar 

  9. Ornstein, D.: An application of probability theory to ergodic theory. Ann. Prob.1, 43–65 (1973).

    Google Scholar 

  10. Shields, P.: The Theory of Bernoulli Shifts. Chicago: Univ. Press. 1973.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Additional information

Research of author supported by NSF Grant ECS-78-21335.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Kieffer, J.C. On obtaining a stationary process isomorphic to a given process with a desired distribution. Monatshefte für Mathematik 96, 183–193 (1983). https://doi.org/10.1007/BF01605487

Download citation

  • Received:

  • Revised:

  • Issue Date:

  • DOI: https://doi.org/10.1007/BF01605487

Keywords

Navigation