Skip to main content

Advertisement

SpringerLink
Log in
Menu
Find a journal Publish with us
Search
Cart
  1. Home
  2. Probability Theory and Related Fields
  3. Article
On the imbedding problem for stochastic and doubly stochastic matrices
Download PDF
Download PDF
  • Published: December 1988

On the imbedding problem for stochastic and doubly stochastic matrices

  • B. Fuglede1 

Probability Theory and Related Fields volume 80, pages 241–260 (1988)Cite this article

  • 180 Accesses

  • 7 Citations

  • Metrics details

Summary

It is shown that, for any, n x n stochastic matrix \(A{\text{ = (}}a_{ij} {\text{) }}\user1{\ddag } (\delta _{ij} )\) which can be imbedded in a continuous time Markov chain, there exist distinct indices i, j such that for all k

$$a_{ik} = 0{\text{ implies }}a_{jk} = 0,$$

and likewise distinct indices i′, j′ such that, for all k,

$$a_{ki'} = 0{\text{ implies }}a_{kj'} = 0.$$

The present proof of this does not use Kingman and Williams' characterization of the patterns of zero entries which can occur in imbeddable stochastic matrices.

In the analogous doubly stochastic situation the same result holds, even with “implies” replaced by “if and only if”. The main result is that the set ℱ of imbeddable stochastic (or doubly stochastic) matrices is a Lipschitz manifold with boundary. For any Markov chain leading to a matrix on the boundary of ℱ the associated intensity matrix in the Kolmogorov differential equation has, at almost every time, at least one zero entry.

Download to read the full article text

Working on a manuscript?

Avoid the common mistakes

References

  1. Berg, C., Christensen, J.P.R, Ressel, P.: Harmonic analysis on semigroups. New York Heidelberg Berlin: Springer 1984

    Google Scholar 

  2. Elfving, G.: Zur Theorie der Markoffschen Ketten. Acta Soc. Sci. Fennicæ, N. Ser. A2, 1–17 (1937)

    MATH  Google Scholar 

  3. Frydman, H.: The embedding problem for Markov chains with 3 states. Proc. Cambridge Philos. Soc. (Math) 87, 285–294 (1980)

    MATH  MathSciNet  Google Scholar 

  4. Frydman, H.: A structure of the bang-bang representation for 3x3 embeddable matrices Z. Wahrscheinlichkeitstheor. Verw. Geb 53, 305–316 (1980)

    Article  MATH  MathSciNet  Google Scholar 

  5. Frydman, H.: A structure of doubly stochastic Markov chains. (Manuscript, 1984)

  6. Fuglede, B.: Continuous selection in a convexity theorem of Minkowski. Expo. Math. 4, 163–178 (1986)

    MATH  MathSciNet  Google Scholar 

  7. Fuglede, B.: A product representation of stochastic matrices with nearly equal rows. Preprint, Copenhagen (1985)

  8. Fuglede, B.: A product representation of bistochastic matrices of nearly equal entries. Preprint, Copenhagen (1985)

  9. Goodman, G.: An intrinsic time for non-stationary finite Markov chains. Z. Wahrscheinlichkeitstheor. Verw. Geb. 16, 165–180 (1970)

    Article  MATH  Google Scholar 

  10. Goodman, G.: The characterization of mixtures of non-stationary Markov transition matrices. Expo. Math. 1, 283–288 (1983)

    MATH  Google Scholar 

  11. Johansen, S.: A central limit theorem for finite semigroups and its application to the imbedding problem for finite state Markov chains. Z. Wahrscheinlichkeitstheor. Verw. Geb. 26, 171–190 (1973)

    MATH  MathSciNet  Google Scholar 

  12. Johansen S.: The bang-bang problem for stochastic matrices. Z. Wahrscheinlichkeitstheor. Verw. Geb. 26, 191–195 (1973)

    MATH  MathSciNet  Google Scholar 

  13. Johansen, S., Ramsey, F.L.: A bang-bang representation for 3x3 embeddable stochastic matrices. Z. Wahrscheinlichkeitstheor. Verw. Geb. 47, 107–118 (1979)

    Article  MathSciNet  Google Scholar 

  14. Kalman, J.A.: Continuity and convexity of projections and barycentric coordinates in convex polyhedra. Pacific J. Math, 11, 1017–1022 (1961)

    MATH  MathSciNet  Google Scholar 

  15. Kingman, J.F.C., Williams, D.: The combinatorial structure of non-homogeneous Markov chains. Z. Wahrscheinlichkeitstheor. Verw. Geb. 26, 77–86 (1973)

    Article  MathSciNet  Google Scholar 

  16. Laurent, P.-J.: Approximation et optimisation. Paris: Hermann 1972

    Google Scholar 

  17. Lee, E.B., Markus, L.: Foundations of optimal control theory. New York: Wiley 1968

    Google Scholar 

  18. Yemelichev, V.A., Kovalev, M.M., Kravtsov, M.K.: Polytopes, graphs and optimisation. (Translated from Russian) Cambridge University Press 1984

Download references

Author information

Authors and Affiliations

  1. Mathematical Institute, University of Copenhagen, Universitetsparken 5, DK-2100, Copenhagen, Denmark

    B. Fuglede

Authors
  1. B. Fuglede
    View author publications

    You can also search for this author in PubMed Google Scholar

Rights and permissions

Reprints and Permissions

About this article

Cite this article

Fuglede, B. On the imbedding problem for stochastic and doubly stochastic matrices. Probab. Th. Rel. Fields 80, 241–260 (1988). https://doi.org/10.1007/BF00356104

Download citation

  • Received: 10 January 1985

  • Issue Date: December 1988

  • DOI: https://doi.org/10.1007/BF00356104

Share this article

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

Keywords

  • Differential Equation
  • Manifold
  • Markov Chain
  • Stochastic Process
  • Probability Theory
Download PDF

Working on a manuscript?

Avoid the common mistakes

Advertisement

Search

Navigation

  • Find a journal
  • Publish with us

Discover content

  • Journals A-Z
  • Books A-Z

Publish with us

  • Publish your research
  • Open access publishing

Products and services

  • Our products
  • Librarians
  • Societies
  • Partners and advertisers

Our imprints

  • Springer
  • Nature Portfolio
  • BMC
  • Palgrave Macmillan
  • Apress
  • Your US state privacy rights
  • Accessibility statement
  • Terms and conditions
  • Privacy policy
  • Help and support

167.114.118.210

Not affiliated

Springer Nature

© 2023 Springer Nature