Skip to main content
Log in

Approximation of Invariant Measures for Regime-switching Diffusions

  • Published:
Potential Analysis Aims and scope Submit manuscript

Abstract

In this paper, we are concerned with long-time behavior of Euler-Maruyama schemes associated with regime-switching diffusion processes. The key contributions of this paper lie in that existence and uniqueness of numerical invariant measures are addressed (i) for regime-switching diffusion processes with finite state spaces by the Perron-Frobenius theorem if the “averaging condition” holds, and, for the case of reversible Markov chain, via the principal eigenvalue approach provided that the principal eigenvalue is positive; (ii) for regime-switching diffusion processes with countable state spaces by means of a finite partition method and an M-Matrix theory. We also reveal that numerical invariant measures converge in the Wasserstein metric to the underlying ones. Several examples are constructed to demonstrate our theory.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. Anderson, W.J.: Continuous-Times Markov Chains. Springer, Berlin (1991)

    Book  Google Scholar 

  2. Bakhtin, Y., Hurth, T.: Invariant densities for dynamical systems with random switching. Nonlinearity 25, 2937–2952 (2012)

    Article  MathSciNet  MATH  Google Scholar 

  3. Bakhtin, Y., Hurth, T., Mattingly, J.C.: Regularity of invariant densities for 1D-systems with random switching. Nonlinearity 28, 3755–3787 (2015)

    Article  MathSciNet  MATH  Google Scholar 

  4. Bardet, J.B., Guérin, H., Malrieu, F.: Long time behavior of diffusion with Markov switching. ALEA Lat. Am. J. Probab. Math. Stat. 7, 151–170 (2010)

    MathSciNet  MATH  Google Scholar 

  5. Benaim, M., Le Borgne, S., Malrieu, F., Zitt, P.-A.: Qualitative properties of certain piecewise deterministic Markov processes. Ann. Inst. Henri Poincar Probab. Stat. 51, 1040–1075 (2015)

    Article  MathSciNet  MATH  Google Scholar 

  6. Bréhier, C.-E.: Approximation of the invariant measure with a Euler scheme for stochastic PDEs driven by space-time white noise. Potential Anal. 40, 1–40 (2014)

    Article  MathSciNet  MATH  Google Scholar 

  7. Chen, M.-F.: From Markov Chains to Non-equillibrium Particle Systems. World Scientific Publishing Co. Pte. Ltd., Singapore (2004)

    Book  Google Scholar 

  8. Chen, M.-F.: Eigenvalues, inequalities, and Ergodicity Theory. Springer, London (2005)

    Google Scholar 

  9. Chen, M.-F., Mao, Y.-H.: An Introduction of Stochastic Processes. Higher Education Press (2007)

  10. Cloez, B., Hairer, M.: Exponential ergodicity for Markov processes with random switching. Bernoulli 21, 505–536 (2015)

    Article  MathSciNet  MATH  Google Scholar 

  11. Higham, D.J., Mao, X., Yuan, C.: Preserving exponential mean-square stability in the simulation of hybrid stochastic differential equations. Numer. Math. 108, 295–325 (2007)

    Article  MathSciNet  MATH  Google Scholar 

  12. Kloeden, P.E., Platen, E.: Numerical Solution of Stochastic Differential Equations. Springer-Verlag, New York (1992)

    Book  MATH  Google Scholar 

  13. Mao, X., Yuan, C., Yin, G.: Numerical method for stationary distribution of stochastic differential equations with Markovian switching. J. Comput. Appl. Math. 174, 1–27 (2005)

    Article  MathSciNet  MATH  Google Scholar 

  14. Mao, X., Yuan, C.: Stochastic Differential Equations with Markovian Switching. Imperial College Press (2006)

  15. Mattingly, J.C., Stuart, A.M., Tretyakov, M.V.: Convergence of numerical time-averaging and stationary measures via Poisson equations. SIAM J. Numer. Anal. 48, 552–577 (2010)

    Article  MathSciNet  MATH  Google Scholar 

  16. Meyn, S., Tweedie, R.L.: Stochastic Stability of Markov Chains. Springer, New York (1992)

    MATH  Google Scholar 

  17. Pinsky, M., Pinsky, R.: Transience recurrence and central limit theorem behavior for diffusions in random temporal enrivoments. Ann. Probab. 21, 433–452 (1993)

    Article  MathSciNet  MATH  Google Scholar 

  18. Pinsky, M., Scheutzow, M.: Some remarks and examples concerning the transience and recurrence of random diffusions. Ann. Inst. Henri. Poincaré 28, 519–536 (1992)

    MathSciNet  MATH  Google Scholar 

  19. Shao, J.: Criteria for transience and recurrence of regime-switching diffusions processes. Electron. J. Probab. 20, 1–15 (2015)

    Article  MathSciNet  Google Scholar 

  20. Shao, J.: Ergodicity of regime-switching diffusions in Wasserstein distances. Stoch. Proc. Appl. 125, 739–758 (2015)

    Article  MathSciNet  MATH  Google Scholar 

  21. Shao, J., Xi, F.: Strong ergodicity of the regime-switching diffusion processes. Stoch. Proc. Appl. 123, 3903–3918 (2013)

    Article  MathSciNet  MATH  Google Scholar 

  22. Shao, J., Xi, F.: Stability and recurrence of regime-switching diffusion processes. SIAM J. Control Optim. 52, 3496–3516 (2014)

    Article  MathSciNet  MATH  Google Scholar 

  23. Talay, D.: Second order discretization schemes of stochastic differential systems for the computation of the invariant law. Stochast. Rep. 29, 13–36 (1990)

    Article  MATH  Google Scholar 

  24. Xi, F.: Feller property and exponential ergodicity of diffusion processes with state-dependent switching. Sci. China Ser. A-Math. 51, 329–342 (2008)

    Article  MathSciNet  MATH  Google Scholar 

  25. Xi, F., Yin, G.: Stability of regime-switching jump diffusions. SIAM J. Control Optim. 48, 525–4549 (2010)

    MathSciNet  MATH  Google Scholar 

  26. Yuan, C., Mao, X.: Asymptotic stability in distribution of stochastic differential equations with Markovian switching. Stoch. Proc. Appl. 103, 277–291 (2003)

    Article  MathSciNet  MATH  Google Scholar 

  27. Yuan, C., Mao, X.: Stationary distributions of Euler-Maruyama-type stochastic difference equations with Markovian switching and their convergence. J. Differ. Equ. Appl. 11, 29–48 (2005)

    Article  MathSciNet  MATH  Google Scholar 

  28. Yuan, C., Mao, X.: Convergence of the Euler–Maruyama method for stochastic differential equations with Markovian switching. Math. Comput. Simul. 64, 223–235 (2004)

    Article  MathSciNet  MATH  Google Scholar 

  29. Yin, G., Zhu, C.: Hybrid Switching Diffusions: Properties and Applications. Springer (2010)

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Chenggui Yuan.

Additional information

Supported in part by NNSFs of China (Nos. 11301030, 11431014, 11401592) and 985-project.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Bao, J., Shao, J. & Yuan, C. Approximation of Invariant Measures for Regime-switching Diffusions. Potential Anal 44, 707–727 (2016). https://doi.org/10.1007/s11118-015-9526-x

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11118-015-9526-x

Keywords

Mathematics Subject Classification

Navigation