Abstract
In this paper, we are concerned with long-time behavior of Euler-Maruyama schemes associated with regime-switching diffusion processes. The key contributions of this paper lie in that existence and uniqueness of numerical invariant measures are addressed (i) for regime-switching diffusion processes with finite state spaces by the Perron-Frobenius theorem if the “averaging condition” holds, and, for the case of reversible Markov chain, via the principal eigenvalue approach provided that the principal eigenvalue is positive; (ii) for regime-switching diffusion processes with countable state spaces by means of a finite partition method and an M-Matrix theory. We also reveal that numerical invariant measures converge in the Wasserstein metric to the underlying ones. Several examples are constructed to demonstrate our theory.
Similar content being viewed by others
References
Anderson, W.J.: Continuous-Times Markov Chains. Springer, Berlin (1991)
Bakhtin, Y., Hurth, T.: Invariant densities for dynamical systems with random switching. Nonlinearity 25, 2937–2952 (2012)
Bakhtin, Y., Hurth, T., Mattingly, J.C.: Regularity of invariant densities for 1D-systems with random switching. Nonlinearity 28, 3755–3787 (2015)
Bardet, J.B., Guérin, H., Malrieu, F.: Long time behavior of diffusion with Markov switching. ALEA Lat. Am. J. Probab. Math. Stat. 7, 151–170 (2010)
Benaim, M., Le Borgne, S., Malrieu, F., Zitt, P.-A.: Qualitative properties of certain piecewise deterministic Markov processes. Ann. Inst. Henri Poincar Probab. Stat. 51, 1040–1075 (2015)
Bréhier, C.-E.: Approximation of the invariant measure with a Euler scheme for stochastic PDEs driven by space-time white noise. Potential Anal. 40, 1–40 (2014)
Chen, M.-F.: From Markov Chains to Non-equillibrium Particle Systems. World Scientific Publishing Co. Pte. Ltd., Singapore (2004)
Chen, M.-F.: Eigenvalues, inequalities, and Ergodicity Theory. Springer, London (2005)
Chen, M.-F., Mao, Y.-H.: An Introduction of Stochastic Processes. Higher Education Press (2007)
Cloez, B., Hairer, M.: Exponential ergodicity for Markov processes with random switching. Bernoulli 21, 505–536 (2015)
Higham, D.J., Mao, X., Yuan, C.: Preserving exponential mean-square stability in the simulation of hybrid stochastic differential equations. Numer. Math. 108, 295–325 (2007)
Kloeden, P.E., Platen, E.: Numerical Solution of Stochastic Differential Equations. Springer-Verlag, New York (1992)
Mao, X., Yuan, C., Yin, G.: Numerical method for stationary distribution of stochastic differential equations with Markovian switching. J. Comput. Appl. Math. 174, 1–27 (2005)
Mao, X., Yuan, C.: Stochastic Differential Equations with Markovian Switching. Imperial College Press (2006)
Mattingly, J.C., Stuart, A.M., Tretyakov, M.V.: Convergence of numerical time-averaging and stationary measures via Poisson equations. SIAM J. Numer. Anal. 48, 552–577 (2010)
Meyn, S., Tweedie, R.L.: Stochastic Stability of Markov Chains. Springer, New York (1992)
Pinsky, M., Pinsky, R.: Transience recurrence and central limit theorem behavior for diffusions in random temporal enrivoments. Ann. Probab. 21, 433–452 (1993)
Pinsky, M., Scheutzow, M.: Some remarks and examples concerning the transience and recurrence of random diffusions. Ann. Inst. Henri. Poincaré 28, 519–536 (1992)
Shao, J.: Criteria for transience and recurrence of regime-switching diffusions processes. Electron. J. Probab. 20, 1–15 (2015)
Shao, J.: Ergodicity of regime-switching diffusions in Wasserstein distances. Stoch. Proc. Appl. 125, 739–758 (2015)
Shao, J., Xi, F.: Strong ergodicity of the regime-switching diffusion processes. Stoch. Proc. Appl. 123, 3903–3918 (2013)
Shao, J., Xi, F.: Stability and recurrence of regime-switching diffusion processes. SIAM J. Control Optim. 52, 3496–3516 (2014)
Talay, D.: Second order discretization schemes of stochastic differential systems for the computation of the invariant law. Stochast. Rep. 29, 13–36 (1990)
Xi, F.: Feller property and exponential ergodicity of diffusion processes with state-dependent switching. Sci. China Ser. A-Math. 51, 329–342 (2008)
Xi, F., Yin, G.: Stability of regime-switching jump diffusions. SIAM J. Control Optim. 48, 525–4549 (2010)
Yuan, C., Mao, X.: Asymptotic stability in distribution of stochastic differential equations with Markovian switching. Stoch. Proc. Appl. 103, 277–291 (2003)
Yuan, C., Mao, X.: Stationary distributions of Euler-Maruyama-type stochastic difference equations with Markovian switching and their convergence. J. Differ. Equ. Appl. 11, 29–48 (2005)
Yuan, C., Mao, X.: Convergence of the Euler–Maruyama method for stochastic differential equations with Markovian switching. Math. Comput. Simul. 64, 223–235 (2004)
Yin, G., Zhu, C.: Hybrid Switching Diffusions: Properties and Applications. Springer (2010)
Author information
Authors and Affiliations
Corresponding author
Additional information
Supported in part by NNSFs of China (Nos. 11301030, 11431014, 11401592) and 985-project.
Rights and permissions
About this article
Cite this article
Bao, J., Shao, J. & Yuan, C. Approximation of Invariant Measures for Regime-switching Diffusions. Potential Anal 44, 707–727 (2016). https://doi.org/10.1007/s11118-015-9526-x
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11118-015-9526-x
Keywords
- Regime-switching diffusion
- Invariant measure
- Euler-maruyama scheme
- Perron-frobenius theorem
- Principal eigenvalue
- M-matrix