Advertisement

Methodology and Computing in Applied Probability

, Volume 20, Issue 4, pp 1199–1222 | Cite as

Markov-Modulated Brownian Motion with Temporary Change of Regime at Level Zero

  • Guy Latouche
  • Matthieu SimonEmail author
Article
  • 44 Downloads

Abstract

We determine the stationary distribution of a one-sided Markov-Modulated Brownian Motion (MMBM) of which the behaviour is modified during the intervals between a visit to level zero and the next visit to a fixed positive level b. We use the semi-regenerative structure of the process, and we also use the fluid approximation for MMBMs introduced by Latouche and Nguyen in 2015. Finally, we show how the expressions can be simplified in some interesting special cases and we conclude by providing some numerical illustrations.

Keywords

Stochastic processes Markov-modulated Brownian motion Stationary distribution Matrix analytic methods Semi-regenerative processes 

Mathematics Subject Classification (2010)

60J65 66K37 60J25 60K15 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Notes

Acknowledgements

We thank the referee for a careful analysis and a detailed report. The research of M. Simon was supported by the Belgian F.R.S.-FNRS through an FRIA research grant. We acknowledge the support of the Australian Research Council Center of Excellence for Mathematical and Statistical Frontiers (ACEMS).

References

  1. Asmussen S (1995) Stationary distributions for fluid flow models with or without Brownian noise. Communications in statistics. Stoch Model 11(1):21–49MathSciNetCrossRefGoogle Scholar
  2. Breuer L (2012) Exit problems for reflected Markov-modulated Brownian motion. J Appl Probab 49(3):697–709MathSciNetCrossRefGoogle Scholar
  3. Campbell SL, Meyer CD (1991) Generalized inverses of linear transformations. Dover publications, New York. RepublicationzbMATHGoogle Scholar
  4. Çinlar E (1975) Introduction to stochastic processes. Prentice–Hall, Englewood CliffsGoogle Scholar
  5. da Silva Soares A, Latouche G (2005) A matrix-analytic approach to fluid queues with feedback control. Int J Simul Syst Sci Technol 6:4–12Google Scholar
  6. da Silva Soares A, Latouche G (2006) Matrix-analytic methods for fluid queues with finite buffers. Perform Eval 63(4–5):295–314CrossRefGoogle Scholar
  7. D’Auria B, Ivanovs J, Kella O, Mandjes M (2012) Two-sided reflection of Markov modulatesd Brownian motion. Stoch Model 28:316–332CrossRefGoogle Scholar
  8. D’Auria B, Kella O (2012) Markov modulation of a two-sided reflected Brownian motion with application to fluid queues. Stoch Process Appl 122(4):1566–1581MathSciNetCrossRefGoogle Scholar
  9. Govorun M, Latouche G, Remiche MA (2013) Stability for fluid queues: characteristic inequalities. Stoch Model 29(1):64–88MathSciNetCrossRefGoogle Scholar
  10. Guo C (2001) Nonsymmetric algebraic Riccati equations and Wiener–Hopf factorization for M-matrices. SIAM Journal on Matrix Analysis and Applications 23(1):225–242MathSciNetCrossRefGoogle Scholar
  11. Harrison J (1985) Brownian motion and stochastic flow systems. Wiley, New YorkzbMATHGoogle Scholar
  12. Harrison J, Lemoine A (1981) Sticky Brownian motion as the limit of storage processes. J Appl Probab 18(1):216–226MathSciNetCrossRefGoogle Scholar
  13. Ivanovs J (2010) Markov-modulated Brownian motion with two reflecting barriers. J Appl Probab 47(4):1034–1047MathSciNetCrossRefGoogle Scholar
  14. Karandikar R, Kulkarni V (1995) Second-order fluid flow models: reflected Brownian motion in a random environment. Oper Res 43(1):77–88CrossRefGoogle Scholar
  15. Latouche G, Nguyen G (2015) Fluid approach to two-sided Markov-modulated Brownian motion. Queueing Systems 80:105–125MathSciNetCrossRefGoogle Scholar
  16. Latouche G, Nguyen G (2015) The morphing of fluid queues into Markov-modulated Brownian motion. Stochastic Systems 5(1):62–86MathSciNetCrossRefGoogle Scholar
  17. Ramaswami V (1999) Matrix analytic methods for stochastic fluid flows. In: Smith D, Hey P (eds) Teletraffic engineering in a competitive world (Proceedings of the 16th International Teletraffic Congress). Elsevier Science B.V., Edinburgh, pp 1019–1030Google Scholar
  18. Ramaswami V (2013) A fluid introduction to Brownian motion and stochastic integration. In: Matrix-analytic methods in stochastic models, vol 27. Springer, New York, pp 209–225Google Scholar
  19. Rogers LCG (1994) Fluid models in queueing theory and Wiener-Hopf factorization of Markov chains. Ann Appl Probab 4(2):390–413MathSciNetCrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media, LLC 2017

Authors and Affiliations

  1. 1.Faculté des Sciences, Département de MathématiqueUniversité libre de Bruxelles (ULB)BruxellesBelgium

Personalised recommendations