Abstract
Through Laplace transforms, we study the extremes of a continuous-time Markov-additive process with one-sided jumps and a finite-state background Markovian state-space, jointly with the epoch at which the extreme is ‘attained’. For this, we investigate discrete-time Markov-additive processes and use an embedding to relate these to the continuous-time setting. The resulting Laplace transforms are given in terms of two matrices, which can be determined either through solving a nonlinear matrix equation or through a spectral method. Our results on extremes are first applied to determine the steady-state buffer-content distribution of several single-station queueing systems. We show that our framework comprises many models dealt with earlier, but, importantly, it also enables us to derive various new results. At the same time, our setup offers interesting insights into the connections between the approaches developed so far, including matrix-analytic techniques, martingale methods, the rate-conservation approach, and the occupation-measure method. We also study networks of fluid queues, and show how the results on single queues can be used to find the Laplace transform of the steady-state buffer-content vector; it has a matrix quasi-product form. Fluid-driven priority systems also have this property.
Article PDF
Similar content being viewed by others
Avoid common mistakes on your manuscript.
References
Ahn S, Ramaswami V (2005) Efficient algorithms for transient analysis of stochastic fluid flow models. J Appl Probab 42:531–549
Arjas E, Speed TP (1973) Symmetric Wiener-Hopf factorisations in Markov additive processes. Z Wahrscheinlichkeitstheor Verw Geb 26:105–118
Asmussen S (1994) Busy period analysis, rare events and transient behavior in fluid flow models. J Appl Math Stoch Anal 7:269–299
Asmussen S (1995) Stationary distributions for fluid flow models with or without Brownian noise. Stoch Models 11:21–49
Asmussen S (2000) Ruin probabilities. World Scientific, Singapore
Asmussen S (2003) Applied probability and queues, 2nd edn. Springer, New York
Asmussen S, Avram F, Pistorius M (2004) Russian and American put options under exponential phase-type Lévy models. Stoch Process their Appl 109:79–111
Asmussen S, Kella O (2000) A multi-dimensional martingale for Markov additive processes and its applications. Adv Appl Probab 32:376–393
Bean NG, O’Reilly MM, Taylor PG (2005a) Algorithms for return probabilities for stochastic fluid flows. Stoch Models 21:149–184
Bean NG, O’Reilly MM, Taylor PG (2005b) Hitting probabilities and hitting times for stochastic fluid flows. Stoch Process their Appl 115:1530–1556
Beneš VE (1963) General stochastic processes in the theory of queues. Addison-Wesley, Reading
Bertoin J (1996) Lévy processes. Cambridge University Press, Cambridge
Boxma OJ, Kella O, Perry D (2001) An intermittent fluid system with exponential on-times and semi-Markov input rates. Probab Eng Inf Sci 15:189–198
Chung KL (2001) A course in probability theory, 3rd edn. Academic, San Diego
Çinlar E (1972) Markov additive processes. I, II. Z Wahrscheinlichkeitstheor Verw Geb 24:85–93; 95–121
Cohen JW (1974) Superimposed renewal processes and storage with gradual input. Stoch Process their Appl 2:31–57
Dȩbicki K, Dieker AB, Rolski T (2007) Quasi-product forms for Lévy-driven fluid networks. Math Oper Res 32:629–647
Dȩbicki K, Mandjes M, van Uitert M (2007) A tandem queue with Lévy input: a new representation of the downstream queue length. Probab Eng Inf Sci 21:83–107
Dieker AB (2006) Applications of factorization embeddings for Lévy processes. Adv Appl Probab 38:768–791
Feller W (1971) An introduction to probability theory and its applications, vol II, 2nd edn. Wiley, New York
Gail HR, Hantler SL, Taylor BA (1996) Spectral analysis of M/G/1 and G/M/1 type Markov chains. Adv Appl Probab 28:114–165
Kaspi H (1982) On the symmetric Wiener-Hopf factorization for Markov additive processes. Z Wahrscheinlichkeitstheor Verw Geb 59:179–196
Kella O (2001) Markov-modulated feedforward fluid networks. Queueing Syst 37:141–161
Kella O, Whitt W (1992a) A storage model with a two-state random environment. Oper Res 40:S257–S262
Kella O, Whitt W (1992b) A tandem fluid network with Lévy input. In: Queueing and related models. Oxford University Press, New York, pp 112–128
Kennedy J (1994) Understanding the Wiener-Hopf factorization for the simple random walk. J Appl Probab 31:561–563
Kroese DP, Scheinhardt WRW (2001) Joint distributions for interacting fluid queues. Queueing Syst 37:99–139
Kulkarni V (1997) Fluid models for single buffer systems. In: Frontiers in queueing. CRC, Boca Raton, pp 321–338
Kyprianou AE, Palmowski Z (2008) Fluctuations of spectrally negative Markov additive processes. In: Séminaire de probabilités vol XLI. Springer, Berlin, pp 121–135
Latouche G, Ramaswami V (1999) Introduction to matrix analytic methods in stochastic modeling. SIAM, Philadelphia
Lucantoni DM (1991) New results on the single server queue with a batch Markovian arrival process. Stoch Models 7:1–46
Miyazawa M (2004) Hitting probabilities in a Markov additive process with linear movements and upward jumps: applications to risk and queueing processes. Ann Appl Probab 14:1029–1054
Miyazawa M, Takada H (2002) A matrix exponential form for hitting probabilities and its application to a Markov-modulated fluid queue with downward jumps. J Appl Probab 39:604–618
Moler C, Van Loan C (2003) Nineteen dubious ways to compute the exponential of a matrix, twenty-five years later. SIAM Rev 45:3–49
Neuts MF (1989) Structured stochastic matrices of M/G/1 type and their applications. Marcel Dekker, New York
Ney P, Nummelin E (1987) Markov additive processes. I. Eigenvalue properties and limit theorems. Ann Probab 15:561–592
Pistorius M (2006) On maxima and ladder processes for a dense class of Lévy processes. J Appl Probab 43:208–220
Prabhu NU (1998) Stochastic storage processes. Springer, New York
Preater J (1997) M/M/∞ transience revisited. J Appl Probab 34:1061–1067
Rogers LCG (1994) Fluid models in queueing theory and Wiener-Hopf factorization of Markov chains. Ann Appl Probab 4:390–413
Scheinhardt WRW, Zwart B (2002) A tandem fluid queue with gradual input. Probab Eng Inf Sci 16:29–45
Takada H (2001) Markov modulated fluid queues with batch fluid arrivals. J Oper Res Soc Jpn 44:344–365
Takada H, Miyazawa M (2002) A Markov modulated fluid queue with batch arrivals and preemptions. Stoch Models 18:529–552
Tzenova E, Adan I, Kulkarni V (2005a) Fluid models with jumps. Stoch Models 21:37–55
Tzenova E, Adan I, Kulkarni V (2005b) A two-priority fluid flow model. Tech. Report 2005-016, EURANDOM
Zhao YQ, Li W, Braun, WJ (2003) Censoring, factorizations, and spectral analysis for transition matrices with block-repeating entries. Methodol Comput Appl Probab 5:35–58
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
Open Access This is an open access article distributed under the terms of the Creative Commons Attribution Noncommercial License (https://creativecommons.org/licenses/by-nc/2.0), which permits any noncommercial use, distribution, and reproduction in any medium, provided the original author(s) and source are credited.
About this article
Cite this article
Dieker, A.B., Mandjes, M. Extremes of Markov-additive Processes with One-sided Jumps, with Queueing Applications. Methodol Comput Appl Probab 13, 221–267 (2011). https://doi.org/10.1007/s11009-009-9140-8
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11009-009-9140-8