Stochastic Bounds for Partially Generated Markov Chains: An Algebraic Approach

  • Ana Bušić
  • Jean-Michel Fourneau
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5261)


We propose several algorithms to obtain bounds based on Censored Markov Chains to analyze partially generated discrete time Markov chains. The main idea is to avoid the generation of a huge (or even infinite) state space and to truncate the state space during the visit. The approach is purely algebraic and provides element-wise and stochastic bounds for the CMC.


Markov Chain Transition Probability Matrix Stochastic Matrix Discrete Time Markov Chain Positive Matrice 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Busic, A., Fourneau, J.-M.: Bounds for point and steady-state availability: An algorithmic approach based on lumpability and stochastic ordering. In: Bravetti, M., Kloul, L., Zavattaro, G. (eds.) EPEW/WS-EM 2005. LNCS, vol. 3670, pp. 94–108. Springer, Heidelberg (2005)Google Scholar
  2. 2.
    Busic, A., Fourneau, J.-M., Pekergin, N.: Worst case analysis of batch arrivals with the increasing convex ordering. In: Horváth, A., Telek, M. (eds.) EPEW 2006. LNCS, vol. 4054, pp. 196–210. Springer, Heidelberg (2006)Google Scholar
  3. 3.
    Dayar, T., Fourneau, J.-M., Pekergin, N.: Transforming stochastic matrices for stochastic comparison with the st-order. RAIRO-RO 37, 85–97 (2003)zbMATHCrossRefMathSciNetGoogle Scholar
  4. 4.
    Dayar, T., Pekergin, N., Younes, S.: Conditional steady-state bounds for a subset of states in Markov chains. In: SMCtools 2006. ACM Press, New York (2006)Google Scholar
  5. 5.
    de Souza e Silva, E., Ochoa, P.M., Mejiá Ochoa, P.: State space exploration in Markov models. ACM SIGMETRICS Perform. Eval. Rev. 20(1), 152–166 (1992)CrossRefGoogle Scholar
  6. 6.
    Fourneau, J.-M., Lecoz, M., Quessette, F.: Algorithms for an irreducible and lumpable strong stochastic bound. Linear Algebra and its Applications 386(1), 167–185 (2004)zbMATHCrossRefMathSciNetGoogle Scholar
  7. 7.
    Fourneau, J.-M., Pekergin, N.: An algorithmic approach to stochastic bounds. In: Calzarossa, M.C., Tucci, S. (eds.) Performance 2002. LNCS, vol. 2459, pp. 64–88. Springer, Heidelberg (2002)CrossRefGoogle Scholar
  8. 8.
    Fourneau, J.-M., Pekergin, N., Younes, S.: Censoring Markov chains and stochastic bounds. In: Wolter, K. (ed.) EPEW 2007. LNCS, vol. 4748, pp. 213–227. Springer, Heidelberg (2007)CrossRefGoogle Scholar
  9. 9.
    Fourneau, J.-M., Plateau, B., Sbeity, I., Stewart, W.J.: SANs and lumpable stochastic bounds: Bounding availability. In: Computer System, Network Performance and Quality of Service, Imperial College Press (2006)Google Scholar
  10. 10.
    Haddad, S., Moreaux, P.: Sub-stochastic matrix analysis for bounds computation - theoretical results. Eur. Jour. of Op. Res. 176(2), 999–1015 (2007)zbMATHCrossRefMathSciNetGoogle Scholar
  11. 11.
    Meyer, C.D.: Stochastic complementation, uncoupling Markov chains and the theory of nearly reducible systems. SIAM Review 31(2), 240–272 (1989)zbMATHCrossRefMathSciNetGoogle Scholar
  12. 12.
    Muller, A., Stoyan, D.: Comparison Methods for Stochastic Models and Risks. Wiley, New York (2002)Google Scholar
  13. 13.
    Pekergin, N., Dayar, T., Alparslan, D.: Compenent-wise bounds for nearly completely decomposable Markov chains using stochastic comparison and reordering. Eur. Jour. of Op. Res. 165, 810–825 (2005)zbMATHCrossRefMathSciNetGoogle Scholar
  14. 14.
    Plateau, B., Fourneau, J.M., Lee, K.H.: PEPS: a package for solving complex Markov models of parallel systems. In: Proceedings of the 4th Int. Conf. on Modelling Techniques and Tools for Computer Performance Evaluation, Spain (1988)Google Scholar
  15. 15.
    Truffet, L.: Near complete decomposability: Bounding the error by a stochastic comparison method. Ad. in App. Prob. 29, 830–855 (1997)zbMATHCrossRefMathSciNetGoogle Scholar
  16. 16.
    Truffet, L.: Reduction technique for discrete time Markov chains on totally ordered state space using stochastic comparisons. Jour. of App. Prob. 37(3), 795–806 (2000)zbMATHCrossRefMathSciNetGoogle Scholar
  17. 17.
    Zhao, Y.Q., Liu, D.: The censored Markov chain and the best augmentation. Jour. of App. Prob. 33, 623–629 (1996)zbMATHCrossRefMathSciNetGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2008

Authors and Affiliations

  • Ana Bušić
    • 1
  • Jean-Michel Fourneau
    • 1
    • 2
  1. 1.INRIA Grenoble - Rhône-AlpesMontbonnotFrance
  2. 2.PRiSM, Université de Versailles-St-QuentinVersaillesFrance

Personalised recommendations