Empirical Comparison of Uniformization Methods for Continuous-Time Markov Chains

  • John D. Diener
  • William H. Sanders


Computation of transient state occupancy probabilities of continuous-time Markov chains is important for evaluating many performance, dependability, and performability models. A number of numerical methods have been developed to perform this computation, including ordinary differential equation solution methods and uniformization. The performance of these methods degrades when the highest departure rate in the chain increases with respect to a fixed time point. A new variant of uniformization, called adaptive uniformization (AU), has been proposed that can potentially avoid such degradation, when several state transitions must occur before a state with a high departure rate is reached. However, in general, AU has a higher time complexity than standard uniformization, and it is not clear, without an implementation, when All will be advantageous. This paper presents the results of three different AU implementations, differing in the method by which the “jump probabilities” are calculated. To evaluate the methods, relative to standard uniformization, a C++ class was developed to compute a bound on the round-off error incurred by each implementation, as well as count the number of arithmetic instructions that must be performed, categorized both by operation type and phase of the algorithm they belong to. An extended machine-repairman reliability model is solved to illustrate use of the class and compare the adaptive uniformization implementations with standard uniformization. Results show that for certain models and mission times, adaptive uniformization can realize significant efficiency gains, relative to standard uniformization, while maintaining the stability of standard uniformization.


Layered Uniformization Uniformization Method Discrete Time Markov Chain Birth Process Standard Uniformization 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. [1]
    J.A. Couvillion, R. Freire, R. Johnson, W.D. Obal II, M.A. Qureshi, R. Rai, W.H. Sanders and J. Tvedt, “Performability Modeling with U1traSAN,” IEEE Software, 8, (Sept. 1991), pp. 69–80.CrossRefGoogle Scholar
  2. [2]
    J. Dunkel and H. Stahl, “On the Transient Analysis of Stiff Markov Chains,” Proc. Third Working Conference on Dependable Computing for Critical Apllications, Modello, Italy, Sept. 1992.Google Scholar
  3. [3]
    W. Feller, An Introduction to Probability Theory and Its Applications,Volume I and II, New York, 1966.MATHGoogle Scholar
  4. [4]
    B.L. Fox and P.W. Glynn, “Computing Poisson Probabilities,” Comm. ACM 31, pp. 440–445, 1988.MathSciNetCrossRefGoogle Scholar
  5. [5]
    R. Geist and K.S. Trivedi, “Ultra-high Reliability Prediction for Fault-Tolerant Computer Systems,” IEEE Trans. on Comp.,C-32(12), pp. 1118–1127, December 1983.CrossRefGoogle Scholar
  6. [6]
    A. Goyal, S. Lavenberg and K.S. Trivedi, “Probabilistic Modeling of Computer System Availability,” Annals of Operation Research, 8, pp. 285–306, 1987.CrossRefGoogle Scholar
  7. [7]
    W.K. Grassman, “Transient Solutions in Markovian queueing systems,” Computers & Operations Research 4, pp. 47–53, 1977.CrossRefGoogle Scholar
  8. [8]
    W.K. Grassman, “Finding Transient Solutions in Markovian Event Systems through Randomization,” in Numerical Solution of Markov Chains, W.J. Stewart (Ed.), Marcel Dekker, New York, 1991.Google Scholar
  9. [9]
    A. Jensen, “Markoff chains as an Aid in the Study of Markoff Processes,” Skand. Aktuarietidskrift., 36, pp. 87–91, 1953.Google Scholar
  10. [10]
    C. Lindemann, Private Communication, November 1993.Google Scholar
  11. [11]
    C. Lindemann, M. Malhotra and K.S. Trivedi, “Numerical Methods for Reliability Evaluation of Closed Fault-tolerant Systems,” Technical Report, Duke University, 1992.Google Scholar
  12. [12]
    M. Malhotra, “A Unified Approach for Transient Analysis of Stiff and Non-Stiff Markov Models,” Technical Report DUKE-CCSR-92–001, Center for Computer Systems Research, Duke University, 1992.Google Scholar
  13. [13]
    A.P.A. van Moorsel, “Performability Evaluation Concepts and Techniques,” Ph.D. Thesis, University of Twente, 1993.Google Scholar
  14. [14]
    A.P.A van Moorsel and W.H. Sanders,“ Adaptive Uniformization,” Stochastic Models, 10:3, 1994.Google Scholar
  15. [15]
    A.P.A. van Moorsel and W.H. Sanders,“ Adaptive Uniformization: Technical Details,” PMRL Technical Report 93–4, University of Arizona, 1992.Google Scholar
  16. [16]
    R.A. Marie, A.L. Reibman and K.S. Trivedi, “Transient Analysis of Acyclic Markov Chains,” Perf. Eval. 7, pp. 175–194, 1987.MathSciNetMATHCrossRefGoogle Scholar
  17. [17]
    A. Reibman, R. Smith and K.S. Trivedi, “Markov and Markov Reward Model Transient Analysis: An Overview of Numerical Approaches,” European Journal of Operational Research, 40, pp. 257–267, 1989.MathSciNetMATHCrossRefGoogle Scholar
  18. [18]
    A. Reibman and K.S. Trivedi, “Numerical Transient Analysis of Markov Models,” Comput. Opns Res. 15, pp. 19–36, 1988.MATHCrossRefGoogle Scholar
  19. [19]
    N.C. Severo, “A Recursion Theorem on Solving Differential- Difference Equations and Applications to some Stochastic Processes,” J. Appl. Prob. 6, pp. 673–681, 1969.MathSciNetMATHCrossRefGoogle Scholar
  20. [20]
    P.H. Sterbenz, Floating-Point Computation, Prentice-Hall, Englewood Cliffs, 1974.Google Scholar
  21. [21]
    B. Stroustrup, The C++ Programming Language, Addison-Wesley, Reading, Mass., 1987.MATHGoogle Scholar
  22. [22]
    K.S. Trivedi, Probability and Statistics with Reliability, Queueing, and Computer Science Applications, Prentice-Hall, Englewood Cliffs, 1982.Google Scholar

Copyright information

© Springer Science+Business Media New York 1995

Authors and Affiliations

  • John D. Diener
    • 1
  • William H. Sanders
    • 2
  1. 1.Department of Electrical and Computer EngineeringThe University of ArizonaUSA
  2. 2.The Center for Reliable and High-Performance Computing Coordinated Science LaboratoryUniversity of Illinois at Urbana-ChampaignUSA

Personalised recommendations