Sensitivity Analysis of the Expected Accumulated Reward Using Uniformization and IRK3 Methods

  • Haiscam Abdallah
  • Moulaye Hamza
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 1988)


This paper deals with the sensitivityc omputation of the expected accumulated reward of stiff Markov Models. Generally, we are faced with the problem of computation time, especiallywh en the Markov process is stiff. We consider the standard uniformization method for which we propose a new error bound. Because the time complexityo f this method becomes large when the stiffness increases, we then suggest an ordinary differential equations method, the third order implicit Runge-Kutta method. After providing a new way of writing the system of equations to be solved, we applythi s method with a stepsize choice different from the classical one in order to accelerate the algorithm execution. Finally, we compare the time complexity of both of the methods on a numerical example.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Reibman, A., Trivedi, K. S.: Transient Analysis of Cumulative Measures of Markov Model Behavior. Communication Statistics-Stochastic Models 5, num. 4 (1989)683–710 MATHMathSciNetCrossRefGoogle Scholar
  2. 2.
    Malhotra, M.: A ComputationallyEfficient Technique for Transient Analysis of Repairable Markovian Systems. Performance Evaluation 24, num. 4, (1996)311–331 MATHCrossRefGoogle Scholar
  3. 3.
    Abdallah, H., Hamza, M.: Sensitivitya nalysis of instantaneous transient measures of highlyreliab le systems. 11th European Simulation Symposium (ESS’99). Erlangen-Nuremberg, Germany, october 26-28, (1999) 652–656 Google Scholar
  4. 4.
    Trivedi, K. S., Riebman, A. L.: Numerical Transient Analysis of Markov Models.Computer and Operations Research 15, num. 1, (1988) 19–36 MATHCrossRefGoogle Scholar
  5. 5.
    Hairer, E., Norsett, S. P., Wanner, G.: Solving ordinary differential equations.Springer, New York, 1993 MATHGoogle Scholar
  6. 6.
    Lindemann, C., Malhotra, M., Trivedi, K. S.: Numerical Methods for Reliability Evaluation of Markov Closed Fault-Tolerant Systems. IEEE Transactions on Reliability44, num. 4, (1995) 694–704 CrossRefGoogle Scholar
  7. 7.
    Trivedi, K. S.: Probabilityan d Statistics with Reliability, Queueing and Computer Science Applications. Prentice-Hall, Englewood Cliffs, N. J, 1982 Google Scholar
  8. 8.
    Abdallah, H., Hamza, M.: Sensibilité de mesures transitoires instantanées des systémes informatiques hautement fiables. Publication Interne 1232, Février, 1999IRISA, Campus de Beaulieu, Rennes, France Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2001

Authors and Affiliations

  • Haiscam Abdallah
    • 1
  • Moulaye Hamza
    • 1
  1. 1.IRISARennes cedexFrance

Personalised recommendations