Skip to main content

Transient Analysis of Semi—Markov Reliability Models — A Tutorial Review with Emphasis on Discrete—Parameter Approaches

  • Chapter
Stochastic Models in Reliability and Maintenance

Summary

Semi—Markov models can be usefully employed for the analysis of various reliability and performance characteristics of technical systems. We consider semi—Markov dependability models of systems whose finite state space S is partitioned into the set of up states u, the set of repairable down states D, and a state ω, standing for irrecoverable system failure: S = uD ∪ {ω}. A great number of reliability and performance measures for such models are examined in this chapter. It is discussed how these measures can be obtained as solutions of certain systems of integral equations if the modelling process has a continuous time parameter. The discrete parameter framework is discussed separately in more detail, since, even though it is subsumed within the continuous parameter case, it deserves special attention for three reasons. First, in some applications, discrete—time modelling is appropriate. Second, discrete—time models can be used for approximately analysing continuous—time models. Finally, for discrete—time models, the computational solution is technically less involved and it will thus be more accessible for even the mathematically less sophisticated analyst. We also present a framework within which many of the measures will be seen to admit of a formal closed form solution.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Aalen, O. O. (1995), “Phase-type distributions in survival analysis,” Scandinavian Journal of Statistics, 22, 447–463

    Google Scholar 

  2. Ahmad, A., Johannet, P. and Auriol, Ph. (1992), “Efficient inverse Laplace transform algorithm for transient overvoltage calculation,” IEE Proceedings-C: Generation, Transmission and Distribution, 139, 117–121

    Google Scholar 

  3. Ahmed, S. B., Alam, M. and Gupta, D. (1989), “Performance modelling and evaluation of flexible manufacturing systems using a semi-Markov approach,” International Journal of Computer Integrated Manufacturing, 2, 275–280

    Google Scholar 

  4. Ball, F. and Yeo, G. F. (1994), “Numerical evaluation of observed sojourn time distribution for a single ion channel incorporating time interval olmission,” Statistics and Computing, 4, 1–12

    Google Scholar 

  5. Ball, F. and Davies, S. (1997), “Clustering of bursts of openings in Markov and semi-Markov models of single channel gating,” Advances in Applied Probability, 29, 92–113

    Google Scholar 

  6. Baxter, L. A. (1981), “Availability measures for a two-state system,” Journal of Applied Probability, 18, 227–235

    Google Scholar 

  7. Baxter, L. A. (1982), “Compound availability measures,” Naval Research Logistics Quarterly, 29, 403–410

    Google Scholar 

  8. Beasley, M. (1991), Reliability for Engineers. Macmillan, Houndmills, Basingstoke, London

    Google Scholar 

  9. Beichelt, F. and Franken, P. (1983), Zuverlssigkeit und Instandhaltung. VEB Verlag Technik, Berlin

    Google Scholar 

  10. Bellman, R. E., Kalaba, R. E. and Lockett, J. A. (1966), Numerical Inversion of the Laplace Transform. Elsevier, New York

    Google Scholar 

  11. Bellman, R. E. and Roth, R. S. (1984), The Laplace Transform. World Scientific, Singapore

    Google Scholar 

  12. Billinton, R., Allan, R. N. and Salvaderi, L. (eds.) (1991), Applied Reliability Assessment in Electric Power Systems. IEEE Press, New York

    Google Scholar 

  13. Birolini, A. (1985), On the Use of Stochastic Processes in Modeling Reliability Problems. Lecture Notes in Economics and Mathematical Systems, 252, Springer-Verlag, Berlin, Heidelberg, New York

    Google Scholar 

  14. Birolini, A. (1991), Qualität und Zuverlässigkeit Technischer Systeme: Theorie, Praxis, Management ( 3rd edn. ). Springer-Verlag, Berlin, Heidelberg, New York

    Google Scholar 

  15. Boehme, T. K., Preuss, W. and van der Wall, V. (1991), On a simple numerical method for computing Stieltjes integrals in reliability theory Probability in the Engineering and Informational Sciences, 5, 113–128

    Google Scholar 

  16. Bousfiha, A. and Limnios, N. (1997), “Ph-Distribution Method for Reliability Evaluation of semi-Markov Systems,” in Advances in Safety Reliability-Proceedings of the European Conference on Safety and Reliability–ESREL’97 (Soares, C. G. ed.). Elsevier, Oxford, 3, 2149–2154

    Google Scholar 

  17. Bruneel, H. (1993), Performance of discrete-time queueing systems. (1986), “On a Computers é4 Operations Research, 20, 303–320

    Google Scholar 

  18. Choi, B. D, Rhee, K. H. and Park, K. K. (1993), “The M/G/1 retrial queue with retrial rate control policy,” Probability in the Engineering and Informational Sciences, 7, 29–46

    Google Scholar 

  19. Chou, J.-H. and Horng, I.-R. (1986), “On a functional approximation for inversion of Laplace transforms via shifted Chebyshev series,” International Journal of Systems Science, 17, 735–739

    Google Scholar 

  20. Ciardo, G., Marie, R., Sericola, B. and Trivedi, K. (1990), “Performability analysis using semi-Markov reward processes,” IEEE Transactions on Computers, C -29, 1251–1264

    Google Scholar 

  21. Crump, K. S. (1976), “Numerical inversion of Laplace transforms using a Fourier series approximation,” Journal of the Association of Computing Machinery, 23, 89–96

    Google Scholar 

  22. Csenki, A. (1991), “The joint distribution of sojourn times in finite semiMarkov processes,” Stochastic Processes and their Applications, 39, 287–299

    Google Scholar 

  23. Csenki, A. (1991), “Some renewal-theoretic investigations in the theory of sojourn times in finite semi-Markov processes,” Journal of Applied Probability, 28, 822–832

    Google Scholar 

  24. Csenki, A. (1992), “The joint distribution of sojourn times in finite Markov processes,” Advances in Applied Probability, 24, 141–160

    Google Scholar 

  25. Csenki, A. (1993), “Occupation frequencies for irreducible finite semiMarkov processes with reliability applications,” Computers and Operations Research, 20, 249–259

    Google Scholar 

  26. Csenki, A. (1993), “On a counting variable in the theory of discrete-parameter Markov chains,” Statistics fi Probability Letters, 18, 105–112

    Google Scholar 

  27. Csenki, A. (1994), “The number of working periods of a repairable Markov system during a finite time interval,” IEEE Transactions on Reliability, R3, 163–169

    Google Scholar 

  28. Csenki, A. (1994), “Cumulative operational time analysis of finite semiMarkov reliability models,” Reliability Engineering and System Safety, 44, 17–25

    Google Scholar 

  29. Csenki, A. (1994), Dependability for systems with a partitioned state space: Markov and semi-Markov theory and computational implementation,“ Lecture Notes in Statistics, 90, Springer-Verlag, Berlin, Heidelberg, New York

    Google Scholar 

  30. Csenki, A. (1994), “On the interval reliability of systems modelled by finite semi-Markov processes,” Microelectronics and Reliability, 34, 1319–1335

    Google Scholar 

  31. Csenki, A. (1994), “Joint availability of systems modelled by finite semiMarkov processes,” Applied Stochastic Models and Data Analysis, 10, 279293

    Google Scholar 

  32. Csenki, A. (1995), “The number of visits to a subset of the state space by a discrete-parameter semi-Markov process,” Statistics êi Probability Letters, 22, 71–77

    Google Scholar 

  33. Csenki, A. (1995), “Total cumulative work until failure of a system modelled by a finite semi-Markov process,” International Journal of Systems Science, 26, 1511–1525

    Google Scholar 

  34. Csenki, A. (1995), “An integral equation approach to the interval reliability of systems modelled by finite semi-Markov processes,” Reliability Engineering and System Safety, 47, 37–45

    Google Scholar 

  35. Csenki, A. (1995), “Set reliability: a unified approach to dependability measures for semi-Markov reliability models,” Systems Analysis Modelling Simulation, 20, 173–186

    Google Scholar 

  36. Csenki, A. (1995), “Mission availability for repairable semi-Markov systems: analytical results and computational implementation,” Statistics, 26, 75–87

    Google Scholar 

  37. Csenki, A. (1995), “Transient analysis of interval availability for repairable systems modelled by finite semi-Markov processes,” IMA Journal of Mathematics Applied in Business and Industry, 6, 267–281

    Google Scholar 

  38. Csenki, A. (1996), “A compound measure of dependability for systems modeled by continuous-time absorbing Markov processes,” Naval Research Logistics, 43, 305–312

    Google Scholar 

  39. Csenki, A. (1996), “A new approach to the cumulative operational time for semi-Markov models of repairable systems,” Reliability Engineering and System Safety, 54, 11–21

    Google Scholar 

  40. Darroch, J. N. and Morris, K. W. (1967), “Some passage-time generating functions for discrete-time and continuous-time finite Markov chains,” Journal of Applied Probability, 4, 496–507

    Google Scholar 

  41. Delves, L. M. and Walsh, J. (eds.) (1974), Numerical Solution of Integral Equations. Oxford University Press, Oxford

    Google Scholar 

  42. Delves, L. M. and Mohamed, J. L. (1985), Computational Methods for Integral Equations. Cambridge University Press, Cambridge

    Google Scholar 

  43. De Souza e Silva, E. and Gail, H. R. (1986), “Calculating cumulative operational time distributions of repairable computer systems,” IEEE Transactions on Computers,C-35 322–332

    Google Scholar 

  44. De Souza e Silva, E. and Gail, H. R. (1992), “Performability analysis of computer systems: from model specification to solution,” Performance Evaluation, 14, 157–196

    Google Scholar 

  45. Dubner, H. and Abate, J. (1968), “Numerical inversion of Laplace transforms by relating them to the finite fourier cosine transform,” Journal of the Association for Computing Machinery, 15, 115–123

    Google Scholar 

  46. Durbin, F. (1974), “Numerical inversion of Laplace transforms: an efficient improvement to Dubner and Abate’s method,” The Computer Journal, 17, 371–376

    Google Scholar 

  47. Feller, W. (1971), An Introduction to Probability Theory and Its Applications II (2nd edn.). John Wiley and Sons, New York

    Google Scholar 

  48. Garbow, B. S., Giunta, G. and Murli, A. (1988), “Software for an implementation of weeks’ method for the inverse Laplace transform problem,” ACM Transactions on Mathematical Software, 14, 163–170

    Google Scholar 

  49. Garbow, B. S., Giunta, G., Lyness, J. N. and Murli, A. (1988), “Algorithm 662: A fortran software package for the numerical inversion of the Laplace transform based on Weeks’ method,” ACM Transactions on Mathematical Software, 14, 171–176

    Google Scholar 

  50. Gaver, D. P. (1966), “Observing stochastic processes, and approximate transform inversion,” Operations Research, 14, 444–459

    Google Scholar 

  51. Goyal, A. and Tantawi, A. N. (1985), “Numerical evaluation of guaranteed availability,” Proceedings of the 15th International Conference on Fault-Tolerant Computing, IEEE Computer Society Press, Silver Spring, Maryland, 324–329

    Google Scholar 

  52. Goyal, A. and Tantawi, A. N. (1988), “A measure of guaranteed availability and its numerical evaluation,” IEEE Transactions on Computers, C-37, 25–32

    Google Scholar 

  53. Grosh, D. L. (1989), A Primer of Reliability Theory. John Wiley and Sons, New York

    Google Scholar 

  54. Gupta, S. M., Jaiswal, N. K. and Goel, L. R. (1982), “Analysis of a two-unit cold standby redundant system with allowed down-time,” International Journal of Systems Science, 13, 1385–1392

    Google Scholar 

  55. Herrmann, C. (1993), A Performance Model for Statistical Multiplexing of Correlated ATM Traffic Superpositions. Messung, Modellierung und Bewertung von Rechen-und Kommunikationssystemen (Walke, B. and Spaniol, O. eds.). Proceedings of the 7th ITG/GI-Fachtagung Aachen, Springer-Verlag, Berlin, 199–211

    Google Scholar 

  56. Höfle-Isphording, U. (1978), Zuverlässigkeitsrechnung. Springer-Verlag, Berlin

    Google Scholar 

  57. Hongler, M. O. and Salama, Y. (1996), “Semi-Markov processes with phase—type waiting times,” Zeitschrift für Angewandte Mathematik und Mechanik, 76, 461–462

    Google Scholar 

  58. Howard, R. A. (1971), Dynamic Probabilistic Systems, II: Semi-Markov and Decision Processes. John Wiley and Sons, New York

    Google Scholar 

  59. Hsueh, M. C, Iyer, R. K. and Trivedi, K. (1988), “Performability modeling based on real data: a case study,” IEEE Transactions on Computers, C -37, 478–484

    Google Scholar 

  60. Islamov, R. T. (1994), “Using Markov reliability modelling for multiple repairable systems,” Reliability Engineering and System Safety, 44, 113118

    Google Scholar 

  61. Jagerman, D. L. (1978), “An inversion technique for the Laplace transform with application to approximation,” The Bell System Technical Journal, 57, 669–710

    Google Scholar 

  62. Jagerman, D. L. (1982), “An inversion technique for the Laplace transform,” The Bell System Technical Journal, 61, 1995–2002

    Google Scholar 

  63. Janssen, J. (ed.) (1986), Semi-Markov Models: Theory and Applications. Plenum Press, New York

    Google Scholar 

  64. Kapur, P. K., Natarajan, T. V. and Chakrabarty, D. (1983), “Availability measures for an intermittently used repairable system,” Microelectronics and Reliability, 23, 841–844

    Google Scholar 

  65. Klaassen, K. B. and Peppen, J. C. L. (1989), System Reliability Concepts and Applications. Edward Arnold, London

    Google Scholar 

  66. Kohlas, J. (1982), Stochastic Methods of Operations Research. Cambridge University Press, Cambridge

    Google Scholar 

  67. Kohlas, J. (1987), Zuverlässigkeit und Verfügbarkeit. Teubner, Stuttgart

    Google Scholar 

  68. Kondo, J. (1991), Integral Equations. Clarendon Press, Oxford

    Google Scholar 

  69. Kubat, O., Sumita, U. and Masuda, Y. (1988), “Dynamic performance evaluation of communication/computer systems with highly reliable components,” Probability in the Engineering and Informational Sciences, 2, 185–213

    Google Scholar 

  70. Kulkarni, V. G., Nicola, V. F. and Trivedi, K. (1987), “The completion time of a job on multimode systems,” Advances in Applied Probability, 19, 932–954

    Google Scholar 

  71. Laprie, J.—C., Costes, A. and Landrault, C. (1981), “Parametric analysis of 2—unit redundant computer systems with corrective and preventive maintenance,” IEEE Transactions on Reliability, R-30, 139–144

    Google Scholar 

  72. Lewis, E. E. (1987), Introduction to Reliability Engineering. John Wiley and Sons, New York

    Google Scholar 

  73. Limnios, N. (1997), Dependability analysis of semi-Markov systems,“ Reliability Engineering and System Safety, 55, 203–207

    Google Scholar 

  74. Limnios, N. and Oprisan, G. (1997), “A General framework for reliability and performability modelling of semi-Markov systems.” Proceedings of the 8th International Symposium on Applied Stochastic Models and Data Analysis, 2, Anacapry, Italy, 261–266

    Google Scholar 

  75. Linz, P. (1985), Analytical and Numerical Methods for Volterra Equations. SIAM, Philadelphia

    Google Scholar 

  76. Longman, I. M (1968), “On the numerical inversion of the Laplace transform of a discontinuous original,” Journal of the Institute of Mathematics and its Applications,4 320–328

    Google Scholar 

  77. Marszalek, W. (1983), “The block—pulse functions method of the two—dimensional Laplace transform,” International Journal of Systems Science, 14, 1311–1317

    Google Scholar 

  78. Marszalek, W. (1984), “On the inverse Laplace transform of irrational and transcendental transfer functions via block—pulse functions method,” International Journal of Systems Science, 15, 869–876

    Google Scholar 

  79. Marszalek, W. (1984), “On the nature of block—pulse operational matrices,” International Journal of Systems Science, 15, 983–989

    Google Scholar 

  80. Masuda, Y. and Sumita, U. (1987), “Analysis of a counting process associated with a semi-Markov process: number of entries into a subset of state space,” Advances in Applied Probability, 19, 767–783

    Google Scholar 

  81. Masuda, Y. and Sumita, U. (1991), “A multivariate reward process defined on a semi-Markov process and its first—passage—time distributions,” Journal of Applied Probability, 28, 360–373

    Google Scholar 

  82. Masuda, Y. and Yamakawa, S. (1997), A Compound Dependability Measure Arising from semi-Markov Reliability Model. Technical Report, Faculty of Science and Technology, Keio University, Yokohama, Japan

    Google Scholar 

  83. Medhi, J. (1982), Stochastic Processes. Wiley Eastern, New Delhi

    Google Scholar 

  84. Mode, C. J. (1985), Stochastic Processes in Demography and Their Computer Implementation. Springer—Verlag, Berlin

    Google Scholar 

  85. Mode, C. J. and Pickens, G. T. (1988), “Computational methods for renewal theory and semi-Markov processes with illustrative examples,” The American Statistician, 42, 143–151

    Google Scholar 

  86. Nagakawa, T. and Osaki, S. (1975), “The discrete Weibull distribution,” IEEE Transactions on Reliability, R-24, 300–301

    Google Scholar 

  87. Nam, L. K. and Zin, C. N. (198), “A semi-Markov reliability analysis of alternating systems,” Transactions of the American Nuclear Society, 60, 413–414

    Google Scholar 

  88. Natarajan, R. and M. A. S. Hameed, M. A. S. (1986), “Some general measures for a complex n-unit standby redundant system,” Microelectronics and Reliability, 26, 619–623

    Google Scholar 

  89. Nollau, V. (1981), Semi-Markovsche Prozesse. Verlag Harri Deutsch, Thun, Frankfurt a. M.

    Google Scholar 

  90. Numerical Algorithms Group (1990) Nag Fortran Library User Manual, Mark 14, 1. Oxford; (Routines: CO6LAF, CO6LBF, and CO6LCF)

    Google Scholar 

  91. Osaki, S. (1985), Stochastic System Reliability Modeling. World Scientific, Singapore

    Google Scholar 

  92. Osaki, S. (1992), Applied Stochastic System Modeling. Springer-Verlag, Berlin

    Google Scholar 

  93. Ouhbi, B. and Limnios, N. (1996), “Non-parametric estimation for semiMarkov kernels with application to reliability analysis,” Applied Stochastic Models and Data Analysis, 12, 209–220

    Google Scholar 

  94. Para, A. F. and Garibba, S. (1980), Reliability Analysis of a Repairable Single Unit Under General Age-Dependence. Synthesis and Analysis Meth-ods for Safety and Reliability Studies (Apostolakis, G., Garibba, S. and Volta, G. eds.). Proceedings of the NATO Advanced Study Institute on Synthesis and Analysis Methods for Safety and Reliability Studies, Urbino, Italy, Plenum Press, New York, 251–268

    Google Scholar 

  95. Platis, A., Limnios, N. and Le, Du M. (1996), “Performability of electric-power systems modeled by non-homogeneous Markov chains,” IEEE Transactions on Reliability, R-45, 605–610

    Google Scholar 

  96. Rao, S. S. (1992), Reliability-Based Design. McGraw-Hill, New York

    Google Scholar 

  97. Rubino, G. and Sericola, B. (1993), “Sojourn times in semi-Markov reward processes: application to fault-tolerant systems modeling,” Reliability Engineering and System Safety, 41, 1–4

    Google Scholar 

  98. Rubino, G. and Sericola, B. (1992), “Interval availability analysis using operational periods,” Performance Evaluation, 14, 257–272

    Google Scholar 

  99. Sculli, D. and Choy, S. K. (1993), “Power plant boiler feed system reliability: a case study,” Computers in Industry, 21, 93–99

    Google Scholar 

  100. B. Sericola, B. (1990), “Closed-form solution for the distribution of the total time spent in a subset of states of a homogeneous Markov process during a finite observation period,” Journal of Applied Probability, 27, 713–719

    Google Scholar 

  101. Singh, C. and Billinton, R. (1977), System Reliability Modelling and Evaluation. Hutchinson, London

    Google Scholar 

  102. Singhal, K. and Vlash, J. (1975), “Computation of time domain response by numerical inversion of the Laplace transform,” Journal of the Franklin Institute, 299, 109–126

    Google Scholar 

  103. Smith, R. M., Trivedi, K. and Ramesh, A. V. (1988), “Performability analysis: measures, an algorithm, and a case study,” IEEE Transactions on Computers, C-37, 406–417

    Google Scholar 

  104. Smith, D. J. (1993), Reliability Maintainability and Risk - Practical Methods for Engineers ( 4th edn. ). Butterworth-Heinemann, Oxford

    Google Scholar 

  105. Stehfest, H. (1970), “Algorithm: 368 numerical inversion of Laplace transforms,” Communications of the ACM, 13, 47–49

    Google Scholar 

  106. Stepanek, E. (1971), “Eine numerische methode zur umkehr der Laplace-transformation,” Wissenschaftliche Zeitschrift für Elektrotechnik, 17, 26 1272

    Google Scholar 

  107. Stepanek, E. (1974), “Erweiterung einer numerischen methode zur umkehr der Laplacetransformation,” Zeitschrift für Elektrische Informations und Energietechnik, 4, 41–44

    Google Scholar 

  108. Stepanek, E. (1974), Praktische Analyse Linearer Systeme durch Faltungsoperationen. Akademische Verlagsgesellschaft, Leipzig

    Google Scholar 

  109. Störmer, H. (1970), Semi-Markoff-Prozesse mit Endlich Vielen Zuständen. Lecture Notes in Operations Research and Mathematical Systems, 34. Springer-Verlag, Berlin, Heidelberg, New York

    Google Scholar 

  110. Sundarajan, C. (1991), Guide to Reliability Engineering - Data, Analysis, Applications, Implementation, and Management. Van Nostrand Reinhold, New York

    Google Scholar 

  111. Talbot, A. (1979), “The accurate numerical inversion of Laplace transforms,” Journal of the Institute of Mathematics and its Applications, 23, 97–120

    Google Scholar 

  112. Tijms, H. C. (1990), Stochastic Modelling and Analysis: A Computational Approach. John Wiley and Sons, New York

    Google Scholar 

  113. Trivedi, K., Muppala, J. K., Woolet, S.P. and Haverkort, B. R. (1992), “Composite performance and dependability analysis,” Performance Evaluation, 14, 197–215

    Google Scholar 

  114. Van der Heiden, M. C. (1987), “Interval availability distribution for a 1—out—of-2 reliability system,” Probability in the Engineering and Informational Sciences, 2, 211–223

    Google Scholar 

  115. Weeks, W. T. (1966), “Numerical inversion of Laplace transforms,” Journal of the Association of Computing Machinery, 13, 419–429

    Google Scholar 

  116. Woodward, M. E. (1993), Communication and Computer Networks Modelling with Discrete—Time Queues. Pentech Press, London

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2002 Springer-Verlag Berlin Heidelberg

About this chapter

Cite this chapter

Csenki, A. (2002). Transient Analysis of Semi—Markov Reliability Models — A Tutorial Review with Emphasis on Discrete—Parameter Approaches. In: Osaki, S. (eds) Stochastic Models in Reliability and Maintenance. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-24808-8_9

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-24808-8_9

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-07725-8

  • Online ISBN: 978-3-540-24808-8

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics