Summary
Semi—Markov models can be usefully employed for the analysis of various reliability and performance characteristics of technical systems. We consider semi—Markov dependability models of systems whose finite state space S is partitioned into the set of up states u, the set of repairable down states D, and a state ω, standing for irrecoverable system failure: S = u ∪ D ∪ {ω}. A great number of reliability and performance measures for such models are examined in this chapter. It is discussed how these measures can be obtained as solutions of certain systems of integral equations if the modelling process has a continuous time parameter. The discrete parameter framework is discussed separately in more detail, since, even though it is subsumed within the continuous parameter case, it deserves special attention for three reasons. First, in some applications, discrete—time modelling is appropriate. Second, discrete—time models can be used for approximately analysing continuous—time models. Finally, for discrete—time models, the computational solution is technically less involved and it will thus be more accessible for even the mathematically less sophisticated analyst. We also present a framework within which many of the measures will be seen to admit of a formal closed form solution.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Aalen, O. O. (1995), “Phase-type distributions in survival analysis,” Scandinavian Journal of Statistics, 22, 447–463
Ahmad, A., Johannet, P. and Auriol, Ph. (1992), “Efficient inverse Laplace transform algorithm for transient overvoltage calculation,” IEE Proceedings-C: Generation, Transmission and Distribution, 139, 117–121
Ahmed, S. B., Alam, M. and Gupta, D. (1989), “Performance modelling and evaluation of flexible manufacturing systems using a semi-Markov approach,” International Journal of Computer Integrated Manufacturing, 2, 275–280
Ball, F. and Yeo, G. F. (1994), “Numerical evaluation of observed sojourn time distribution for a single ion channel incorporating time interval olmission,” Statistics and Computing, 4, 1–12
Ball, F. and Davies, S. (1997), “Clustering of bursts of openings in Markov and semi-Markov models of single channel gating,” Advances in Applied Probability, 29, 92–113
Baxter, L. A. (1981), “Availability measures for a two-state system,” Journal of Applied Probability, 18, 227–235
Baxter, L. A. (1982), “Compound availability measures,” Naval Research Logistics Quarterly, 29, 403–410
Beasley, M. (1991), Reliability for Engineers. Macmillan, Houndmills, Basingstoke, London
Beichelt, F. and Franken, P. (1983), Zuverlssigkeit und Instandhaltung. VEB Verlag Technik, Berlin
Bellman, R. E., Kalaba, R. E. and Lockett, J. A. (1966), Numerical Inversion of the Laplace Transform. Elsevier, New York
Bellman, R. E. and Roth, R. S. (1984), The Laplace Transform. World Scientific, Singapore
Billinton, R., Allan, R. N. and Salvaderi, L. (eds.) (1991), Applied Reliability Assessment in Electric Power Systems. IEEE Press, New York
Birolini, A. (1985), On the Use of Stochastic Processes in Modeling Reliability Problems. Lecture Notes in Economics and Mathematical Systems, 252, Springer-Verlag, Berlin, Heidelberg, New York
Birolini, A. (1991), Qualität und Zuverlässigkeit Technischer Systeme: Theorie, Praxis, Management ( 3rd edn. ). Springer-Verlag, Berlin, Heidelberg, New York
Boehme, T. K., Preuss, W. and van der Wall, V. (1991), On a simple numerical method for computing Stieltjes integrals in reliability theory Probability in the Engineering and Informational Sciences, 5, 113–128
Bousfiha, A. and Limnios, N. (1997), “Ph-Distribution Method for Reliability Evaluation of semi-Markov Systems,” in Advances in Safety Reliability-Proceedings of the European Conference on Safety and Reliability–ESREL’97 (Soares, C. G. ed.). Elsevier, Oxford, 3, 2149–2154
Bruneel, H. (1993), Performance of discrete-time queueing systems. (1986), “On a Computers é4 Operations Research, 20, 303–320
Choi, B. D, Rhee, K. H. and Park, K. K. (1993), “The M/G/1 retrial queue with retrial rate control policy,” Probability in the Engineering and Informational Sciences, 7, 29–46
Chou, J.-H. and Horng, I.-R. (1986), “On a functional approximation for inversion of Laplace transforms via shifted Chebyshev series,” International Journal of Systems Science, 17, 735–739
Ciardo, G., Marie, R., Sericola, B. and Trivedi, K. (1990), “Performability analysis using semi-Markov reward processes,” IEEE Transactions on Computers, C -29, 1251–1264
Crump, K. S. (1976), “Numerical inversion of Laplace transforms using a Fourier series approximation,” Journal of the Association of Computing Machinery, 23, 89–96
Csenki, A. (1991), “The joint distribution of sojourn times in finite semiMarkov processes,” Stochastic Processes and their Applications, 39, 287–299
Csenki, A. (1991), “Some renewal-theoretic investigations in the theory of sojourn times in finite semi-Markov processes,” Journal of Applied Probability, 28, 822–832
Csenki, A. (1992), “The joint distribution of sojourn times in finite Markov processes,” Advances in Applied Probability, 24, 141–160
Csenki, A. (1993), “Occupation frequencies for irreducible finite semiMarkov processes with reliability applications,” Computers and Operations Research, 20, 249–259
Csenki, A. (1993), “On a counting variable in the theory of discrete-parameter Markov chains,” Statistics fi Probability Letters, 18, 105–112
Csenki, A. (1994), “The number of working periods of a repairable Markov system during a finite time interval,” IEEE Transactions on Reliability, R3, 163–169
Csenki, A. (1994), “Cumulative operational time analysis of finite semiMarkov reliability models,” Reliability Engineering and System Safety, 44, 17–25
Csenki, A. (1994), Dependability for systems with a partitioned state space: Markov and semi-Markov theory and computational implementation,“ Lecture Notes in Statistics, 90, Springer-Verlag, Berlin, Heidelberg, New York
Csenki, A. (1994), “On the interval reliability of systems modelled by finite semi-Markov processes,” Microelectronics and Reliability, 34, 1319–1335
Csenki, A. (1994), “Joint availability of systems modelled by finite semiMarkov processes,” Applied Stochastic Models and Data Analysis, 10, 279293
Csenki, A. (1995), “The number of visits to a subset of the state space by a discrete-parameter semi-Markov process,” Statistics êi Probability Letters, 22, 71–77
Csenki, A. (1995), “Total cumulative work until failure of a system modelled by a finite semi-Markov process,” International Journal of Systems Science, 26, 1511–1525
Csenki, A. (1995), “An integral equation approach to the interval reliability of systems modelled by finite semi-Markov processes,” Reliability Engineering and System Safety, 47, 37–45
Csenki, A. (1995), “Set reliability: a unified approach to dependability measures for semi-Markov reliability models,” Systems Analysis Modelling Simulation, 20, 173–186
Csenki, A. (1995), “Mission availability for repairable semi-Markov systems: analytical results and computational implementation,” Statistics, 26, 75–87
Csenki, A. (1995), “Transient analysis of interval availability for repairable systems modelled by finite semi-Markov processes,” IMA Journal of Mathematics Applied in Business and Industry, 6, 267–281
Csenki, A. (1996), “A compound measure of dependability for systems modeled by continuous-time absorbing Markov processes,” Naval Research Logistics, 43, 305–312
Csenki, A. (1996), “A new approach to the cumulative operational time for semi-Markov models of repairable systems,” Reliability Engineering and System Safety, 54, 11–21
Darroch, J. N. and Morris, K. W. (1967), “Some passage-time generating functions for discrete-time and continuous-time finite Markov chains,” Journal of Applied Probability, 4, 496–507
Delves, L. M. and Walsh, J. (eds.) (1974), Numerical Solution of Integral Equations. Oxford University Press, Oxford
Delves, L. M. and Mohamed, J. L. (1985), Computational Methods for Integral Equations. Cambridge University Press, Cambridge
De Souza e Silva, E. and Gail, H. R. (1986), “Calculating cumulative operational time distributions of repairable computer systems,” IEEE Transactions on Computers,C-35 322–332
De Souza e Silva, E. and Gail, H. R. (1992), “Performability analysis of computer systems: from model specification to solution,” Performance Evaluation, 14, 157–196
Dubner, H. and Abate, J. (1968), “Numerical inversion of Laplace transforms by relating them to the finite fourier cosine transform,” Journal of the Association for Computing Machinery, 15, 115–123
Durbin, F. (1974), “Numerical inversion of Laplace transforms: an efficient improvement to Dubner and Abate’s method,” The Computer Journal, 17, 371–376
Feller, W. (1971), An Introduction to Probability Theory and Its Applications II (2nd edn.). John Wiley and Sons, New York
Garbow, B. S., Giunta, G. and Murli, A. (1988), “Software for an implementation of weeks’ method for the inverse Laplace transform problem,” ACM Transactions on Mathematical Software, 14, 163–170
Garbow, B. S., Giunta, G., Lyness, J. N. and Murli, A. (1988), “Algorithm 662: A fortran software package for the numerical inversion of the Laplace transform based on Weeks’ method,” ACM Transactions on Mathematical Software, 14, 171–176
Gaver, D. P. (1966), “Observing stochastic processes, and approximate transform inversion,” Operations Research, 14, 444–459
Goyal, A. and Tantawi, A. N. (1985), “Numerical evaluation of guaranteed availability,” Proceedings of the 15th International Conference on Fault-Tolerant Computing, IEEE Computer Society Press, Silver Spring, Maryland, 324–329
Goyal, A. and Tantawi, A. N. (1988), “A measure of guaranteed availability and its numerical evaluation,” IEEE Transactions on Computers, C-37, 25–32
Grosh, D. L. (1989), A Primer of Reliability Theory. John Wiley and Sons, New York
Gupta, S. M., Jaiswal, N. K. and Goel, L. R. (1982), “Analysis of a two-unit cold standby redundant system with allowed down-time,” International Journal of Systems Science, 13, 1385–1392
Herrmann, C. (1993), A Performance Model for Statistical Multiplexing of Correlated ATM Traffic Superpositions. Messung, Modellierung und Bewertung von Rechen-und Kommunikationssystemen (Walke, B. and Spaniol, O. eds.). Proceedings of the 7th ITG/GI-Fachtagung Aachen, Springer-Verlag, Berlin, 199–211
Höfle-Isphording, U. (1978), Zuverlässigkeitsrechnung. Springer-Verlag, Berlin
Hongler, M. O. and Salama, Y. (1996), “Semi-Markov processes with phase—type waiting times,” Zeitschrift für Angewandte Mathematik und Mechanik, 76, 461–462
Howard, R. A. (1971), Dynamic Probabilistic Systems, II: Semi-Markov and Decision Processes. John Wiley and Sons, New York
Hsueh, M. C, Iyer, R. K. and Trivedi, K. (1988), “Performability modeling based on real data: a case study,” IEEE Transactions on Computers, C -37, 478–484
Islamov, R. T. (1994), “Using Markov reliability modelling for multiple repairable systems,” Reliability Engineering and System Safety, 44, 113118
Jagerman, D. L. (1978), “An inversion technique for the Laplace transform with application to approximation,” The Bell System Technical Journal, 57, 669–710
Jagerman, D. L. (1982), “An inversion technique for the Laplace transform,” The Bell System Technical Journal, 61, 1995–2002
Janssen, J. (ed.) (1986), Semi-Markov Models: Theory and Applications. Plenum Press, New York
Kapur, P. K., Natarajan, T. V. and Chakrabarty, D. (1983), “Availability measures for an intermittently used repairable system,” Microelectronics and Reliability, 23, 841–844
Klaassen, K. B. and Peppen, J. C. L. (1989), System Reliability Concepts and Applications. Edward Arnold, London
Kohlas, J. (1982), Stochastic Methods of Operations Research. Cambridge University Press, Cambridge
Kohlas, J. (1987), Zuverlässigkeit und Verfügbarkeit. Teubner, Stuttgart
Kondo, J. (1991), Integral Equations. Clarendon Press, Oxford
Kubat, O., Sumita, U. and Masuda, Y. (1988), “Dynamic performance evaluation of communication/computer systems with highly reliable components,” Probability in the Engineering and Informational Sciences, 2, 185–213
Kulkarni, V. G., Nicola, V. F. and Trivedi, K. (1987), “The completion time of a job on multimode systems,” Advances in Applied Probability, 19, 932–954
Laprie, J.—C., Costes, A. and Landrault, C. (1981), “Parametric analysis of 2—unit redundant computer systems with corrective and preventive maintenance,” IEEE Transactions on Reliability, R-30, 139–144
Lewis, E. E. (1987), Introduction to Reliability Engineering. John Wiley and Sons, New York
Limnios, N. (1997), Dependability analysis of semi-Markov systems,“ Reliability Engineering and System Safety, 55, 203–207
Limnios, N. and Oprisan, G. (1997), “A General framework for reliability and performability modelling of semi-Markov systems.” Proceedings of the 8th International Symposium on Applied Stochastic Models and Data Analysis, 2, Anacapry, Italy, 261–266
Linz, P. (1985), Analytical and Numerical Methods for Volterra Equations. SIAM, Philadelphia
Longman, I. M (1968), “On the numerical inversion of the Laplace transform of a discontinuous original,” Journal of the Institute of Mathematics and its Applications,4 320–328
Marszalek, W. (1983), “The block—pulse functions method of the two—dimensional Laplace transform,” International Journal of Systems Science, 14, 1311–1317
Marszalek, W. (1984), “On the inverse Laplace transform of irrational and transcendental transfer functions via block—pulse functions method,” International Journal of Systems Science, 15, 869–876
Marszalek, W. (1984), “On the nature of block—pulse operational matrices,” International Journal of Systems Science, 15, 983–989
Masuda, Y. and Sumita, U. (1987), “Analysis of a counting process associated with a semi-Markov process: number of entries into a subset of state space,” Advances in Applied Probability, 19, 767–783
Masuda, Y. and Sumita, U. (1991), “A multivariate reward process defined on a semi-Markov process and its first—passage—time distributions,” Journal of Applied Probability, 28, 360–373
Masuda, Y. and Yamakawa, S. (1997), A Compound Dependability Measure Arising from semi-Markov Reliability Model. Technical Report, Faculty of Science and Technology, Keio University, Yokohama, Japan
Medhi, J. (1982), Stochastic Processes. Wiley Eastern, New Delhi
Mode, C. J. (1985), Stochastic Processes in Demography and Their Computer Implementation. Springer—Verlag, Berlin
Mode, C. J. and Pickens, G. T. (1988), “Computational methods for renewal theory and semi-Markov processes with illustrative examples,” The American Statistician, 42, 143–151
Nagakawa, T. and Osaki, S. (1975), “The discrete Weibull distribution,” IEEE Transactions on Reliability, R-24, 300–301
Nam, L. K. and Zin, C. N. (198), “A semi-Markov reliability analysis of alternating systems,” Transactions of the American Nuclear Society, 60, 413–414
Natarajan, R. and M. A. S. Hameed, M. A. S. (1986), “Some general measures for a complex n-unit standby redundant system,” Microelectronics and Reliability, 26, 619–623
Nollau, V. (1981), Semi-Markovsche Prozesse. Verlag Harri Deutsch, Thun, Frankfurt a. M.
Numerical Algorithms Group (1990) Nag Fortran Library User Manual, Mark 14, 1. Oxford; (Routines: CO6LAF, CO6LBF, and CO6LCF)
Osaki, S. (1985), Stochastic System Reliability Modeling. World Scientific, Singapore
Osaki, S. (1992), Applied Stochastic System Modeling. Springer-Verlag, Berlin
Ouhbi, B. and Limnios, N. (1996), “Non-parametric estimation for semiMarkov kernels with application to reliability analysis,” Applied Stochastic Models and Data Analysis, 12, 209–220
Para, A. F. and Garibba, S. (1980), Reliability Analysis of a Repairable Single Unit Under General Age-Dependence. Synthesis and Analysis Meth-ods for Safety and Reliability Studies (Apostolakis, G., Garibba, S. and Volta, G. eds.). Proceedings of the NATO Advanced Study Institute on Synthesis and Analysis Methods for Safety and Reliability Studies, Urbino, Italy, Plenum Press, New York, 251–268
Platis, A., Limnios, N. and Le, Du M. (1996), “Performability of electric-power systems modeled by non-homogeneous Markov chains,” IEEE Transactions on Reliability, R-45, 605–610
Rao, S. S. (1992), Reliability-Based Design. McGraw-Hill, New York
Rubino, G. and Sericola, B. (1993), “Sojourn times in semi-Markov reward processes: application to fault-tolerant systems modeling,” Reliability Engineering and System Safety, 41, 1–4
Rubino, G. and Sericola, B. (1992), “Interval availability analysis using operational periods,” Performance Evaluation, 14, 257–272
Sculli, D. and Choy, S. K. (1993), “Power plant boiler feed system reliability: a case study,” Computers in Industry, 21, 93–99
B. Sericola, B. (1990), “Closed-form solution for the distribution of the total time spent in a subset of states of a homogeneous Markov process during a finite observation period,” Journal of Applied Probability, 27, 713–719
Singh, C. and Billinton, R. (1977), System Reliability Modelling and Evaluation. Hutchinson, London
Singhal, K. and Vlash, J. (1975), “Computation of time domain response by numerical inversion of the Laplace transform,” Journal of the Franklin Institute, 299, 109–126
Smith, R. M., Trivedi, K. and Ramesh, A. V. (1988), “Performability analysis: measures, an algorithm, and a case study,” IEEE Transactions on Computers, C-37, 406–417
Smith, D. J. (1993), Reliability Maintainability and Risk - Practical Methods for Engineers ( 4th edn. ). Butterworth-Heinemann, Oxford
Stehfest, H. (1970), “Algorithm: 368 numerical inversion of Laplace transforms,” Communications of the ACM, 13, 47–49
Stepanek, E. (1971), “Eine numerische methode zur umkehr der Laplace-transformation,” Wissenschaftliche Zeitschrift für Elektrotechnik, 17, 26 1272
Stepanek, E. (1974), “Erweiterung einer numerischen methode zur umkehr der Laplacetransformation,” Zeitschrift für Elektrische Informations und Energietechnik, 4, 41–44
Stepanek, E. (1974), Praktische Analyse Linearer Systeme durch Faltungsoperationen. Akademische Verlagsgesellschaft, Leipzig
Störmer, H. (1970), Semi-Markoff-Prozesse mit Endlich Vielen Zuständen. Lecture Notes in Operations Research and Mathematical Systems, 34. Springer-Verlag, Berlin, Heidelberg, New York
Sundarajan, C. (1991), Guide to Reliability Engineering - Data, Analysis, Applications, Implementation, and Management. Van Nostrand Reinhold, New York
Talbot, A. (1979), “The accurate numerical inversion of Laplace transforms,” Journal of the Institute of Mathematics and its Applications, 23, 97–120
Tijms, H. C. (1990), Stochastic Modelling and Analysis: A Computational Approach. John Wiley and Sons, New York
Trivedi, K., Muppala, J. K., Woolet, S.P. and Haverkort, B. R. (1992), “Composite performance and dependability analysis,” Performance Evaluation, 14, 197–215
Van der Heiden, M. C. (1987), “Interval availability distribution for a 1—out—of-2 reliability system,” Probability in the Engineering and Informational Sciences, 2, 211–223
Weeks, W. T. (1966), “Numerical inversion of Laplace transforms,” Journal of the Association of Computing Machinery, 13, 419–429
Woodward, M. E. (1993), Communication and Computer Networks Modelling with Discrete—Time Queues. Pentech Press, London
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2002 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Csenki, A. (2002). Transient Analysis of Semi—Markov Reliability Models — A Tutorial Review with Emphasis on Discrete—Parameter Approaches. In: Osaki, S. (eds) Stochastic Models in Reliability and Maintenance. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-24808-8_9
Download citation
DOI: https://doi.org/10.1007/978-3-540-24808-8_9
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-07725-8
Online ISBN: 978-3-540-24808-8
eBook Packages: Springer Book Archive