Skip to main content

Approximative Symbolic Model Checking of Continuous-Time Markov Chains

Extended Abstract

  • Conference paper
  • First Online:
CONCUR’99 Concurrency Theory (CONCUR 1999)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 1664))

Included in the following conference series:

Abstract

This paper presents a symbolic model checking algorithm for continuous-time Markov chains for an extension of the continuous stochastic logic CSL of Aziz et al [1]. The considered logic contains a time-bounded until-operator and a novel operator to express steadystate probabilities. We show that the model checking problem for this logic reduces to a system of linear equations (for unbounded until and the steady state-operator) and a Volterra integral equation system for timebounded until. We propose a symbolic approximate method for solving the integrals using MTDDs (multi-terminal decision diagrams), a generalisation of MTBDDs. These new structures are suitable for numerical integration using quadrature formulas based on equally-spaced abscissas, like trapezoidal, Simpson and Romberg integration schemes.

The first and second author are sponsored by the DAAD-Project AZ 313-ARC-XII- 98/38 on stochastic modelling and verification.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. A. Aziz, K. Sanwal, V. Singhal and R. Brayton. Verifying continuous time Markov chains. In CAV, LNCS 1102, pp. 269–276, 1996.

    Google Scholar 

  2. A. Aziz, V. Singhal, F. Balarin, R. Brayton and A. Sangiovanni-Vincentelli. It usually works: the temporal logic of stochastic systems. In CAV, LNCS 939, pp. 155–165, 1995.

    Google Scholar 

  3. I. Bahar, E. Frohm, C. Gaona, G. Hachtel, E. Macii, A. Padro and F. Somenzi. Algebraic decision diagrams and their applications. Formal Methods in System Design, 10(2/3):171–206, 1997.

    Article  Google Scholar 

  4. C. Baier. On algorithmic verification methods for probabilistic systems. Habilitation thesis (submitted), Univ. Mannheim, 1998.

    Google Scholar 

  5. C. Baier, E. Clarke, V. Hartonas-Garmhausen, M. Kwiatkowska, and M. Ryan. Symbolic model checking for probabilistic processes. In ICALP, LNCS 1256, pp. 430–440, 1997.

    Google Scholar 

  6. C. Baier and M. Kwiatkowska. Model checking for a probabilistic branching-time logic with fairness. Distr. Comp., 11(3): 125–155, 1998.

    Article  Google Scholar 

  7. D. Beauquier and A. Slissenko. Polytime model checking for timed probabilistic computation tree logic. Acta Inf., 35: 645–664, 1998.

    Article  MathSciNet  Google Scholar 

  8. A. Bianco and L. de Alfaro. Model checking of probabilistic and nondeterministic systems. In FSTTCS, LNCS 1026, pp. 499–513, 1995.

    Google Scholar 

  9. R. Bryant. Graph-based algorithms for boolean function manipulation. IEEE Trans. on Comp., C-35(8): 677–691, 1986.

    Article  Google Scholar 

  10. W. Chan, R. Anderson, P. Beame, S. Burns, F. Modugno, D. Notkin and J. D. Reese. Model checking large software specifications. IEEE Trans. on Softw. Eng., 24(7): 498–519, 1998.

    Article  Google Scholar 

  11. I. Christoff and L. Christoff. Reasoning about safety and liveness properties for probabilistic systems. In FSTTCS, LNCS 652, pp 342–355, 1992.

    Google Scholar 

  12. E. Clarke, M. Fujita, P. McGeer, J. Yang and X. Zhao. Multi-terminal binary decision diagrams: an efficient data structure for matrix representation. In Proc. IEEE Int. Workshop on Logic Synthesis, pp. 1–15, 1993.

    Google Scholar 

  13. E. Clarke, O. Grumberg and D. Long. Verification tools for finite-state concurrent programs. In A Decade of Concurrency, LNCS 803, pp. 124–175, 1993.

    Google Scholar 

  14. C. Courcoubetis and M. Yannakakis. Verifying temporal properties of finite-state probabilistic programs. In FOCS, pp. 338–345, 1988.

    Google Scholar 

  15. C. Courcoubetis and M. Yannakakis. The complexity of probabilistic verification. J. ACM, 42(4): 857–907, 1995.

    Article  MATH  MathSciNet  Google Scholar 

  16. L. de Alfaro. How to specify and verify the long-run average behavior of probabilistic systems. In LICS, 1998.

    Google Scholar 

  17. L. de Alfaro. Stochastic transition systems. In CONCUR, LNCS 1466, pp. 423–438, 1998.

    Google Scholar 

  18. G. Hachtel, E. Macii, A. Padro and F. Somenzi. Markovian analysis of large finitestate machines. IEEE Trans. on Comp. Aided Design of Integr. Circ. and Sys., 15(12): 1479–1493, 1996.

    Article  Google Scholar 

  19. H. Hansson and B. Jonsson. A logic for reasoning about time and probability. Form. Asp. of Comp., 6: 512–535, 1994.

    Article  MATH  Google Scholar 

  20. V. Hartonas-Garmhausen, S. Campos and E. M. Clarke. ProbVerus: probabilistic symbolic model checking. In Formal Methods for Real-Time and Probabilistic Systems (ARTS), LNCS 1601, pp. 96–110, 1999.

    Chapter  Google Scholar 

  21. H. Hermanns. Interactive Markov Chains. Ph.D thesis, U. Erlangen-Nürnberg, 1998.

    Google Scholar 

  22. H. Hermanns and J.-P. Katoen. Automated compositional Markov chain generation for a plain-old telephone system. Sci. of Comp. Programming, 1999.

    Google Scholar 

  23. A. Pnueli, L. Zuck. Probabilistic verification. Inf. and Comp., 103,: 1–29, 1993.

    Article  MATH  MathSciNet  Google Scholar 

  24. W. Press, B. Flannery, S. Teukolsky and W. Vetterling. Numerical Recipes in C: The Art of Scientific Computing. Cambridge Univ. Press, 1989.

    Google Scholar 

  25. W. Stewart. Introduction to the Numerical Solution of Markov Chains. Princeton Univ. Press, 1994.

    Google Scholar 

  26. K. S. Trivedi, J. K. Muppala, S. P. Woolet, and B. R. Haverkort. Composite performance and dependability analysis. Performance Evaluation, 14: 197–215, 1992.

    Article  MATH  Google Scholar 

  27. M. Y. Vardi. Automatic verification of probabilistic concurrent finite state programs. In FOCS, pp 327–338, 1985.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 1999 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Baier, C., Katoen, JP., Hermanns, H. (1999). Approximative Symbolic Model Checking of Continuous-Time Markov Chains. In: Baeten, J.C.M., Mauw, S. (eds) CONCUR’99 Concurrency Theory. CONCUR 1999. Lecture Notes in Computer Science, vol 1664. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-48320-9_12

Download citation

  • DOI: https://doi.org/10.1007/3-540-48320-9_12

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-66425-3

  • Online ISBN: 978-3-540-48320-5

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics