Approximate Probabilistic Model Checking

  • Thomas Hérault
  • Richard Lassaigne
  • Frédéric Magniette
  • Sylvain Peyronnet
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 2937)


Symbolic model checking methods have been extended recently to the verification of probabilistic systems. However, the representation of the transition matrix may be expensive for very large systems and may induce a prohibitive cost for the model checking algorithm. In this paper, we propose an approximation method to verify quantitative properties on discrete Markov chains. We give a randomized algorithm to approximate the probability that a property expressed by some positive LTL formula is satisfied with high confidence by a probabilistic system. Our randomized algorithm requires only a succinct representation of the system and is based on an execution sampling method. We also present an implementation and a few classical examples to demonstrate the effectiveness of our approach.


Model Check Execution Path Discrete Time Markov Chain Monotone Formula Symbolic Model Check 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Alur, R., Henzinger, T.A.: Reactive modules. In: Proceedings of the 11th IEEE Symposium on Logic in Computer Science, pp. 207–218 (1996)Google Scholar
  2. 2.
  3. 3.
    Bianco, A., de Alfaro, L.: Model checking of probabilistic and nondeterministic systems. In: Thiagarajan, P.S. (ed.) FSTTCS 1995. LNCS, vol. 1026, pp. 499–513. Springer, Heidelberg (1995)Google Scholar
  4. 4.
    Biere, A., Cimatti, A., Clarke, E., Zhu, Y.: Symbolic model checking without BDD’s. In: Cleaveland, W.R. (ed.) TACAS 1999. LNCS, vol. 1579, pp. 193–207. Springer, Heidelberg (1999)CrossRefGoogle Scholar
  5. 5.
    Courcoubetis, C., Yannakakis, M.: The complexity of probabilistic verification. Journal of the ACM 42(4), 857–907 (1995)zbMATHCrossRefMathSciNetGoogle Scholar
  6. 6.
    D’Argenio, P., Jeannet, B., Jensen, H., Larsen, K.: Reachability analysis of probabilistic systems by successive refinements. In: Proc. of the joint PAPM/PROBMIV (2001)Google Scholar
  7. 7.
    de Alfaro, L., Kwiatkowska, M., Norman, G., Parker, D., Segala, R.: Symbolic model checking of concurrent probabilistic processes using MTBDDs and the kronecker representation. In: Schwartzbach, M.I., Graf, S. (eds.) TACAS 2000. LNCS, vol. 1785, p. 395. Springer, Heidelberg (2000)CrossRefGoogle Scholar
  8. 8.
    Hartonas-Garmhausen, V., Campos, S., Clarke, E.: Probverus: Probabilistic symbolic model checking. In: Katoen, J.-P. (ed.) AMAST-ARTS 1999, ARTS 1999, and AMAST-WS 1999. LNCS, vol. 1601, p. 96. Springer, Heidelberg (1999)CrossRefGoogle Scholar
  9. 9.
    Hansson, H., Jonsson, B.: A logic for reasoning about time and reliability. Formal Aspects of Computing 6, 512–535 (1994)zbMATHCrossRefGoogle Scholar
  10. 10.
    Hermanns, H., Katoen, J.-P., Meyer-Kayser, J., Siegle, M.: Markov chain model checker. In: Schwartzbach, M.I., Graf, S. (eds.) TACAS 2000. LNCS, vol. 1785, pp. 347–362. Springer, Heidelberg (2000)CrossRefGoogle Scholar
  11. 11.
    Hoeffding, W.: Probability inequalities for sums of bounded random variables. Journal of the American Statistical Association 58, 13–30 (1963)zbMATHCrossRefMathSciNetGoogle Scholar
  12. 12.
    Jeannet, B., D’Argenio, P.R., Larsen, K.G.: RAPTURE: A tool for verifying Markov Decision Processes. In: Proc. of CONCUR 2002 (2002)Google Scholar
  13. 13.
    Karp, R.M., Luby, M., Madras, N.: Monte-Carlo algorithms for enumeration and reliability problems. Journal of Algorithms 10, 429–448 (1989)zbMATHCrossRefMathSciNetGoogle Scholar
  14. 14.
    Kemeny, J., Snell, J., Knapp, A.: Denumerable markov chains. Springer, Heidelberg (1976)zbMATHGoogle Scholar
  15. 15.
    Kwiatkowska, M., Norman, G., Parker, D.: Probabilistic symbolic model checking with PRISM: a hybrid approach. In: Katoen, J.-P., Stevens, P. (eds.) TACAS 2002. LNCS, vol. 2280, p. 52. Springer, Heidelberg (2002)CrossRefGoogle Scholar
  16. 16.
    Lassaigne, R., Peyronnet, S.: Approximate Verification of Probabilistic Systems. In: Hermanns, H., Segala, R. (eds.) PROBMIV 2002, PAPM-PROBMIV 2002, and PAPM 2002. LNCS, vol. 2399, pp. 213–214. Springer, Heidelberg (2002)CrossRefGoogle Scholar
  17. 17.
    Lovasz, L., Winkler, P.: Exact mixing time in an unknown markov chain. Electronic journal of combinatorics (1995)Google Scholar
  18. 18.
    Monniaux, D.: An abstract Monte-Carlo method for the analysis of probabilistic programs (extended abstract). In: 28th Symposium on Principles of Programming Languages (POPL 2001), pp. 93–101. Association for Computer Machinery (2001)Google Scholar
  19. 19.
    Motwani, R., Raghavan, P.: Randomized Algorithms. Cambridge University Press, Cambridge (1995)zbMATHGoogle Scholar
  20. 20.
    Papadimitriou, C.H.: Computational Complexity. Addison-Wesley, Reading (1994)zbMATHGoogle Scholar
  21. 21.
    Pnueli, A., Zuck, L.: Verification of multiprocess probabilistic protocols. Distributed Computing 1, 53–72 (1986)zbMATHCrossRefGoogle Scholar
  22. 22.
    Pnueli, A., Zuck, L.: Probabilistic verification. Information and Computation 103(1), 1–29 (1993)zbMATHCrossRefMathSciNetGoogle Scholar
  23. 23.
  24. 24.
    Rabinovich, A.: Quantitative analysis of probabilistic channel systems. In: Baeten, J.C.M., Lenstra, J.K., Parrow, J., Woeginger, G.J. (eds.) ICALP 2003. LNCS, vol. 2719, Springer, Heidelberg (2003)CrossRefGoogle Scholar
  25. 25.
    Sistla, A.P., Clarke, E.M.: The complexity of propositional linear temporal logics. Journal of the ACM 32(3), 733–749 (1985)zbMATHCrossRefMathSciNetGoogle Scholar
  26. 26.
    Vardi, M.Y.: Automatic verification of probabilistic concurrent finite-state programs. In: Proc. 26th Annual Symposium on Foundations of Computer Science, pp. 327–338 (1985)Google Scholar
  27. 27.
    Vardi, M.Y., Wolper, P.: An Automata-Theoretic Approach to Automatic Program Verification (Preliminary Report). In: Proceedings of the first IEEE Symposium on Logic in Computer Science, pp. 332–344 (1986)Google Scholar
  28. 28.
    Younes, H.L.S., Simmons, R.G.: Probabilistic Verication of Discrete Event Systems using Acceptance Sampling. In: Brinksma, E., Larsen, K.G. (eds.) CAV 2002. LNCS, vol. 2404, pp. 223–235. Springer, Heidelberg (2002)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2004

Authors and Affiliations

  • Thomas Hérault
    • 1
  • Richard Lassaigne
    • 2
  • Frédéric Magniette
    • 1
  • Sylvain Peyronnet
    • 1
  1. 1.LRIUniversity Paris XI 
  2. 2.University Paris VII 

Personalised recommendations