Distribution-Based Bisimulation for Labelled Markov Processes

  • Pengfei Yang
  • David N. Jansen
  • Lijun Zhang
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10419)


In this paper we propose a (sub)distribution-based bisimulation for labelled Markov processes and compare it with earlier definitions of state and event bisimulation, which both only compare states. In contrast to those state-based bisimulations, our distribution bisimulation is weaker, but corresponds more closely to linear properties. We construct a logic and a metric to describe our distribution bisimulation and discuss linearity, continuity and compositional properties.



This work has been supported by the National Natural Science Foundation of China (Grants 61532019, 61472473), the CAS/SAFEA International Partnership Program for Creative Research Teams, the Sino-German CDZ project CAP (GZ 1023).


  1. 1.
    Abate, A.: Approximation metrics based on probabilistic bisimulations for general state-space Markov processes: a survey. Electr. Notes Theor. Comput. Sci. 297, 3–25 (2013)CrossRefMATHGoogle Scholar
  2. 2.
    Abate, A., Katoen, J.-P., Lygeros, J., Prandini, M.: Approximate model checking of stochastic hybrid systems. Eur. J. Control 16(6), 624–641 (2010)MathSciNetCrossRefMATHGoogle Scholar
  3. 3.
    Bacci, G., Bacci, G., Larsen, K.G., Mardare, R.: On-the-fly exact computation of bisimilarity distances. In: Piterman, N., Smolka, S.A. (eds.) TACAS 2013. LNCS, vol. 7795, pp. 1–15. Springer, Heidelberg (2013). doi: 10.1007/978-3-642-36742-7_1 CrossRefGoogle Scholar
  4. 4.
    Blute, R., Desharnais, J., Edalat, A., Panangaden, P.: Bisimulation for labelled Markov processes. In: IEEE Symposium on Logic in Computer Science (LICS), pp. 149–158. IEEE Computer Society (1997)Google Scholar
  5. 5.
    van Breugel, F., Sharma, B., Worrell, J.: Approximating a behavioural pseudometric without discount for probabilistic systems. Logical Methods Comput. Sci. 4(2), 123–137 (2008)MathSciNetMATHGoogle Scholar
  6. 6.
    Chaput, P., Danos, V., Panangaden, P., Plotkin, G.D.: Approximating Markov processes by averaging. J. ACM 61(1), 5:1–5:45 (2014)MathSciNetCrossRefMATHGoogle Scholar
  7. 7.
    Daca, P., Henzinger, T.A., Křetínský, J., Petrov, T.: Linear distances between Markov chains. In: Concurrency Theory (CONCUR). Leibniz International Proceedings in Informatics (LIPIcs), vol. 59, pp. 20:1–20:15. Schloss Dagstuhl-Leibniz-Zentrum fuer Informatik (2016)Google Scholar
  8. 8.
    Danos, V., Desharnais, J., Laviolette, F., Panangaden, P.: Bisimulation and cocongruence for probabilistic systems. Inf. Comput. 204(4), 503–523 (2006)MathSciNetCrossRefMATHGoogle Scholar
  9. 9.
    Danos, V., Desharnais, J., Panangaden, P.: Conditional expectation and the approximation of labelled markov processes. In: Amadio, R., Lugiez, D. (eds.) CONCUR 2003. LNCS, vol. 2761, pp. 477–491. Springer, Heidelberg (2003). doi: 10.1007/978-3-540-45187-7_31 CrossRefGoogle Scholar
  10. 10.
    Danos, V., Desharnais, J., Panangaden, P.: Labelled Markov processes: stronger and faster approximations. Electr. Notes Theor. Comput. Sci. 87, 157–203 (2004)CrossRefMATHGoogle Scholar
  11. 11.
    D’Argenio, P.R., Terraf, P.S., Wolovick, N.: Bisimulations for non-deterministic labelled Markov processes. Math. Struct. Comput. Sci. 22(1), 43–68 (2012)MathSciNetCrossRefMATHGoogle Scholar
  12. 12.
    Deng, Y.: Semantics of Probabilistic Processes. Springer, Heidelberg (2014)CrossRefMATHGoogle Scholar
  13. 13.
    Desharnais, J., Edalat, A., Panangaden, P.: A logical characterization of bisimulation for labeled Markov processes. In: IEEE Symposium on Logic in Computer Science (LICS), pp. 478–487. IEEE Computer Society (1998)Google Scholar
  14. 14.
    Desharnais, J., Edalat, A., Panangaden, P.: Bisimulation for labelled Markov processes. Inf. Comput. 179(2), 163–193 (2002)MathSciNetCrossRefMATHGoogle Scholar
  15. 15.
    Desharnais, J., Gupta, V., Jagadeesan, R., Panangaden, P.: Approximating labelled Markov processes. Inf. Comput. 184(1), 160–200 (2003)MathSciNetCrossRefMATHGoogle Scholar
  16. 16.
    Desharnais, J., Gupta, V., Jagadeesan, R., Panangaden, P.: Metrics for labelled Markov processes. Theor. Comput. Sci. 318(3), 323–354 (2004)MathSciNetCrossRefMATHGoogle Scholar
  17. 17.
    Doyen, L., Henzinger, T.A., Raskin, J.F.: Equivalence of labeled Markov chains. Int. J. Found. Comput. Sci. 19(3), 549–563 (2008)MathSciNetCrossRefMATHGoogle Scholar
  18. 18.
    Durrett, R.: Probability: Theory and Examples, 3rd edn. Duxbury Press, Belmont (2004)MATHGoogle Scholar
  19. 19.
    Feng, Y., Zhang, L.: When equivalence and bisimulation join forces in probabilistic automata. In: Jones, C., Pihlajasaari, P., Sun, J. (eds.) FM 2014. LNCS, vol. 8442, pp. 247–262. Springer, Cham (2014). doi: 10.1007/978-3-319-06410-9_18 CrossRefGoogle Scholar
  20. 20.
    Ferns, N., Panangaden, P., Precup, D.: Bisimulation metrics for continuous Markov decision processes. SIAM J. Comput. 40(6), 1662–1714 (2011)MathSciNetCrossRefMATHGoogle Scholar
  21. 21.
    Gebler, D., Larsen, K.G., Tini, S.: Compositional metric reasoning with probabilistic process calculi. In: Pitts, A. (ed.) FoSSaCS 2015. LNCS, vol. 9034, pp. 230–245. Springer, Heidelberg (2015). doi: 10.1007/978-3-662-46678-0_15 CrossRefGoogle Scholar
  22. 22.
    Hennessy, M.: Exploring probabilistic bisimulations, part I. Formal Asp. Comput. 24(4–6), 749–768 (2012)MathSciNetCrossRefMATHGoogle Scholar
  23. 23.
    Hermanns, H., Krčál, J., Křetínský, J.: Probabilistic bisimulation: naturally on distributions. In: Baldan, P., Gorla, D. (eds.) CONCUR 2014. LNCS, vol. 8704, pp. 249–265. Springer, Heidelberg (2014). doi: 10.1007/978-3-662-44584-6_18 Google Scholar
  24. 24.
    Kemeny, J.G., Snell, J.L.: Finite Markov chains. Springer, Heidelberg (1960)MATHGoogle Scholar
  25. 25.
    Larsen, K.G., Skou, A.: Bisimulation through probablistic testing. Inf. Comput. 94(1), 1–28 (1991)CrossRefMATHGoogle Scholar
  26. 26.
    Panangaden, P.: Labelled Markov Processes. Imperial College Press, London (2009)CrossRefMATHGoogle Scholar
  27. 27.
    Segala, R., Lynch, N.A.: Probabilistic simulations for probabilistic processes. Nord. J. Comput. 2(2), 250–273 (1995)MathSciNetMATHGoogle Scholar
  28. 28.
    Tang, Q., van Breugel, F.: Computing probabilistic bisimilarity distances via policy iteration. In: Concurrency Theory (CONCUR). LIPIcs, vol. 59, p. 22:1–22:15. Schloss Dagstuhl - Leibniz-Zentrum fuer Informatik (2016)Google Scholar
  29. 29.
    Terraf, P.S.: Unprovability of the logical characterization of bisimulation. CoRR abs/1005.5142 (2010)Google Scholar
  30. 30.
    Urabe, N., Hasuo, I.: Generic forward and backward simulations III: quantitative simulations by Matrices. In: Baldan, P., Gorla, D. (eds.) CONCUR 2014. LNCS, vol. 8704, pp. 451–466. Springer, Heidelberg (2014). doi: 10.1007/978-3-662-44584-6_31 Google Scholar
  31. 31.
    Vink, E.P., Rutten, J.J.M.M.: Bisimulation for probabilistic transition systems: a coalgebraic approach. In: Degano, P., Gorrieri, R., Marchetti-Spaccamela, A. (eds.) ICALP 1997. LNCS, vol. 1256, pp. 460–470. Springer, Heidelberg (1997). doi: 10.1007/3-540-63165-8_202 CrossRefGoogle Scholar

Copyright information

© Springer International Publishing AG 2017

Authors and Affiliations

  1. 1.State Key Laboratory of Computer ScienceInstitute of Software, CASBeijingChina
  2. 2.University of Chinese Academy of SciencesBeijingChina

Personalised recommendations