Bicategories of Markov Processes

  • Florence Clerc
  • Harrison Humphrey
  • Prakash Panangaden
Chapter
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10460)

Abstract

We construct bicategories of Markov processes where the objects are input and output sets, the morphisms (one-cells) are Markov processes and the two-cells are simulations. This builds on the work of Baez, Fong and Pollard, who showed that a certain kind of finite-space continuous-time Markov chain (CTMC) can be viewed as morphisms in a category. This view allows a compositional description of their CTMCs. Our contribution is to develop a notion of simulation between processes and construct a bicategory where the two-cells are simulation morphisms. Our version is for processes that are essentially probabilistic transition systems with discrete time steps and which do not satisfy a detailed balance condition. We have also extended the theory to continuous space processes.

References

  1. 1.
    Baez, J.C., Fong, B., Pollard, B.S.: A compositional framework for Markov processes, September 2015. arXiv:1508.06448
  2. 2.
    Desharnais, J., Edalat, A., Panangaden, P.: Bisimulation for labeled Markov processes. Inf. Comput. 179(2), 163–193 (2002)CrossRefMATHGoogle Scholar
  3. 3.
    Fong, B.: Decorated cospans. Theory Appl. Categ. 30, 1096–1120 (2015)MathSciNetMATHGoogle Scholar
  4. 4.
    Larsen, K.G., Skou, A.: Bisimulation through probablistic testing. Inf. Comput. 94, 1–28 (1991)CrossRefMATHGoogle Scholar
  5. 5.
    Milner, R. (ed.): A Calculus of Communicating Systems. LNCS, vol. 92. Springer, Heidelberg (1980)MATHGoogle Scholar
  6. 6.
    Milner, R.: Communication and Concurrency. Prentice-Hall, Upper Saddle River (1989)MATHGoogle Scholar
  7. 7.
    Mislove, M., Ouaknine, J., Pavlovic, D., Worrell, J.: Duality for labelled Markov processes. In: Walukiewicz, I. (ed.) FoSSaCS 2004. LNCS, vol. 2987, pp. 393–407. Springer, Heidelberg (2004). doi:10.1007/978-3-540-24727-2_28 CrossRefGoogle Scholar
  8. 8.
    Norris, J.R.: Markov Chains. Cambridge Series in Statistical and Probabilistic Mathematics. Cambridge University Press, Cambridge (1997)Google Scholar
  9. 9.
    Panangaden, P.: Labelled Markov Processes. Imperial College Press, London (2009)CrossRefMATHGoogle Scholar
  10. 10.
    Park, D.: Concurrency and automata on infinite sequences. In: Deussen, P. (ed.) GI-TCS 1981. LNCS, vol. 104, pp. 167–183. Springer, Heidelberg (1981). doi:10.1007/BFb0017309 CrossRefGoogle Scholar

Copyright information

© Springer International Publishing AG 2017

Authors and Affiliations

  • Florence Clerc
    • 1
  • Harrison Humphrey
    • 1
  • Prakash Panangaden
    • 1
  1. 1.School of Computer ScienceMcGill UniversityMontrealCanada

Personalised recommendations