Abstract
Equivalence relations can be used to reduce the state space of a system model, thereby permitting more efficient analysis. This paper extends the notion of weighted lumpability (WL) defined on continuous-time Markov chains (CTMCs) to the discrete-time setting, i.e., discrete-time Markov chains (DTMCs). We provide a structural definition of weighted probabilistic equivalence (WPE), define the quotient under WPE and prove some elementary properties. We show that ω-regular properties are preserved when reducing the state space of a DTMC using WPE. Finally, we show that WPE is compositional w.r.t. synchronous parallel composition.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Ash, R.B., Doleans-Dade, C.A.: Probability and Measure Theory. Academic Press (2000)
Aziz, A., Singhal, V., Balarin, F.: It Usually Works: The Temporal Logic of Stochastic Systems. In: Wolper, P. (ed.) CAV 1995. LNCS, vol. 939, pp. 155–165. Springer, Heidelberg (1995)
Baier, C., Katoen, J.-P.: Principles of Model Checking. MIT Press (2008)
Baier, C., Katoen, J.-P., Hermanns, H., Wolf, V.: Comparative branching-time semantics for Markov chains. Inf. Comput. 200(2), 149–214 (2005)
Bernardo, M.: Non-bisimulation-based Markovian behavioral equivalences. J. Log. Algebr. Program. 72(1), 3–49 (2007)
Buchholz, P.: Exact and ordinary lumpability in finite Markov chains. J. of Appl. Prob., 59–75 (1994)
Desharnais, J., Edalat, A., Panangaden, P.: A logical characterization of bisimulation for labeled Markov processes. In: LICS, pp. 478–487 (1998)
Feller, W.: An Introduction to Probability Theory and Its Applications, vol. 1. John Wiley and Sons (1968)
Glabbeek, R.J.V., Smolka, S.A., Steffen, B.: Reactive, generative and stratified models of probabilistic processes. Information and Computation 121, 130–141 (1990)
Han, T., Katoen, J.-P., Mereacre, A.: Compositional Modeling and Minimization of Time-Inhomogeneous Markov Chains. In: Egerstedt, M., Mishra, B. (eds.) HSCC 2008. LNCS, vol. 4981, pp. 244–258. Springer, Heidelberg (2008)
Hansson, H., Jonsson, B.: A logic for reasoning about time and reliability. Formal Asp. Comput. 66(5), 512–535 (1994)
Huynh, D.T., Tian, L.: On some equivalence relations for probabilistic processes. Fundam. Inform. 17(3), 211–234 (1992)
Jones, C., Plotkin, G.: A probabilistic powerdomain of evaluations. In: LICS, pp. 186–195. IEEE Press, Piscataway (1989)
Jonsson, B., Larsen, K.G.: Specification and refinement of probabilistic processes. In: LICS, pp. 266–277 (1991)
Jou, C.-C., Smolka, S.A.: Equivalences, Congruences, and Complete Axiomatizations for Probabilistic Processes. In: Baeten, J.C.M., Klop, J.W. (eds.) CONCUR 1990. LNCS, vol. 458, pp. 367–383. Springer, Heidelberg (1990)
Katoen, J.-P., Khattri, M., Zapreev, I.S.: A Markov reward model checker. In: QEST, pp. 243–244. IEEE CS Press (2005)
Katoen, J.-P., Mereacre, A.: Model Checking HML on Piecewise-Constant Inhomogeneous Markov Chains. In: Cassez, F., Jard, C. (eds.) FORMATS 2008. LNCS, vol. 5215, pp. 203–217. Springer, Heidelberg (2008)
Kemeny, J., Snell, J.: Finite Markov chains. VanNostrand (1969)
Kwiatkowska, M., Norman, G., Parker, D.: Prism 2.0: A tool for probabilistic model checking. In: QEST, pp. 322–323. IEEE Computer Society Press (2004)
Larsen, K.G., Skou, A.: Bisimulation through probabilistic testing. In: POPL, pp. 344–352 (1989)
Norman, G., Parker, D., Kwiatkowska, M., Shukla, S.: Evaluating the reliability of NAND multiplexing with PRISM. IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems 24(10), 1629–1637 (2005)
Segala, R.: Modelling and Verification of Randomized Distributed Real Time Systems. PhD thesis, MIT (1995)
Sharma, A., Katoen, J.-P.: Weighted Lumpability on Markov Chains. In: Voronkov, A. (ed.) PSI 2011. LNCS, vol. 7162, pp. 322–339. Springer, Heidelberg (2012)
Thomas, W., Wilke, T.: Automata Logics, and Infinite Games: A Guide to Current Research. Springer, Heidelberg (2002)
Tofts, C.M.N.: Processes with probablities, priority and time. Formal Asp. Comput. 6(5), 536–564 (1994)
Tofts, C.M.N.: Compositional Performance Analysis. In: Brinksma, E. (ed.) TACAS 1997. LNCS, vol. 1217, pp. 290–305. Springer, Heidelberg (1997)
Wolf, V., Baier, C., Majster-Cederbaum, M.E.: Trace machines for observing continuous-time Markov chains. ENTCS 153(2), 259–277 (2006)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Sharma, A. (2012). Weighted Probabilistic Equivalence Preserves ω-Regular Properties. In: Schmitt, J.B. (eds) Measurement, Modelling, and Evaluation of Computing Systems and Dependability and Fault Tolerance. MMB&DFT 2012. Lecture Notes in Computer Science, vol 7201. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-28540-0_9
Download citation
DOI: https://doi.org/10.1007/978-3-642-28540-0_9
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-28539-4
Online ISBN: 978-3-642-28540-0
eBook Packages: Computer ScienceComputer Science (R0)