Abstract
This paper presents a model-checking approach for analyzing discrete-time Markov reward models. For this purpose, the temporal logic probabilistic CTL is extended with reward constraints. This allows to formulate complex measures – involving expected as well as accumulated rewards – in a precise and succinct way. Algorithms to efficiently analyze such formulae are introduced. The approach is illustrated by model-checking a probabilistic cost model of the IPv4 zeroconf protocol for distributed address assignment in ad-hoc networks.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Aziz, A., Sanwal, K., Singhal, V., Brayton, R.: Verifying continuous time Markov chains. In: Alur, R., Henzinger, T.A. (eds.) CAV 1996. LNCS, vol. 1102, pp. 269–276. Springer, Heidelberg (1996)
Baier, C., Haverkort, B.R., Hermanns, H., Katoen, J.-P.: On the logical characterization of performability properties. In: Welzl, E., Montanari, U., Rolim, J.D.P. (eds.) ICALP 2000. LNCS, vol. 1853, pp. 780–792. Springer, Heidelberg (2000)
Baier, C., Haverkort, B.R., Hermanns, H., Katoen, J.-P.: Model-checking algorithms for continuous-time Markov chains. IEEE Transactions on Software Engineering 29(6), 524–545 (2003)
Bernardo, M.: An algebra-based method to associate rewards with EMPA terms. In: Degano, P., Gorrieri, R., Marchetti-Spaccamela, A. (eds.) ICALP 1997. LNCS, vol. 1256, pp. 358–368. Springer, Heidelberg (1997)
Bohnenkamp, H., van der Stok, P., Hermanns, H., Vaandrager, F.W.: Cost optimisation of the IPv4 zeroconf protocol. In: Intl. Conf. on Dependable Systems and Networks, IEEE CS Press, Los Alamitos (2003) (to appear)
Cheshire, S., Adoba, B., Guttman, E.: Dynamic configuration of IPv4 link-local addresses (2002) (draft), available at http://www.ietf.org/internet-drafts
Ciardo, G., Muppala, J., Trivedi, K.S.: SPNP: Stochastic Petri Net Package. In: Proc. 3rd Int’l. Workshop on Petri Nets and Performance Models, pp. 142–151 (1989)
Clark, G., Gilmore, S., Hillston, J.: Specifying performance measures for PEPA. In: Katoen, J.-P. (ed.) AMAST-ARTS 1999, ARTS 1999, and AMAST-WS 1999. LNCS, vol. 1601, pp. 211–227. Springer, Heidelberg (1999)
Clarke, E., Grumberg, O., Peled, D.: Model Checking. MIT Press, Cambridge (1999)
de Alfaro, L.: How to specify and verify the long-run average behavior of probabilistic systems. In: IEEE Symp. on Logic in Computer Science, pp. 454-465 (1998)
Hansson, H., Jonsson, B.: A logic for reasoning about time and reliability. Form. Asp. of Comp. 6, 512–535 (1994)
Haverkort, B., Cloth, L., Hermanns, H., Katoen, J.-P., Baier, C.: Model checking performability properties. In: Intl. Conf. on Dependable Systems and Networks, pp. 103–113 (2002)
Kemeny, J.G., Snell, J.L.: Finite Markov Chains. Van Nostrand (1960)
Kulkarni, V.G.: Modeling and Analysis of Stochastic Systems. Chapman and Hall, Boca Raton (1995)
Obal, W.D., Sanders, W.H.: State-space support for path-based reward variables. Performance Evaluation 35(3-4), 233–251 (1999)
Qureshi, M.A., Sanders, W.H.: Reward model solution method with impulse and rate rewards: An algorithm and numerical results. Performance Evaluation 20, 413–436 (1994)
Reibman, A., Trivedi, K.: Transient analysis of cumulative measures of Markov model behavior. Commun. Statist. Stochastic Models 5(4), 683–710 (1989)
Smith, R.M., Trivedi, K.S., Ramesh, A.V.: Performability analysis: measures, an algorithm and a case study. IEEE Tr. on Computers 37(4), 406–417 (1988)
Sokolsky, O., Philippou, A., Lee, I., Christou, K.: Modeling and analysis of power-aware systems. In: Garavel, H., Hatcliff, J. (eds.) TACAS 2003. LNCS, vol. 2619, pp. 409–425. Springer, Heidelberg (2003)
Voeten, J.P.M.: Performance evaluation with temporal rewards. Performance Evaluation 50, 189–218 (2002)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2004 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Andova, S., Hermanns, H., Katoen, JP. (2004). Discrete-Time Rewards Model-Checked. In: Larsen, K.G., Niebert, P. (eds) Formal Modeling and Analysis of Timed Systems. FORMATS 2003. Lecture Notes in Computer Science, vol 2791. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-40903-8_8
Download citation
DOI: https://doi.org/10.1007/978-3-540-40903-8_8
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-21671-1
Online ISBN: 978-3-540-40903-8
eBook Packages: Springer Book Archive