Markov Set-Chains as Abstractions of Stochastic Hybrid Systems
The objective of this study is to introduce an abstraction procedure that applies to a general class of dynamical systems, that is to discrete-time stochastic hybrid systems (dt-SHS). The procedure abstracts the original dt-SHS into a Markov set-chain (MSC) in two steps. First, a Markov chain (MC) is obtained by partitioning the hybrid state space, according to a controllable parameter, into non-overlapping domains and computing transition probabilities for these domains according to the dynamics of the dt-SHS. Second, explicit error bounds for the abstraction that depend on the above parameter are derived, and are associated to the computed transition probabilities of the MC, thus obtaining a MSC. We show that one can arbitrarily increase the accuracy of the abstraction by tuning the controllable parameter, albeit at an increase of the cardinality of the MSC. Resorting to a number of results from the MSC literature allows the analysis of the dynamics of the original dt-SHS. In the present work, the asymptotic behavior of the dt-SHS dynamics is assessed within the abstracted framework.
Unable to display preview. Download preview PDF.
- 1.Abate, A., Prandini, M., Lygeros, J., Sastry, S.: Probabilistic reachability and safety for controlled discrete time stochastic hybrid systems. Automatica (accepted, 2007)Google Scholar
- 4.Clarke, E.M., Grumberg, O., Peled, D.A.: Model Checking. The MIT Press, Cambridge (2002)Google Scholar
- 6.D’Innocenzo, A., Julius, A.A., Di Benedetto, M.D., Pappas, G.J.: Approximate timed abstractions of hybrid automata. In: Proceedings of the 46th IEEE Conference on Decision and Control. New Orleans, Louisiana, USA, 12–14 December (2007)Google Scholar
- 9.Julius, A.A., Pappas, G.J.: Approximate abstraction of stochastic hybrid systems. IEEE Trans. Automatic Control (provisionally accepted)Google Scholar
- 11.Øksendal, B.: Stochastic Differential Equations: An Introduction with Applications, 6th edn. Springer, Heidelberg (2003)Google Scholar