Abstract
This chapter is concerned with leveraging the concept of stochastic reachability such that it may capture state and time constraints, dynamics of the target set, randomisation of the time horizon and so on. We formulate state-constrained stochastic reachability for a stochastic hybrid process with no controllers. The idea is that we specialise the stochastic reachability problem asking that the desired trajectories to satisfy additional conditions (e.g. to avoid an obstacle or to go through a particular set). Analytic solutions are provided using the infinitesimal generator of the process. Concretely, the reach set probabilities in the case of state-constrained reachability are solutions for a Dirichlet boundary value problem defined using this generator. The complexity of this problem is due also to the particular expression of this integro-differential operator. To overcome this difficulty, we propose to consider a viewpoint approach and to solve the problem for different abstraction levels or for different components, which can be defined in the structure of a stochastic hybrid system.
An erratum to this chapter can be found at http://dx.doi.org/10.1007/978-1-4471-2795-6_12
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Barles, C., Chasseigne, E., Imbert, C.: On the Dirichlet problem for second-order elliptic integro-differential equations. Preprint (2007)
Baier, C., Haverkort, B.R., Hermanns, H., Katoen, J.-P.: Reachability in continuous-time Markov reward decision processes. In: Logic and Automata: History and Perspectives, pp. 53–71 (2007)
Baxter, J.R., Chacon, R.V.: Compactness of stopping times. Z. Wahrscheinlichkeitstheor. Verw. Geb. 40(3), 169–181 (1977)
Blumenthal, R.M., Getoor, R.K.: Markov Processes and Potential Theory. Academic Press, New York (1968)
Bovier, A.: Metastability. Lecture Notes in Mathematics, vol. 1970. Springer, Berlin (2009)
Choquet, G.: Theory of capacities. Ann. Inst. Fourier 5, 131–291 (1953)
Doob, J.L.: Classical Potential Theory and Its Probabilistic Counterpart. Springer, Berlin (1984)
Dynkin, E.B.: Markov Processes I. Springer, Berlin (1965)
Garroni, M.G., Menaldi, J.L.: Second Order Elliptic Integro-Differential Problems. Chapman & Hall/CRC Press, London/Boca Raton (2002)
Getoor, R.K.: Excursions of a Markov process. Ann. Probab. 7(2), 244–266 (1979)
Grimmett, G., Stirzaker, D.: Probability and Random Processes. Oxford University Press, London (1982)
Kunita, H., Watanabe, T.: Notes on transformations of Markov processes connected with multiplicative functionals. Mem. Fac. Sci., Kyushu Univ., Ser. A, Math. 17(2), 181–191 (1963)
Sharpe, M.: General Theory of Markov Processes. Academic Press, San Diego (1988)
Taira, K.: Boundary value problems for elliptic integro-differential operator. Math. Z. 222, 305–327 (1996)
Author information
Authors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag London Limited
About this chapter
Cite this chapter
Bujorianu, L.M. (2012). Stochastic Reachability with Constraints. In: Stochastic Reachability Analysis of Hybrid Systems. Communications and Control Engineering. Springer, London. https://doi.org/10.1007/978-1-4471-2795-6_10
Download citation
DOI: https://doi.org/10.1007/978-1-4471-2795-6_10
Published:
Publisher Name: Springer, London
Print ISBN: 978-1-4471-2794-9
Online ISBN: 978-1-4471-2795-6
eBook Packages: EngineeringEngineering (R0)