Stochastic Reachability with Constraints

  • Luminita Manuela Bujorianu
Part of the Communications and Control Engineering book series (CCE)


This chapter is concerned with leveraging the concept of stochastic reachability such that it may capture state and time constraints, dynamics of the target set, randomisation of the time horizon and so on. We formulate state-constrained stochastic reachability for a stochastic hybrid process with no controllers. The idea is that we specialise the stochastic reachability problem asking that the desired trajectories to satisfy additional conditions (e.g. to avoid an obstacle or to go through a particular set). Analytic solutions are provided using the infinitesimal generator of the process. Concretely, the reach set probabilities in the case of state-constrained reachability are solutions for a Dirichlet boundary value problem defined using this generator. The complexity of this problem is due also to the particular expression of this integro-differential operator. To overcome this difficulty, we propose to consider a viewpoint approach and to solve the problem for different abstraction levels or for different components, which can be defined in the structure of a stochastic hybrid system.




  1. 11.
    Barles, C., Chasseigne, E., Imbert, C.: On the Dirichlet problem for second-order elliptic integro-differential equations. Preprint (2007) Google Scholar
  2. 14.
    Baier, C., Haverkort, B.R., Hermanns, H., Katoen, J.-P.: Reachability in continuous-time Markov reward decision processes. In: Logic and Automata: History and Perspectives, pp. 53–71 (2007) Google Scholar
  3. 15.
    Baxter, J.R., Chacon, R.V.: Compactness of stopping times. Z. Wahrscheinlichkeitstheor. Verw. Geb. 40(3), 169–181 (1977) CrossRefMATHMathSciNetGoogle Scholar
  4. 33.
    Blumenthal, R.M., Getoor, R.K.: Markov Processes and Potential Theory. Academic Press, New York (1968) MATHGoogle Scholar
  5. 37.
    Bovier, A.: Metastability. Lecture Notes in Mathematics, vol. 1970. Springer, Berlin (2009) Google Scholar
  6. 51.
    Choquet, G.: Theory of capacities. Ann. Inst. Fourier 5, 131–291 (1953) CrossRefMathSciNetGoogle Scholar
  7. 74.
    Doob, J.L.: Classical Potential Theory and Its Probabilistic Counterpart. Springer, Berlin (1984) CrossRefMATHGoogle Scholar
  8. 77.
    Dynkin, E.B.: Markov Processes I. Springer, Berlin (1965) CrossRefMATHGoogle Scholar
  9. 95.
    Garroni, M.G., Menaldi, J.L.: Second Order Elliptic Integro-Differential Problems. Chapman & Hall/CRC Press, London/Boca Raton (2002) CrossRefMATHGoogle Scholar
  10. 100.
    Getoor, R.K.: Excursions of a Markov process. Ann. Probab. 7(2), 244–266 (1979) CrossRefMATHMathSciNetGoogle Scholar
  11. 109.
    Grimmett, G., Stirzaker, D.: Probability and Random Processes. Oxford University Press, London (1982) MATHGoogle Scholar
  12. 154.
    Kunita, H., Watanabe, T.: Notes on transformations of Markov processes connected with multiplicative functionals. Mem. Fac. Sci., Kyushu Univ., Ser. A, Math. 17(2), 181–191 (1963) MATHMathSciNetGoogle Scholar
  13. 208.
    Sharpe, M.: General Theory of Markov Processes. Academic Press, San Diego (1988) MATHGoogle Scholar
  14. 222.
    Taira, K.: Boundary value problems for elliptic integro-differential operator. Math. Z. 222, 305–327 (1996) CrossRefMathSciNetGoogle Scholar

Copyright information

© Springer-Verlag London Limited 2012

Authors and Affiliations

  • Luminita Manuela Bujorianu
    • 1
  1. 1.School of MathematicsUniversity of ManchesterManchesterUK

Personalised recommendations