A Statistical Approach for Computing Reachability of Non-linear and Stochastic Dynamical Systems

  • Luca Bortolussi
  • Guido Sanguinetti
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8657)


We present a novel approach to compute reachable sets of dynamical systems with uncertain initial conditions or parameters, leveraging state-of-the-art statistical techniques. From a small set of samples of the true reachable function of the system, expressed as a function of initial conditions or parameters, we emulate such function using a Bayesian method based on Gaussian Processes. Uncertainty in the reconstruction is reflected in confidence bounds which, when combined with template polyhedra ad optimised, allow us to bound the reachable set with a given statistical confidence. We show how this method works straightforwardly also to do reachability computations for uncertain stochastic models.


Gaussian Process Input Point Reachability Analysis Reachability Problem Noisy Observation 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Andersson, H., Britton, T.: Stochastic Epidemic Models and Their Statistical Analysis. Springer (2000)Google Scholar
  2. 2.
    Bartocci, E., Bortolussi, L., Nenzi, L., Sanguinetti, G.: On the robustness of temporal properties for stochastic models. In: Proc. of HSB. EPTCS, vol. 125, pp. 3–19 (2013)Google Scholar
  3. 3.
    Becker, W., Worden, K., Rowson, J.: Bayesian sensitivity analysis of bifurcating nonlinear models. Mechanical Systems and Signal Processing 34(1-2), 57–75 (2013)CrossRefGoogle Scholar
  4. 4.
    Belta, C., Habets, L.C.: Controlling a class of nonlinear systems on rectangles. IEEE Trans. on Automatic Control 51(11), 1749–1759 (2006)CrossRefMathSciNetGoogle Scholar
  5. 5.
    Bhatia, A., Frazzoli, E.: Incremental search methods for reachability analysis of continuous and hybrid systems. In: Alur, R., Pappas, G.J. (eds.) HSCC 2004. LNCS, vol. 2993, pp. 142–156. Springer, Heidelberg (2004)Google Scholar
  6. 6.
    Bishop, C.M.: Pattern recognition and machine learning. Springer, NY (2009)Google Scholar
  7. 7.
    Bortolussi, L., Hillston, J., Latella, D., Massink, M.: Continuous approximation of collective systems behaviour: a tutorial. Performance Evaluation (2013)Google Scholar
  8. 8.
    Bortolussi, L., Sanguinetti, G.: Learning and designing stochastic processes from logical constraints. In: Joshi, K., Siegle, M., Stoelinga, M., D’Argenio, P.R. (eds.) QEST 2013. LNCS, vol. 8054, pp. 89–105. Springer, Heidelberg (2013)CrossRefGoogle Scholar
  9. 9.
    Bortolussi, L., Sanguinetti, G.: Smoothed model checking for uncertain Continuous Time Markov Chains. arXiv preprint arXiv:1402.1450 (2014)Google Scholar
  10. 10.
    Bujorianu, L.M.: A statistical inference method for the stochastic reachability analysis. In: Proceedings of IEEE CDC 2005 (2005)Google Scholar
  11. 11.
    Burden, R.L., Faires, J.D.: Numerical analysis. Brooks/Cole, Cengage Learning, Boston (2011)Google Scholar
  12. 12.
    Chutinan, A., Krogh, B.H.: Computing polyhedral approximations to flow pipes for dynamic systems. In: Proc. of IEEE CDC, vol. 2 (1998)Google Scholar
  13. 13.
    Dang, T., Dreossi, T.: Falsifying oscillation properties of parametric biological models. In: Proc. of HSB. EPTCS, vol. 125 (2013)Google Scholar
  14. 14.
    Dang, T., Gawlitza, T.M.: Template-based unbounded time verification of affine hybrid automata. In: Yang, H. (ed.) APLAS 2011. LNCS, vol. 7078, pp. 34–49. Springer, Heidelberg (2011)CrossRefGoogle Scholar
  15. 15.
    Dang, T., Le Guernic, C., Maler, O.: Computing reachable states for nonlinear biological models. Theor. Comput. Sci. 412(21) (2011)Google Scholar
  16. 16.
    Dang, T., Nahhal, T.: Coverage-guided test generation for continuous and hybrid systems. Formal Methods in System Design 34(2) (2009)Google Scholar
  17. 17.
    De Schutter, B., Heemels, W.P., Lunze, J., Prieur, C.: Survey of modeling, analysis, and control of hybrid systems. In: Handbook of Hybrid Systems Control–Theory, Tools, Applications, pp. 31–55 (2009)Google Scholar
  18. 18.
    Donzé, A., Maler, O.: Systematic simulation using sensitivity analysis. In: Bemporad, A., Bicchi, A., Buttazzo, G. (eds.) HSCC 2007. LNCS, vol. 4416, pp. 174–189. Springer, Heidelberg (2007)Google Scholar
  19. 19.
    Duggirala, P.S., Mitra, S., Viswanathan, M.: Verification of annotated models from executions. In: Proc. of ACM EMSOFT 2013 (2013)Google Scholar
  20. 20.
    Frehse, G., et al.: SpaceEx: Scalable verification of hybrid systems. In: Gopalakrishnan, G., Qadeer, S. (eds.) CAV 2011. LNCS, vol. 6806, pp. 379–395. Springer, Heidelberg (2011)CrossRefGoogle Scholar
  21. 21.
    Gardiner, C.W.: Stochastic methods. Springer (2009)Google Scholar
  22. 22.
    Girard, A., Le Guernic, C., Maler, O.: Efficient computation of reachable sets of linear time-invariant systems with inputs. In: Hespanha, J.P., Tiwari, A. (eds.) HSCC 2006. LNCS, vol. 3927, pp. 257–271. Springer, Heidelberg (2006)Google Scholar
  23. 23.
    Girard, A., Pappas, G.J.: Verification using simulation. In: Hespanha, J.P., Tiwari, A. (eds.) HSCC 2006. LNCS, vol. 3927, pp. 272–286. Springer, Heidelberg (2006)Google Scholar
  24. 24.
    Kurzhanski, A.B., Varaiya, P.: On ellipsoidal techniques for reachability analysis. Optimization Methods and Software 17(2) (2002)Google Scholar
  25. 25.
    Lawrence, N.D., Sanguinetti, G., Rattray, M.: Modelling transcriptional regulation using gaussian processes. In: NIPS, pp. 785–792. MIT Press (2006)Google Scholar
  26. 26.
    Maler, O.: Computing reachable sets: an introduction. Technical report (2008),
  27. 27.
    Oakley, J.E., O’Hagan, A.: Probabilistic sensitivity analysis of complex models: a bayesian approach. J. of the Royal Statistical Society B 66(3), 751–769 (2004)CrossRefzbMATHMathSciNetGoogle Scholar
  28. 28.
    Rasmussen, C.E., Williams, C.K.I.: Gaussian processes for machine learning. MIT Press, Cambridge (2006)zbMATHGoogle Scholar
  29. 29.
    Ben Sassi, M.A., Testylier, R., Dang, T., Girard, A.: Reachability analysis of polynomial systems using linear programming relaxations. In: Chakraborty, S., Mukund, M. (eds.) ATVA 2012. LNCS, vol. 7561, pp. 137–151. Springer, Heidelberg (2012)CrossRefGoogle Scholar
  30. 30.
    Srinivas, N., Krause, A., Kakade, S., Seeger, M.: Information-theoretic regret bounds for Gaussian process optimisation in the bandit setting. IEEE Trans. Inf. Th. 58(5), 3250–3265 (2012)CrossRefMathSciNetGoogle Scholar
  31. 31.
    Tang, B.: Orthogonal array-based latin hypercubes. Journal of the American Statistical Association 88(424), 1392–1397 (1993)CrossRefzbMATHMathSciNetGoogle Scholar

Copyright information

© Springer International Publishing Switzerland 2014

Authors and Affiliations

  • Luca Bortolussi
    • 1
  • Guido Sanguinetti
    • 2
    • 3
  1. 1.DMGUniversity of Trieste, and CNR/ISTIPisaItaly
  2. 2.School of InformaticsUniversity of EdinburghUK
  3. 3.SynthSys, Centre for Synthetic and Systems BiologyUniversity of EdinburghUK

Personalised recommendations