An Active Learning Approach to the Falsification of Black Box Cyber-Physical Systems

  • Simone SilvettiEmail author
  • Alberto Policriti
  • Luca Bortolussi
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10510)


Search-based testing is widely used to find bugs in models of complex Cyber-Physical Systems. Latest research efforts have improved this approach by casting it as a falsification procedure of formally specified temporal properties, exploiting the robustness semantics of Signal Temporal Logic. The scaling of this approach to highly complex engineering systems requires efficient falsification procedures, which should be applicable also to black box models. Falsification is also exacerbated by the fact that inputs are often time-dependent functions. We tackle the falsification of formal properties of complex black box models of Cyber-Physical Systems, leveraging machine learning techniques from the area of Active Learning. Tailoring these techniques to the falsification problem with time-dependent, functional inputs, we show a considerable gain in computational effort, by reducing the number of model simulations needed. The effectiveness of the proposed approach is discussed on a challenging industrial-level benchmark from automotive.


Model-based testing Robustness Gaussian Processes Cyber-Physical Systems Falsification 


  1. 1.
    Abbas, H., Fainekos, G., Sankaranarayanan, S., Ivančić, F., Gupta, A.: Probabilistic temporal logic falsification of cyber-physical systems. ACM Trans. Embed. Comput. Syst. (TECS) 12(2s), 95 (2013)Google Scholar
  2. 2.
    Akazaki, T.: Falsification of conditional safety properties for cyber-physical systems with Gaussian process regression. In: Falcone, Y., Sánchez, C. (eds.) RV 2016. LNCS, vol. 10012, pp. 439–446. Springer, Cham (2016). doi: 10.1007/978-3-319-46982-9_27 CrossRefGoogle Scholar
  3. 3.
    Alur, R., Courcoubetis, C., Halbwachs, N., Henzinger, T.A., Ho, P.-H., Nicollin, X., Olivero, A., Sifakis, J., Yovine, S.: The algorithmic analysis of hybrid systems. Theo. Comput. Sci. 138(1), 3–34 (1995)MathSciNetCrossRefzbMATHGoogle Scholar
  4. 4.
    Annpureddy, Y., Liu, C., Fainekos, G., Sankaranarayanan, S.: S-TaLiRo: a tool for temporal logic falsification for hybrid systems. In: Abdulla, P.A., Leino, K.R.M. (eds.) TACAS 2011. LNCS, vol. 6605, pp. 254–257. Springer, Heidelberg (2011). doi: 10.1007/978-3-642-19835-9_21 CrossRefGoogle Scholar
  5. 5.
    Baheti, R., Gill, H.: Cyber-physical systems. Impact Control Technol. 12, 161–166 (2011)Google Scholar
  6. 6.
    Bardh Hoxha, H.A., Fainekos, G.: Benchmarks for temporal logic requirements for automotive systems. In: Proceedings of ARCH, vol. 34, pp. 25–30 (2015)Google Scholar
  7. 7.
    Deshmukh, J., Jin, X., Kapinski, J., Maler, O.: Stochastic local search for falsification of hybrid systems. In: Finkbeiner, B., Pu, G., Zhang, L. (eds.) ATVA 2015. LNCS, vol. 9364, pp. 500–517. Springer, Cham (2015). doi: 10.1007/978-3-319-24953-7_35 CrossRefGoogle Scholar
  8. 8.
    Donzé, A.: Breach, a toolbox for verification and parameter synthesis of hybrid systems. In: Touili, T., Cook, B., Jackson, P. (eds.) CAV 2010. LNCS, vol. 6174, pp. 167–170. Springer, Heidelberg (2010). doi: 10.1007/978-3-642-14295-6_17 CrossRefGoogle Scholar
  9. 9.
    Donzé, A., Maler, O.: Robust satisfaction of temporal logic over real-valued signals. In: Chatterjee, K., Henzinger, T.A. (eds.) FORMATS 2010. LNCS, vol. 6246, pp. 92–106. Springer, Heidelberg (2010). doi: 10.1007/978-3-642-15297-9_9 CrossRefGoogle Scholar
  10. 10.
    Dreossi, T., Dang, T., Donzé, A., Kapinski, J., Jin, X., Deshmukh, J.V.: Efficient guiding strategies for testing of temporal properties of hybrid systems. In: Havelund, K., Holzmann, G., Joshi, R. (eds.) NFM 2015. LNCS, vol. 9058, pp. 127–142. Springer, Cham (2015). doi: 10.1007/978-3-319-17524-9_10 Google Scholar
  11. 11.
    Fainekos, G.E., Sankaranarayanan, S., Ueda, K., Yazarel, H.: Verification of automotive control applications using S-TaLiRo. In: Proceeings of ACC, pp. 3567–3572. IEEE (2012)Google Scholar
  12. 12.
    Jin, X., Deshmukh, J.V., Kapinski, J., Ueda, K., Butts, K.: Powertrain control verification benchmark. In: Proceedings of HSCC, pp. 253–262. ACM (2014)Google Scholar
  13. 13.
    Maler, O., Manna, Z., Pnueli, A.: Prom timed to hybrid systems. In: Bakker, J.W., Huizing, C., Roever, W.P., Rozenberg, G. (eds.) REX 1991. LNCS, vol. 600, pp. 447–484. Springer, Heidelberg (1992). doi: 10.1007/BFb0032003 CrossRefGoogle Scholar
  14. 14.
    Maler, O., Nickovic, D.: Monitoring temporal properties of continuous signals. In: Lakhnech, Y., Yovine, S. (eds.) FORMATS/FTRTFT -2004. LNCS, vol. 3253, pp. 152–166. Springer, Heidelberg (2004). doi: 10.1007/978-3-540-30206-3_12 CrossRefGoogle Scholar
  15. 15.
    McKay, M.D., Beckman, R.J., Conover, W.J.: Comparison of three methods for selecting values of input variables in the analysis of output from a computer code. Technometrics 21(2), 239–245 (1979)MathSciNetzbMATHGoogle Scholar
  16. 16.
    Pnueli, A.: The temporal logic of programs. In: Proceedings of Foundations of Computer Science, pp. 46–57. IEEE (1977)Google Scholar
  17. 17.
    Rasmussen, C.E., Nickisch, H.: Gaussian processes for machine learning (GPML) toolbox. J. Mach. Learn. Res. 11, 3011–3015 (2010)MathSciNetzbMATHGoogle Scholar
  18. 18.
    Rasmussen, C.E., Williams, C.K.I.: Gaussian Processes for Machine Learning. MIT Press, New York (2006)zbMATHGoogle Scholar
  19. 19.
    Rubinstein, R.Y., Kroese, D.P.: The Cross-Entropy Method: A Unified Approach to Combinatorial Optimization, Monte-Carlo Simulation and Machine Learning. Springer, New York (2013). doi: 10.1007/978-1-4757-4321-0 CrossRefzbMATHGoogle Scholar
  20. 20.
    Sankaranarayananm S., Fainekos, G.: Falsification of temporal properties of hybrid systems using the cross-entropy method. In: Proceedings of HSCC, pp. 125–134. ACM (2012)Google Scholar
  21. 21.
    Vinnakota, B.: Analog and Mixed-Signal Test. Prentice Hall, Upper Saddle River (1998)Google Scholar
  22. 22.
    Zhao, Q., Krogh, B.H., Hubbard, P.: Generating test inputs for embedded control systems. IEEE Control Syst. 23(4), 49–57 (2003)CrossRefGoogle Scholar

Copyright information

© Springer International Publishing AG 2017

Authors and Affiliations

  • Simone Silvetti
    • 1
    • 2
    Email author
  • Alberto Policriti
    • 2
    • 3
  • Luca Bortolussi
    • 4
    • 5
    • 6
  1. 1.Esteco SpATriesteItaly
  2. 2.DIMAUniversity of UdineUdineItaly
  3. 3.Istituto di Genomica ApplicataUdineItaly
  4. 4.DMGUniversity of TriesteTriesteItaly
  5. 5.Modelling and Simulation GroupSaarland UniversitySaarbrückenGermany
  6. 6.CNR-ISTIPisaItaly

Personalised recommendations