Advertisement

Model-Based Testing Strategies and Their (In)dependence on Syntactic Model Representations

  • Jan PeleskaEmail author
  • Wen-ling Huang
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9933)

Abstract

Model-based testing (MBT) in its most advanced form allows for automated test case identification, test data calculation, and test procedure generation from reference models describing the expected behaviour of the system under test (SUT). If the underlying algorithms for test case identification operate only on the syntactic representation of test models, however, the resulting test strength depends on the syntactic representation as well. This observation is true, even if syntactically differing models are behaviourally equivalent. In this paper, we present a systematic approach to elaborating test case selection strategies that only depend on the behavioural semantics of test models, but are invariant under syntactic transformations preserving the semantics. The benefits of these strategies are discussed, and practical generation algorithms are presented.

Keywords

Model-based testing Equivalence class partition testing Kripke structures Complete testing theories 

Notes

Acknowledgements

The authors would like to thank the members of the FMICS-AVOCS program committee for the invitation to present this paper. Furthermore, we thank Alexander Pretschner for stimulating discussions concerning the topic of test strategies and their potential dependencies on syntactic model representations.

The work presented in this paper has been elaborated within project ITTCPS – Implementable Testing Theory for Cyber-physical Systems (http://www.informatik.uni-bremen.de/agbs/projects/ittcps/index.html) which has been granted by the University of Bremen in the context of the German Universities Excellence Initiative. (http://en.wikipedia.org/wiki/German_Universities_Excellence_Initiative).

References

  1. 1.
    Braunstein, C., Haxthausen, A.E., Huang, W., Hübner, F., Peleska, J., Schulze, U., Vu Hong, L.: Complete model-based equivalence class testing for the ETCS ceiling speed monitor. In: Merz, S., Pang, J. (eds.) ICFEM 2014. LNCS, vol. 8829, pp. 380–395. Springer, Heidelberg (2014)Google Scholar
  2. 2.
    CENELEC: EN 50128: 2011 Railway Applications - Communication, Signalling and Processing Systems - Software for Railway Control and Protection Systems (2011)Google Scholar
  3. 3.
    Chow, T.S.: Testing software design modeled by finite-state machines. IEEE Trans. Softw. Eng. SE 4(3), 178–186 (1978)CrossRefzbMATHGoogle Scholar
  4. 4.
    Fujiwara, S., Bochmann, G.V., Khendek, F., Amalou, M., Ghedamsi, A.: Test selection based on finite state models. IEEE Trans. Softw. Eng. 17(6), 591–603 (1991)CrossRefGoogle Scholar
  5. 5.
    Hierons, R.M.: Testing from a nondeterministic finite state machine using adaptive state counting. IEEE Trans. Comput. 53(10), 1330–1342 (2004). http://doi.ieeecomputersociety.org/10.1109/TC.2004.85 CrossRefGoogle Scholar
  6. 6.
    Huang, W., Peleska, J.: Complete model-based equivalence class testing. STTT 18(3), 265–283 (2016). doi: 10.1007/s10009-014-0356-8 CrossRefGoogle Scholar
  7. 7.
    Hübner, F., Huang, W., Peleska, J.: Experimental evaluation of a novel equivalence class partition testing strategy. In: Blanchette, J.C., Kosmatov, N. (eds.) TAP 2015. LNCS, vol. 9154, pp. 155–172. Springer, Heidelberg (2015). doi: 10.1007/978-3-319-21215-9_10 CrossRefGoogle Scholar
  8. 8.
    ISO, DIS 26262–4: Road vehicles - functional safety - part 4: product development: system level. Technical report, International Organization for Standardization (2009)Google Scholar
  9. 9.
    Luo, G., von Bochmann, G., Petrenko, A.: Test selection based on communicating nondeterministic finite-state machines using a generalized WP-method. IEEE Trans. Softw. Eng. 20(2), 149–162 (1994). http://doi.ieeecomputersociety.org/10.1109/32.265636 CrossRefGoogle Scholar
  10. 10.
    Object Management Group: OMG Systems Modeling Language (OMG SysML), Version 1.4. Technical report, Object Management Group (2015). http://www.omg.org/spec/SysML/1.4
  11. 11.
    Peleska, J.: Industrial-strength model-based testing - state of the art and current challenges. In: Petrenko, A.K., Schlingloff, H. (eds.) Proceedings Eighth Workshop on Model-Based Testing, Rome, Italy, 17 March 2013. Electronic Proceedings in Theoretical Computer Science, vol. 111, pp. 3–28. Open Publishing Association (2013)Google Scholar
  12. 12.
    Peleska, J., Honisch, A., Lapschies, F., Löding, H., Schmid, H., Smuda, P., Vorobev, E., Zahlten, C.: A real-world benchmark model for testing concurrent real-time systems in the automotive domain. In: Wolff, B., Zaïdi, F. (eds.) ICTSS 2011. LNCS, vol. 7019, pp. 146–161. Springer, Heidelberg (2011)CrossRefGoogle Scholar
  13. 13.
    Peleska, J., Huang, W., Hübner, F.: A novel approach to HW/SW integration testing of route-based interlocking system controllers. In: Lecomte, T., Pinger, R., Romanovsky, A. (eds.) RSSRail 2016. LNCS, vol. 9707, pp. 32–49. Springer, Heidelberg (2016). doi: 10.1007/978-3-319-33951-1_3 CrossRefGoogle Scholar
  14. 14.
    Petrenko, A., Yevtushenko, N.: Adaptive testing of deterministic implementations specified by nondeterministic FSMs. In: Wolff, B., Zaïdi, F. (eds.) ICTSS 2011. LNCS, vol. 7019, pp. 162–178. Springer, Heidelberg (2011)CrossRefGoogle Scholar
  15. 15.
    Petrenko, A., Yevtushenko, N.: Adaptive testing of nondeterministic systems with FSM. In: 15th International IEEE Symposium on High-Assurance Systems Engineering, HASE 2014, Miami Beach, FL, USA, 9–11 January 2014, pp. 224–228. IEEE Computer Society (2014). http://dx.doi.org/10.1109/HASE.2014.39
  16. 16.
    Roscoe, A.W.: Understanding Concurrent Systems. Springer, Heidelberg (2010)CrossRefzbMATHGoogle Scholar
  17. 17.
    Vasilevskii, M.P.: Failure diagnosis of automata. Kibernetika (Transl.) 4, 98–108 (1973)MathSciNetGoogle Scholar
  18. 18.
    WG-71, R.S.E.: Software considerations in airborne systems and equipment certification. Technical report, RTCA/DO-178C, RTCA Inc, 1140 Connecticut Avenue, N.W., Suite 1020, Washington, D.C. 20036, December 2011Google Scholar

Copyright information

© Springer International Publishing AG 2016

Authors and Affiliations

  1. 1.Verified Systems International GmbHBremenGermany
  2. 2.Department of Mathematics and Computer ScienceUniversity of BremenBremenGermany

Personalised recommendations