Scalable Incremental Test-case Generation from Large Behavior Models
Model-based testing is a popular black-box testing technology that enables automation of test generation and execution, while achieving a given coverage. The application of this technology to large and complex systems is still a challenging problem, due to the state-space explosion resulting from the size of specification models.
In this paper, we evaluate a test-case generation approach that tackles this complexity along two axes. Firstly, our approach relies on a synchronous specification language for test models, thus avoiding the problem of interleaving actions. Secondly, our specification language enables incremental test-case generation by providing support for compositional modeling, in which each requirement or view of the system is expressed as a separate partial model. The individual requirement models are then naturally combined by conjunction, which is incrementally computed during the generation of tests.
We apply our test-case generation technique to two large industrial case studies: (1) an electronic control unit (ECU) of an agricultural device; and (2) a railway interlocking system. We demonstrate the scalability of our approach by creating a series of test models with increasing complexity and report on the experimental results.
Unable to display preview. Download preview PDF.
- 1.Aichernig, B.K., Brandl, H., Jöbstl, E., Krenn, W., Schlick, R., Tiran, S.: Killing strategies for model-based mutation testing. Software Testing, Verification and Reliability (Early view) (2014)Google Scholar
- 4.Aichernig, B.K., Lorber, F., Tiran, S.: Formal test-driven development with verified test cases. In: MODELSWARD 2014, pp. 626–635. SCITEPRESS, Lisbon (January 2014)Google Scholar
- 5.Arcaini, P., Gargantini, A.: Test generation for sequential nets of abstract state machines with information passing. Science of Computer Programming 94, Part 2(0), 93–108 (2014)Google Scholar
- 6.Arcaini, P., Gargantini, A., Riccobene, E.: An abstraction technique for testing decomposable systems by model checking. In: Seidl, M., Tillmann, N. (eds.) TAP 2014. LNCS, vol. 8570, pp. 36–52. Springer, Heidelberg (2014) Google Scholar
- 8.Bourhfir, C., Dssouli, R., Aboulhamid, E., Rico, N.: A guided incremental test case generation procedure for conformance testing for CEFSM specified protocols. In: Testing of Communicating Systems. IFIP, vol. 3, pp. 279–294. Springer, Heidelberg (1998)Google Scholar
- 9.Choi, Y., Heimdahl, M.P.E.: Model checking RSML-e requirements. In: HASE, pp. 109–118. IEEE Computer Society (2002)Google Scholar
- 11.Daca, P., Henzinger, T.A., Krenn, W., Ničković, D.: Compositional specifications for ioco testing. Technical Report IST-2014-148-v2+1, IST Austria (2014). http://repository.ist.ac.at/152/1/main_tr.pdf (visited on: March 27, 2014)
- 14.Fraser, G., Wotawa, F.: Creating test-cases incrementally with model-checkers. In: GI Jahrestagung (2). LNI, vol. 110, pp. 381–386. GI (2007)Google Scholar
- 15.Koo, H.-M., Mishra, P.: Functional test generation using design and property decomposition techniques. ACM Trans. Embed. Comput. Syst. 8(4), 32:1–32:33 (2009)Google Scholar
- 17.Schwarzl, C., Peischl, B.: Test sequence generation from communicating UML state charts: An industrial application of symbolic transition systems. QSIC 2010, 122–131 (2010)Google Scholar