Advances in test generation for testing software and systems

An introduction to selected papers from ICTSS 2013
  • Hüsnü YenigünEmail author
  • Cemal Yilmaz
  • Andreas Ulrich


Among the software quality assurance techniques, testing stands out as one of the most frequently used techniques in practice. Consequently, testing is also widely studied in research. An important aspect in testing that receives much attention is the problem of automated test generation. This introductory paper summarizes the papers selected from the 25th IFIP International Conference on Testing Software and Systems (ICTSS 2013), which all deal with this topic. The field is briefly introduced by pointing out to some of the existing survey articles and relating the selected papers in this issue to each other and to the known body of knowledge.


Software testing Test generation  Model-based testing 



We would like to thank the authors of the selected articles for their motivation to provide extended versions of their work originally submitted to ICTSS 2013, the reviewers of the articles for their relentless efforts on providing feedback and holding up the quality of the submitted work, and all members of the technical program committee of ICTSS 2013.


  1. 1.
    Anand, S., Burke, E.K., Chen, T.Y., Clark, J.A., Cohen, M.B., Grieskamp, W., Harman, M., Harrold, M.J., McMinn, P.: An orchestrated survey of methodologies for automated software test case generation. J. Syst. Softw. 86(8), 1978–2001 (2013)CrossRefGoogle Scholar
  2. 2.
    Binder, R.V., Legeard, B., Kramer, A.: Model-based testing: where does it stand? Commun. ACM 58(2), 52–56 (2015)CrossRefGoogle Scholar
  3. 3.
    Broy, M., Jonsson, B., Katoen, J., Leucker, M., Pretschner, A. (eds.): Model-Based Testing of Reactive Systems, Advanced Lectures, Lecture Notes in Computer Science, vol. 3472. Springer, Berlin (2005)Google Scholar
  4. 4.
    Chow, T.S.: Testing software design modeled by finite-state machines. IEEE Trans. Softw. Eng. 4(3), 178–187 (1978)CrossRefzbMATHGoogle Scholar
  5. 5.
    Dias Neto, A.C., Subramanyan, R., Vieira, M., Travassos, G.H.: A survey on model-based testing approaches: a systematic review. In: Proceedings of the 1st ACM International Workshop on Empirical Assessment of Software Engineering Languages and Technologies, WEASELTech 2007, pp. 31–36. ACM (2007)Google Scholar
  6. 6.
    Dijkstra, E.W.: Notes on Structured Programming. (1970) (circulated privately)
  7. 7.
    Enoiu, E.P., Čaušević, A., Ostrand, T.J., Weyuker, E.J., Sundmark, D., Pettersson, P.: Automated test generation using model checking: an industrial evaluation. Int. J. Softw. Tools Technol. Transfer. doi: 10.1007/s10009-014-0355-9
  8. 8.
    Faria, J.P., Paiva, A.C.R.: A toolset for conformance testing against uml sequence diagrams based on event-driven colored petri nets. Int. J. Softw. Tools Technol. Transfer. doi: 10.1007/s10009-014-0354-x
  9. 9.
    Frantzen, L., Tretmans, J., Willemse, T.A.C.: Test generation based on symbolic specifications. In: J. Grabowski, B. Nielsen (eds.) Formal Approaches to Software Testing, 4th International Workshop, FATES 2004, Linz, Austria, September 21, 2004, Revised Selected Papers, Lecture Notes in Computer Science, vol. 3395, pp. 1–15. Springer (2005)Google Scholar
  10. 10.
    Fraser, G., Wotawa, F., Ammann, P.: Testing with model checkers: a survey. Softw. Test. Verif. Reliab. 19(3), 215–261 (2009)CrossRefGoogle Scholar
  11. 11.
    Hierons, R.M., Merayo, M.G., Núñez, M.: Implementation relations for the distributed test architecture. In: Suzuki, K., Higashino, T., Ulrich, A., Hasegawa, T. (eds.) Testing of Software and Communicating Systems, 20th IFIP TC 6/WG 6.1 International Conference, TestCom 2008, 8th International Workshop, FATES 2008, Tokyo, Japan Proceedings, 10–13 June 2008, Lecture Notes in Computer Science, vol. 5047, pp. 200–215. Springer (2008)Google Scholar
  12. 12.
    Hierons, R.M., Ural, H.: Optimizing the length of checking sequences. IEEE Trans. Comput. 55(5), 618–629 (2006)MathSciNetCrossRefGoogle Scholar
  13. 13.
    Huang, W.l., Peleska, J.: Complete model-based equivalence class testing. Int. J. Softw. Tools Technol. Transfer. doi: 10.1007/s10009-014-0356-8
  14. 14.
    Kurshan, R. P.: Lecture Notes in Computer Science. In: Grumberg, O., Veith, H. (eds.) 25 Years of Model Checking, vol. 5000, pp. 46–64. Springer, Heidelberg (2008)Google Scholar
  15. 15.
    Kushik, N., El-Fakih, K., Yevtushenko, N., Cavalli, A.R.: On adaptive experiments for nondeterministic finite state machines. Int. J. Softw. Tools Technol. Transfer. doi: 10.1007/s10009-014-0357-7
  16. 16.
    Larsen, K.G., Mikucionis, M., Nielsen, B.: Online testing of real-time systems using UPPAAL: status and future work. In: E. Brinksma, W. Grieskamp, J. Tretmans (eds.) Perspectives of Model-Based Testing, 5–10 September 2004, Dagstuhl Seminar Proceedings, vol. 04371. IBFI, Schloss Dagstuhl, Germany (2005)Google Scholar
  17. 17.
    Lee, D., Yannakakis, M.: Principles and methods of testing finite state machines-a survey. Proc. IEEE 84(8), 1090–1123 (1996)CrossRefGoogle Scholar
  18. 18.
    Ponce de León, H., Haar, S., Longuet, D.: Model-based testing for concurrent systems: unfolding-based test selection. Int. J. Softw. Tools Technol. Transfer. doi: 10.1007/s10009-014-0353-y
  19. 19.
    Moore, E.F.: Gedanken-experiments on sequential machines. In: Shannon, C., McCarthy, J. (eds.) Automata Studies, pp. 129–153. Princeton University Press, Princeton (1956)Google Scholar
  20. 20.
    Nielsen, B., Skou, A.: Automated test generation from timed automata. Softw. Tools Technol. Transf. 5(1), 59–77 (2003)CrossRefzbMATHGoogle Scholar
  21. 21.
    Orso, A., Rothermel, G.: Software testing: a research travelogue (2000–2014). In: 36th International Conference on on Software Engineering, ICSE, Future of Software Engineering Track, FOSE, Hyderabad, India, pp. 117–132 (2014)Google Scholar
  22. 22.
    Ovatman, T., Aral, A., Polat, D., Ünver, A.O.: An overview of model checking practices on verification of plc software. Softw. Syst. Model. 1–24 (2014). doi: 10.1007/s10270-014-0448-7
  23. 23.
    Petrenko, A., da Silva Simão, A., Maldonado, J.C.: Model-based testing of software and systems: recent advances and challenges. Softw. Tools Technol. Transf. 14(4), 383–386 (2012)CrossRefGoogle Scholar
  24. 24.
    Petrenko, A., Yevtushenko, N.: Adaptive testing of nondeterministic systems with FSM. In: 15th International IEEE Symposium on High-Assurance Systems Engineering, HASE 2014, Miami Beach, FL, USA, 9–11 January 2014, pp. 224–228. IEEE Computer Society (2014)Google Scholar
  25. 25.
    Petrenko, A., Yevtushenko, N., von Bochmann, G.: Testing deterministic implementations from nondeterministic fsm specifications. In: Selected Proceedings of the IFIP TC6 9th International Workshop on Testing of Communicating Systems, pp. 125–140. Chapman & Hall, Ltd., London (1996)Google Scholar
  26. 26.
    Schrammel, P., Melham, T., Kroening, D.: Generating test case chains for reactive systems. Int. J. Softw. Tools Technol. Transfer. doi: 10.1007/s10009-014-0358-6
  27. 27.
    Shafique, M., Labiche, Y.: A systematic review of state-based test tools. Softw. Tools Technol. Transf. 17(1), 59–76 (2015)CrossRefGoogle Scholar
  28. 28.
    da Silva Simão, A., Petrenko, A.: Generating checking sequences for partial reduced finite state machines. In: K. Suzuki, T. Higashino, A. Ulrich, T. Hasegawa (eds.) Testing of Software and Communicating Systems, 20th IFIP TC 6/WG 6.1 International Conference, TestCom 2008, 8th International Workshop, FATES 2008, Tokyo, Japan, Proceedings, 10–13 June 2008, Lecture Notes in Computer Science, vol. 5047, pp. 153–168. Springer (2008)Google Scholar
  29. 29.
    Tretmans, J.: Model based testing with labelled transition systems. In: Hierons, R.M., Bowen, J.P., Harman, M. (eds.) Formal Methods and Testing. Lecture Notes in Computer Science, vol. 4949, pp. 1–38. Springer, Berlin, Heidelberg (2008)Google Scholar
  30. 30.
    Ural, H., Wu, X., Zhang, F.: On minimizing the lengths of checking sequences. IEEE Trans. Comput. 46(1), 93–99 (1997)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2015

Authors and Affiliations

  • Hüsnü Yenigün
    • 1
    Email author
  • Cemal Yilmaz
    • 1
  • Andreas Ulrich
    • 2
  1. 1.Sabanci UniversityIstanbulTurkey
  2. 2.Siemens AG, Corporate TechnologyMunichGermany

Personalised recommendations