Filtering TOBIAS Combinatorial Test Suites

  • Yves Ledru
  • Lydie du Bousquet
  • Olivier Maury
  • Pierre Bontron
Part of the Lecture Notes in Computer Science book series (LNCS, volume 2984)


TOBIAS is a combinatorial testing tool, aimed at the production of large test suites. In this paper, TOBIAS is applied to conformance tests for model-based specifications (expressed with assertions, pre and post-conditions) and associated implementations. The tool takes advantage of the executable character of VDM or JML assertions which provide an oracle for the testing process. Executing large test suites may require a lot of time. This paper shows how assertions can be exploited at generation time to filter the set of test cases, and at execution time to detect inconclusive test cases.


combinatorial testing model-based specifications VDM JML 


  1. 1.
    Aichernig, B.K.: Automated black-box testing with abstract VDM oracles. In: Felici, M., Kanoun, K., Pasquini, A. (eds.) SAFECOMP 1999. LNCS, vol. 1698, pp. 250–259. Springer, Heidelberg (1999)CrossRefGoogle Scholar
  2. 2.
    Boyapati, C., Khurshid, S., Marinov, D.: Korat: Automated testing based on java predicates. In: Proceedings of the International Symposium on Software Testing and Analysis, Rome, July 22-24. IEEE, Los Alamitos (2002)Google Scholar
  3. 3.
    Cheon, Y., Leavens, G.T.: A simple and practical approach to unit testing: The JML and JUnit way. In: Magnusson, B. (ed.) ECOOP 2002. LNCS, vol. 2374, pp. 231–255. Springer, Heidelberg (2002)CrossRefGoogle Scholar
  4. 4.
    Cohen, D.M., Dalal, S.R., Parelius, J., Patton, G.C.: The combinatorial design approach to automatic test generation. IEEE Software 13(5), 83–88 (1996)CrossRefGoogle Scholar
  5. 5.
    du Bousquet, L., Martin, H., Jézéquel, J.-M.: Conformance Testing from UML specifications, Experience Report. In: Informatik, G.f. (ed.) p-UML workshop, Toronto. Lecture Notes in Informatics, vol. P-7, pp. 43–56 (2001)Google Scholar
  6. 6.
    The VDM Tool Group. VDM-SL Toolbox User Manual. Technical report, IFAD (October 2000),
  7. 7.
    Jéron, T., Morel, P.: Test Generation Derived from Model-checking. In: Halbwachs, N., Peled, D.A. (eds.) CAV 1999. LNCS, vol. 1633, pp. 108–121. Springer, Heidelberg (1999)CrossRefGoogle Scholar
  8. 8.
    The Java Modeling Language (JML) Home Page,
  9. 9.
  10. 10.
    Leavens, G.T., Baker, A.L., Ruby, C.: JML: A notation for detailed design. In: Kilov, H., Rumpe, B., Simmonds, I. (eds.) Behavioral Specifications of Businesses and Systems, pp. 175–188. Kluwer, Dordrecht (1999)Google Scholar
  11. 11.
    Leavens, G.T., Baker, A.L., Ruby, C.: Preliminary design of JML: A behavioral interface specification language for Java. Technical Report 98-06q, Iowa State University, Department of Computer Science (June 2002)Google Scholar
  12. 12.
    Maury, O., Ledru, Y., Bontron, P., du Bousquet, L.: Using TOBIAS for the automatic generation of VDM test cases. In: Third VDM Workshop (in conjunction with FME 2002) (July 2002)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2004

Authors and Affiliations

  • Yves Ledru
    • 1
  • Lydie du Bousquet
    • 1
  • Olivier Maury
    • 1
  • Pierre Bontron
    • 1
  1. 1.Laboratoire LogicielsSystèmes, Réseaux – IMAGSaint Martin d’Hères CedexFrance

Personalised recommendations