Skip to main content
SpringerLink
Log in

Generating tests from B specifications and dynamic selection criteria

  • Original Article
  • Published:
Formal Aspects of Computing

Abstract

This paper is about generating tests from dynamic selection criteria called test purposes, in addition to structural tests, obtained from static selection criteria. We present a method that re-uses a behavioral model and an abstract test concretization layer developed for structural testing, and relies on additional test purposes. We propose, in the B framework, a process of test generation that uses the symbolic animation mechanisms of Leirios Test Generator (LTG) based on constraint solving, and guided by the test purposes. We build for that a B model that is the synchronized product of a behavioral B abstract model and a test purpose described as a labeled transition system. We prove the correctness of this method, and show some experimental results obtained on the IAS case study. IAS is an industrial smart-card platform dedicated to the operations of Identification, Authentication and electronic Signature. Our experiments show that the tests obtained from test purposes are complementary to the structural tests.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Abrial J-R (1996) The B book: assigning programs to meanings. Cambridge University Press, Cambridge

    Book  MATH  Google Scholar 

  2. Amman P, Ding W, Xu D (2001) Using a model checker to test safety properties. In: ICECCS’01. IEEE Computer Society, New York

  3. Bouquet F, Dadeau F, Groslambert J, Julliand J (2006) Safety property driven test generation from JML specifications. In: FATES/RV’06. Lecture notes in computer science, vol 4262, pp 225–239. Springer, Berlin

  4. Broy M, Jonsson B, Katoen J-P, Leucker M, Pretschner A (eds) (2005) Model-based testing of reactive systems. In: Lecture notes in computer science, vol 3472. Springer, Berlin

  5. Bernard E, Legeard B, Luck X, Peureux F (2004) Generation of test sequences from formal specifications: GSM 11-11 standard case study. Softw Pract Experience 34(10): 915–948

    Article  Google Scholar 

  6. Bert D, Potet M-L, Stouls N (2005) Genesyst: a tool to reason about behavioral aspects of B event specifications. In: ZB’05. Lecture notes in computer science, vol 3455. Springer, Berlin

  7. Calamé J, Ioustinova N, VanDe Pol J (2007) Automatic model-based generation of parameterized test cases using data abstraction. ENTCS 191: 25–48

    Google Scholar 

  8. Constant C, Jéron T, Marchand H, Rusu V (2007) Integrating formal verification and conformance testing for reactive systems. IEEE Trans Softw Eng 33(8): 558–574

    Article  Google Scholar 

  9. Colin S, Legeard B, Peureux F (2004) Preamble computation in automated test case generation using constraint logic programming. J Softw Test Verification Reliab 14(3): 213–235

    Article  Google Scholar 

  10. Dubreil J, Jéron T, Marchand H (2008) Automatic test generation for security properties. Deliverable L3.3, INRIA/IRISA Vertecs Project, Politess Project, ANR-05-RNRT-01301

  11. Farchi EE, Hartman A, Pinter SS (2002) Using a model-based test generator to test for standard conformance. IBM Syst J 41(1): 89–110

    Article  Google Scholar 

  12. Frantzen L, Tretmans J, Willemse TAC (2005) Test generation based on symbolic specifications. In: Grabowski J, Nielsen B (eds) FATES 2004, formal approaches to software testing. Lecture notes in computer science, vol 3395, pp 1–15. Springer, Berlin

  13. Grabowski J, Hogrefe D, Nahm R (1993) Test case generation with test purpose specification by MSCs. In: SDL’93—using objects

  14. GIXEL (2004) Common IAS Platform for eAdministration, Technical Specifications, 1.01 Premium edition. http://www.gixel.fr

  15. Joshi R, Holzmann G (2007) A mini challenge: build a verifiable filesystem. Formal Aspects Comput 19(2): 269–272

    Article  MATH  Google Scholar 

  16. Jard C, Jéron T (2005) TGV: theory, principles and algorithms. Softw Tools Technol Transfert 7(1): 297–315

    Article  Google Scholar 

  17. Jeannet T, Jéron T, Rusu V, Zinovieva E (2005) Symbolic test selection based on approximate analysis. In: TACAS’05. Lecture notes in computer science, vol 3440, pp 349–364. Springer, Berlin

  18. Jaffuel E, Legeard B (2007) LEIRIOS test generator: automated test generation from B models. In: B’2007. Lecture notes in computer science, vol 4355, pp 277–280. Springer, Berlin

  19. Julliand J, Masson P-A, Tissot R (2008) Generating security tests in addition to functional tests. In: AST’08, 3rd international workshop on automation of software test, pp 41–44, Leipzig, Germany, May 2008. ACM Press, New York

  20. Julliand J, Masson P-A, Tissot R (2008) Generating tests from B specifications and test purposes. In: ABZ’08, international conference on ASM, B and Z. Lecture notes in computer science, vol 5328, pp 139–152, London, UK, September 2008. Springer, Berlin

  21. Masson P-A, Julliand J, Plessis J-C, Jaffuel E, Debois G (2007) Automatic generation of model-based tests for a class of security properties. In: A-MOST’07, pp 12–22. ACM Press, New York

  22. Pretschner A, Mouelhi T, Le Traon Y (2008) Model-based tests for access control policies. In: ICST’08, international conference on software testing, verification, and validation, pp 338–347. IEEE Computer Society, New York

  23. Satpathy M, Leuschel M, Butler M (2005) ProTest: an automatic test environment for B specifications. In: MBT’04. ENTCS, vol 111, pp 113–136

  24. Satpathy M, Malik Q-A, Lilius J (2006) Synthesis of scenario based test cases from B models. In: FATES/RV’06. Lecture notes in computer science, vol 4262, pp 133–149. Springer, Berlin

  25. Tan L, Sokolsky O, Lee I (2004) Specification-based testing with linear temporal logic. In: IRI’2004, IEEE international conference on information reuse and integration, pp 413–498

  26. Utting M, Legeard B (2006) Practical model-based testing—a tools approach. Elsevier, Amsterdam

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. LIFC, Université de Franche-Comté, 16, route de Gray, 25030, Besançon Cedex, France

    Jacques Julliand, Pierre-Alain Masson, Régis Tissot & Pierre-Christophe Bué

Authors
  1. Jacques Julliand
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Pierre-Alain Masson
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Régis Tissot
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Pierre-Christophe Bué
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding authors

Correspondence to Jacques Julliand, Pierre-Alain Masson, Régis Tissot or Pierre-Christophe Bué.

Additional information

Michael Poppleton and Michael Butler

This research was partially funded by the French National Research Agency ANR (POSE ANR-05-RNTL-01001) and the Région Franche-Comté.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Julliand, J., Masson, PA., Tissot, R. et al. Generating tests from B specifications and dynamic selection criteria. Form Asp Comp 23, 3–19 (2011). https://doi.org/10.1007/s00165-009-0132-9

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00165-009-0132-9

Keywords

Search

Navigation