Extending the Test Template Framework to Deal with Axiomatic Descriptions, Quantifiers and Set Comprehensions

  • Maximiliano Cristiá
  • Claudia Frydman
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7316)


The Test Template Framework (TTF) is a method for model-based testing (MBT) from Z specifications. Although the TTF covers many features of the Z notation, it does not explain how to deal with axiomatic descriptions, quantifiers and set comprehensions. In this paper we extend the TTF so it can process specifications including these features. The techniques presented here may be useful for other MBT methods for the Z notation or for other notations such as Alloy and B, since they use similar mathematical theories.


Disjunctive Normal Form Generate Test Case Abstract State Machine Generate Natural Language Atomic Predicate 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Stocks, P., Carrington, D.: A Framework for Specification-Based Testing. IEEE Transactions on Software Engineering 22, 777–793 (1996)CrossRefGoogle Scholar
  2. 2.
    Stocks, P.: Applying Formal Methods to Software Testing. PhD thesis, Department of Computer Science, University of Queensland (1993)Google Scholar
  3. 3.
    Utting, M., Legeard, B.: Practical Model-Based Testing: A Tools Approach. Morgan Kaufmann Publishers Inc., San Francisco (2006)Google Scholar
  4. 4.
    Hierons, R.M., Bogdanov, K., Bowen, J.P., Cleaveland, R., Derrick, J., Dick, J., Gheorghe, M., Harman, M., Kapoor, K., Krause, P., Lüttgen, G., Simons, A.J.H., Vilkomir, S., Woodward, M.R., Zedan, H.: Using formal specifications to support testing. ACM Comput. Surv. 41, 1–76 (2009)CrossRefGoogle Scholar
  5. 5.
    Grieskamp, W., Gurevich, Y., Schulte, W., Veanes, M.: Generating finite state machines from abstract state machines. In: ISSTA 2002: Proceedings of the 2002 ACM SIGSOFT International Symposium on Software Testing and Analysis, pp. 112–122. ACM, New York (2002)CrossRefGoogle Scholar
  6. 6.
    Legeard, B., Peureux, F., Utting, M.: A Comparison of the BTT and TTF Test-Generation Methods. In: Bert, D., P. Bowen, J., C. Henson, M., Robinson, K. (eds.) B 2002 and ZB 2002. LNCS, vol. 2272, pp. 309–329. Springer, Heidelberg (2002)CrossRefGoogle Scholar
  7. 7.
    Bernot, G., Gaudel, M.C., Marre, B.: Software testing based on formal specifications: a theory and a tool. Softw. Eng. J. 6, 387–405 (1991)CrossRefGoogle Scholar
  8. 8.
    Cristiá, M., Monetti, P.R.: Implementing and Applying the Stocks-Carrington Framework for Model-Based Testing. In: Breitman, K., Cavalcanti, A. (eds.) ICFEM 2009. LNCS, vol. 5885, pp. 167–185. Springer, Heidelberg (2009)CrossRefGoogle Scholar
  9. 9.
    Cristiá, M., Albertengo, P., Rodríguez Monetti, P.: Pruning testing trees in the Test Template Framework by detecting mathematical contradictions. In: Fiadeiro, J.L., Gnesi, S. (eds.) SEFM, pp. 268–277. IEEE Computer Society (2010)Google Scholar
  10. 10.
    Cristiá, M.: Fastest tool, (last access November 2011)
  11. 11.
    Cristiá, M., Plüss, B.: Generating natural language descriptions of Z test cases. In: Kelleher, J.D., Namee, B.M., van der Sluis, I., Belz, A., Gatt, A., Koller, A. (eds.) INLG, pp. 173–177. The Association for Computer Linguistics (2010)Google Scholar
  12. 12.
    Cristia, M., Hollmann, D., Albertengo, P., Frydman, C., Monetti, P.R.: A Language for Test Case Refinement in the Test Template Framework. In: Qin, S., Qiu, Z. (eds.) ICFEM 2011. LNCS, vol. 6991, pp. 601–616. Springer, Heidelberg (2011)CrossRefGoogle Scholar
  13. 13.
    Cristiá, M., Santiago, V., Vijaykumar, N.: On comparing and complementing two MBT approaches. In: Vargas, F., Cota, E. (eds.) LATW, pp. 1–6. IEEE Computer Society (2010)Google Scholar
  14. 14.
    Cristiá, M., Albertengo, P., Frydman, C., Plüss, B., Rodríguez Monetti, P.: Applying the Test Template Framework to aerospace software. In: Proceedings of the 34th IEEE Annual Software Engineering Workshop, Limerik, Irland. IEEE Computer Society (2011)Google Scholar
  15. 15.
    ECSS: Space Engineering – Ground Systems and Operations: Telemetry and Telecommand Packet Utilization. Technical Report ECSS-E-70-41A, European Space Agency (2003)Google Scholar
  16. 16.
    Barnes, J., Chapman, R., Johnson, R., Widmaier, J., Cooper, D., Everett, B.: Engineering the Tokeneer enclave protection software. In: Proceedings of the IEEE International Symposium on Secure Software Engineering. IEEE (2006)Google Scholar
  17. 17.
    Spivey, J.M.: The Z notation: a reference manual. Prentice Hall International (UK) Ltd., Hertfordshire (1992)Google Scholar
  18. 18.
    Saaltink, M.: The Z/EVES mathematical toolkit version 2.2 for Z/EVES version 1.5. Technical report, ORA Canada (1997)Google Scholar
  19. 19.
    Ammann, P., Offutt, J.: Using formal methods to derive test frames in category-partition testing. In: Compass 1994: 9th Annual Conference on Computer Assurance, Gaithersburg, MD, pp. 69–80. National Institute of Standards and Technology (1994)Google Scholar
  20. 20.
    Hall, P.A.V.: Towards testing with respect to formal specification. In: Proc. Second IEE/BCS Conference on Software Engineering, Conference Publication, IEE/BCS, vol. 290, pp. 159–163 (1988)Google Scholar
  21. 21.
    Hierons, R.M., Sadeghipour, S., Singh, H.: Testing a system specified using Statecharts and Z. Information and Software Technology 43, 137–149 (2001)CrossRefGoogle Scholar
  22. 22.
    Hierons, R.M.: Testing from a Z specification. Software Testing, Verification & Reliability 7, 19–33 (1997)CrossRefGoogle Scholar
  23. 23.
    Hörcher, H.M., Peleska, J.: Using Formal Specifications to Support Software Testing. Software Quality Journal 4, 309–327 (1995)CrossRefGoogle Scholar
  24. 24.
    Burton, S.: Automated Testing from Z Specifications. Technical report, Department of Computer Science – University of York (2000)Google Scholar
  25. 25.
    Cristiá, M., Frydman, C.: Applying SMT solvers to the Test Template Framework. In: Petrenko, A.K., Schlingloff, H. (eds.) Proceedings 7th Workshop on Model-Based Testing, Tallinn, Estonia, March 25. Electronic Proceedings in Theoretical Computer Science, vol. 80, pp. 28–42. Open Publishing Association (2012)Google Scholar
  26. 26.
    Meudec, C.: Automatic generation of software tests from formal specifications. PhD thesis, Queen’s University of Belfast, Northern Ireland, UK (1997)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2012

Authors and Affiliations

  • Maximiliano Cristiá
    • 1
  • Claudia Frydman
    • 2
  1. 1.CIFASIS and UNRRosarioArgentina
  2. 2.CIFASIS-LSIS and AMUMarseilleFrance

Personalised recommendations