Advertisement

Evolving the ETSI Test Description Language

  • Philip Makedonski
  • Gusztáv Adamis
  • Martti Käärik
  • Finn Kristoffersen
  • Xavier Zeitoun
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9959)

Abstract

Increasing software and system complexity due to the integration of more and more diverse sub-systems presents new testing challenges. Standardisation and certification requirements in certain domains such as telecommunication, automotive, aerospace, and health-care contribute further challenges for testing systems operating in these domains. Consequently, there is a need for suitable methodologies, processes, languages, and tools to address these testing challenges. To address some of these challenges, the Test Description Language (TDL) has been developed at the European Telecommunications Standards Institute (ETSI) over the past three years. TDL bridges the gap between declarative test purposes and imperative test cases by offering a standardised language for the specification of test descriptions. TDL started as a standardised meta-model, subsequently enriched with a graphical syntax, exchange format, and a UML profile. A reference implementation of TDL has been developed as a common platform to accelerate the adoption of TDL and lower the barrier to entry for both end-users and tool-vendors. This article tells the story of the evolution of TDL from its conception.

Keywords

Model-based testing Test description language Domain-specific modeling 

Notes

Acknowledgement

The work on TDL has been funded by ETSI in the context of the STF projects 454, 476, and 492.

References

  1. 1.
    Docx4j. http://www.docx4java.org. Accessed 25 June 2016
  2. 2.
    Papyrus. https://www.eclipse.org/papyrus/. Accessed 20 June 2016
  3. 3.
    Robot framework. https://robotframework.org. Accessed 20 June 2016
  4. 4.
    Sirius. https://www.eclipse.org/sirius/. Accessed 20 June 2016
  5. 5.
    Tdl. http://tdl.etsi.org. Accessed 20 June 2016
  6. 6.
    Xtext. https://eclipse.org/Xtext/. Accessed 20 June 2016
  7. 7.
    Association for Standardisation of Automation, Measuring Systems (ASAM): Release Presentation: ASAM AE ATX V1.0.0, Automotive Test Exchange Format, July 2012. http://www.asam.net/nc/home/asam-standards.html
  8. 8.
    Bouquet, F., Grandpierre, C., Legeard, B., Peureux, F., Vacelet, N., Utting, M.: A subset of precise uml for model-based testing. In: Proceedings of the 3rd International Workshop on Advances in Model-based Testing, A-MOST 2007, pp. 95–104. ACM, New York (2007)Google Scholar
  9. 9.
    ETSI EG 203 130: Methods for Testing and Specification (MTS); Model-Based Testing (MBT); Methodology for Standardised Test Specification Development, v1.1.1. European Telecommunications Standards Institute (ETSI), Sophia-Antipolis, France, April 2013Google Scholar
  10. 10.
    ETSI ES 201 873–1: Methods for Testing and Specification (MTS); The Testing and Test Control Notation version 3; - Part 1: Core Language, v4.8.1. European Telecommunications Standards Institute (ETSI), Sophia-Antipolis, France, July 2016Google Scholar
  11. 11.
    ETSI ES 202 553: Methods for Testing and Specification (MTS); TPLan: A notation for expressing Test Purposes, v1.2.1. European Telecommunications Standards Institute (ETSI), Sophia-Antipolis, France, June 2009Google Scholar
  12. 12.
    ETSI ES 202 951: Methods for Testing and Specification (MTS); Model-Based Testing (MBT); Requirements for Modelling Notations, v1.1.1. European Telecommunications Standards Institute (ETSI), Sophia-Antipolis, France, July 2011Google Scholar
  13. 13.
    ETSI ES 203 119–1: Methods for Testing and Specification (MTS); The Test Description Language (TDL); Part 1: Abstract Syntax and Associated Semantics, v1.3.0. European Telecommunications Standards Institute (ETSI), Sophia-Antipolis, France, July 2016Google Scholar
  14. 14.
    ETSI ES 203 119–2: Methods for Testing and Specification (MTS); The Test Description Language (TDL); Part 2: Graphical Syntax, v1.2.0. European Telecommunications Standards Institute (ETSI), Sophia-Antipolis, France, July 2016Google Scholar
  15. 15.
    ETSI ES 203 119–3: Methods for Testing and Specification (MTS); The Test Description Language (TDL); Part 3: Exchange Format, v1.2.0. European Telecommunications Standards Institute (ETSI), Sophia-Antipolis, France, July 2016Google Scholar
  16. 16.
    ETSI ES 203 119–4: Methods for Testing and Specification (MTS); The Test Description Language (TDL); Part 4: Structured Test Objective Specification (Extension), v1.2.0. European Telecommunications Standards Institute (ETSI), Sophia-Antipolis, France, July 2016Google Scholar
  17. 17.
    ETSI ES 102 840: Methods for Testing and Specification (MTS); Model-Based Testing (MBT); Model-Based Testing in Standardisation, v1.2.1. European Telecommunications Standards Institute (ETSI), Sophia-Antipolis, France, February 2011Google Scholar
  18. 18.
    Grossmann, J., Müller, W.: A formal behavioral semantics for TestML. In: Second International Symposium on Leveraging Applications of Formal Methods, Verification and Validation, ISoLA 2006, pp. 441–448, November 2006Google Scholar
  19. 19.
    Guduvan, A., Waeselynck, H., Wiels, V., Durrieu, G., Fusero, Y., Schieber, M.: A meta-model for tests of avionics embedded systems. In: MODELSWARD 2013, Proceedings of the 1st International Conference on Model-Driven Engineering and Software Development, Barcelona, Spain, 19–21 February 2013, pp. 5–13 (2013)Google Scholar
  20. 20.
    International Telecommunication Union (ITU): Recommendation Z.120 Annex B: Formal Semantics of Message Sequence Chart (MSC), 04/98. Online: Z.120 Annex B (04/98), Standard document. URL: http://www.itu.int/rec/T-REC-Z.120-199804-I!AnnB/en
  21. 21.
    International Telecommunication Union (ITU): Recommendation Z.120: Message Sequence Chart (MSC), 02/11. Online: Z.120 (02/11), Standard document. URL: http://www.itu.int/rec/T-REC-Z.120-201102-I/en
  22. 22.
    ISO: Road vehicles - Open Test sequence eXchange format - Part 1: General information and use cases. International ISO multipart standard No. 13209–1 (2011)Google Scholar
  23. 23.
    ISO: Road vehicles - Open Test sequence eXchange format - Part 2: Core data model specification and requirements. International ISO multipart standard No. 13209–2 (2012)Google Scholar
  24. 24.
    ISO: Road vehicles - Open Test sequence eXchange format - Part 3: Standard extensions and requirements. International ISO multipart standard No. 13209–3 (2012)Google Scholar
  25. 25.
    ISO/IEC: Information Technology - Open Systems Interconnection - Conformance testing methodology and framework - Part 1: General Concepts. International ISO/IEC multipart standard No. 9646–1 (1994–1998)Google Scholar
  26. 26.
    Kanstrén, T., Puolitaival, O.P., Rytky, V.M., Saarela, A., Keränen, J.S.: Experiences in setting up domain-specific model-based testing. In: 2012 IEEE International Conference on Industrial Technology (ICIT), pp. 319–324, March 2012Google Scholar
  27. 27.
    Kolovos, D.S., Paige, R.F., Polack, F.A.C.: On the evolution of OCL for capturing structural constraints in modelling languages. In: Abrial, J.-R., Glässer, U. (eds.) Rigorous Methods for Software Construction and Analysis. LNCS, vol. 5115, pp. 204–218. Springer, Heidelberg (2009). doi: 10.1007/978-3-642-11447-2_13 CrossRefGoogle Scholar
  28. 28.
    Micskei, Z., Waeselynck, H.: The many meanings of UML 2 Sequence diagrams: a survey. Softw. Syst. Model. 10(4), 489–514 (2010)CrossRefGoogle Scholar
  29. 29.
    Object Management Group OMG: UML Profile For MARTE: Modeling and Analysis of Real-Time Embedded Systems, Version 1.1. OMG Document Number: formal/2011-06-02, Standard document, June 2011. URL: http://www.omg.org/spec/MARTE/1.1/
  30. 30.
    Object Management Group OMG: Object Constraint Language, Version 2.3.1. OMG Document Number: formal/2012-05-09, Standard document, May 2012. URL: http://www.omg.org/spec/OCL/2.3.1/
  31. 31.
    Object Management Group OMG: UML Testing Profile (UTP), Version 1.2. OMG Document Number: formal/2013-04-03, Standard document, April 2013. URL: http://www.omg.org/spec/UTP/1.2/
  32. 32.
    Object Management Group OMG: CCDL Whitepaper. Razorcat Technical Report, 23 January 2014, January 2014. http://www.razorcat.eu/PDF/Razorcat_Technical_Report_CCDL_Whitepaper_02.pdf
  33. 33.
    Object Management Group OMG: Meta Object Facility Core, Version 2.4.2. OMG Document Number: formal/2014-04-05, Standard document, April 2014. URL: http://www.omg.org/spec/MOF/2.4.2/
  34. 34.
    Object Management Group OMG: XML Metadata Interchange (XMI), Version 2.4.2. OMG Document Number: formal/2014-04-06, Standard document. URL: http://www.omg.org/spec/XMI/2.5.1/
  35. 35.
    Pajunen, T., Takala, T., Katara, M.: Model-based testing with a general purpose keyword-driven test automation framework. In: ICSTW, pp. 242–251. IEEE, March 2011Google Scholar

Copyright information

© Springer International Publishing AG 2016

Authors and Affiliations

  • Philip Makedonski
    • 1
  • Gusztáv Adamis
    • 2
  • Martti Käärik
    • 3
  • Finn Kristoffersen
    • 4
  • Xavier Zeitoun
    • 5
  1. 1.Institute of Computer ScienceUniversity of GöttingenGöttingenGermany
  2. 2.Test Competence CenterEricsson Hungary Ltd.BudapestHungary
  3. 3.Elvior OUTalinnEstonia
  4. 4.Cinderella ApSCopenhagenDenmark
  5. 5.CEA, LISTGif-sur-yvetteFrance

Personalised recommendations