Advertisement

Software & Systems Modeling

, Volume 18, Issue 2, pp 1543–1570 | Cite as

From use case maps to executable test procedures: a scenario-based approach

  • Nader KesserwanEmail author
  • Rachida Dssouli
  • Jamal Bentahar
  • Bernard Stepien
  • Pierre Labrèche
Regular Paper

Abstract

Testing embedded systems software has become a costly activity as these systems become more complex to fulfill rising needs. Testing processes should be both effective and affordable. An ideal testing process should begin with validated requirements and begin as early as possible so that requirements defects can be fixed before they propagate and become more difficult to address. Furthermore, the testing process should facilitate test procedures creation and automate their execution. We propose a novel methodology for testing functional requirements. The methodology activities include standard notations, such as UCM for modeling scenarios derived from requirements, TDL for describing test cases and TTCN-3 for executing test procedures; other test scripting languages can also be used with our methodology. Furthermore, the automation of the methodology generates test artifacts through model transformation. The main goals of this test methodology are to leverage requirements represented as scenarios, to replace the natural language test case descriptions with test scenarios in TDL, and to generate executable test procedures. Demonstration of the feasibility of the proposed approach is based on a public case study. An empirical evaluation of our approach is given using a case study from the avionics domain.

Keywords

Model-driven testing Testing methodology Embedded systems Test generation TTCN-3 TDL UCM 

Notes

Acknowledgements

This research was supported by CRIAQ, Esterline CMC Electronics, Solutions Isoneo and Mitacs-Accelerated Graduate Research Internship Program. Project title: Test Automation with TTCN-3, Grant Numbers: FR05066, FR05067.

References

  1. 1.
    Adolph, S., Cockburn, A., Bramble, P.: Patterns for Effective Use Cases. Addison-Wesley Longman Publishing Co., Inc., Boston (2002)Google Scholar
  2. 2.
    Baker, P., Dai, Z.R., Grabowski, J., Schieferdecker, I., Williams, C.: Model-Driven Testing: Using the UML Testing Profile. Springer, Berlin (2007). ISBN 9783540725626Google Scholar
  3. 3.
    Bertolino, A., Fantechi, A., Gnesi, S., Lami, G.: Product line use cases: Scenario-based specification and testing of requirements. In: Software Product Lines, pp. 425–445. Springer, Berlin Heidelberg (2006)Google Scholar
  4. 4.
    Boniol, F., Wiels, V.: The landing gear system case study. In: ABZ 2014: The Landing Gear Case Study, pp. 1–18. Springer (2014)Google Scholar
  5. 5.
    Boulet, P., Amyot, D., Stepien, B.: Towards the generation of tests in the test description language from use case map models. In: SDL 2015: Model-Driven Engineering for Smart Cities, pp. 193–201. Springer (2015)Google Scholar
  6. 6.
    Briand, L., Labiche, Y.: A UML-based approach to system testing. Softw. Syst. Model. 1(1), 10–42 (2002)CrossRefzbMATHGoogle Scholar
  7. 7.
    Buhr, R.J.A.: Use case maps as architectural entities for complex systems. IEEE Trans. Softw. Eng. 24(12), 1131–1155 (1998)CrossRefGoogle Scholar
  8. 8.
    DO-178A Software Considerations in Airborne Systems and Equipment Certification, Document Number: DO-178A, Issue Date: 3/22/1985, Committee: SC-152, Category: SoftwareGoogle Scholar
  9. 9.
    DO-178C: Available from RTCA at www.rtca.org
  10. 10.
    Dvorak, D.: NASA study on Flight Software Complexity. NASA office of chief engineer (2009)Google Scholar
  11. 11.
    Elberzhager, F., Rosbach, A., Münch, J., Eschbach, R.: Reducing test effort: a systematic mapping study on existing approaches. Inf. Softw. Technol. 54(10), 1092–1106 (2012)CrossRefGoogle Scholar
  12. 12.
    Hasling, B., Goetz, H., Beetz, K.: Model based testing of system requirements using UML use case models. In: 2008 1st International Conference on Software Testing, Verification, and Validation, pp. 367–376. IEEE (2008, April)Google Scholar
  13. 13.
    Heckel, R., Lohmann, M.: Towards model-driven testing. Electron. Notes Theor. Comput. Sci. 82(6), 33–43 (2003). ISBN 1571-0661CrossRefGoogle Scholar
  14. 14.
  15. 15.
  16. 16.
  17. 17.
  18. 18.
  19. 19.
  20. 20.
  21. 21.
  22. 22.
    Hovsepyan, A., Van Landuyt, D., Michiels, S., Joosen, W., Rangel, G., Fernandez Briones, J., Depauw, J.: Model-driven software development of safety-critical avionics systems: an experience report. In: 1st International Workshop on Model-Driven Development Processes and Practices co-located with ACM/IEEE 17th International Conference on Model Driven Engineering Languages & Systems (MoDELS 2014), vol. 1249 (2014, September)Google Scholar
  23. 23.
  24. 24.
    Kealey, J., Amyot, D.: Enhanced use case map traversal semantics. In: Gaudin, E., Najm, E., Reed, R. (eds.) SDL 2007. LNCS, vol. 4745, pp. 133–149. Springer, Heidelberg (2007)Google Scholar
  25. 25.
    Leite, J.C.S.P., Hadad, G., Doorn, J., Kaplan, G.: A scenario construction process. Requir. Eng. J. 5(1), 38–61 (2000)CrossRefGoogle Scholar
  26. 26.
    Makedonski, P., Adamis, G., Käärik, M., Ulrich, A., Wendland, M.-F., Wiles, A.: Bringing TDL to users: a hands-on tutorial. In: User Conference on Advanced Automated Testing (UCAAT 2014), MunichGoogle Scholar
  27. 27.
    Marrone, S., Flammini, F., Mazzocca, N., Nardone, R., Vittorini, V.: Towards model-driven V&V assessment of railway control systems. Int. J. Softw. Tools Technol. Transf. 16(6), 669–683 (2014)CrossRefGoogle Scholar
  28. 28.
    Nebut, C., Fleurey, F., Le Traon, Y., Jezequel, J.M.: Automatic test generation: a use case driven approach. IEEE Trans. Softw. Eng. 32(3), 140–155 (2006)CrossRefGoogle Scholar
  29. 29.
    Nogueira, S., Sampaio, A., Mota, A.: Test generation from state based use case models. Formal Asp. Comput. 26(3), 441–490 (2014)MathSciNetCrossRefzbMATHGoogle Scholar
  30. 30.
    Ryser, J., Glinz, M.: A scenario-based approach to validating and testing software systems using statecharts. In: Proceedings of 12th International Conference on Software and Systems Engineering and Their Applications (1999, December)Google Scholar
  31. 31.
    Sarmiento, E., Sampaio do Prado Leite, J. C., Almentero, E.: C&L: generating model based test cases from natural language requirements descriptions. In: 2014 IEEE 1st International Workshop on Requirements Engineering and Testing (RET), pp. 32–38. IEEE (2014, August)Google Scholar
  32. 32.
    Schatz, Bernhard.: 10 years model-driven—what did we achieve?. In: Proceedings of the 2011 Second Eastern European Regional Conference on the Engineering of Computer Based Systems (ECBS-EERC ’11). IEEE Computer Society, Washington, DC, USA, 1-. (2011). doi: 10.1109/ECBS-EERC.2011.42
  33. 33.
    Somé, S. S., Cheng, X.: An approach for supporting system-level test scenarios generation from textual use cases. In: Proceedings of the 2008 ACM Symposium on Applied computing, pp. 724–729. ACM (2008, March)Google Scholar
  34. 34.
    Ulrich, A., Jell, S., Votintseva, A., Kull, A.: The ETSI Test Description Language TDL and its application. In: 2014 2nd International Conference on Model-Driven Engineering and Software Development (MODELSWARD), pp. 601–608. IEEE (2014, January)Google Scholar
  35. 35.
    What is the Benefit of a Model-Based Design of Embedded Software Systems in the Car Industry?Manfred Broy (Technical University Munich, Germany), Sascha Kirstan (Altran Technologies, Germany), Helmut Krcmar (Technical University Munich, Germany) and Bernhard Schätz (Technical University Munich, Germany). doi: 10.4018/978-1-61350-438-3.ch013
  36. 36.
    Zhang, M., Yue, T., Ali, S., Zhang, H., Wu, J.: A systematic approach to automatically derive test cases from use cases specified in restricted natural languages. In: Proceedings of the 8th International Conference on System Analysis and Modeling: Models and Reusability (SAM’14) (2014)Google Scholar

Copyright information

© Springer-Verlag GmbH Germany 2017

Authors and Affiliations

  • Nader Kesserwan
    • 1
    Email author
  • Rachida Dssouli
    • 1
  • Jamal Bentahar
    • 1
  • Bernard Stepien
    • 2
  • Pierre Labrèche
    • 3
  1. 1.Concordia Institute for Information Systems Engineering (CIISE)Concordia UniversityMontrealCanada
  2. 2.University of OttawaOttawaCanada
  3. 3.Esterline CMC ElectronicsMontrealCanada

Personalised recommendations