Skip to main content

A Systematic Approach to Requirements Driven Test Generation for Safety Critical Systems

  • Conference paper
Model-Based Safety and Assessment (IMBSA 2014)

Part of the book series: Lecture Notes in Computer Science ((LNPSE,volume 8822))

Included in the following conference series:

Abstract

We describe ongoing work into the generation of test cases for safety critical systems using Event-B and the Rodin toolset. Verification of software to DO-178C is a two stage process. First a suite of test cases must be validated against the system requirements (requirements coverage), and then the software implementation is verified using the validated test suite. During verification of the implementation structural coverage is also measured.

Our work focuses on the first step, the generation of test cases and their validation against the requirements. We construct closed-system models incorporating both the system to be tested and its environment. These models capture the system requirements, and describe the interactions between the system and its environment. In particular, safety constraints can be represented by invariants, and their preservation ensured through event guards. From these models test cases can be generated, and requirements coverage can be measured from model coverage.

This document is an overview of MOD sponsored research and is released to inform projects that include safety-critical or safety-related software. The information contained in this document should not be interpreted as representing the views of the MOD, nor should it be assumed that it reflects any current or future MOD policy. The information cannot supersede any statutory or contractual requirements or liabilities and is offered without prejudice or commitment.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Abrial, J.-R.: The B-Book: Assigning Programs to Meanings. Cambridge University Press (1996)

    Google Scholar 

  2. Abrial, J.-R.: Modeling in Event-B: System and Software Engineering. Cambridge University Press (2010)

    Google Scholar 

  3. Abrial, J.-R., Butler, M., Hallerstede, S., Hoang, T.S., Mehta, F., Voisin, L.: Rodin: an open toolset for modelling and reasoning in Event-B. International Journal on Software Tools for Technology Transfer 12(6), 447–466 (2010)

    Article  Google Scholar 

  4. ADVANCE: D5.2 - ADVANCE Process Integration II (2013), http://www.advance-ict.eu/files/AdvanceD5.2.pdf

  5. Bernot, G., Gaudel, M.-C., Marre, B.: Software testing based on formal specifications: a theory and a tool. Software Engineering Journal 6(6), 387–405 (1991)

    Article  Google Scholar 

  6. Brucker, A., Wolff, B.: On theorem prover-based testing. Formal Aspects of Computing 25(5), 683–721 (2013)

    Article  MathSciNet  Google Scholar 

  7. Colley, J., Butler, M.: A formal, systematic approach to STPA using Event-B refinement and proof. In: Dale, C., Anderson, T. (eds.) Assuring the Safety of Systems: Proceedings of the 21st Safety-Critical Systems Symposium (2013)

    Google Scholar 

  8. Dinca, I., Ipate, F., Mierla, L., Stefanescu, A.: Learn and test for event-B – A rodin plugin. In: Derrick, J., Fitzgerald, J., Gnesi, S., Khurshid, S., Leuschel, M., Reeves, S., Riccobene, E. (eds.) ABZ 2012. LNCS, vol. 7316, pp. 361–364. Springer, Heidelberg (2012)

    Chapter  Google Scholar 

  9. Dinca, I., Ipate, F., Stefanescu, A.: Model learning and test generation for Event-B decomposition. In: Margaria, T., Steffen, B. (eds.) ISoLA 2012, Part I. LNCS, vol. 7609, pp. 539–553. Springer, Heidelberg (2012)

    Chapter  Google Scholar 

  10. Gaudel, M.-C.: Testing can be formal, too. In: Mosses, P.D., Nielsen, M., Schwartzbach, M.I. (eds.) CAAP 1995, FASE 1995, and TAPSOFT 1995. LNCS, vol. 915, pp. 82–96. Springer, Heidelberg (1995)

    Chapter  Google Scholar 

  11. Heimdahl, M., George, D., Weber, R.: Specification test coverage adequacy criteria = specification test generation inadequacy criteria? In: Proceedings Eighth IEEE International Symposium on High Assurance Systems Engineering, pp. 178–186 (2004)

    Google Scholar 

  12. Hoare, C.A.R.: An axiomatic basis for computer programming. Commun. ACM 12(10), 576–580 (1969)

    Article  Google Scholar 

  13. International Software Testing Qualifications Board: Advanced Level Syllabus: Test Analyst (2012)

    Google Scholar 

  14. Leuschel, M., Butler, M.: ProB: An automated analysis toolset for the B method. International Journal on Software Tools for Technology Transfer 10(2), 185–203 (2008)

    Article  Google Scholar 

  15. Leveson, N.G.: Engineering a Safer World: Systems Thinking Applied to Safety. The MIT Press (2011)

    Google Scholar 

  16. RTCA, Inc.: DO-178B, Software Considerations in Airborne Systems and Equipment Certification (December 1992)

    Google Scholar 

  17. RTCA, Inc.: DO-178C, Software Considerations in Airborne Systems and Equipment Certification (December 2011)

    Google Scholar 

  18. SAE International: ARP4754A, Guidelines for Development of Civil Aircraft and Systems (December 2010)

    Google Scholar 

  19. Snook, C., Butler, M.: UML-B: Formal modeling and design aided by UML. ACM Transactions on Software Engineering and Methodology 15(1), 92–122 (2006)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2014 Springer International Publishing Switzerland

About this paper

Cite this paper

Wilkinson, T., Butler, M., Colley, J. (2014). A Systematic Approach to Requirements Driven Test Generation for Safety Critical Systems. In: Ortmeier, F., Rauzy, A. (eds) Model-Based Safety and Assessment. IMBSA 2014. Lecture Notes in Computer Science, vol 8822. Springer, Cham. https://doi.org/10.1007/978-3-319-12214-4_4

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-12214-4_4

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-12213-7

  • Online ISBN: 978-3-319-12214-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics