From testing theory to test driver implementation

  • Jan Peleska
  • Michael Siegel
Session 8: Testing and Debugging
Part of the Lecture Notes in Computer Science book series (LNCS, volume 1051)


In this article we describe the theoretical foundations for the VVT-RT test system (Verification, Validation and Test for Reactive Real-Time Systems) which supports automated test generation, test execution and test evaluation for reactive systems. VVT-RT constructs and evaluates tests based on formal CSP specifications [6], making use of their representation as labelled transition systems generated by the CSP model checker FDR [3]. The present article provides a sound formal basis for the development and verification of high-quality test tools: Since, due to the high degree of automation offered by VVT-RT, human interaction becomes superfluous during critical phases of the test process, the trustworthiness of the test tool is an issue of great importance. The VVT-RT system will therefore be formally verified so that it can be certified for testing safety-critical systems. The present article represents the starting point of this verification suite, where the basic strategies for test generation and test evaluation used by the system are formally described and verified. VVT-RT has been designed to support automation of both untimed and real-time tests. The present article describes the underlying theory for the untimed case. Exploiting these results, the concepts and high-level algorithms used for the automation of real-time tests are described in a second report which is currently prepared [14]. At present, VVT-RT is applied for hardware-in-the-loop tests of railway and tramway control computers.


CSP FDR may tests must tests reactive systems refinement test evaluation test generation 


  1. 1.
    E. Brinksma: A theory for the derivation of tests. In P. H. J. van Eijk, C. A. Vissers and M. Diaz (Eds.): The Formal Description Technique LOTOS. Elsevire Science Publishers B. V. (North-Holland), (1989), 235–247.Google Scholar
  2. 2.
    ELPRO LET GmbH: Programmablaufplan — Bahnübergang. ELPRO LET GmbH (1994).Google Scholar
  3. 3.
    Formal Systems Ltd.: Failures Divergence Refinement. User Manual and Tutorial Version 1.4. Formal Systems (Europe) Ltd (1994).Google Scholar
  4. 4.
    M.-C. Gaudel: Testing can be formal, too. In P. D. Mosses, M. Nielsen and M. I. Schwartzbach (Eds.): Proceedings of TAPSOFT '95: Theory and Practice of Software Development. Aarhus, Denmark, May 1995, Springer (1995).Google Scholar
  5. 5.
    M. C. Hennessy: Algebraic Theory of Processes. MIT Press (1988).Google Scholar
  6. 6.
    C.A.R. Hoare. Communicating sequential processes. Prentice-Hall International, Englewood Cliffs NJ (1985).Google Scholar
  7. 7.
    H. M. Hörcher and J. Peleska: The Role of Formal Specifications in Software Test. Tutorial, held at the FME '94.Google Scholar
  8. 8.
    H. M. Hörcher: Improving Software Tests using Z Specifications. To appear in J. P. Bowen and M. G. Hinchey (Eds.): ZUM '95: 9th International Conference of Z Users, LNCS, Springer (1995).Google Scholar
  9. 9.
    E. Mikk: Compilation of Z Specifications into C for Automatic Test Result Evaluation. To appear in J. P. Bowen and M. G. Hinchey (Eds.): ZUM '95: 9th International Conference of Z Users, LNCS, Springer (1995).Google Scholar
  10. 10.
    R. Milner: Communication and Concurrency. Prentice-Hall International, Englewood Cliffs NJ (1989).Google Scholar
  11. 11.
    M. Müllerburg: Systematic Testing: a Means for Validating Reactive Systems. In EuroSTAR'94: Proceedings of the 2nd European Intern. Conf. on Software Testing, Analysis&Review. British Computer Society, (1994).Google Scholar
  12. 12.
    J. Peleska: Bahnübergangssteuerung Straβenbahn — ELPRO LET GmbH: Prüfspezifikation für formale Verifikation und automatisierte Testdurchführung. JP Software-Consulting (1994).Google Scholar
  13. 13.
    J. Peleska: Bahnübergangssteuerung Straβenbahn — ELPRO LET GmbH: Sicherheitsspezifikation und BUE-Spezifikation. JP Software-Consulting (1994).Google Scholar
  14. 14.
    J. Peleska: Trustworthy Tests for Reactive Systems — Automation of Real-Time Testing. In preparation, JP, Software-Consulting (1995).Google Scholar
  15. 15.
    J. Peleska and M. Siegel: From Testing Theory to Test Driver Implementation. Technical Report, JP Software-Consulting (1995).Google Scholar
  16. 16.
    J. Peleska: Test Automation for Safety-Critical Systems: Industrial Application and Future Developments. To appear in Proceedings of the Formal Methods Europe Conference, FME '96., LNCS, Springer (1996).Google Scholar
  17. 17.
    A. W. Roscoe and G. Barret: Unbounded Nondeterminism in CSP. In MFPS '89, volume LNCS 298, Springer-Verlag, (1989).Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 1996

Authors and Affiliations

  • Jan Peleska
    • 1
    • 2
  • Michael Siegel
    • 1
    • 2
  1. 1.JP Software-ConsultingKiel
  2. 2.Institut für Informatik und Praktische MathematikChristian-Albrechts-Universität zu KielKielGermany

Personalised recommendations