A First Step in the Design of a Formally Verified Constraint-Based Testing Tool: FocalTest

  • Matthieu Carlier
  • Catherine Dubois
  • Arnaud Gotlieb
Conference paper

DOI: 10.1007/978-3-642-30473-6_5

Volume 7305 of the book series Lecture Notes in Computer Science (LNCS)
Cite this paper as:
Carlier M., Dubois C., Gotlieb A. (2012) A First Step in the Design of a Formally Verified Constraint-Based Testing Tool: FocalTest. In: Brucker A.D., Julliand J. (eds) Tests and Proofs. TAP 2012. Lecture Notes in Computer Science, vol 7305. Springer, Berlin, Heidelberg

Abstract

Constraint-based test data generators rely on SMT or constraint solvers to automatically generate test data (e.g., Pex, Sage, Gatel, PathCrawler, Euclide). However, for some test data generation requests corresponding to particular test objectives, these tools may fail to deliver the expected test data because they focus on efficiency rather than soundness and completeness. We adopt an opposite view in the development of FocalTest, a test data generation tool for Focalize programs. The goal of the tool is to generate an MC/DC-compliant set of test data over the precondition of user-defined program properties. The development of such a correct-by-construction test data generator requires 1) to provide a formally verified translation of Focalize programs and properties into constraint systems; 2) to introduce a formally verified constraint solver able to solve those constraint systems. This paper is concerned with the first step only where we formally demonstrate with Coq the soundness of the translation of an intermediate functional language into a constraint system. This objective requires to formally define the operational semantics of the source language that features the manipulation of concrete data types via pattern-matching and function calls, constructions that are mirrored in the constraint language. Although such a semantics-oriented formalization is only a first step of a larger goal which is to provide a formally verified constraint-based testing tool, we argue that it is an important contribution to the building of more robust software testing tools.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Copyright information

© Springer-Verlag Berlin Heidelberg 2012

Authors and Affiliations

  • Matthieu Carlier
    • 1
  • Catherine Dubois
    • 1
    • 2
  • Arnaud Gotlieb
    • 3
  1. 1.CEDRIC-ENSIIEÉvryFrance
  2. 2.INRIAParisFrance
  3. 3.Certus V&V CenterSIMULA RESEARCH LAB.LysakerNorway