Benchmarking finite-state verifiers

  • George S. Avrunin
  • James C. Corbett
  • Matthew B. Dwyer
The opinion corner

Abstract.

A variety of largely automated methods have been proposed for finite-state verification of computer systems. Although anecdotal accounts of success are widely reported, there is very little empirical data on the relative strengths and weaknesses of those methods across a broad range of analysis questions and systems. This information, however, is critical for the transfer of the technology from research to practice. We review some of the problems involved in obtaining this information and suggest several ways in which the community can facilitate empirical evaluation of finite-state verification tools.

Key words: Finite-state verification – Benchmarking – Empirical evaluation – Model checking 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Copyright information

© Springer-Verlag Berlin Heidelberg 2000

Authors and Affiliations

  • George S. Avrunin
    • 1
  • James C. Corbett
    • 2
  • Matthew B. Dwyer
    • 3
  1. 1.Department of Mathematics and Statistics, University of Massachusetts, Amherst, MA 01003-4515, USA; E-mail: avrunin@math.umass.eduUS
  2. 2.Department of Information and Computer Science, University of Hawaii, Honolulu, HI 96822, USA; E-mail: corbett@hawaii.eduUS
  3. 3.Department of Computing and Information Sciences, Kansas State University, Manhattan, KS 66506-2302, USA; E-mail: dwyer@cis.ksu.eduUS

Personalised recommendations