Unit Testing Tool Competitions – Lessons Learned

  • Sebastian Bauersfeld
  • Tanja E. J. Vos
  • Kiran Lakhotia
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8432)

Abstract

This paper reports about the two rounds of the Java Unit Testing Tool Competition that ran in the context of the Search Based Software Testing (SBST) workshop at ICST 2013 and the first Future Internet Testing (FITTEST) workshop at ICTSS 2013. It describes the main objectives of the benchmark, the Java classes that were selected in both competitions, the data that was collected, the tools that were used for data collection, the protocol that was carried out to execute the benchmark and how the final benchmark scores for each participating tool were calculated. Eventually, we discuss the challenges encountered during the events, what we learned and how we plan to improve our framework for future competitions.

Keywords

Benchmark Mutation testing Automated unit testing 

Copyright information

© Springer International Publishing Switzerland 2014

Authors and Affiliations

  • Sebastian Bauersfeld
    • 1
  • Tanja E. J. Vos
    • 1
  • Kiran Lakhotia
    • 2
  1. 1.Centro de Métodos de Producción de Software (ProS)Universidad Politécnica de ValenciaValenciaSpain
  2. 2.University College LondonLondonUK

Personalised recommendations