Empirical Software Engineering

, Volume 21, Issue 4, pp 1437–1475

Using text clustering to predict defect resolution time: a conceptual replication and an evaluation of prediction accuracy

Article

DOI: 10.1007/s10664-015-9391-7

Cite this article as:
Assar, S., Borg, M. & Pfahl, D. Empir Software Eng (2016) 21: 1437. doi:10.1007/s10664-015-9391-7

Abstract

Defect management is a central task in software maintenance. When a defect is reported, appropriate resources must be allocated to analyze and resolve the defect. An important issue in resource allocation is the estimation of Defect Resolution Time (DRT). Prior research has considered different approaches for DRT prediction exploiting information retrieval techniques and similarity in textual defect descriptions. In this article, we investigate the potential of text clustering for DRT prediction. We build on a study published by Raja (2013) which demonstrated that clusters of similar defect reports had statistically significant differences in DRT. Raja’s study also suggested that this difference between clusters could be used for DRT prediction. Our aims are twofold: First, to conceptually replicate Raja’s study and to assess the repeatability of its results in different settings; Second, to investigate the potential of textual clustering of issue reports for DRT prediction with focus on accuracy. Using different data sets and a different text mining tool and clustering technique, we first conduct an independent replication of the original study. Then we design a fully automated prediction method based on clustering with a simulated test scenario to check the accuracy of our method. The results of our independent replication are comparable to those of the original study and we confirm the initial findings regarding significant differences in DRT between clusters of defect reports. However, the simulated test scenario used to assess our prediction method yields poor results in terms of DRT prediction accuracy. Although our replication confirms the main finding from the original study, our attempt to use text clustering as the basis for DRT prediction did not achieve practically useful levels of accuracy.

Keywords

Defect resolution time Prediction Text mining Data clustering Independent replication Simulation 

Copyright information

© Springer Science+Business Media New York 2015

Authors and Affiliations

  1. 1.Ecole de ManagementInstitut Mines-TelecomEvryFrance
  2. 2.Department of Computer ScienceLund UniversityLundSweden
  3. 3.Institute of Computer ScienceUniversity of TartuTartuEstonia

Personalised recommendations