Using Functional Defect Analysis as an Input for Software Process Improvement: Initial Results

  • Tanja Toroi
  • Anu Raninen
  • Hannu Vainio
Part of the Communications in Computer and Information Science book series (CCIS, volume 301)


In this paper we present how functional defect analysis can be applied for software process improvement (SPI) purposes. Software defect data is shown to be one of the most important available management information sources for SPI decisions. Our preliminary analysis with three software companies’ defect data (11653 defects in total) showed that 65% of all the defects are functional defects. To better understand this mass, we have developed a detailed scheme for functional defect classification. Applying our scheme, defects can be classified with accuracy needed to generate practical results. The presented scheme is at initial stages of validation and has been tested with one software company’s defect data consisting of 1740 functional defects. Based on the classification we were able to provide the case organization with practical improvement suggestions.


functional defects defect data analysis process improvement 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Vinter, O.: Experience-Based Approaches to Process Improvement. In: Proceedings of the 13th International Software Quality Week, San Francisco, USA (2000) Google Scholar
  2. 2.
    Grady, R.B.: Practical software metrics for project management and process improvement. Prentice Hall, New Jersey (1992)Google Scholar
  3. 3.
    Fredericks, M., Basili, V.: Using Defect Tracking and Analysis to Improve Software Quality. DoD Data & Analysis Center for Software (DACS) (1998) Google Scholar
  4. 4.
    El Emam, K., Wieczorek, I.: The repeatability of code defect classifications. In: Proceedings of the Ninth International Symposium on Software Reliability Engineering, pp. 322–333 (1998) Google Scholar
  5. 5.
    Bhandari, I., Halliday, M.J., Chaar, J., Chillarege, R., Jones, K., Atkinson, J.S., Lepori-Costello, C., Jasper, P.Y., Tarver, E.D., Lewis, C.C., Yonezawa, M.: In-process improvement through defect data interpretation. IBM Systems Journal 33(1), 182–214 (1994)CrossRefGoogle Scholar
  6. 6.
    Freimut, B.: Developing and using defect classification schemes. Fraunhofer IESE IESE-Report No. 72 (2001) Google Scholar
  7. 7.
    IEEE standard classification for software anomalies. IEEE Std 1044-2009 (Revision of IEEE Std 1044-1993), pp. C1–C15, 7 (2010) Google Scholar
  8. 8.
    Chillarege, R., Bhandari, I., Chaar, J., Halliday, M., Moebus, D., Ray, B., Wong, M.-Y.: Orthogonal defect classification – a concept for in-process measurements. IEEE Transactions on Software Engineering 18(11), 943–956 (1992)CrossRefGoogle Scholar
  9. 9.
    Beizer, B.: Software Testing Techniques. International Thomson Computer Press (1990) Google Scholar
  10. 10.
    Humphrey, W.: A discipline for software engineering. Addison-Wesley (2007) Google Scholar
  11. 11.
    Raninen, A., Toroi, T., Vainio, H., Ahonen, J.J.: Defect Data Analysis as Input for Software Process Improvement. In: TBP 13th International Conference on Product-Focused Software Development and Process Improvement, PROFES 2012 (2012) Google Scholar
  12. 12.
    Cockburn, A., Williams, L.: The Costs and Benefits of Pair Programming. In: Succi, G., Marchesi, M. (eds.) Extreme Programming Examined, pp. 223–243 (2001)Google Scholar
  13. 13.
    Gilb, T., Graham, D.: Software inspection. Addison-Wesley, Great Britain (1993)Google Scholar
  14. 14.
    Dustin, E., Rashka, J., Paul, J.: Automated Software Testing: Introduction, Management, and Performance. Addison-Wesley (1999)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2012

Authors and Affiliations

  • Tanja Toroi
    • 1
  • Anu Raninen
    • 1
    • 2
  • Hannu Vainio
    • 1
  1. 1.School of ComputingUniversity of Eastern FinlandKuopioFinland
  2. 2.Lero – The Irish Software Engineering Research CentreUniversity of LimerickIreland

Personalised recommendations