Modelling Failures Occurrences of Open Source Software with Reliability Growth

  • Bruno Rossi
  • Barbara Russo
  • Giancarlo Succi
Part of the IFIP Advances in Information and Communication Technology book series (IFIPAICT, volume 319)

Abstract

Open Source Software (OSS) products are widely used although a general consensus on their quality is far to be reached. Providing results on OSS reliability - as quality indicator – contributes to shed some light on this issue and allows organizations to make informed decisions in adopting OSS products or in releasing their own OSS. In this paper, we use a classical technique of Software Reliability Growth to model failures occurrences across versions. We have collected data from the bug tracking systems of three OSS products, Mozilla Firefox, OpenSuse and OpenOffice.org. Our analysis aims at determining and discussing patterns of failure occurrences in the three OSS products to be used to predict reliability behaviour of future releases. Our findings indicate that in the three cases, failures occurrences follow a predetermined pattern, which shows: a) an initial stage in which the community learns the new version b) after this first period a rapid increase of the failure detection rate until c) very few failures are left and the discovery of a new failure discovery is rare. This is the stage in which the version can be considered reliable.

Keywords

Software failures software reliability growth open source software 

References

  1. 1.
    Antoniol, G., Ayari, K., Di Penta, M., Khomh, F., Guéhéneuc, Y.: Is it a bug or an enhancement?: a text-based approach to classify change requests. In: CASCON 2008, vol. 23 (2008)Google Scholar
  2. 2.
    Bassin, K., Santhanam, P.: Use of software triggers to evaluate software process effectiveness and capture customer usage profiles. In: Eighth International Symposium on Software Reliability Engineering, Case Studies, pp. 103–114. IEEE Computer Society, Los Alamitos (1997)CrossRefGoogle Scholar
  3. 3.
    Draper, N.R., Smith, H.: Applied Regression Analysis. Wiley- Interscience, Chichester (1998)MATHGoogle Scholar
  4. 4.
    Fenton, N., Neil, M.: A Critique of Software Defect Prediction Models. IEEE Transactions on Software Engineering 25(5), 675–689 (1999)CrossRefGoogle Scholar
  5. 5.
    Godfrey, M.W., Whitehead, J.: Proceedings of the 2009 6th IEEE International Working Conference on Mining Software Repositories, Vancouver Canada, May 16-17 (2009)Google Scholar
  6. 6.
    Li, P.L., Herbsleb, J., Shaw, M.: Forecasting field defect rates using a combined timebased and metrics-based approach: a case study of OpenBSD. In: 16th IEEE International Symposium on Software Reliability Engineering (ISSRE), pp. 10–19 (2005)Google Scholar
  7. 7.
    Li, P.L., Herbsleb, J., Shaw, M.: Finding Predictors of Field Defects for Open Source Software Systems in Commonly Available Data Sources: a Case Study of OpenBSD. In: 11th IEEE International Symposium on Software Metrics (2005)Google Scholar
  8. 8.
    Li, P.L., Shaw, M., Herbsleb, J., Ray, B., Santhanam, P.: Empirical evaluation of defect projection models for widely-deployed production software systems. In: Proceedings of the twelfth international symposium on Foundations of software engineering, pp. 263–272 (2004)Google Scholar
  9. 9.
    Li, P.L., Shaw, M., Herbsleb, J.: Selecting a defect prediction model for maintenance resource planning and software insurance. In: Proceedings of the Fifth International Workshop on Economics-driven Software Engineering Research, Oregon, USA (2003)Google Scholar
  10. 10.
    Lyu, M.R.: Handbook of Software Reliability Engineering. McGraw-Hill, New York (1996)Google Scholar
  11. 11.
    Musa, J.D., Iannino, A., Okumoto, K.: Software Reliability: Measurement, Prediction, Application. McGraw-Hill, New York (1989)Google Scholar
  12. 12.
    Rahmani, C., Siy, H., Azadmanesh, A.: An Experimental Analysis of Open Source Software Reliability. In: F2DA 2009 Workshop on 28th IEEE Symposium on Reliable Distributed Systems, Niagara Falls (2009)Google Scholar
  13. 13.
    Rigdon, S.E., Basu, A.P.: Statistical Methods for the Reliability of Repairable systems, p. 281. Wiley and Sons, Chichester (2000)MATHGoogle Scholar
  14. 14.
    Succi, G., Pedrycz, W., Stefanovic, M., Russo, B.: An Investigation on the Occurrence of Service Requests in Commercial Software Applications. Empirical Software Engineering Journal 8(2), 197–215 (2003)CrossRefGoogle Scholar
  15. 15.
    Tamura, Y., Yamada, S.: Comparison of Software Reliability Assessment Methods for Open Source Software. In: 11th International Conference on Parallel and Distributed Systems - Workshops (ICPADS 2005), vol. 2, pp. 488–492 (2005)Google Scholar
  16. 16.
    Wood, A.: Predicting software reliability. Computer 29(11), 69–77 (1996)CrossRefGoogle Scholar
  17. 17.
    Yamada, S., Ohba, M., Osaki, S.: S-Shaped Reliability Growth Modeling for Software Error Detection. IEEE Transactions on Reliability, 475–484 (December 1983)Google Scholar
  18. 18.
    Zhou, Y., Davis, J.: Open Source Software Reliability Model: an empirical approach. In: International Conference on Software Engineering: Proceedings of the fifth workshop on Open Source Software Engineering, St. Louis, MO (2005)Google Scholar

Copyright information

© IFIP 2010

Authors and Affiliations

  • Bruno Rossi
    • 1
  • Barbara Russo
    • 1
  • Giancarlo Succi
    • 1
  1. 1.CASE – Center for Applied Software EngineeringFree University of Bolzano-BozenBolzanoItaly

Personalised recommendations