Skip to main content
SpringerLink
Log in

Effect of change in environment on reliability growth modeling integrating fault reduction factor and change point: a general approach

  • Original Research
  • Published:
Annals of Operations Research Aims and scope Submit manuscript

Abstract

This paper presents a generalized software reliability modeling framework that predominantly encompasses randomness of field environment, fault reduction factor (FRF), and change point to study their simultaneous effect on software bug removal process. To address and capture unpredicted randomness of the field environment in testing phase it is assumed that the environment before and after a change point may not be the same and therefore there is a need to consider distinct environment factors before and after the change point in the modeling of bug removal action. Based on the general approach, three new change point-based software reliability growth models (SRGMs) are proposed incorporating time-dependent exponentiated Weibull (EW) FRF and distinct random environment distributions. To elaborate, in SRGM-I and SRGM-II, a steady environment is supposed before the change point whereas one-parameter exponential environment is assumed after the change point in SRGM-I and a two-parameter Gamma environment is considered after the change point in SRGM-II while in SRGM-III, exponential environment before change point and Gamma environment after change point are taken into consideration. In addition, a few established FRF-based models are deduced from the proposed general approach. Estimation of parameters of proposed SRGMs is carried out in two phases using three real test data sets and their validation is evaluated through several performance measures including coefficient of determination, mean square error, bias, variation, root mean square prediction error and Akaike information criteria. Fitting of the models to the datasets is also examined in related goodness of fit curves. Further, numerical illustration is worked out to conduct a cost-reliability assessment and suggest optimum release time.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15

Similar content being viewed by others

Notes

  1. Change point is assumed to occur where sudden change in the slope of the tangent to the \({m_r}(t)\)curve is observed.

References

  • Aggarwal, A. G., Dhaka, V., & Nijhawan, N. (2017). Reliability analysis for multi-release open-source software systems with change point and exponentiated Weibull fault reduction factor. Life Cycle Reliability and Safety Engineering, 6(1), 3–14.

    Article  Google Scholar 

  • Aggarwal, A. G., Dhaka, V., Nijhawan, N., & Tandon, A. (2019). Reliability growth analysis for multi-release open source software systems with change point. System Performance and Management Analytics, 125–137.

  • Akaike, H. (1974). A new look at the statistical model identification. IEEE Transactions on Automatic Control, 19(6), 716–723.

    Article  Google Scholar 

  • Chatterjee, S., Nigam, S., Singh, J. B., & Upadhyaya, L. N. (2012). Effect of change point and imperfect debugging in software reliability and its optimal release policy. Mathematical and Computer Modelling of Dynamical Systems, 18(5), 539–551.

    Article  Google Scholar 

  • Chatterjee, S., & Shukla, A. (2016). Modeling and analysis of software fault detection and correction process through Weibull-type fault reduction factor, change point and imperfect debugging. Arabian Journal for Science and Engineering, 41(12), 5009–5025.

    Article  Google Scholar 

  • Goel, A. L., & Okumoto, K. (1979). Time-dependent error-detection rate model for software reliability and other performance measures. IEEE Transactions on Reliability, 28(3), 206–211.

    Article  Google Scholar 

  • Hsu, C. J., Huang, C. Y., & Chang, J. R. (2011). Enhancing software reliability modeling and prediction through the introduction of time-variable fault reduction factor. Applied Mathematical Modelling, 35(1), 506–521.

    Article  Google Scholar 

  • Huang, C. Y. (2005). Cost-reliability-optimal release policy for software reliability models incorporating improvements in testing efficiency. Journal of Systems and Software, 77(2), 139–155.

    Article  Google Scholar 

  • Huang, C. Y., & Hung, T. Y. (2010). Software reliability analysis and assessment using queueing models with multiple change-points. Computers and Mathematics with Applications, 60, 2015–2030.

    Article  Google Scholar 

  • Inoue, S., Ikeda, J., & Yamada, S. (2016). Bivariate change-point modeling for software reliability assessment with uncertainty of testing-environment factor. Annals of Operations Research, 244(1), 209–220.

    Article  Google Scholar 

  • Inoue, S., & Yamada, S. (2015). Software reliability assessment with multiple changes of testing-environment. IEICE Transactions on Fundamentals of Electronics Communications and Computer Sciences, 98(10), 2031–2041.

    Article  Google Scholar 

  • Inoue, S., & Yamada, S. (2018). Markovian software reliability modeling with change-point. International Journal of Reliability Quality and Safety Engineering, 25(02), 1850009.

    Article  Google Scholar 

  • Inoue, S., & Yamada, S. (2020). Markovian multiple change-point modeling for software reliability assessment. International Journal of Reliability Quality and Safety Engineering, 27(06), 2050017.

    Article  Google Scholar 

  • Inoue, S., & Yamada, S. (2021). Software shipping time estimation for Markovian change-point reliability model. International Journal of Reliability Quality and Safety Engineering, 28(03), 2150021.

    Article  Google Scholar 

  • Jain, M., Manjula, T., & Gulati, T. R. (2014). Imperfect debugging study of SRGM with fault reduction factor and multiple change point. International Journal of Mathematics in Operational Research, 6(2), 155–175.

    Article  Google Scholar 

  • Kapur, P. K., Panwar, S., Singh, O., & Kumar, V. (2019). Joint optimization of software time-to-market and testing duration using multi-attribute utility theory. Annals of Operations Research, 312, 1–28.

    Google Scholar 

  • Kapur, P. K., Pham, H., Gupta, A., & Jha, P. C. (2011). Software reliability assessment with OR applications. Springer.

    Book  Google Scholar 

  • Lin, C. T. (2011). Analyzing the effect of imperfect debugging on software fault detection and correction processes via a simulation framework. Mathematical and Computer Modelling, 54(11–12), 3046–3064.

    Article  Google Scholar 

  • Liu, Y., Li, D., Wang, L., & Hu, Q. (2016). A general modeling and analysis framework for software fault detection and correction process. Journal of Software: Testing Verification and Reliability, 26(5), 351–365.

    Google Scholar 

  • Minamino, Y., Inoue, S., & Yamada, S. (2016). NHPP-based change-point modeling for software reliability assessment and its application to software development management. Annals of Operations Research, 244(1), 85–101.

    Article  Google Scholar 

  • Musa, J. D. (1975). A theory of software reliability and its application. IEEE Transactions on Software Engineering, 1(03), 312–327.

    Article  Google Scholar 

  • Musa, J. D., Iannino, A., & Okumoto, K. (1987). Software reliability: Measurement, prediction application. NY: McGraw Hill.

    Google Scholar 

  • Nijhawan, N., Aggarwal, A. G., & Dhaka, V. (2018). An SRGM for multi-release open source software system. International Journal of Innovation and Technology Management, 15(02), 1850011.

    Article  Google Scholar 

  • Nijhawan, N., & Dhaka, V. (2022). Software reliability modeling and assessment integrating time dependent fault reduction factor in random environment. Optimization models in Software Reliability (pp. 135–158). Cham: Springer.

    Chapter  Google Scholar 

  • Nijhawan, N., & Aggarwal, A. G. (2015). On development of change point based Generalized SRGM for software with multiple releases. In Published in the proceedings of IEEE 4th international conference on reliability, Infocom Technologies and Optimization (ICRITO) at Amity Institute of Information Technology, 1–6.

  • Ohba, M. (1984). Inflection S-shaped software reliability growth model. Stochastic models in reliability theory (pp. 144–162). Springer.

    Chapter  Google Scholar 

  • Pachauri, B., Dhar, J., & Kumar, A. (2015). Incorporating inflection S-shaped fault reduction factor to enhance software reliability growth. Applied Mathematical Modelling, 39(5–6), 1463–1469.

    Article  Google Scholar 

  • Paul, S. R., & Thiagarajah, K. (1992). Multi-sample test of equal Gamma distribution scale parameters in presence of unknown common shape parameter. Communications in statistics-theory and methods, 21(6), 1633–1650.

    Article  Google Scholar 

  • Peng, R., Li, Y. F., Zhang, W. J., & Hu, Q. P. (2014). Testing effort dependent software reliability model for imperfect debugging process considering both detection and correction. Reliability Engineering and System Safety, 126, 37–43.

    Article  Google Scholar 

  • Pham, H. (2006). System software reliability reliability Engineering Series. Springer.

    Book  Google Scholar 

  • Pham, H. (2013). Loglog fault-detection rate and testing coverage software reliability models subject to random environments. Vietnam Journal of Computer Science, 1, 39–45.

    Article  Google Scholar 

  • Pham, H. (2014). A new software reliability model with vtub-shaped fault detection rate and the uncertainty of operating environments. Optimization, 63(10), 1481–1490.

    Article  Google Scholar 

  • Pham, H. (2016). A generalized fault-detection software reliability model subject to random operating environments. Vietnam Journal of Computer Science, 3(3), 145–150.

    Article  Google Scholar 

  • Pillai, K., Nair, V. S., & S (1997). A model for software development effort and cost estimation. IEEE Transactions on Software Engineering, 23(8), 485–497.

    Article  Google Scholar 

  • Song, K. Y., Chang, I. H., & Pham, H. (2017a). A three-parameter fault-detection software reliability model with the uncertainty of operating environments. Journal of Systems Science and Systems Engineering, 26, 121–132.

    Article  Google Scholar 

  • Song, K. Y., Chang, I. H., & Pham, H. (2017b). An NHPP software reliability model with S-shaped growth curve subject to random operating environments and optimal release time. Applied Sciences, 7, 1304.

    Article  Google Scholar 

  • Song, K. Y., Chang, I. H., & Pham, H. (2018). Optimal release time and sensitivity analysis using a new NHPP software reliability model with probability of fault removal subject to operating environments. Applied Sciences, 8(5), 714.

    Article  Google Scholar 

  • Song, K. Y., Chang, I. H., & Pham, H. (2019). NHPP software reliability model with inflection factor of the fault detection rate considering the uncertainty of software operating environments and predictive analysis. Symmetry, 11(521), 1–21.

    Google Scholar 

  • Teng, X. L., & Pham, H. (2006). A new methodology for predicting software reliability in the random field environments. IEEE Transactions on Reliability, 55(3), 458–468.

    Article  Google Scholar 

  • Tjur, T. (2009). Coefficients of determination in logistic regression models - a new proposal: the coefficient of discrimination. American Statistician, 63(4), 366–372.

    Article  Google Scholar 

  • Xie, M. (1991). Software reliability modelling (1st ed.). World Scientific.

    Book  Google Scholar 

  • Xie, M., Hu, Q. P., Wu, Y. P., & NgS. H (2007). A study of the modeling and analysis of software fault-detection and fault-correction processes. Quality and Reliability Engineering International, 23, 459–470.

    Article  Google Scholar 

  • Yamada, S. (2014). Software reliability modeling: fundamentals and applications (Vol. 5). Springer.

    Book  Google Scholar 

  • Yamada, S., Tokuno, K., & Osaki, S. (1992). Imperfect debugging models with fault introduction rate for software reliability assessment. International Journal of Systems Science, 23(12), 2241–2252.

    Article  Google Scholar 

  • Yang, J., Liu, Y., Xie, M., & Zhao, M. (2016). Modeling and analysis of reliability of multi-release open source software incorporating both fault detection and correction processes. Journal of Systems and Software, 115, 102–110.

    Article  Google Scholar 

  • Youngren, M. A. (1991). Dependence in target element detections induced by the environment. Naval Research Logistics (NRL), 38(4), 567–577.

    Article  Google Scholar 

  • Zachariah, B. (2015). Optimal stopping time in software testing based on failure size approach. Annals of Operations Research, 235(1), 771–784.

    Article  Google Scholar 

  • Zhang, X., & Pham, H. (2000). An analysis of factors affecting software reliability. Journal of Systems and Software, 50(1), 43–56.

    Article  Google Scholar 

  • Zhu, M., & Pham, H. (2018). A software reliability model incorporating martingale process with gamma-distributed environmental factors. Annals of Operations Research. https://doi.org/10.1007/s10479-018-2951-7

    Article  Google Scholar 

  • Zhu, M., & Pham, H. (2020). A generalized multiple environmental factors software reliability model with stochastic fault detection process. Annals of Operations Research, 311, 1–22.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Daulat Ram College, University of Delhi, Delhi, India

    Vikas Dhaka

  2. Shaheed Rajguru College of Applied Sciences for Women, University of Delhi, Delhi, India

    Nidhi Nijhawan

Authors
  1. Vikas Dhaka
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Nidhi Nijhawan
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Nidhi Nijhawan.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Dhaka, V., Nijhawan, N. Effect of change in environment on reliability growth modeling integrating fault reduction factor and change point: a general approach. Ann Oper Res (2022). https://doi.org/10.1007/s10479-022-05084-6

Download citation

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s10479-022-05084-6

Keywords

Search

Navigation