Abstract
The amalgamation of technologies in the information technology sector resulted in unprecedented growth in software reliability modelling in the past four decades. Over the period much attention has been given on developing a fault detection model and then considering fault correction as debugging processes as a complex process in which a detected fault may not immediately be corrected because of manipulation delays and some uncertainties. To overcome these issues academician and industrialists both are working hand in hand to find out the optimal software launch time by minimizing overall testing cost. Through this work, we have developed a unified framework for developing testing effort-based software reliability growth models to optimize the launch time of the software by minimizing the total cost incurred during the software lifecycle and considering fault detection and correction separately. Further, we have used multi-attribute utility theory by considering four attributes viz. cost, the ratio of detected and corrected faults, the ratio of the corrected and total number of faults, total effort utilized to establish the optimum software launch time. The recommended model is authenticated on a real-life software failure data set.
Similar content being viewed by others
References
Ahmad N, Khan MG, Rafi LS (2010) A study of testing-effort dependent inflection S-shaped software reliability growth models with imperfect debugging. Int J Qual Reliab Manag 27(1):89–110
Chatterjee S, Shukla A (2016) Modeling and analysis of software fault detection and correction process through Weibull-type fault reduction factor, change point and imperfect debugging. Arab J Sci Eng 41(12):5009–5025
Garmabaki AH, Aggarwal AG, Kapur PK, Yadavali VSS (2012) Modeling two-dimensional software multi-upgradation and related release problem (a multi-attribute utility approach). Int J Reliab Qual Saf Eng 19(03):1250012
Goel AL, Okumoto K (1979) Time-dependent error-detection rate model for software reliability and other performance measures. IEEE Trans Reliab 28:206–211
Huang CY (2005) Cost reliability optimal release policy for software reliability models incorporating improvements in testing efficiency. J Syst Softw 77:139–155
Huang CY, Lyu MR (2005) Optimal release time for software systems considering cost, testing effort, and testing efficiency. IEEE Trans Reliab 54(4):583–591
Huang CY, Lin CT (2006) Software reliability analysis by considering fault dependency and debugging time lag. IEEE Trans Reliab 55(3):436–450
Inoue S (2006) A study on stochastic modelling for accurate software reliability assessment. Doctoral dissertation, Ph.D. Thesis
Kapur PK, Garg RB (1989) Cost-reliability optimum release policies for software system under penalty cost. Int J Syst Sci 20:2547–2562
Kapur PK, Garg RB (1992) A software reliability growth model for an error removal phenomenon. Softw Eng J 7:291–294
Kapur PK, Shrivastava AK (2015) Release and testing stop time of a software: a new insight. In: 2015 4th International conference on reliability, Infocom technologies and optimization (ICRITO) (trends and future directions). IEEE, pp 1–7
Kapur PK, Garg RB, Bhalla VK (1993) Release policies with random software life cycle and penalty cost. Micro Electron Reliab 33(1):7–12
Kapur PK, Goswami DN, Bardhan A (2007) A general software reliability growth model with testing effort dependent learning process. Int J Model Simul 27(4):340–346
Kapur PK, Aggarwal AG, Anand S (2009a) A new insight into software reliability growth modeling. Int J Perform Eng 5(3):267–274
Kapur PK, Aggarwal AG, Garmabaki AS (2009b) Generalized framework for fault detection and correction processes for successive release of software. In: International conference on quality reliability and Infocom Technology. Narosa Publications, pp 252–263
Kapur PK, Pham H, Gupta A, Jha PC (2011a) Software reliability assessment with OR application. Springer, Berlin
Kapur PK, Pham H, Anand S, Yadav K (2011b) A unified approach for developing software reliability growth models in the presence of imperfect debugging and error generation. IEEE Trans Reliab 60(1):331–340
Kapur PK, Singh O, Singh JN, Shrivastava AK (2013) Software release time based on multi attribute utility theory. Commun Dependability Qual Manag 16(4):5–16
Kapur PK, Singh O, Shrivastava AK, Singh JN (2015) A software up-gradation model with testing effort and two types of imperfect debugging. In: 2015 International conference on futuristic trends on computational analysis and knowledge management (ABLAZE). IEEE, pp 613–618
Kapur PK, Mishra G, Shrivastava AK (2016) A generalized framework for modelling multi up-gradations of a software with testing effort and change point. In: 2016 International conference on innovation and challenges in cyber security (ICICCS-INBUSH). IEEE, pp 129–134
Kapur PK, Shrivastava AK, Singh O (2017) When to release and stop testing of a software. J Indian Soc Probab Stat 18(1):19–37
Khurshid S, Shrivastava AK, Iqbal J (2019) Effort based software reliability model with fault reduction factor, change point and imperfect debugging. Int J Inf Technol. https://doi.org/10.1007/s41870-019-00286-x
Kumar D, Gupta P (2019) Fuzzy software release problem with learning functions for fault detection and correction processes. In: Hoda M, Chauhan N, Quadri S, Srivastava P (eds) Software engineering. Advances in Intelligent Systems and Computing, vol 731. Springer, Singapore, pp 655–661
Kumar V, Kapur PK, Sahni R, Shrivastava AK (2018) Testing time and effort-based successive release modeling of a software in the presence of imperfect debugging. In: Quality, IT and business operations. Springer, Singapore, pp 421–434
Kuo SY, Huang CY, Lyu MR (2001) Framework for modeling software reliability, using various testing-efforts and fault-detection rates. IEEE Trans Reliab 50(3):310–321
Li X, Li YF, Xie M, Ng SH (2011) Reliability analysis and optimal version-updating for open source software. Inf Softw Technol 53(9):929–936
Li Q, Li H, Lu M (2015) Incorporating S-shaped testing-effort functions into NHPP software reliability model with imperfect debugging. J Syst Eng Electron 26(1):190–207
Lin CT (2011) Analyzing the effect of imperfect debugging on software fault detection and correction processes via a simulation framework. Math Comput Model 54(11–12):3046–3064
Lin CT, Huang CY, Jang JR (2005) Integrating generalized Weibull testing-effort function and multiple change-points into software reliability growth models. In: Proceedings of the 12th Asia-Pacific software engineering conference, Taipei, pp 431–438
Liu Y, Li D, Wang L, Hu Q (2016) A general modeling and analysis framework for software fault detection and correction process. Softw Test Verif Reliab 26(5):351–365
Lo J, Huang C (2006) An integration of fault detection and correction processes in software reliability analysis. J Syst Softw 79(9):1312–1323
Majumdar R, Shrivastava AK, Kapur PK, Khatri SK (2017) Release and testing stop time of a software using multi-attribute utility theory. Life Cycle Reliab Saf Eng 6(1):47–55
Minamino Y, Inoue S, Yamada S (2015) Multi-attribute utility theory for estimation of optimal release time and change-point. Int J Reliable Qual Saf Eng 22(04):1550019
Ohba M (1984) Inflection S-shaped software reliability growth model. In: Osaki S, Hatoyama Y (eds) Stochastic models in reliability theory, vol 235. Lecture notes in economics and mathematical systems. Springer, Berlin
Okumoto K, Goel AL (1979) Optimum release time for software systems based on reliability and cost criteria. J Syst Softw 1:315–318
Pachauri B, Kumar A, Dhar J (2014) Software reliability growth modeling with dynamic faults and release time optimization using GA and MAUT. Appl Math Comput 242:500–509
Pachauri B, Kumar A, Dhar J (2019) Reliability analysis of open source software systems considering the effect of previously released version. Int J Comput Appl 41(1):31–38
Peng R, Zhai Q (2017) Modeling of software fault detection and correction processes with fault dependency. Maint Reliab 19(3):467–475
Peng R, Li YF, Zhang WJ, Hu QP (2014) Testing effort dependent software reliability model for imperfect debugging process considering both detection and correction. Reliab Eng Syst Saf 126:37–43
Peng R, Li YF, Zhang JG, Li X (2015) A risk-reduction approach for optimal software release time determination with the delay incurred cost. Int J Syst Sci 46(9):1628–1637
Pham H (1996) A software cost model with imperfect debugging, random life cycle and penalty cost. Int J Syst Sci 27:455–463
Pham H (2003) Software reliability and cost models: perspectives, comparison, and practice. Eur J Oper Res 149(3):475–489
Pham H, Zhang X (1999a) A software cost model with warranty and risk costs. IEEE Trans Comput 48(1):71–75
Pham H, Zhang X (1999b) Software release policies with gain in reliability justifying costs. Ann Softw Eng 8:147–166
Schneidewind NF (1975) Analysis of error processes in computer software. ACM Sigplan Not 10(6):337–346
Schneidewind NF (2001a) Modelling the fault correction process, software reliability engineering 2001. In: 12th International symposium on ISSRE 2001. Proceedings, pp 185–190
Schneidewind NF (2001b) Modelling the fault correction process. In: Proceedings 12th international symposium on software reliability engineering. IEEE, pp 185–190
Shrivastava AK, Kapur PK (2018) Development of software reliability growth models with time lag and change-point and a new perspective for release time problem. Math Appl Inf Syst 2:34–52
Shrivastava AK, Sachdeva N (2019) Generalized software release and testing stop time policy. Int J Qual Reliab Manag. https://doi.org/10.1108/IJQRM-07-2019-0227
Shu Y, Liu H, Wu Z, Yang X (2009) Modeling of software fault detection and correction processes based on the correction lag. Inf Technol J 8:735–742
Singh O, Kapur PK, Shrivastava AK, Das L (2014) A unified approach for successive release of a software under two types of imperfect debugging. In: 2014 3rd International conference on reliability, Infocom technologies and optimization (ICRITO) (trends and future directions). IEEE, pp 1–6
Singh O, Kapur PK, Shrivastava AK, Kumar V (2015) Release time problem with multiple constraints. Int J Syst Assur Eng Manag 6(1):83–91
Tickoo A, Kapur PK, Shrivastava AK, Khatri SK (2016) Testing effort based modeling to determine optimal release and patching time of software. Int J Syst Assur Eng Manag 7(4):427–434
Ukimoto S, Dohi T (2013) A software cost model with reliability constraint under two operational scenarios. Int J Softw Eng Appl 7(3):236–239
Wang L, Hu Q, Liu J (2016a) Software reliability growth modeling and analysis with dual fault detection and correction processes. IIE Trans 48(4):359–370
Wang J, Wu Z, Shu Y, Zhang Z (2016b) An optimized method for software reliability model based on non homogeneous Poisson process. Appl Math Model 40(13–14):6324–6339
Wu YP, Hu QP, Xie M, Ng SH (2008) Modeling and analysis of software fault detection and correction process by considering time dependency. IEEE Trans Reliab 56(4):629–642
Xie M, Zhao M (1992) The Schneidewind software reliability model revisited. In: Proceedings of the 3rd Int’l symposium on software reliability engineering, research, Triangle Park, pp 184–192
Xie M, Yang B (2003) A study of the effect of imperfect debugging on software development cost. IEEE Trans Softw Eng 29(5):471–473
Xie M, Hu QP, Wu YP, Ng SH (2007) A study of the modeling and analysis of software fault-detection and fault-correction processes. Qual Reliab Eng Int 23:459–470
Yamada S, Osaki S (1987) Optimal software release policies with simultaneous cost and reliability requirements. Eur J Oper Res 31:46–51
Yamada S, Ohba M, Osaki S (1983) S-shaped reliability growth modeling for software error detection. IEEE Trans Reliab 32:475–478
Yamada S, Ohtera H, Narihisa H (1986) Software reliability growth models with testing-effort. Reliab IEEE Trans 35(1):19–23
Yamada S, Hishitani J, Osaki S (1993) Software-reliability growth with a Weibull test-effort: a model and application. IEEE Trans Reliab 42(1):100–106
Yang B, Hu H, Jia L (2008) A study of uncertainty in software cost and its impact on optimal software release time. IEEE Trans Softw Eng 34:813–825
Yang J, Liu Y, Xie M, Zhao M (2016) Modeling and analysis of reliability of multi-release open source software incorporating both fault detection and correction processes. J Syst Softw 115:102–110
Yi Z, Wen Y, Wu X (2019) Impacts of networking effects on software reliability growth processes: a multi-attribute utility theory approach. Qual Reliab Eng Int 35(6):1952–1972
Yun WY, Bai DS (1990) Optimum software release policy with random life cycle. IEEE Trans Reliab 39(2):167–170
Zhang X, Teng X, Pham H (2003) Considering fault removal efficiency in software reliability assessment. IEEE Trans Syst Man Cybern Part A 33(1):114–120
Zhang N, Cui G, Liu H (2013) Software reliability analysis using queuing-based model with testing effort. J Softw 8(6):1301–1307
Zhang J, Lu Y, Yang S, Xu C (2016) NHPP-based software reliability model considering testing effort and multivariate fault detection rate. J Syst Eng Electron 27(1):260–270
Zhao Q, Zheng J, Li J (2012) Software reliability modeling with testing-effort function and imperfect debugging. Telkomnika 10(8):1992–1998
Zhu M, Pham H (2018) A two-phase software reliability modeling involving with software fault dependency and imperfect fault removal. Comput Lang Syst Struct 53:27–42
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Choudhary, C., Kapur, P.K., Khatri, S.K. et al. Effort based release time of software for detection and correction processes using MAUT. Int J Syst Assur Eng Manag 11 (Suppl 2), 367–378 (2020). https://doi.org/10.1007/s13198-020-00955-2
Received:
Revised:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s13198-020-00955-2