Abstract
Quantitative process management (QPM) and causal analysis and resolution (CAR) are requirements of capability maturity model (CMM) levels 4 and 5, respectively. They indicate the necessity of process improvement based on objective evidence obtained from statistical analysis of metrics. However, it is difficult to achieve these requirements in practice, and only a few companies have done so successfully. Evidence-based risk-management methods have been proposed for the control of software processes, but are not fully appreciated, compared to clinical practice in medicine. Furthermore, there is no convincing answer as to why these methods are difficult to incorporate in software processes, despite the fact that they are well established in some business enterprises and industries. In this article, we challenge this issue, point out a problem peculiar to software processes, and develop a generally applicable method for identifying the risk of failure for a project in its early stages. The proposed method is based on statistical analyses of process measurements collected continuously throughout a project by a risk assessment and tracking system (RATS). Although this method may be directly applicable to only a limited number of process types, the fundamental idea might be useful for a broader range of applications.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Barnett, V. (1998). Multivariate outliers. In P. Armitage & T. Colton (Eds.), Encyclopedia of biostatistics, vol. 4 (pp. 2920–2926). New York: Wiley.
Bieman, J. (2004). The role of prognostication in software design. Software Quality Journal, 12, 7–8.
De Lacalle, L. N. L., Lamikiz, A., Salgado, M. A., Herranz, S., & Rivero, A. (2002). Process planning for reliable high-speed machining of moulds. International Journal of Production Research, 40, 2789–2809.
Ellis, R. C. T., Wood, G. D., & Thorpe, T. (2004). Technology-based learning and the project manager. Engineering, Construction and Architectural Management, 11, 358–365.
Hirayama, M., Mizuno, O., & Kikuno, T. (2004). Test item prioritizing metrics for selective software testing. IEICE Transactions on Information and Systems, E87-D, 2733–2743.
Hosmer, D. W., & Lemeshow, S. (1989). Applied logistic regression. New York: Wiley.
Ingham, M. D., Rasmussen, R. D., Bennett, M. B., & Moncada, A. C. (2005). Engineering complex embedded systems with state analysis and the mission data system. Journal of Aerospace Computing, Information and Communication, 2, 507–536.
JMP Statistics Software. (2006). SAS Institute, Cary, NC, USA. http://www.jmp.com/
Kang, B., Kwon, Y.-J., & Lee, R. Y. (2005). A design and test technique for embedded software. Proceedings – Third ACIS International Conference on Software Engineering Research, Management and Applications, SERA 2005, No. 1563157, 160–165.
Khoshgoftaar, T. M., Seliya, N., & Sundaresh, N. (2006). An empirical study of predicting software faults with case-based reasoning. Software Quality Journal, 14, 85–111.
Khoshgoftaar, T. M., Szabo, R. M., & Woodcock, T. G. (1994). An empirical study of program quality during testing and maintenance. Software Quality Journal, 3, 137–151.
Kitchenham, B., & Mendes, E. (2004). Software productivity measurement using multiple size measures. IEEE Trans Software Engineering, 30, 1023–1035.
Kojima, T., Hasegawa, T., & Nakamura, T. (2005). Proceedings of SEPG Japan (in Japanese). Available in CD format.
Liu, F., Noguchi, K., Dhungana, A., Srirangam, V. V. N. S. N. A., & Inuganti, P. (2006). A quantitative approach for setting technical targets based on impact analysis in software quality function deployment (SQFD). Software Quality Journal, 14, 113–134.
LogXact Statistical Software. (2006). Cytel Statistics and Epidemiology Research Corporation, Seattle, WA, USA. http://www.scientific-solutions.ch/tech/logxact/index.html
Maydl, W. (2004). Model checking for component-based software development for embedded systems. Proceedings of the Eighth IASTED International Conference on Software Engineering and Applications, 331–338.
Moore, D. S., & McCabe, G. P. (1998). Introduction to the practice of statistics. New York: W.H. Freeman & Company.
Pfahl, D., Laitenberger, O., Dorsch, J., & Ruhe, G. (2003). An externally replicated experiment for evaluating the learning effectiveness of using simulations in software project management education. Empirical Software Engineering, 8, 367–395.
Williams, M. (2005). Software glitch halts Tokyo Stock Exchange, COMPUTERWORLD November 1. http://www.computerworld.com/action/article.do?command=viewArticleBasic&articleId=105838
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Kojima, T., Hasegawa, T., Misumi, M. et al. Risk analysis of software process measurements. Software Qual J 16, 361–376 (2008). https://doi.org/10.1007/s11219-007-9040-5
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11219-007-9040-5