Abstract
A major challenge in process improvement is to understand process innovation. and improvement efficiency and use. How do we know that process innovations and improvements give organizational benefits? We need a mechanism for measuring. In this paper, we report from a longitudinal action research study at the telecom company Ericsson where a measurement mechanism was designed and successfully used in practice to understand, learn, and measure process efficiency. In the concrete, the measurement mechanism was built through empirical testing combined with using a goal-question-metrics (GQM) approach. The resulting measurement mechanism consists of four correlated metrics that indicate process use, process commitment, process learning, and process improvement. The same measurement mechanism can also he used to obtain feedback and evaluation, thereby allowing the organization to determine process efficiency and use, and to determine the success of the process improvements.
Chapter PDF
Similar content being viewed by others
References
Abrahamsson, P. “Measuring the Success of Software Process Improvement: The Dimensions,” in Proceedings of the European Software Process Improvement (EuroSPI2000) Conference, Copenhagen, Denmark, November 7–9, 2000.
Abrahamsson, P. “Rethinking the Concept of Commitment in Software Process Improvement,” Scandinavian Journal of Information Systems (13), 2001, pp. 69–98.
Albrecht, A. J. “Measuring Application Development Productivity,” in Proceedings of the IBM Application Development Symposium, Monterrey, California, October 1979, pp. 83–92.
Albrecht, A. J., and Gaffney, Jr., J. E. “Software Function, Source Lines of Code, and Development Effort Prediction: A Software Science Validation,” IEEE Transactions on Software Engineering (SE-9:6), October 1979, pp. 639–648.
Argyris, C., and Schön, D. Organizational Learning, Reading, MA: Addison-Wesley, 1978.
Bartunek, J. M., and Louis M. R. Insider/Outsider Team Research, Qualitative Research Methods (Vol. 40), Thousand Oaks, CA: Sage Publications, 1996.
Basili, V. G., Caldiera, G., and Rombach H. D. “The Goal/Question Metric Approach,” in J. Marciniak (ed.), Encyclopedia of Software Engineering, Volume 1, New York: John Wiley & Sons, 1994, pp. 528–532.
Basili, V. R., and Rombach, H. D. “The TAME Project: Towards Improvement Oriented Software Environments,” IEEE Transactions on Software Engineering (14:6), 1988, pp. 758–773.
Basili, V. R., and Weiss, D. M. “A Methodology for Collecting Valid Software Engineering Data,” IEEE Transactions on Software Engineering (10:4), 1984, pp. 728–738.
Baskerville, R., and Pries-Heje, J. “Grounded Action Research: A Method for Understanding IT in Practice,” Management and Information Technology (9), 1999, pp. 1–23.
Baskerville, R., and Wood-Harper, A. T. “Diversity in Information Systems Action Research Methods,” European Journal of Information Systems (7), 1998, pp. 90–107.
Baskerville, R., and Wood-Harper, A. T. “A Critical Perspective on Action Research as a Method for Information Systems Research,” Journal of Information Technology (11), 1996, pp. 235–246.
Brown, J. S., Collins, A., and Duguid, P. “Situated Cognition and the Culture of Learning,” Educational Researcher (18:1), 1989, pp. 32–42.
Börjesson, A. “Simple Indicators for Tracking Software Process Improvement Progress,” in I. Richardson, P. Runeson, and R. Messnarz (eds.), Software Process Improvement, Berlin-Heidelberg: Springer-Verlag, 2006, pp. 74–87.
Chrissis, M. B., Konrad, M., and Shrum, S. CMMI: Guidelines for Process Integration and Product Improvement, Boston, MA: Addison-Wesley, 2003.
Daskalantonakis, M. “A Practical View of Software Measurement and Implementation Experiences Within Motorola.,” IEEE Transactions on Software Engineering (18), 1992, pp. 998–1010.
Davison, R. M., Martinsons, M. G., and Kock, N. “Principles of Canonical Action Research,” Information Systems Journal (14), 2004, pp. 65–86.
Delone, W., and McLean, E. “Information Systems Success: The Quest for the Dependent Variable,” Information Systems Research (3:1), March 1992, pp. 60–95.
Deming, W. E. Out of the Crisis, Cambridge, MA: MIT Center for Advanced Engineering Study, 1986.
Dybå, T. “An Instrument for Measuring the Key Factors of Success in Software Process Improvement,” Empirical Software Engineering (5), 2000, pp. 357–390.
Enskog, U. “Process Awareness and Use at Ericsson AB,” B.Sc. Thesis, IT University of Göteborg, Sweden, 2006.
Fenton, N. E., and Pfleeger, S. L. Software Metrics: A Rigorous and Practical Approach (2nd ed.), Boston: PWS Publishing, 1997.
Flaherty, M. J. “Programming Process Productivity Measurement System for System 370,” IBM System Journal (24:2), 1985, pp. 168–175.
Florac, W. A., and Carleton, A. D. Measuring the Software Process, Boston, MA: Addison-Wesley Professional, 1999.
Galliers, R. D. “Choosing an Information Systems Research Approach,” in R. D. Galliers (ed.), Information Systems Research: Issues, Methods, and Practical Guidelines, Oxford, England: Blackwell Scientific Publications, 1992, pp. 144–162.
Garmus, D., and Herron, D. Measuring The Software Process: A Practical Guide to Functional Measurements, Englewood Cliffs, NJ: Prentice Hall, 1995.
Goldenson, D. R., and Herbsleb, J. “After the Appraisal: A Systematic Survey of Process Improvement, its Benefits, and Factors that Influence Success,” Technical Report, CMU/SEI-95-TR-009, Carnegie Mellon University, Software Engineering Institute, Pittsburgh, PA, 1995.
Gopal, A., Krishnan, M. S., Mukhopadhyay, T., and Goldenson, D. R. “Measurement Programs in Software Development: Determinants of Success,” IEEE Transaction on Software Engineering (28:9), September 2002, pp. 863–875.
Grady, R. B. Successful Software Process Improvement, Upper Saddle River, NJ: Prentice Hall, 1997.
Herbsleb, J., Carleton, A., Rozum, J., Siegel, J., and Zubrow, D. “Benefits of CMM-Based Software Orocess Improvement: Initial Results.” Technical Report, CMU/SEI-94-TR-13, Carnegie Mellon University, Software Engineering Institute, Pittsburgh, PA, 1994.
Humphrey, W. S. Managing the Software Process, Reading, MA: Addison Wesley, 1989.
IEEE. IEEE Standard 1061: Standard for a Software Quality Metrics Methodology, Piscataway, NJ: IEEE Standards Department, 1998.
ISO/IEC TR 15504. Information Technology—Process Assessment. Part 2–3, International Organization for Standardization, Geneva, 2003.
ISO/IEC TR 15504. Information Technology—Process Assessment. Part 1 and 4, International Organization for Standardization, Geneva, 2004.
ISO/IEC TR 15504. Information Technology—Process Assessment. Part 5, International Organization for Standardization, Geneva, 2006.
Jeffery, R., and Berry, M. “A Framework for Evaluation and Prediction of Metrics Programs Success,” in Proceedings of the IEEE International Software Metrics Symposium, Los Alamitos, CA: IEEE Computer Society Press, 1993, pp. 28–39.
Jones, C. Assessment and Control of Software Risks, Englewood Cliffs, NJ: Prentice Hall, 1994.
Jones, C. Sources of Errors in Software Cost Estimating, Version 1.0, Burlington, MA: Software Productivity Research, 1993.
Kaner, C., and Bond, W. P. “Software Engineering Metrics: What Do They Measure and How Do We Know?,” in Proceedings of the 10 th International Software Metrics Symposium (METRICS 2004), Los Alamitos, CA: IEEE Computer Society Press, 2004.
Kuvaja, P., Similä, J., Krzanik, L., Bicego, A., Saukkonen, S., and Koch, G. Software Process Assessment and Improvement. The BOOTSTRAP Approach, Oxford, England: Blackwell Publishers, 1994.
Leave, J., and Wenger, E. Situated Learning: Legitimate Peripheral Participation, Cambridge, England: Cambridge University Press, 1991.
Mashiko, Y., and Basili, V. R. “Using the GQM Paradigm to Investigate Influential Factors for Software Process Improvement,” Journal of Systems and Software (36), 1997, pp. 17–32.
Mathiassen, L. “Collaborative Practice Research. Information,” Technology & People (14:4), 2002, pp. 321–345.
McFeeley, B. “IDEAL. A User’s Guide for Software Process Improvement,” Handbook CMU/SEI-96-HB-001, The Software Engineering Institute, Carnegie Mellon University, Pittsburgh, PA, 1996.
Merriam, S. B., and Caffarella, R. S. Learning in Adulthood: A Comprehensive Guide (2nd ed.), San Francisco: Jossey-Bass, 1999.
Patton, M. Q. How to Use Qualitative Methods in Evaluation, Newbury Park, CA: Sage Publications, 1987.
Paulk, M. C., Weber, C., Curtis, B., and Chnssis, M. B. The Capability Maturity Model:. Guidelines for Improving the Software Process, Reading, MA: Addison-Wesley, 1995.
Pfleeger, S. L. “Lessons Learned in Building a Corporate Metrics Program,” IEEE Software, May 1993, pp. 67–74.
Rogers, E. M. Diffusion of Innovations (5th ed.), New York: Free Press, 2003.
Schaffer, R. H., and Thomson, H. A. “Successful Change programs Begin with Results,” Harvard Business Review (70), 1992, pp. 80–89.
Seddon, P. B., and Kiew, M-Y. “A Partial Test and Development of DeLone and McLean’s Model of IS Success,” Australian Journal of Information Systems (4:1), September 1996, pp. 90–109.
SEMA. “Software Engineering Management Analysis: Process Maturity Profile of the Software Community,” Software Engineering Institute, Carnegie-Mellon University, Pittsburgh, PA, 2002 (updated maturity profiles can be found at http://www.sei.cmu.edu/appraisal-program/profile/profile.html).
Sigurd, G., and Tedsjö, J. “Making Use of Regular Process Surveys: A Case Study at Ericsson,” B.Sc. Thesis, IT University of Göteborg, Sweden, 2005.
Susman, G., and Evered, R. “An Assessment of the Scientific Merits of Action Research,” Administrative Science Quarterly (23), 1978, pp. 582–603.
Wenger, E. Communities of Practice: Learning, Meaning, and Identity, New York: Cambridge University Press, 1998.
Wiegers, K. E. “Software Process Improvement: Eight Traps to Avoid, CrossTalk,” The Journal of Defense Software Engineering, September 1998, pp. 9–12.
Vinter, O., Lauesen, S., and Pries-Heje, J. “Preventing Requirements Issues from Becoming Defects,” in C. Ghezzi and M. Fusani (eds.), Proceedings of the Fourth International Conference on Achieving Quality in Software: Software Quality in the Communication Society, Venice: AQUIS, 1998, pp. 427–431.
Yin, R. Case Study Research, Newbury Park, CA: Sage Publications, 1994.
Zharan, S. Software Process Improvement: Practical Guidelines for Business Success, Harlow, England: Addison-Wesley, 1998.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2007 International Federation for Information Processing
About this paper
Cite this paper
Börjesson, A., Baaz, A., Pries-Heje, J., Timmerås, M. (2007). Measuring Process Innovations and Improvements. In: McMaster, T., Wastell, D., Ferneley, E., DeGross, J.I. (eds) Organizational Dynamics of Technology-Based Innovation: Diversifying the Research Agenda. TDIT 2007. IFIP International Federation for Information Processing, vol 235. Springer, Boston, MA. https://doi.org/10.1007/978-0-387-72804-9_14
Download citation
DOI: https://doi.org/10.1007/978-0-387-72804-9_14
Publisher Name: Springer, Boston, MA
Print ISBN: 978-0-387-72803-2
Online ISBN: 978-0-387-72804-9
eBook Packages: Computer ScienceComputer Science (R0)