Skip to main content
SpringerLink
Log in

Improving Completeness of Measurement Systems for Monitoring Software Development Workflows

  • Conference paper
Software Quality. Increasing Value in Software and Systems Development (SWQD 2013)

Part of the book series: Lecture Notes in Business Information Processing ((LNBIP,volume 133))

Included in the following conference series:

Abstract

Monitoring and controlling of software projects executed according to Lean or Agile software development requires, in principle, continuous measurement and use of indicators to monitor development areas and/or identify problem areas. Indicators are specific kind of measures with associated analysis models and decision criteria (ISO/IEC 15939). Indicating/highlighting problems in processes, is often used in Lean SW development and despite obvious benefits there are also dangers with improper use of indicators – using inadequate indicators can mislead the stakeholders towards sub-optimizations/erroneous decisions. In this paper we present a method for assessing completeness of information provided by measurement systems (i.e. both measures and indicators). The method is a variation of value stream mapping modeling with an application in a software development organization in the telecom domain. We also show the use of this method at one of the units of Ericsson where it was applied to provide stakeholders with an early warning system about upcoming problems with software quality.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 54.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 72.00
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Staron, M., Meding, W., Karlsson, G., Nilsson, C.: Developing measurement systems: an industrial case study. Journal of Software Maintenance and Evolution: Research and Practice (2010)

    Google Scholar 

  2. Staron, M., Meding, W., Nilsson, C.: A Framework for Developing Measurement Systems and Its Industrial Evaluation. Information and Software Technology 51, 721–737 (2008)

    Article  Google Scholar 

  3. McGarry, J.: Practical software measurement: objective information for decision makers. Addison-Wesley, Boston (2002)

    Google Scholar 

  4. Meding, W., Staron, M.: The Role of Design and Implementation Models in Establishing Mature Measurement Programs. Presented at the Nordic Workshop on Model Driven Engineering, Tampere, Finland (2009)

    Google Scholar 

  5. van Solingen, R., Berghout, E.: The Goal/Question/Metric Method. A Practical Guide for Quality Improvement of Software Development. McGraw-Hill, London (1999)

    Google Scholar 

  6. Staron, M., Meding, W.: Defect Inflow Prediction in Large Software Projects. e-Informatica Software Engineering Journal 4, 1–23 (2010)

    Google Scholar 

  7. International Standard Organization and International Electrotechnical Commission, ISO/IEC 15939 Software engineering – Software measurement process, International Standard Organization/International Electrotechnical Commission, Geneva (2007)

    Google Scholar 

  8. Brockers, A., Differding, C., Threin, G.: The role of software process modeling in planning industrial measurement programs. In: The 3rd International Software Metrics Symposium, pp. 31–40 (1996)

    Google Scholar 

  9. Staron, M., Meding, W.: Using Models to Develop Measurement Systems: A Method and Its Industrial Use, Presented at the Software Process and Product Measurement, Amsterdam, NL (2009)

    Google Scholar 

  10. Dolcemascolo, D.: Improving the extended value stream: lean for the entire supply chain. Productivity Press, New York (2006)

    Google Scholar 

  11. Kitchenham, B., Hughes, R.T., Linkman, S.C.: Modeling Software Measurement Data. IEEE Transactions on Software Engineering 27, 788–804 (2001)

    Article  Google Scholar 

  12. Lawler, J., Kitchenham, B.: Measurement modeling technology. IEEE Software 20, 68–75 (2003)

    Article  Google Scholar 

  13. Monperrus, M., Jézéquel, J.-M., Champeau, J., Hoeltzener, B.: A Model-Driven Measurement Approach. In: Czarnecki, K., Ober, I., Bruel, J.-M., Uhl, A., Völter, M. (eds.) MoDELS 2008. LNCS, vol. 5301, pp. 505–519. Springer, Heidelberg (2008)

    Chapter  Google Scholar 

  14. Lee, Y.W., Strong, D.M., Kahn, B.K., Wang, R.Y.: AIMQ: a methodology for information quality assessment. Information & Management 40, 133–146 (2002)

    Article  Google Scholar 

  15. Staron, M., Meding, W.: Ensuring Reliability of Information Provided by Measurement Systems. In: Abran, A., Braungarten, R., Dumke, R.R., Cuadrado-Gallego, J.J., Brunekreef, J. (eds.) IWSM 2009. LNCS, vol. 5891, pp. 1–16. Springer, Heidelberg (2009)

    Chapter  Google Scholar 

  16. Kahn, B.K., Strong, D.M., Wang, R.Y.: Information Quality Benchmarks: Product and Service Performance. Communications of the ACM 45, 184–192 (2002)

    Article  Google Scholar 

  17. Mayer, D.M., Willshire, M.J.: A Data Quality Engineering Framework. In: International Conference on Information Quality, pp. 1–8 (1997)

    Google Scholar 

  18. Goodhue, D.L., Thompson, R.L.: Task-technology fit and individual performance. MIS Quarterly 19, 213–237 (1995)

    Article  Google Scholar 

  19. Serrano, M., Calero, C., Trujillo, J., Luján-Mora, S., Piattini, M.: Empirical Validation of Metrics for Conceptual Models of Data Warehouses. In: Persson, A., Stirna, J. (eds.) CAiSE 2004. LNCS, vol. 3084, pp. 506–520. Springer, Heidelberg (2004)

    Chapter  Google Scholar 

  20. Caballero, I., Verbo, E., Calero, C., Piattini, M.: A Data Quality Measurement Information Model Based on ISO/IEC 15939 (2007), http://mitiq.mit.edu/iciq/PDF/

  21. Burkhard, R., Spescha, G., Meier, M.: “A-ha!”: How to Visualize Strategies with Complementary Visualizations. In: Conference on Visualising and Presenting Indicator Systems (2005)

    Google Scholar 

  22. International Bureau of Weights and Measures, International vocabulary of basic and general terms in metrology = Vocabulaire international des termes fondamentaux et généraux de métrologie, 2nd edn. International Organization for Standardization, Genève (1993)

    Google Scholar 

  23. International Standard Organization and International Electrotechnical Commission, Software engineering – Software measurement process, ISO/IEC, Geneva (2002)

    Google Scholar 

  24. International Standard Organization, Systems engineering – System life cycle processes 15288:2002 (2002)

    Google Scholar 

  25. International Standard Organization, Information technology – Software product evaluation 14598-1:1999 (1999)

    Google Scholar 

  26. International Standard Organization and International Electrotechnical Commission, ISO/IEC 9126 - Software engineering – Product quality Part: 1 Quality model, International Standard Organization/International Electrotechnical Commission, Geneva (2001)

    Google Scholar 

  27. Umarji, M., Emurian, H.: Acceptance Issues in Metrics Program Implementation, p. 20 (2005)

    Google Scholar 

  28. Gopal, A., Mukhopadhyay, T., Krishnan, M.S.: The impact of institutional forces on software metrics programs. IEEE Transactions on Software Engineering 31, 679–694 (2005)

    Article  Google Scholar 

  29. Umarji, M., Emurian, H.: Acceptance issues in metrics program implementation, p. 10 (2005)

    Google Scholar 

  30. Kilpi, T.: Implementing a Software Metrics Program at Nokia. IEEE Software 18, 72–77 (2001)

    Article  Google Scholar 

  31. Wand, Y., Wang, R.Y.: Anchoring data quality dimensions in ontological foundations. Commun. ACM 39, 86–95 (1996)

    Article  Google Scholar 

  32. Fenton, N.E., Pfleeger, S.L.: Software metrics: a rigorous and practical approach, 2nd edn. International Thomson Computer Press, London (1996)

    Google Scholar 

  33. Tomaszewski, P., Berander, P., Damm, L.-O.: From Traditional to Streamline Development - Opportunities and Challenges. Software Process Improvement and Practice 2007, 1–20 (2007)

    Google Scholar 

  34. Baskerville, R.L., Wood-Harper, A.T.: A Critical Perspective on Action Research as a Method for Information Systems Research. Journal of Information Technology 1996, 235–246 (1996)

    Article  Google Scholar 

  35. Susman, G.I., Evered, R.D.: An Assessment of the Scientific Merits of Action Research. Administrative Science Quarterly 1978, 582–603 (1978)

    Article  Google Scholar 

  36. Fenton, N., Krause, P., Neil, M.: Software measurement: uncertainty and causal modeling. IEEE Software 19, 116–122 (2002)

    Article  Google Scholar 

  37. Fenton, N.E., Neil, M.: Software metrics: successes, failures and new directions. Journal of Systems and Software 47, 149–157 (1999)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Computer Science and Engineering, University of Gothenburg, Sweden

    Miroslaw Staron

  2. Ericsson SW Research and SW Metrics Team, Ericsson AB, Sweden

    Wilhelm Meding & Micael Caiman

Authors
  1. Miroslaw Staron
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Wilhelm Meding
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Micael Caiman
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Institute of Software Technology and Interactive Systems, Vienna University of Technology, Vienna, Austria

    Dietmar Winkler  & Stefan Biffl  & 

  2. Software Quality Lab GmbH, Linz, Austria

    Johannes Bergsmann

Rights and permissions

Reprints and permissions

Copyright information

© 2013 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Staron, M., Meding, W., Caiman, M. (2013). Improving Completeness of Measurement Systems for Monitoring Software Development Workflows. In: Winkler, D., Biffl, S., Bergsmann, J. (eds) Software Quality. Increasing Value in Software and Systems Development. SWQD 2013. Lecture Notes in Business Information Processing, vol 133. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-35702-2_14

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-35702-2_14

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-35701-5

  • Online ISBN: 978-3-642-35702-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation