Skip to main content
View expanded cover

International Conference on Software Process Improvement and Capability Determination

SPICE 2015: Software Process Improvement and Capability Determination pp 72–84Cite as

Evaluation of Software Mediated Process Assessments for IT Service Management

Part of the Communications in Computer and Information Science book series (CCIS,volume 526)

Abstract

IT service organisations are cognisant that continual service improvement can be achieved by conducting regular process assessments. However, such assessments are expensive and so we have developed a Decision Support System (DSS) tool which uses the international standard for process assessment ISO/IEC 15504 to offer a transparent and efficient approach. This paper provides evidence of evaluation of this software-mediated process assessment (SMPA) approach which was based on ISO/IEC 15504, ISO/IEC 20000 and the IT Infrastructure Library (ITIL®). In a usability evaluation of the online tool, participants reported largely positive experiences finding the online survey easy to use trustworthy, comfortable, generally effective, and more transparent and less costly to implement than a manual assessment. However, to engage in process improvement, human judgment, and possibly expert assessment facilitators are necessary for assessment validation and improvement, that is, a fully automated online survey that is strictly standard-based is not very useful. Further clarification of the survey questions with relevant examples, clearer answer options and having more visible goal statements on every question page were suggested.

Keywords

  • ITSM process assessment
  • ISO/IEC 15504
  • Evaluation
  • IT service management
  • Process improvement

This is a preview of subscription content, access via your institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • DOI: 10.1007/978-3-319-19860-6_7
  • Chapter length: 13 pages
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
eBook
USD   54.99
Price excludes VAT (USA)
  • ISBN: 978-3-319-19860-6
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
Softcover Book
USD   69.99
Price excludes VAT (USA)
Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Barafort, B., Betry, V., Cortina, S., Picard, M., St-Jean, M., Renault, A., Valdès, O.: ITSM Process Assessment Supporting ITIL. Public Research Centre Henri Tudor (ed.) Zaltbommel, Netherlands. Van Haren Publishing (2009)

    Google Scholar 

  2. Bernard, P.: Foundations of ITIL, Chittenden, J. (ed.) Zaltbommel, Netherlands. Van Haren Publishing (2012)

    Google Scholar 

  3. Lloyd, V.: ITIL Continual Service Improvement. The Stationery Office, London, UK (2011)

    Google Scholar 

  4. ISO/IEC, ISO/IEC 15504-2:2004 – Information Technology – Process Assessment – Part 2: Performing an Assessment. International Organization for Standardization: Geneva, Switzerland (2004)

    Google Scholar 

  5. Mesquida, A.L., Mas, A., Amengual, E., Calvo-Manzano, J.A.: IT Service Management Process Improvement based on ISO/IEC 15504: A Systematic Review. Information and Software Technology 54(3), 239–247 (2012)

    CrossRef  Google Scholar 

  6. ISO/IEC, ISO/IEC TS 15504-8:2012 - Information Technology - Process Assessment - Part 8: An Exemplar Process Assessment Model for IT Service Management. International Organization for Standardization: Geneva, Switzerland (2012)

    Google Scholar 

  7. Shrestha, A., Cater-Steel, A., Toleman, M., Rout, T.: towards transparent and efficient process assessments for IT service Management. In: Mitasiunas, A., Rout, T., O’Connor, R.V., Dorling, A. (eds.) SPICE 2014. CCIS, vol. 477, pp. 165–176. Springer, Heidelberg (2014)

    CrossRef  Google Scholar 

  8. CMMI, Standard CMMI® Appraisal Method for Process Improvement (SCAMPISM) A, Version 1.3: Method Definition Document. Software Engineering Institute: Carnegie Mellon University, MA, USA (2011)

    Google Scholar 

  9. MacDonald, I.: ITIL Process Assessment Framework. The Co-operative Financial Services: Manchester, UK (2010)

    Google Scholar 

  10. Deutskens, E., de Ruyter, K., Wetzels, M.: An Assessment of Equivalence Between Online and Mail Surveys in Service Research. Journal of Service Research 8(4), 346–355 (2006)

    CrossRef  Google Scholar 

  11. Parasuraman, A., Zeithaml, V.A., Berry, L.L.: A Conceptual Model of Service Quality and its Implications for Future Research. Journal of Marketing 49(4), 41–50 (1985)

    CrossRef  Google Scholar 

  12. Lepmets, M., Cater-Steel, A., Gacenga, F., Ras, E.: Extending the IT Service Quality Measurement Framework through a Systematic Literature Review. Journal of Service Science Research 4(1), 7–47 (2012)

    CrossRef  Google Scholar 

  13. Jia, R., Reich, B.H.: IT Service Climate—An Essential Managerial Tool to Improve Client Satisfaction with IT Service Quality. Information Systems Management 28(2), 174–179 (2011)

    CrossRef  Google Scholar 

  14. Spath, D., Bauer, W., Praeg, C.-P.: IT Service Quality Management: Assumptions, Frameworks and Effects on Business Performance. In: Quality Management for IT Services-Perspectives on Business and Process Performance. IGI Global, PA, pp. 1–21 (2011)

    Google Scholar 

  15. Edgeman, R.L., Bigio, D., Ferleman, T.: Six Sigma and Business Excellence: Strategic and Tactical Examination of IT Service Level Management at the Office of the Chief Technology Officer of Washington, DC. Quality and Reliability Engineering International 21(3), 257–273 (2005)

    CrossRef  Google Scholar 

  16. Barafort, B., Di Renzo, B., Merlan, O.: Benefits resulting from the combined use of ISO/IEC 15504 with the information technology infrastructure library (ITIL). In: Oivo, M., Komi-Sirviö, M. (eds.) 4th International Conference on Product Focussed Software Development and Process Improvement (PROFES). Lecture Notes in Computer Science, vol. 2559, pp. 314–325. Springer, Heidelberg (2002)

    CrossRef  Google Scholar 

  17. Checkland, P., Scholes, J.: Soft Systems Methodology in Practice, 1st edn. J Wiley, Chichester (1990)

    Google Scholar 

  18. Hevner, A.R., March, S.T., Park, J., Ram, S.: Design Science in Information Systems Research. MIS Quarterly 28(1), 75–106 (2004)

    Google Scholar 

  19. Gregor, S., Jones, D.: The Anatomy of a Design Theory. Journal of the Association for Information Systems 8(5), 312–335 (2007)

    Google Scholar 

  20. Pries-Heje, J., Baskerville, R.: The Design Theory Nexus. MIS Quarterly 32(4), 731–755 (2008)

    Google Scholar 

  21. Sein, M.K., Henfridsson, O., Purao, S., Rossi, M., Lindgren, R.: Action Design Research. MIS Quarterly 35(1), 37–56 (2011)

    Google Scholar 

  22. Iivari, J.: A Paradigmatic Analysis of Information Systems As a Design Science. Scandinavian Journal of Information Systems 19(2) Article 5 (2007)

    Google Scholar 

  23. Walls, J.G., Widmeyer, G.R., El Sawy, O.A.: Building an Information System Design Theory for Vigilant EIS. Information Systems Research 3(1), 36–59 (1992)

    CrossRef  Google Scholar 

  24. Van Aken, J.E.: The Nature of Organizing Design: Both Like and Unlike Material Object Design. Eindhoven Center for Innovation Studies (ECIS) (2006)

    Google Scholar 

  25. Carlsson, S.A., Henningsson, S., Hrastinski, S., Keller, C.: Socio-technical IS Design Science Research: Developing Design Theory for IS Integration Management. Information Systems and e-Business Management 9(1), 109–131 (2011)

    CrossRef  Google Scholar 

  26. Venable, J., Pries-Heje, J., Baskerville, R.: A comprehensive framework for evaluation in design science research. In: Peffers, K., Rothenberger, M., Kuechler, B. (eds.) DESRIST 2012. LNCS, vol. 7286, pp. 423–438. Springer, Heidelberg (2012)

    Google Scholar 

  27. Peffers, K., Tuunanen, T., Rothenberger, M.A., Chatterjee, S.: A Design Science Research Methodology for Information Systems Research. Journal of Management Information Systems 24(3), 45–77 (2007)

    CrossRef  Google Scholar 

  28. Pries-Heje, J., Baskerville, R., Venable, J.R.: Strategies for Design Science Research Evaluation. In: 16th European Conference on Information Systems. Galway, Ireland (2008)

    Google Scholar 

  29. Peffers, K., Tuunanen, T., Rothenberger, M.A., Chatterjee, S.: A Design Science Research Methodology for Information Systems Research. Journal of Management Information Systems 24(3), 45–77 (2008)

    CrossRef  Google Scholar 

  30. ISO/IEC, ISO/IEC 25010:2011 – Systems and software engineering – Systems and software Quality Requirements and Evaluation (SQuaRE) - System and software quality models. International Organisation for Standardisation: Geneva, Switzerland (2011)

    Google Scholar 

  31. TRC, TRC Annual Report 2012/13. Toowoomba Regional Council: Toowoomba (2013)

    Google Scholar 

  32. ISO/IEC, ISO/IEC 33001:2015 – Information technology – Process assessment – Concepts and terminology. International Organisation for Standardisation: Geneva, Switzerland (2015)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. School of Management and Enterprise, University of Southern Queensland, Toowoomba, Australia

    Anup Shrestha, Aileen Cater-Steel, Mark Toleman & Terry Rout

Authors
  1. Anup Shrestha
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Aileen Cater-Steel
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Mark Toleman
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Terry Rout
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Aileen Cater-Steel .

Editor information

Editors and Affiliations

  1. Griffith University, Brisbane, Queensland, Australia

    Terry Rout

  2. Dublin City University, Dublin, Ireland

    Rory V. O’Connor

  3. Impronova AB, Lindome, Sweden

    Alec Dorling

Rights and permissions

Reprints and Permissions

Copyright information

© 2015 Springer International Publishing Switzerland

About this paper

Cite this paper

Shrestha, A., Cater-Steel, A., Toleman, M., Rout, T. (2015). Evaluation of Software Mediated Process Assessments for IT Service Management. In: Rout, T., O’Connor, R., Dorling, A. (eds) Software Process Improvement and Capability Determination. SPICE 2015. Communications in Computer and Information Science, vol 526. Springer, Cham. https://doi.org/10.1007/978-3-319-19860-6_7

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-19860-6_7

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-19859-0

  • Online ISBN: 978-3-319-19860-6

  • eBook Packages: Computer ScienceComputer Science (R0)