Skip to main content
SpringerLink
Log in

Exploring the Relations Between Net Benefits of IT Projects and CIOs’ Perception of Quality of Software Development Disciplines

  • Research Paper
  • Published:
Business & Information Systems Engineering Aims and scope Submit manuscript

Abstract

Software development enterprises are under consistent pressure to improve their management techniques and development processes. These are comprised of several software development methodology (SDM) disciplines such as requirements acquisition, design, coding, testing, etc. that must be continuously improved and individually tailored to suit specific software development projects. The paper proposes a methodology that enables the identification of SDM discipline quality categories and the evaluation of SDM disciplines’ net benefits. It advances the evaluation of software process quality from single quality category evaluation to multiple quality categories evaluation as proposed by the Kano model. An exploratory study was conducted to test the proposed methodology. The exploratory study results show that different types of Kano quality are present in individual SDM disciplines and that applications of individual SDM disciplines vary considerably in their relation to net benefits of IT projects. Consequently, software process quality evaluation models should start evaluating multiple categories of quality instead of just one and should not assume that the application of every individual SDM discipline has the same effect on the enterprise’s net benefits.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

References

  • Anand S, Burke EK, Chen TY et al (2013) An orchestrated survey of methodologies for automated software test case generation. J Syst Softw 86(8):1978–2001

    Google Scholar 

  • Avison D, Fitzgerald G (2006a) Methodologies for developing information systems: a historical perspective. In: Avison D, Elliot S, Krogstie J, Pries-Heje J (eds) The past and future of information systems: 1976–2006 and beyond. Springer, Boston, pp 27–38

    Google Scholar 

  • Avison D, Fitzgerald G (2006b) Information systems development: methodologies, techniques and tools, 4th edn. McGraw-Hill Higher Education, New York

    Google Scholar 

  • Barr ET, Harman M, McMinn P et al (2015) The Oracle problem in software testing: a survey. IEEE Trans Softw Eng 41(5):507–525

    Google Scholar 

  • Basili V, Heidrich J, Lindvall M, et al (2007) GQM^+ strategies—aligning business strategies with software measurement. In: First international symposium on empirical software engineering and measurement (ESEM 2007), pp 488–490

  • Bass JM (2016) Artefacts and agile method tailoring in large-scale offshore software development programmes. Inf Softw Technol 75:1–16

    Google Scholar 

  • Bolon-Canedo V, Sanchez-Marono N, Alonso-Betanzos A et al (2014) A review of microarray datasets and applied feature selection methods. Inf Sci 282:111–135

    Google Scholar 

  • Breiman L, Friedman JH, Olshen RA, Stone CJ (1984) Classification and regression trees. Wadsworth Internacional, California

    Google Scholar 

  • Bresnahan T, Brynjolfsson E, Hitt L (2002) Information technology, workplace organization, and the demand for skilled labor: firm-level evidence. Q J Econ 117(1):339–376

    Google Scholar 

  • Brynjolfsson E, Hitt L (1996) Paradox lost? firm-level evidence on the returns to information systems spending. Manag Sci 42(4):541–558

    Google Scholar 

  • Brynjolfsson E, Hitt L, Yang S (2002) Intangible assets: computers and organizational capital. Brook Pap Econ Act 1:137–198

    Google Scholar 

  • Chen L-F (2012) A novel approach to regression analysis for the classification of quality attributes in the Kano model: an empirical test in the food and beverage industry. OMEGA Int J Manag Sci 40(5):651–659

    Google Scholar 

  • Chen C-C, Chuang M-C (2008) Integrating the Kano model into a robust design approach to enhance customer satisfaction with product design. Int J Prod Econ 114(2):667–681

    Google Scholar 

  • Clarke P, O’Connor RV (2012) The situational factors that affect the software development process: towards a comprehensive reference framework. Inf Softw Technol 54(5):433–447

    Google Scholar 

  • Cockburn A (2002) Agile software development. Addison-Wesley, Boston

    Google Scholar 

  • Čufar A, Mrhar A, Robnik-Šikonja M (2015) Assessment of surveys for the management of hospital clinical pharmacy services. Artif Intell Med 64(2):147–158

    Google Scholar 

  • Ernst NA, Borgida A, Jureta IJ, Mylopoulos J (2014) Agile requirements engineering via paraconsistent reasoning. Inf Syst 43:100–116

    Google Scholar 

  • Fernandez DM, Wagner S, Kalinowski M et al (2017) Naming the pain in requirements engineering. Empir Soft Eng 22:2298–2338

    Google Scholar 

  • Forrester EC, Buteau BL, Shrum S (2011) CMMI for services: guidelines for superior service. Addison-Wesley, Upper Saddle River, NJ

    Google Scholar 

  • Guyon I, Elisseeff A (2003) An introduction to variable and feature selection. J Mach Learn Res 3(3):1157–1182

    Google Scholar 

  • Herzberg F, Mausner B, Snyderman BB (1959) The motivation to work. Wiley, Hoboken

    Google Scholar 

  • Hovelja T (2008) Organisational effects on information technology productivity in enterprises: the case of Slovenia. Econ Bus Rev 10(3):243–261

    Google Scholar 

  • Hovelja T, Rožanec A, Rupnik R (2010) Measuring the success of the strategic information systems planning in enterprises in Slovenia. Management 15(2):25–46

    Google Scholar 

  • Hovelja T, Vasilecas O, Rupnik R (2013) A model of influences of environmental stakeholders on strategic information systems planning success in an enterprise. Technol Econ Dev Econ 19(3):465–488

    Google Scholar 

  • Hovelja T, Vasilecas O, Vavpotič D (2015) Exploring the influences of the use of elements comprising information system development methodologies on strategic business goals. Technol Econ Dev Econ 21(6):885–898

    Google Scholar 

  • Ilbahar E, Cebi S (2017) Classification of design parameters for E-commerce websites: a novel fuzzy Kano approach. Telemat Inform 34(8):1814–1825

    Google Scholar 

  • Ishikawa K (1990) Introduction to quality control. Chapman and Hall, London

    Google Scholar 

  • Järvinen J, Komi-Sirviö S, Ruhe G (2000) The PROFES improvement methodology—enabling technologies and methodology design. PROFES. Springer, Heidelberg, pp 257–270

    Google Scholar 

  • Jørgensen M (2016) A survey on the characteristics of projects with success in delivering client benefits. Inf Softw Technol 78:83–94

    Google Scholar 

  • Kakar AK (2017) Do reflexive software development teams perform better? Bus Inf Syst Eng 59(5):347–359

    Google Scholar 

  • Kano N (2001) Life cycle and creation of attractive quality. In: 4th international QMOD conference quality management and organisational development proceedings, Linköpings Universitet, Sweden

  • Kano N, Seraku N, Takahashi F, Tsuji S (1984) Attractive quality and must-be quality. J Jpn Soc Qual Control 14(2):147–156

    Google Scholar 

  • Karvonen T, Behutiye W, Oivo M, Kuvaja P (2017) Systematic literature review on the impacts of agile release engineering practices. Inf Softw Technol 86:87–100

    Google Scholar 

  • Kim J, de Dear R (2012) Nonlinear relationships between individual IEQ factors and overall workspace satisfaction. Build Environ 49:33–40

    Google Scholar 

  • Kneuper R (2009) CMMI improving software and systems development processes using capability maturity model integration (CMMI-DEV). Rocky Nook, Santa Barbara

    Google Scholar 

  • Kondo Y (2001) Customer satisfaction: how can I measure it? Total Qual Manag 12(7–8):867–872

    Google Scholar 

  • Kruchten P (2000) The rational unified process: an introduction, 2nd edn. Addison-Wesley, Boston

    Google Scholar 

  • Laporte C, O’Connor R, García Paucar LH (2016) The implementation of ISO/IEC 29110 software engineering standards and guides in very small entities. Evaluation of Novel approaches to software engineering. Springer, Heidelberg, pp 162–179

    Google Scholar 

  • Lauesen S, Kuhail MA (2012) Task descriptions versus use cases. Requir Eng 17(1):3–18

    Google Scholar 

  • Lee Y-C, Sheu L-C, Tsou Y-G (2008) Quality function deployment implementation based on Fuzzy Kano model: an application in PLM system. Comput Ind Eng 55(1):48–63

    Google Scholar 

  • Lee S-G, Yang C-G, Lee S-B, Lee J-B (2015) A study on the antecedents and consequences of satisfaction and dissatisfaction in web portal usage. Serv Bus 9(3):567–586

    Google Scholar 

  • Lin S-P, Yang C-L, Chan Y, Sheu C (2010) Refining Kano’s “quality attributes-satisfaction” model: a moderated regression approach. Int J Prod Econ 126(2):255–263

    Google Scholar 

  • Lofgren M, Witell L (2008) Two decades of using Kano’s theory of attractive quality: a literature review. Qual Manag J 15(1):59–75

    Google Scholar 

  • Loon HV (2007) Process assessment and ISO/IEC 15504: a reference book. Springer, New York

    Google Scholar 

  • Lucassen G, Dalpiaz F, van der Werf JMEM, Brinkkemper S (2016) Improving agile requirements: the quality user story framework and tool. Requir Eng 21(3):383–403

    Google Scholar 

  • Maglyas A, Nikula U, Smolander K, Fricker SA (2017) Core software product management activities. J Adv Manag Res 14(1):23–45

    Google Scholar 

  • Matzler K, Hinterhuber H (1998) How to make product development projects more successful by integrating Kano’s model of customer satisfaction into quality function deployment. Technovation 18(1):25–38

    Google Scholar 

  • Mayer JH (2012) Using the Kano model to identify attractive user-interface software components. In: Digital innovation in the service economy. 33th international conference on information systems (ICIS). Red Hook, Curran, Orlando, USA, pp 1470–1486

  • Mamavi O, Nagati H, Pache G, Wehrle FT (2015) How does performance history impact supplier selection in public sector? Ind Manag Data Syst 115(1):107–128

    Google Scholar 

  • Mikulic J, Prebezac D (2011) A critical review of techniques for classifying quality attributes in the Kano model. Manag Serv Qual 21(1):46–66

    Google Scholar 

  • Miller G (2001) Sizing up today’s lightweight software processes. IT Prof 3(3):46–49

    Google Scholar 

  • Mittal N, Nault BR (2009) Investments in information technology: indirect effects and information technology intensity. Inf Syst Res 20(1):140–154

    Google Scholar 

  • Nagashima M, Wehrle F, Kerbache L, Lassagne M (2015) Impacts of adaptive collaboration on demand forecasting accuracy of different product categories throughout the product life cycle. Supply Chain Manag 20:415–433

    Google Scholar 

  • Neumann G, Sobernig S, Aram M (2014) Evolutionary business information systems perspectives and challenges of an emerging class of information systems. Bus Inf Syst Eng 6(1):33–38

    Google Scholar 

  • Raspotnig C, Opdahl A (2013) Comparing risk identification techniques for safety and security requirements. J Syst Softw 86(4):1124–1151

    Google Scholar 

  • Robnik-Šikonja M, Kononenko I (2003) Theoretical and empirical analysis of ReliefF and RReliefF. Mach Learn 53(1–2):23–69

    Google Scholar 

  • Robnik-Šikonja M, Savicky P (2016) CORElearn: classification, regression and feature evaluation R package. http://CRAN.R-project.org/package=CORElearn. Accessed 1 Feb 2019

  • Robnik-Šikonja M, Vanhoof K (2007) Evaluation of ordinal attributes at value level. Data Min Knowl Disc 14(2):225–243

    Google Scholar 

  • Robnik-Šikonja M, Brijs K, Vanhoof K (2009) Ordinal evaluation: a new perspective on country images. In: Perner P (ed) Advances in data mining. Applications and theoretical aspects. Springer, Berlin, Heidelberg, pp 261–275

  • Robson C (2002) Real world research: a resource for social scientists and practitioner-researchers, 2nd edn. Blackwell, Oxford

    Google Scholar 

  • Rodriguez P, Haghighatkhah A, Lwakatare LE et al (2017) Continuous deployment of software intensive products and services: a systematic mapping study. J Syst Softw 123:263–291

    Google Scholar 

  • Rogers EM (2003) Diffusion of innovations, 5th edn. Free Press, New York

    Google Scholar 

  • Soetens QD, Demeyer S, Zaidman A, Perez J (2016) Change-based test selection: an empirical evaluation. Empir Softw Eng 21(5):1990–2032

    Google Scholar 

  • Standish-Group (2015) CHAOS report. https://www.standishgroup.com/. Accessed 29 June 2016

  • Unterkalmsteiner M, Gorschek T, Islam AKMM et al (2014) A conceptual framework for SPI evaluation. J Softw Evolut Process 26(2):251–279

    Google Scholar 

  • Urbach N, Müller B (2011) The updated DeLone and McLean model of information systems success. In: Dwivedi Y, Wade M, Schneberger S (eds) Information systems theory. Springer, New York, pp 1–18

    Google Scholar 

  • Vavpotič D, Bajec M (2009) An approach for concurrent evaluation of technical and social aspects of software development methodologies. Inf Softw Technol 51(2):528–545

    Google Scholar 

  • Vavpotič D, Hovelja T (2012) Improving the evaluation of software development methodology adoption and its impact on enterprise performance. Comput Sci Inf Syst 9(1):165–187

    Google Scholar 

  • Violante MG, Vezzetti E (2017) Kano qualitative vs quantitative approaches: an assessment framework for products attributes analysis. Comput Ind 86:15–25

    Google Scholar 

  • Wells H (2012) How effective are project management methodologies? an explorative evaluation of their benefits in practice. Proj Manag J 43(6):43–58

    Google Scholar 

  • Witell L, Löfgren M, Dahlgaard J (2013) Theory of attractive quality and the Kano methodology—the past, the present, and the future. Tot Qual Manag Bus Excell 24(11–12):1241–1252

    Google Scholar 

  • Yin RK (2009) Case study research: design and methods, 4th edn. Sage, Thousand Oaks

    Google Scholar 

  • Zdravkovic J, Svee E-O, Giannoulis C (2015) Capturing consumer preferences as requirements for software product lines. Requir Eng 20(1):71–90

    Google Scholar 

  • Zhao L, Chen Z, Hu Y et al (2018) Distributed feature selection for efficient economic big data analysis. IEEE Trans Big Data 4(2):164–176

    Google Scholar 

Download references

Acknowledgements

The authors acknowledge the financial support from the Slovenian Research Agency (research core Funding No P6-0411 and No P2-0359) and from the European Union’s Horizon 2020 research and innovation program under Grant Agreements No 825153 and 777204.

Author information

Authors and Affiliations

  1. Faculty of Computer and Information Science, University of Ljubljana, Večna Pot 113, 1000, Ljubljana, Slovenia

    Damjan Vavpotič, Marko Robnik-Šikonja & Tomaž Hovelja

Authors
  1. Damjan Vavpotič
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Marko Robnik-Šikonja
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Tomaž Hovelja
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Damjan Vavpotič.

Additional information

Accepted after two revisions by Matthias Jarke.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Vavpotič, D., Robnik-Šikonja, M. & Hovelja, T. Exploring the Relations Between Net Benefits of IT Projects and CIOs’ Perception of Quality of Software Development Disciplines. Bus Inf Syst Eng 62, 347–360 (2020). https://doi.org/10.1007/s12599-019-00612-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12599-019-00612-4

Keywords

Search

Navigation