Advertisement

Empirical Software Engineering

, Volume 22, Issue 5, pp 2339–2372 | Cite as

User satisfaction and system success: an empirical exploration of user involvement in software development

  • Muneera BanoEmail author
  • Didar Zowghi
  • Francesca da Rimini
Article

Abstract

For over four decades user involvement has been considered intuitively to lead to user satisfaction, which plays a pivotal role in successful outcome of a software project. The objective of this paper is to explore the notion of user satisfaction within the context of the user involvement and system success relationship. We have conducted a longitudinal case study of a software development project and collected qualitative data by means of interviews, observations and document analysis over a period of 3 years. The analysis of our case study data revealed that user satisfaction significantly contributes to the system success even when schedule and budget goals are not met. The case study data analysis also presented additional factors that contribute to the evolution of user satisfaction throughout the project. Users’ satisfaction with their involvement and the resulting system are mutually constituted while the level of user satisfaction evolves throughout the stages of software development process. Effective management strategies and user representation are essential elements of maintaining an acceptable level of user satisfaction throughout software development process.

Keywords

User Involvement User Satisfaction System Success Software Development 

Notes

Acknowledgments

We would like to express our gratitude to the ASG management and staff for allowing us to conduct this study. We also acknowledge the funding provided to Muneera Bano by the University of Technology Sydney, and Schlumberger award of the Faculty For The Future (FFTF).

References

  1. Abelein U, Paech B (2013) Understanding the influence of user participation and involvement on system success–A systematic mapping study. Empir Softw Eng 20(1):28–81CrossRefGoogle Scholar
  2. Au N, Ngai EW, Cheng TE (2008) Extending the understanding of end user information systems satisfaction formation: An equitable needs fulfillment model approach. MIS Quarterly 43–66Google Scholar
  3. Bailey JE, Pearson SW (1983) Development of a tool for measuring and analyzing computer user satisfaction. Manag Sci 29(5):530–545CrossRefGoogle Scholar
  4. Ballantine J, Bonner M, Levy M, Martin A, Munro I, Powell P (1996) The 3-D model of information systems success: the search for the dependent variable continues. Info Res Manag J (IRMJ) 9(4):5–15Google Scholar
  5. Bano M, Zowghi D (2013) ‘Users' involvement in requirements engineering and system success’ In 3rd IEEE International Workshop on Empirical Requirements Engineering (EmpiRE) at International Requirements Engineering Conference 2013, Rio de Janeiro, Brazil. 24–31Google Scholar
  6. Bano M, Zowghi D (2015) A systematic review on the relationship between user involvement and system success. Inf Softw Technol 58:148–169CrossRefGoogle Scholar
  7. Barki H, Hartwick J (1989) Rethinking the concept of user involvement. MIS Quarterly 53–63Google Scholar
  8. Baronas A-MK, Louis MR (1988) Restoring a sense of control during implementation: how user involvement leads to system acceptance. MIS Quarterly 111–24Google Scholar
  9. Bhattacherjee A (2001) Understanding information systems continuance: an expectation-confirmation model. MIS Quarterly 351–70Google Scholar
  10. Briggs RO, Reinig BA, de Vreede G-J (2006) Meeting Satisfaction for Technology-Supported Groups An Empirical Validation of a Goal-Attainment Model. Small Group Res 37(6):585–611CrossRefGoogle Scholar
  11. Briggs RO, Reinig B, de VreedeG-J (2012) The yield shift theory of satisfaction and its application to the IS/IT domain. Info Syst Theory, Springer, 185–217Google Scholar
  12. Cavaye AL (1995) User participation in system development revisited. Info Manag 28(5):311–323CrossRefGoogle Scholar
  13. Charmaz K (2006) Constructing Grounded Theory. SAGEGoogle Scholar
  14. Cruzes DS, Dybå T (2011) Recommended steps for thematic synthesis in software engineering. Int Symp Emp Software Eng Measure (ESEM), IEEE, 275–84Google Scholar
  15. Dalcher D (2009) Software project success: moving beyond failure. Eur J Info Profession 10(1):42–50Google Scholar
  16. DeLone WH, McLean ER (1992) Information systems success: The quest for the dependent variable. Inf Syst Res 3(1):60–95CrossRefGoogle Scholar
  17. Delone WH, McLean ER (2003) The DeLone and McLean model of information systems success: a ten-year update. J Manag Inf Syst 19(4):9–30CrossRefGoogle Scholar
  18. Doll WJ, Torkzadeh G (1988) The measurement of end-user computing satisfaction. MIS Quarterly 259–74Google Scholar
  19. Doll WJ, Xia W, Torkzadeh G (1994) A confirmatory factor analysis of the end-user computing satisfaction instrument. MIS Quarterly 453–61Google Scholar
  20. Dybå T, Dingsøyr T, Hanssen GK (2007) Applying Systematic Reviews to Diverse Study Types: An Experience Report. First Int Symp Emp Software Eng Measure, ESEM 2007., IEEE. 225–34Google Scholar
  21. Eason K (1989) Information Technology and Organizational Change, Taylor and Francis, IncGoogle Scholar
  22. El Emam K (2008) A replicated survey of IT software project failures. IEEE Softw 25(5):84–90MathSciNetCrossRefGoogle Scholar
  23. Gregor S (2006) The nature of theory in information systems. MIS Quarterly 611–42Google Scholar
  24. Harris MA, Weistroffer HR (2009) A new look at the relationship between user involvement in systems development and system success. Commun Assoc Inf Syst 24(1):42Google Scholar
  25. Hartwick J, Barki H (1994) Explaining the role of user participation in information system use. Manag Sci 40(4):440–465CrossRefGoogle Scholar
  26. He J, King WR (2008) The role of user participation in information systems development: implications from a meta-analysis. J Manag Inf Syst 25(1):301–331CrossRefGoogle Scholar
  27. Hirschheim RA (1989) User participation in practice: Experiences with participative systems design. Participat Syst Dev 194–212Google Scholar
  28. Hirschheim R, Klein HK (1989) Four paradigms of information systems development. Commun ACM 32(10):1199–1216CrossRefGoogle Scholar
  29. Hwang MI, Thorn RG (1999) The effect of user engagement on system success: a meta-analytical integration of research findings. Info Manag 35(4):229–236CrossRefGoogle Scholar
  30. Igbaria M, Wormley WM (1992) Organizational experiences and career success of MIS professionals and managers: an examination of race differences. MIS Quarterly 507–29Google Scholar
  31. Iivari N (2006) Representing the User’ in software development—a cultural analysis of usability work in the product development context. Inter Comput 18(4):635–664CrossRefGoogle Scholar
  32. Iivari J, Isomäki H, Pekkola S (2010) The user–the great unknown of systems development: reasons, forms, challenges, experiences and intellectual contributions of user involvement. Inf Syst J 20(2):109–117CrossRefGoogle Scholar
  33. Ives B, Olson MH (1984) User involvement and MIS success: A review of research. Manag Sci 30(5):586–603CrossRefGoogle Scholar
  34. Ives B, Olson MH, Baroudi JJ (1983) The measurement of user information satisfaction. Commun ACM 26(10):785–793CrossRefGoogle Scholar
  35. Klobas JE, McGill TJ (2010) The role of involvement in learning management system success. J Comput High Educ 22(2):114–134CrossRefGoogle Scholar
  36. Kujala S (2003) User involvement: a review of the benefits and challenges. Behav Info Technol 22(1):1–16MathSciNetCrossRefGoogle Scholar
  37. Lawrence M, Low G (1993) Exploring individual user satisfaction within user-led development. MIS Quarterly 195–208Google Scholar
  38. Lee AS, Baskerville RL (2003) Generalizing generalizability in information systems research. Inf Syst Res 14(3):221–243CrossRefGoogle Scholar
  39. Liu V, Khalifa M (2003) Determinants of satisfaction at different adoption stages of Internet-based services. J Assoc Inf Syst 4(1):12Google Scholar
  40. McHaney R, Hightower R, Pearson J (2002) A validation of the end-user computing satisfaction instrument in Taiwan. Info Manag 39(6):503–511CrossRefGoogle Scholar
  41. McKeen JD, Guimaraes T (1997) Successful strategies for user participation in systems development. J Manag Inform Syst 133–50Google Scholar
  42. McKeen JD, Guimaraes T, Wetherbe JC (1994) The relationship between user participation and user satisfaction: an investigation of four contingency factors. MIS Quarterly 427–51Google Scholar
  43. McKinney V, Yoon K, Zahedi FM (2002) The measurement of web-customer satisfaction: An expectation and disconfirmation approach. Inf Syst Res 13(3):296–315CrossRefGoogle Scholar
  44. Melone NP (1990) A theoretical assessment of the user-satisfaction construct in information systems research. Manag Sci 36(1):76–91MathSciNetCrossRefGoogle Scholar
  45. Montesdioca GPZ, Maçada ACG (2015) Measuring user satisfaction with information security practices. Comput Security 48:267–280CrossRefGoogle Scholar
  46. Muller MJ, Haslwanter JH, Dayton T (1997) Participatory practices in the software lifecycle. Handbook Human-Comput Int 2:255–297CrossRefGoogle Scholar
  47. Myers MD (1997) Qualitative Research in Information Systems. MIS Quarterly 241Google Scholar
  48. Oliver RL (1996) Varieties of value in the consumption satisfaction response. Adv Consum Res 23:143–147Google Scholar
  49. Palanisamy R (2001) User involvement in information systems planning leads to strategic success: an empirical study’. J Serv Res 1(2):125Google Scholar
  50. Palmer JW, Griffith DA (1998) An emerging model of Web site design for marketing. Commun ACM 41(3):44–51CrossRefGoogle Scholar
  51. Petter S, DeLone W, McLean E (2008) Measuring information systems success: models, dimensions, measures, and interrelationships. Eur J Inf Syst 17(3):236–263CrossRefGoogle Scholar
  52. Procaccino JD, Verner JM, Overmyer SP, Darter ME (2002) Case study: factors for early prediction of software development success. Inf Softw Technol 44(1):53–62CrossRefGoogle Scholar
  53. Procaccino JD, Verner JM, Lorenzet SJ (2006) Defining and contributing to software development success. Commun ACM 49(8):79–83CrossRefGoogle Scholar
  54. Ralph P, Kelly P (2014) The dimensions of software engineering success. Proceedings of the 36th International Conference on Software Engineering, ICSE 2014, ACM. 24–35Google Scholar
  55. Reinig BA (2003) Toward an understanding of satisfaction with the process and outcomes of teamwork. J Manag Inf Syst 19(4):65–83CrossRefGoogle Scholar
  56. Robey D, Farrow D (1982) User involvement in information system development: A conflict model and empirical test. Manag Sci 28(1):73–85CrossRefGoogle Scholar
  57. Rouibah K, Hamdy HI, Al-Enezi MZ (2009) Effect of management support, training, and user involvement on system usage and satisfaction in Kuwait. Ind Manag Data Syst 109(3):338–356CrossRefGoogle Scholar
  58. Runeson P, Höst M (2009) Guidelines for conducting and reporting case study research in software engineering. Empir Softw Eng 14(2):131–164CrossRefGoogle Scholar
  59. Rushinek A, Rushinek SF (1986) What makes users happy? Commun ACM 29(7):594–598CrossRefGoogle Scholar
  60. Savolainen P, Ahonen JJ, Richardson I (2012) Software development project success and failure from the supplier's perspective: A systematic literature review. Int J Proj Manag 30(4):458–469CrossRefGoogle Scholar
  61. Seddon PB (1997) A respecification and extension of the DeLone and McLean model of IS success. Inf Syst Res 8(3):240–253CrossRefGoogle Scholar
  62. Srijumpa R, Speece M, Paul H (2002) Satisfaction drivers for Internet service technology among stock brokerage customers in Thailand. J Financ Serv Mark 6(3):240–253CrossRefGoogle Scholar
  63. Suh K, Kim S, Lee J (1994) End-user’s disconfirmed expectations and the success of information systems. Info Res Manag J 7(4):30Google Scholar
  64. Susarla A, Barua A, Whinston AB (2003) Understanding the service component of application service provision: empirical analysis of satisfaction with ASP services. MIS Q 27(1):91–123CrossRefGoogle Scholar
  65. Wagner EL, Piccoli G (2007) Moving beyond user participation to achieve successful IS design. Commun ACM 50(12):51–55CrossRefGoogle Scholar
  66. Walsham G (1995) The emergence of interpretivism in IS research. Inf Syst Res 6(4):376–394CrossRefGoogle Scholar
  67. Walsham G (2006) Doing interpretive research. Eur J Inf Syst 15(3):320–330CrossRefGoogle Scholar
  68. Wixom BH, Todd PA (2005) A theoretical integration of user satisfaction and technology acceptance. Inf Syst Res 16(1):85–102CrossRefGoogle Scholar
  69. Wu JTB, Marakas GM (2006) The impact of operational user participation on perceived system implementation success: An empirical investigation. J Comput Info Syst 46(5):127–140Google Scholar
  70. Yin RK (2013) Case study research: Design and methods. Sage publicationsGoogle Scholar
  71. Yoon,Y, Guimaraes T, O’Neal Q (1995) Exploring the factors associated with expert systems success. MIS Quarterly 83–106Google Scholar
  72. Zowghi D, da Rimini F, Bano M (2015) Problems and challenges of user involvement in software development: an empirical study', Proceedings of the 19th ACM International Conference on Evaluation and Assessment in Software Engineering, EASE 2015 9Google Scholar

Copyright information

© Springer Science+Business Media New York 2016

Authors and Affiliations

  • Muneera Bano
    • 1
    Email author
  • Didar Zowghi
    • 1
  • Francesca da Rimini
    • 1
  1. 1.Faculty of Engineering and Information TechnologyUniversity of Technology SydneyUltimoAustralia

Personalised recommendations