Skip to main content
SpringerLink
Log in

Der Stand der Forschung zur Erfolgsmessung von Informationssystemen

Eine Analyse vorhandener mehrdimensionaler Ansätze

The State of Research on Information Systems Success

A Review of Existing Multidimensional Approaches

  • State of the art
  • Published:
WIRTSCHAFTSINFORMATIK

Zusammenfassung

Die Erfolgsmessung von Informationssystemen (IS) ist sowohl für die Forschung als auch für die Praxis von großem Interesse. Dieser Artikel untersucht mehrdimensionale Ansätze der IS-Erfolgsmessung sowie den aktuellen Stand der Forschung in diesem Gebiet anhand einer Literaturanalyse und einer Klassifizierung von Veröffentlichungen aus den Jahren 2003 bis 2007. Auf der Basis von insgesamt 41 wissenschaftlichen Zeitschriften- und Konferenzartikeln erfolgt die Identifikation einschlägiger Forschung sowie die Kategorisierung, Konsolidierung und Diskussion der beschriebenen Forschungsergebnisse. Die Resultate zeigen, dass die vorherrschende empirische Forschung den individuellen Nutzen eines bestimmten IS-Typs anhand von Befragungen der entsprechenden Benutzer und anschließender Analyse mittels Strukturgleichungsmodellen ermittelt. Das Modell zur IS-Erfolgsmessung von DeLone und McLean ist die dominante theoretische Grundlage der untersuchten empirischen Literatur. Dieser Artikel bietet dem Leser einen umfangreichen Überblick sowie eine Strukturierung der Forschung zur Erfolgsmessung von Informationssystemen. Des Weiteren werden Möglichkeiten zur Weiterentwicklung identifiziert und Anregungen für zukünftige Forschung gegeben.

Abstract

Measuring information systems (IS) success is of great interest to both researchers and practitioners. This article examines multidimensional approaches to measuring IS success and explores the current state of IS success research through a literature review and by classifying articles published between 2003 and 2007. Based on a total of 41 academic journal and conference publications, the relevant research carried out is identified, while the research results are categorized, consolidated, and discussed. The results show that the dominant empirical research analyzes the individual impact of a certain type of information system by ascertaining users’ evaluation of it by means of surveys and then applying structural equation modeling. The DeLone and McLean Information Systems Success Model is the main theoretical basis of the reviewed empirical studies. This article provides researchers with a comprehensive review and structuring of IS success research. Furthermore, opportunities for additional development are identified and future research directions suggested.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Abb. 1
Abb. 2
Abb. 3
Abb. 4

Literatur

  • Alavi M, Carlson P (1992) A review of MIS research and disciplinary development. Journal of Management Information Systems 8(4):45–62

    Google Scholar 

  • Almutairi H, Subramanian GH (2005) An empirical application of the DeLone and McLean model in the Kuwaiti private sector. Journal of Computer Information Systems 45(3):113–122

    Google Scholar 

  • APA (2001) Publication manual of the American Psychological Association, 5. Aufl. APA, Washington, DC

  • Bailey JE, Pearson SW (1983) Development of a tool for measuring and analyzing computer user satisfaction. Management Science 29(5):530–545

    Article  Google Scholar 

  • Ballantine J, Bonner M, Levy M, Martin A, Munro I, Powell P (1996) The 3-D model of information systems success: the search for the dependent variable continues. Information Resource Management Journal 9(4):5–14

    Google Scholar 

  • Bartis E, Mitev N (2007) A multiple narrative approach to information systems failure: a successful system that failed. In: Proceedings of the 15th European conference on information systems (ECIS 07). St. Gallen

  • Bélanger F, Fan W, Schaupp LC, Krishen A, Everhart J, Poteet D, Nakamoto K (2006) Web site success metrics: addressing the duality of goals. Communications of the ACM 49(12):114–116

    Article  Google Scholar 

  • Bradley RV, Pridmore JL, Byrd TA (2006) Information systems success in the context of different corporate cultural types: an empirical investigation. Journal of Management Information Systems 23(2):267–294

    Article  Google Scholar 

  • Briggs RO, De Vreede GJ, Nunamaker JF Jr, Sprague RH Jr (2003) Special issue: information systems success. Journal of Management Information Systems 19(4):5–8

    Google Scholar 

  • Brynjolfsson E (1993) The productivity paradox of information technology. Communications of the ACM 36(12):66–77

    Article  Google Scholar 

  • Byrd TA, Thrasher EH, Lang T, Davidson NW (2006) A process-oriented perspective of IS success: examining the impact of IS on operational cost. Omega 34(5):448–460

    Article  Google Scholar 

  • Caya O, Pinsonneault A (2004) „Are we in crisis?“ An assessment of thirty years of introspection in IS. In: Proceedings of the 32nd annual conference of the Administrative Sciences Association of Canada (ASAC 2004). Quebec

  • Cha-Jan Chang J, King WR (2005) Measuring the performance of information systems: a functional scorecard. Journal of Management Information Systems 22(1):85–115

    Article  Google Scholar 

  • Chae HCM (2007) IS success model and perceived IT value. In: Proceedings of the 13th Americas conference on information systems (AMCIS 07). Keystone

  • Cheung CMK, Lee MKO (2005) The asymmetric effect of website attribute performance on satisfaction: an empirical study. In: Proceedings of the 38th Hawaii international conference on system sciences (HICSS 05). Big Island

  • Clay PF, Dennis AR, Ko DG (2005) Factors affecting the loyal use of knowledge management systems. In: Proceedings of the 38th Hawaii international conference on system sciences (HICSS 05). Big Island

  • Davis FD (1989) Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS Quarterly 13(3):318–340

    Article  Google Scholar 

  • DeLone WH, McLean ER (1992) Information systems success: the quest for the dependent variable. Information Systems Research 3(1):60–95

    Article  Google Scholar 

  • DeLone WH, McLean ER (2002) Information systems success revisited. In: Proceedings of the 35th Hawaii international conference on system sciences (HICSS 02). Big Island, S 238–249

  • DeLone WH, McLean ER (2003) The DeLone and McLean model of information systems success: a ten-year update. Journal of Management Information Systems 19(4):9–30

    Google Scholar 

  • DeLone WH, McLean ER (2004) Measuring e-commerce success: applying the DeLone & McLean Information systems success model. International Journal of Electronic Commerce 9(1):31–47

    Google Scholar 

  • Fettke P (2006) State-of-the-Art des State-of-the-Art: Eine Untersuchung der Forschungsmethode „Review“ innerhalb der Wirtschaftsinformatik. WIRTSCHAFTSINFORMATIK 48(4):257–266

    Article  Google Scholar 

  • Gable G, Sedera D, Chan T (2003) Enterprise systems success: a measurement model. In: Proceedings of the 24th international conference on information systems (ICIS 03). Seattle

  • Garrity EJ, Glassberg B, Kim YJ, Sanders GL, Shin SK (2005) An experimental investigation of web-based information systems success in the context of electronic commerce. Decision Support Systems 39(3):485–503

    Article  Google Scholar 

  • Gatian AW (1994) Is user satisfaction a valid measure of system effectiveness? Information & Management 26(3):119–131

    Google Scholar 

  • Gonzalez R, Gasco J, Llopis J (2006) Information systems outsourcing: A literature analysis. Information & Management 43(7):821–834

    Google Scholar 

  • Goodhue DL, Thompson RL (1995) Task-technology fit and individual performance. MIS Quarterly 19(2):213

    Article  Google Scholar 

  • Grover V, Jeong SR, Segars AH (1996) Information systems effectiveness: the construct space and patters of application. Information & Management 31(4):177–191

    Google Scholar 

  • Hu PJH (2003) Evaluating telemedicine systems success: a revised model. In: Proceedings of the 36th Hawaii international conference on system sciences (HICSS 03). Big Island

  • IDC (2007) IDC press release. Framingham

  • Iivari J (2005) An empirical test of the DeLone-McLean model of information system success. The DATA BASE for Advances in Information Systems 26(2):8–27

    Google Scholar 

  • Jennex ME, Olfman L (2003) A knowledge management success model: an extension of DeLone and McLean’s IS success model. In: Proceedings of the 9th Americas conference on information systems (AMCIS 03). Tampa

  • Jennex ME, Olfman L (2004) Assessing knowledge management success/effectiveness models. In: Proceedings of the 37th Hawaii international conference on system sciences (HICSS 04). Big Island

  • Keen PGW (1980) Reference disciplines and a cumulative tradition. In: Proceedings of the 1st international conference on information systems (ICIS 80). Philadelphia, S 9–18

  • King WR, He J (2005) Understanding the role and methods of meta-analysis in IS research. Communication of the AIS 16:656–686

    Google Scholar 

  • Kleist VF, Williams L, Peace AG (2004) A performance evaluation framework for a public university knowledge management system. Journal of Computer Information Systems 44(3):9–16

    Google Scholar 

  • Kulkarni UR, Ravindran S, Freeze R (2006) A knowledge management success model: theoretical development and empirical validation. Journal of Management Information Systems 23(3):309–347

    Article  Google Scholar 

  • Larsen KRT (2003) A taxonomy of antecedents of information systems success: variable analysis studies. Journal of Management Information Systems 20(2):169–246

    Google Scholar 

  • Lucas Jr HC (1978) Empirical evidence for a descriptive model of implementation. MIS Quarterly 2(2):27

    Article  Google Scholar 

  • Mao E, Ambrose P (2004) A theoretical and empirical validation of is success models in a temporal and quasi volitional technology usage context. In: Proceedings of the 10th Americas conference on information systems (AMCIS 04). New York

  • Nelson RR, Todd PA, Wixom BH (2005) Antecedents of information and system quality: an empirical examination within the context of data warehousing. Journal of Management Information Systems 21(4):199–235

    Google Scholar 

  • Palvia P, Mao E, Midha V (2003) Management information systems research: what’s there in a methodology? Communication of the AIS 11:289–309

    Google Scholar 

  • Palvia P, Mao E, Midha V (2004) Research methodologies in MIS: an update. Communication of the AIS 14:526–542

    Google Scholar 

  • Pare G, Aubry D, Lepanto L, Sicotte C (2005) Evaluating PACS success: a multidimensional model. In: Proceedings of the 38th Hawaii international conference on system sciences (HICSS 05). Big Island

  • Qian Z, Bock GW (2005) An empirical study on measuring the success of knowledge repository systems. In: Proceedings of the 38th Hawaii international conference on system sciences (HICSS 05). Big Island

  • Rai A, Lang SS, Welker RB (2002) Assessing the validity of IS success models: an empirical test and theoretical analysis. Information Systems Research 13(1):50–69

    Article  Google Scholar 

  • Rainer Jr RK, Watson HJ (1995) The keys to executive information system success. Journal of Management Information Systems 12(2):83–98

    Google Scholar 

  • Rosemann M, Vessey I (2005) Linking theory and practice: performing a reality check on a model of IS success. In: Proceedings of the 13th European conference on information systems (ECIS 05). Regensburg

  • Rosemann M, Vessey I (2008) Toward improving the relevance of information systems research to practice: the role of applicability checks. MIS Quarterly 32(1):1–22

    Google Scholar 

  • Saunders C (2008) MIS journal rankings. http://www.isworld.org/csaunders/rankings.htm. Accessed 2008-10-15

  • Schaupp LC, Fan W, Belanger F (2006) Determining success for different website goals. In: Proceedings of the 39th Hawaii international conference on system sciences (HICSS 06). Kauai

  • Seddon PB (1997) A respecification and extension of the DeLone and McLean model of IS success. Information Systems Research 8(3):240–253

    Article  Google Scholar 

  • Seddon PB, Kiew MY (1994) A partial test and development of the DeLone and McLean model of IS success. In: Proceedings of the 15th international conference on information systems (ICIS 94). Vancouver, S 99–110

  • Seddon PB, Staples S, Patnayakuni R, Bowtell M (1999) Dimensions of information systems success. Communications of the AIS 2:1–60

    Google Scholar 

  • Sedera D (2006) An empirical investigation of the salient characteristics of IS-success models. In: Proceedings of the 12th Americas conference on information systems (AMCIS 06). Acapulco

  • Sedera D, Gable G (2004a) A factor and structural equation analysis of the enterprise systems success measurement model. In: Proceedings of the 37th Hawaii international conference on system sciences (HICSS 04). Big Island

  • Sedera D, Gable G (2004b) A factor and structural equation analysis of the enterprise systems success measurement model. In: Proceedings of the 25th international conference on information systems (ICIS 04). Washington, DC, S. December 12–15

  • Sedera D, Gable G, Chan T (2004a) Knowledge management as an antecedent of enterprise system success. In: Proceedings of the 10th Americas conference on information systems (AMCIS 04). New York

  • Sedera D, Gable G, Chan T (2004b) Measuring enterprise systems success: the importance of a multiple stakeholder perspective. In: Proceedings of the 12th European conference on information systems (ECIS 04). Turku

  • Seen M, Rouse AC, Beaumont N (2007) Explaining and predicting information systems acceptance and success: an integrative model. In: Proceedings of the 15th European conference on information systems (ECIS 07). St Gallen

  • Shannon CE, Weaver W (1949) The mathematical theory of communication. University of Illinois Press, Urbana

  • Shin B (2003) An exploratory investigation of system success factors in data warehousing. Journal of the AIS 4:141–170

    Google Scholar 

  • Sugumaran V, Arogyaswamy B (2003) Measuring IT performance: „contingency“ variables and value modes. Journal of Computer Information Systems 44(2):79–86

    Google Scholar 

  • Thomas P (2006) Information systems success and technology acceptance within government organization. In: Proceedings of the 12th Americas conference on information systems (AMCIS 06). Acapulco

  • Tinsley HE, Weiss DJ (1975) Interrater reliability and agreement of subjective judgments. Journal of Counseling Psychology 22(4):358–376

    Article  Google Scholar 

  • Verner J, Cox K, Bleistein SJ (2006) Predicting good requirements for in-house development projects. In: Proceedings of the 2006 ACM/IEEE international symposium on empirical software engineering. Rio de Janeiro, S 154–163

  • Watson RT, Pitt LF, Kavan CB (1998) Measuring information systems service quality: lessons from two longitudinal case studies. MIS Quarterly 22(1):61–79

    Article  Google Scholar 

  • Webster J, Watson RT (2002) Analyzing the past to prepare for the future: writing a literature review. MIS Quarterly 26(2):xiii–xxiii

    Google Scholar 

  • Wilkin C, Castleman T (2003) Development of an instrument to evaluate the quality of delivered information systems. In: Proceedings of the 36th Hawaii international conference on system sciences (HICSS 03). Big Island

  • Wixom BH, Todd PA (2005) A theoretical integration of user satisfaction and technology acceptance. Information Systems Research 16(1):85–102

    Article  Google Scholar 

  • Wu JH, Wang YM (2006) Measuring KMS success: A respecification of the DeLone and McLean’s model. Information & Management 43(6):728–739

    Google Scholar 

  • Yusof MM, Paul RJ, Stergioulas LK (2006) Towards a framework for health information systems evaluation. In: Proceedings of the 39th Hawaii international conference on system sciences (HICSS 06). Kauai

Download references

Author information

Authors and Affiliations

  1. European Business School (EBS), Institute of Research on Information Systems (IRIS), Rheingaustr. 1, 65375, Oestrich-Winkel, Deutschland

    Nils Urbach,  Stefan Smolnik &  Gerold Riempp

Authors
  1. Nils Urbach
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Stefan Smolnik
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Gerold Riempp
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Nils Urbach.

Additional information

Angenommen nach zwei Überarbeitungen durch Prof. Dr. Buxmann.

This article is also available in English via http://www.springerlink.com and http://www.bise-journal.org: Urbach N, Smolnik S, Riempp G (2009) The State of Research on Information Systems Success – A Review of Existing Multidimensional Approaches. Bus. Inf. Syst. Eng. doi: 10.1007/s12599-009-0059-y.

Anhang

Anhang

Klassifikation der empirischen Beiträge

Beitrag

Theoretische Grundlage

Untersuchungsgegenstand

Untersuchungseinheit

Evaluationsperspektive

Datensammlung

 

DeLone & McLean (1992)

DeLone & McLean (2003)

Davis (1989)

Seddon (1997)

Sonstige

n/a

Einzelne IT- Applikation

IT-Typ oder

IT-Applikations-typ

Alle IT-Applika-tionen

IT-Funktion einer Organi-sation

n/a

Individuelle

Ebene

Organisa-torische Ebene

n/a

Anwender

IT-Führungs-kräfte

IT-Personal

Multi-Stake-holder

n/a

Umfrage

Interview

Fall-studie

Sonstige

Struktur-gleichungs-modellierung

Regressions-analyse

Faktor-analyse

Varianz-analyse

Cluster-analyse

Sonstige

Almutairi u. Subramanian (2005)

X

 

 

 

 

 

 

 

X

 

 

X

X

 

 

 

X

 

 

X

 

 

 

 

X

 

 

 

X

Bartis u. Mitev (2007)

 

 

 

 

X

 

X

 

 

 

 

X

X

 

 

 

 

X

 

 

 

X

 

 

 

 

 

 

X

Bradley et al. (2006)

 

X

 

 

 

 

 

 

X

 

 

X

X

 

 

X

 

 

 

X

 

 

 

X

 

 

 

X

 

Byrd et al. (2006)

X

 

 

 

 

 

 

 

X

 

 

X

X

 

 

X

 

 

 

X

 

 

X

X

 

X

X

 

 

Cha-Jan Chang u. King (2005)

 

 

 

 

X

 

 

 

 

X

 

X

X

 

X

 

 

 

 

X

 

 

 

X

 

X

 

 

 

Cheung u. Lee (2005)

 

 

 

 

X

 

X

 

 

 

 

X

 

 

X

 

 

 

v

X

 

 

 

 

X

 

 

 

 

Clay et al. (2005)

X

 

 

 

 

 

X

 

 

 

 

X

 

 

X

 

 

 

 

X

 

 

 

X

 

 

 

 

 

Gable et al. (2003)

X

 

 

 

X

 

 

X

 

 

 

X

X

 

 

 

 

X

 

X

 

 

 

 

 

X

 

 

 

Garrity et al. (2005)

X

 

X

 

X

 

 

X

 

 

 

X

 

 

X

 

 

 

 

X

 

 

 

X

 

 

X

 

 

Iivari (2005)

X

 

 

 

 

 

X

 

 

 

 

X

 

 

X

 

 

 

 

X

 

 

 

X

 

 

 

 

 

Kulkarni et al. (2006)

 

X

 

 

 

 

 

X

 

 

 

X

 

 

X

 

 

 

 

X

 

 

 

X

 

X

 

 

 

Larsen (2003)

 

 

 

 

 

X

 

 

 

 

X

 

 

X

 

 

 

 

X

 

 

 

X

 

 

 

X

X

 

Mao u. Ambrose (2004)

X

 

 

X

 

 

 

X

 

 

 

X

 

 

X

 

 

 

 

X

 

 

 

X

 

X

 

 

 

Nelson et al. (2005)

X

 

 

X

X

 

 

X

 

 

 

X

 

 

X

 

 

 

 

X

 

 

 

X

 

 

X

 

 

Pare et al. (2005)

 

X

 

 

X

 

X

 

 

 

 

X

 

 

X

 

 

 

 

X

X

 

 

 

 

 

 

v

X

Qian u. Bock (2005)

X

 

 

 

X

 

 

X

 

 

 

X

 

 

X

 

 

 

 

X

 

 

 

X

 

X

X

 

 

Rosemann u. Vessey (2005)

X

X

 

 

 

 

 

 

 

 

X

 

 

X

 

 

 

 

X

 

 

 

X

 

 

 

 

 

X

Sabherwal et al. (2006)

X

 

X

 

X

 

 

 

 

 

X

X

 

 

X

 

 

 

 

 

 

 

X

X

 

 

 

 

 

Schaupp et al. (2006)

X

X

X

 

 

 

 

X

 

 

 

X

 

 

X

 

 

 

 

X

 

 

 

X

 

 

 

 

 

Sedera (2006)

X

X

 

 

X

 

 

X

 

 

 

X

X

 

X

 

 

 

 

X

 

 

 

 

 

X

 

 

X

Sedera u. Gable (2004b)

X

 

 

 

X

 

 

X

 

 

 

X

X

 

X

 

 

 

 

X

 

 

 

X

 

X

 

 

 

Sedera u. Gable (2004a)

X

 

 

 

X

 

 

X

 

 

 

X

X

 

X

 

 

 

 

X

 

 

 

X

 

X

 

 

 

Sedera et al. (2004a)

 

 

 

 

X

 

 

X

 

 

 

X

X

 

X

 

 

 

 

X

 

 

 

X

 

 

 

 

 

Sedera et al. (2004b)

 

 

 

 

X

 

 

X

 

 

 

X

X

 

 

 

 

X

 

X

 

 

 

 

 

 

X

 

 

Shin (2003)

 

X

 

 

 

 

X

 

 

 

 

X

 

 

X

 

 

 

 

X

X

 

 

 

X

X

X

 

 

Wilkin u. Castleman (2003)

X

 

 

 

 

 

 

X

 

 

 

X

X

 

 

 

 

X

 

 

X

 

X

 

 

 

 

 

X

Wixom u. Todd (2005)

X

 

X

 

X

 

 

X

 

 

 

X

 

 

X

 

 

 

 

X

 

 

 

X

 

 

 

 

 

Wu u. Wang (2006)

X

X

 

 

 

 

 

X

 

 

 

X

 

 

X

 

 

 

 

X

 

 

 

X

 

X

 

 

 

Gesamt

28

18

8

4

2

15

1

6

15

3

1

3

26

12

2

19

2

1

4

2

23

3

1

5

17

3

11

7

2

6

Klassifikation der nicht empirischen Beiträge

Beitrag

Methodologie

Theoretische Grundlage

Untersuchungsgegenstand

 

Framework/

Konzeptionelles

Modell

Spekulation/

Kommentar

Literatur-

analyse

Sonstige

DeLone &

McLean (1992)

DeLone &

McLean (2003)

Davis

(1989)

Seddon

(1997)

Sonstige

n/a

Einzelne

IT-Applikation

IT-Typ oder IT-Applikationstyp

Alle

IT-Applikationen

IT-Funktion einer Organisation

n/a

Bélanger et al. (2006)

 

X

 

 

 

 

 

 

 

 

 

X

 

 

 

Briggs et al. (2003)

 

X

 

 

 

 

 

 

 

X

 

 

 

 

X

Chae (2007)

X

 

 

 

X

X

 

 

X

 

 

 

 

 

X

DeLone u. McLean (2003)

X

 

 

 

X

 

 

 

 

 

 

 

 

 

X

DeLone u. McLean (2004)

X

 

 

 

 

X

 

 

 

 

 

X

 

 

 

Hu (2003)

X

 

 

 

X

 

 

 

 

 

 

X

 

 

 

Jennex u. Olfman (2003)

X

 

 

 

X

 

 

 

 

 

 

X

 

 

 

Jennex u. Olfman (2004)

X

 

 

 

 

 

 

 

 

X

 

X

 

 

 

Kleist et al. (2004)

X

 

 

 

X

 

 

 

 

 

X

 

 

 

 

Seen et al. (2007)

X

 

 

 

 

 

 

 

X

 

 

 

 

 

X

Sugumaran u. Arogyaswamy (2003)

X

 

 

 

 

X

 

 

X

 

 

 

 

 

X

Thomas (2006)

X

 

 

 

X

 

 

 

X

 

 

 

X

 

 

Yusof et al. (2006)

X

 

 

 

 

X

 

 

X

 

 

X

 

 

 

Gesamt

13

11

2

0

0

6

4

0

0

5

2

1

6

1

0

4

 

Rights and permissions

Reprints and permissions

About this article

Cite this article

Urbach, N., Smolnik, S. & Riempp, G. Der Stand der Forschung zur Erfolgsmessung von Informationssystemen. Wirtsch. Inform. 51, 363–375 (2009). https://doi.org/10.1007/s11576-009-0181-y

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11576-009-0181-y

Schlüsselwörter

Keywords

Search

Navigation