Skip to main content
SpringerLink
Log in

An Analysis of Literature Reviews on IS Business Value: How Deficiencies in Methodology and Theory Use Resulted in Limited Effectiveness

  • Conference paper
Scandinavian Information Systems Research (SCIS 2010)

Part of the book series: Lecture Notes in Business Information Processing ((LNBIP,volume 60))

Included in the following conference series:

Abstract

Enduring doubts about the value of IS investments reveal that IS researchers have not fully managed to identify and to explain the economic benefits of IS. This paper assumes that literature reviews, which represent a powerful instrument for the identification and synthesis of knowledge, have not tapped their full potential to address this issue due to deficiencies in methodology. The analysis of 18 literature reviews published in pertinent academic outlets during the past 20 years shows such deficiencies. Two of the most critical weaknesses identified are (1) the lack of theory use in most reviews and (2) a weak linkage of reviews, resulting in little progress in theory and framework development. The systematic identification of these weaknesses and the extraction of promising methodological examples from past literature are the main contributions of this work, which supports the composition of more effective literature reviews in future research.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Carr, N.G.: IT Doesn’t Matter. Harvard Business Review 81(5), 41–49 (2003)

    Google Scholar 

  2. WITSA, Global ICT Spending Tops $3.5 Trillion: Industry Experiences Subdued Spending Growth (2008), http://www.witsa.org/press/Digital_Planet_Release_final.doc

  3. Bannister, F., Remenyi, D.: Acts of faith: instinct, value and IT investment decisions. Journal of Information Technology 15(3), 231–241 (2000)

    Article  Google Scholar 

  4. West, L.A., Courtney, J.F.: The Information Problems in Organizations – A Research Model for the Value of Information and Information Systems. Decision Sciences 24(2), 229–251 (1993)

    Article  Google Scholar 

  5. Hitt, L.M., Brynjolfsson, E.: Productivity, Business Profitability, and Consumer Surplus: Three Different Measures of Information Technology Value. MIS Quarterly 20(2), 121–142 (1996)

    Article  Google Scholar 

  6. Stiroh, K., Botsch, M.: Information Technology and Productivity Growth in the 2000s. German Economic Review 8(2), 255–280 (2007)

    Article  Google Scholar 

  7. Im, K.S., Dow, K.E., Grover, V.: A Reexamination of IT Investment and the Market Value of the Firm – An Event Study Methodology. Information Systems Research 12(1), 103–117 (2001)

    Article  Google Scholar 

  8. Dehning, B., Stratopoulos, T.: Dupont Analysis of an IT-Enabled Competitive Advantage. The International Journal of Accounting Information Systems 3(3), 165–176 (2002)

    Article  Google Scholar 

  9. Kohli, R., Grover, V.: Business value of IT: An essay on expanding research directions to keep up with the times. Journal of the Association for Information Systems 9(1), 23–39 (2008)

    Google Scholar 

  10. Agarwal, R., Lucas, H.C.: The Information Systems Identity Crisis: Focusing on High-Visibility and High-Impact Research. MIS Quarterly 29(3), 381–398 (2005)

    Google Scholar 

  11. Webster, J., Watson, R.T.: Analyzing the past to prepare for the future: Writing a literature review. MIS Quarterly 26(2), xiii–xxiii (2002)

    Google Scholar 

  12. Sutton, R.I., Staw, B.M.: What Theory Is Not. Administrative Science Quarterly 40(3), 371–384 (1995)

    Article  Google Scholar 

  13. Baker, M.J.: Writing a Literature Review. The Marketing Review 1, 219–247

    Google Scholar 

  14. Zorn, T., Campbell, N.: Improving the Writing of Literature Reviews Through a Literature Integration Exercise. Business Communication Quarterly 69(2), 172–183 (2006)

    Article  Google Scholar 

  15. Bem, D.J.: Writing a Review for Psychological Bulletin. Psychological Bulletin 118(2), 172–177 (1995)

    Article  Google Scholar 

  16. Orlikowski, W.J., Iacono, C.S.: Desperately Seeking the ’IT’ in IT Research. A Call to Theorizing the IT Artifact. Information Systems Research 12(2), 121–134 (2001)

    Article  Google Scholar 

  17. ATIS, ATIS Telecom Glossary 2007 (2007), http://www.atis.org/glossary/

  18. Wiseman, D.: Information Economics: a practical approach to valuing information systems. Journal of Information Technology 7(3), 169–176 (1992)

    Article  Google Scholar 

  19. Berghout, E., Renkema, T.: Evaluating information systems investment proposals: a comparative review of current methodologies. Information and Software Technology 37(1), 1–13 (1997)

    Google Scholar 

  20. Melville, N., Kraemer, K., Gurbaxani, V.: Review: Information technology and organizational performance: An integrative model of IT business value. MIS Quarterly 28(2), 283–322 (2004)

    Google Scholar 

  21. Bharadwaj, A.S.: A resource-based perspective on information technology capability and firm performance: An empirical investigation. MIS Quarterly 24(1), 169–196 (2000)

    Article  Google Scholar 

  22. Brynjolfsson, E., Yang, S.: The intangible costs and benefits of computer investments: Evidence from the financial markets. In: Proceedings of the International Conference on Information Systems, Atlanta, Georgia (1999)

    Google Scholar 

  23. Barua, A., Kriebel, C.H., Mukhopadhyay, T.: Information technologies and business value – an analytical and empirical investigation. Information Systems Research 6(1), 3–23 (1995)

    Article  Google Scholar 

  24. Dehning, B., Richardson, V.J.: Returns on Investments in Information Technology: A Research Synthesis. Journal of Information Systems 16(1), 7–30 (2002)

    Article  Google Scholar 

  25. Irani, Z.: Information systems evaluation – navigating through the problem domain. Information & Management 40(1), 11–24 (2002)

    Article  Google Scholar 

  26. Bakos, J.Y.: Dependent Variables for the Study of Firm and Industry-Level Impacts of Information Technology. In: Proceedings of the International Conference on Information Systems, Pittsburgh, Pennsylvania, USA (1987)

    Google Scholar 

  27. Kauffman, R.J., Weill, P.: An Evaluative Framework for Research on the Performance Effects of Information Technology Investment. In: Proceedings of the International Conference on Information Systems, Boston, Massachusetts, USA, pp. 377–388 (1989)

    Google Scholar 

  28. Brynjolfsson, E., Yang, S.: Information Technology and Productivity: A Review of the Literature. Advances in Computers 43, 179–215 (1996)

    Article  Google Scholar 

  29. Devaraj, S., Kohli, R.: Information technology payoff in the health-care industry: A longitudinal study. Journal of Management Information Systems 16(4), 41–67 (2000)

    Google Scholar 

  30. Chau, P.Y.K., Kuan, K.K.Y., Liang, T.P.: Research on IT value: what we have done in Asia and Europe. European Journal of Information Systems 16(3), 196–201 (2007)

    Article  Google Scholar 

  31. Dubin, R.: Theory development. Free Press, New York (1978)

    Google Scholar 

  32. Whetten, D.A.: What constitutes a theoretical contribution? Academy of Management Review 14(4), 490–495 (1989)

    Article  Google Scholar 

  33. Gregor, S.: The Nature of Theory in Information Systems. MIS Quarterly 30(3), 611–642 (2006)

    Google Scholar 

  34. York University, Theories Used in IS Research Wiki (2009), http://www.fsc.yorku.ca/york/istheory/wiki/index.php/Main_Page

  35. Salipante, P., Notz, W., Bigelow, J.: A Matrix Approach to Literature Reviews. In: Staw, B.M., Cummings, L.L. (eds.) Research in Organizational Behavior, pp. 321–348. JAI Press, Greenwich (1982)

    Google Scholar 

  36. Cooper, H.M.: Synthesizing research - a guide for literature reviews, 3rd edn. Sage Publications, Thousand Oaks (1998)

    Google Scholar 

  37. Rainer, K., Miller, M.: Examining differences across journal rankings. Communications of the ACM 48(2), 91–94 (2005)

    Article  Google Scholar 

  38. DeLone, W.H., McLean, E.R.: Measuring e-commerce success: Applying the DeLone & McLean information systems success model. International Journal of Electronic Commerce 9(1), 31–47 (2004)

    Google Scholar 

  39. Brynjolfsson, E.: The productivity paradox of information technology. Communications of the ACM 36(12), 66–77 (1993)

    Article  Google Scholar 

  40. Soh, C., Markus, M.L.: How IT Creates Business Value: A Process Theory Synthesis. In: Proceedings of the 16th International Conference on Information Systems, Amsterdam, The Netherlands (1995)

    Google Scholar 

  41. Sircar, S., Turnbow, J.L., Bordoloi, B.: The impact of information technology investments on firm performance: a review of the literature. The Journal of Engineering Valuation and Cost Analysis 1(3), 171–181 (1998)

    Google Scholar 

  42. Seddon, P.B., Patnayakuni, R., Bowtell, M.: Dimensions of information systems success. Communications of the AIS 2(3), 1–61 (1999)

    Google Scholar 

  43. Chan, Y.E.: IT value: The great divide between qualitative and quantitative and individual and organizational measures. Journal of Management Information Systems 16(4), 225–261 (2000)

    Google Scholar 

  44. Irani, Z., Love, P.E.D.: Developing a frame of reference for ex-ante IT/IS investment evaluation. European Journal of Information Systems 11(1), 74–82 (2002)

    Article  Google Scholar 

  45. Sylla, C., Wen, H.J.: A conceptual framework for evaluation of information technology investments. International Journal of Technology Management 24(2-3), 236–261 (2002)

    Article  Google Scholar 

  46. Dedrick, J., Gurbaxani, V., Kraemer, K.L.: Information technology and economic performance: A critical review of the empirical evidence. ACM Computing Surveys 35(1), 1–28 (2003)

    Article  Google Scholar 

  47. Wan, Z., Fang, Y., Wade, M.: The Ten-Year Odyssey of the IS Productivity Paradoxon – A Citation Analysis (1996-2006). In: Proceedings of the Americas Conference on Information Systems, Keystone, CO, USA (2007)

    Google Scholar 

  48. Seddon, P.B.: A respecification and extension of the DeLone and McLean model of IS success. Information Systems Research 8(3), 240–253 (1997)

    Article  Google Scholar 

  49. Mason, R.O.: Measuring Information Output: A Communication Systems Approach. Information & Management 1(5), 219–234 (1978)

    Article  Google Scholar 

  50. Shannon, C.E., Weaver, W.: The Mathematical Theory of Communication. University of Illinois Press, Urbana (1949)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Business Information Systems, RWTH Aachen University, 52062, Aachen, Germany

    Guido Schryen

Authors
  1. Guido Schryen
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Department of Informatics, Copenhagen Business School, Howitzvej 60, DK-2000, Frederiksberg, Denmark

    Karlheinz Kautz

  2. Department of Computer Science, Aalborg University, Selma Lagerlöfs Vej 300, 9220, Aalborg, Denmark

    Peter Axel Nielsen

Rights and permissions

Reprints and permissions

Copyright information

© 2010 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Schryen, G. (2010). An Analysis of Literature Reviews on IS Business Value: How Deficiencies in Methodology and Theory Use Resulted in Limited Effectiveness. In: Kautz, K., Nielsen, P.A. (eds) Scandinavian Information Systems Research. SCIS 2010. Lecture Notes in Business Information Processing, vol 60. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-14874-3_10

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-14874-3_10

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-14873-6

  • Online ISBN: 978-3-642-14874-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation