Evaluating KMS Effectiveness for Decision Support: Preliminary Results

Part of the Annals of Information Systems book series (AOIS, volume 4)


This study evaluated the effectiveness of two knowledge management systems (KMS) for supporting individual decision makers in a predictive judgment task. The systems differed with respect to the way the technology was used to assist knowledge utilisation during the judgment process. The informating white-box KMS brought together relevant know-what and know-how in the form conducive to human consumption. The automating black-box KMS embedded codified knowledge within the software and automated its application. The preliminary results obtained from two contexts are mixed and suggest the contingent nature of KMS effectiveness on organisational identification.


Knowledge Management Systems (KMS) KMS Design KMS Effectiveness Decision Making Decision Support Experiment 


  1. AAOTE BC Knowledge Management. 1998. Arthur Andersen Office of Training and Education, Arthur Andersen.Google Scholar
  2. Alavi, M., and D.E. Leidner. 2001. Knowledge management and knowledge management systems: Conceptual foundations and research issues. MIS Quarterly 25(1): 107–136.CrossRefGoogle Scholar
  3. Alavi, M., and D.E. Leidner. 2002. Knowledge management systems: Issues, challenges and benefits. In Knowledge management systems: Theory and practice, ed. S. Barnes, 15–35. Oxford, UK: Thomson Learning.Google Scholar
  4. Andreassen, P.B. 1991. Causal prediction versus extrapolation: Effects on information source on judgemental forecasting accuracy, Working paper, MIT.Google Scholar
  5. Arkes, H.R., R.M. Dawes, and C. Christensen. 1986. Factors influencing the use of a decision rule in a probabilistic task. Organisational Behaviour and Human Decision Processes 37: 93–110.CrossRefGoogle Scholar
  6. Arnott, D. 2002. Decision biases and decision support systems development, Working Paper. No. 2002/04, Australia: Decision Support Systems Laboratory, Monash University.Google Scholar
  7. Ashton, R.H., and S.S. Kramer. 1980. Students as surrogates in behavioural accounting research: Some evidence. Journal of Accounting Research 18(1): 1–15.CrossRefGoogle Scholar
  8. Barnes, S. 2002. Introduction. In Knowledge management systems: Theory and practice, ed. S. Barnes, and S. Barnes, 1–11. Oxford, UK: Thomson Learning.Google Scholar
  9. Becerra-Fernandez, I., A. Gonzales, and R. Sabherwal. 2004. Knowledge management: Challenges, solutions, and technologies. Upper Saddle River, NJ: Pearson Education, Inc.Google Scholar
  10. Dalrymple, D.J. 1987. Sales forecasting practices: Results from a United States Survey. International Journal of Forecasting 3: 379–391.CrossRefGoogle Scholar
  11. Davenport, T.H., and L. Prusak. 1997. Information ecology. Oxford: Oxford University Press.Google Scholar
  12. Fischhoff, B. 1982. Debiasing. In Judgement under uncertainty: Heuristics and biases, ed. D. Kahneman, P. Slovic, and A. Tversky, 422–444. New York: Cambridge University Press.Google Scholar
  13. Glorfeld, L.A.W., and B.C. Hardgrave. 1996. An improved method for developing neural networks: The case of evaluating commercial loan creditworthiness. Computer Operation Research 23(10): 933–944.CrossRefGoogle Scholar
  14. Godbout, A.J. 1991. Filtering knowledge: Changing information into knowledge assets. Journal of Systemic Knowledge Management January: 1–9.Google Scholar
  15. Gregor, S., and I. Benbasat. 1999. Explanations from intelligent systems: Theoretical foundations and implications for practice. MIS Quarterly 23(4): 497–531.CrossRefGoogle Scholar
  16. Handzic, M. 2004. Knowledge management: Through the technology glass. Singapore: World Scientific Publishing.Google Scholar
  17. Handzic, M. 2007. Supporting decision makers with knowledge management systems. In Proceedings of the Eleventh Pacific Asia Conference on Information Systems, 3–6 July, Auckland, New Zealand, 46–54.Google Scholar
  18. Handzic, M., and G. Bewsell. 2005. Corporate memories: Tombs or wellsprings of knowledge. In Innovations of knowledge management, ed. B. Montano, 69–85. Hershey, USA: IRM Press.Google Scholar
  19. Harvey, N., F. Bolger, and A. McClelland. 1994. On the nature of expectations. British Journal of Psychology 85: 203–229.Google Scholar
  20. Hasan, H. 2003. The role of computer-based KM systems. In Australian studies in knowledge management, ed. H. Hasan, and M. Handzic, 322–341. Wollongong: UOW Press.Google Scholar
  21. Hewson, D. 1999. Start talking and get to work. Business Life November: 72–76.Google Scholar
  22. Holsapple, C.W. 2003. Handbook on knowledge management. Berlin: Springer.Google Scholar
  23. Huck, S.W., W.H. Cormier, and W.G. Bounds Jr. 1974. Reading statistics and research. New York: Harper and Row.Google Scholar
  24. Klayman, J. 1988. Learning from experience. In Human judgement: The SJT view, ed. B. Brehmer, and C.R.B. Joyce. Amsterdam: North-Holland.Google Scholar
  25. Kleiner, A., and G. Roth. 1998. How to make experience your company’s best teacher. In Harvard business review on knowledge management. Boston: Harvard Business School Press.Google Scholar
  26. Lawrence, M., P. Goodwin, M. O’Connor, and D. Onkal. 2006. Judgmental forecasting: A review of progress over the last 25 years. International Journal of Forecasting 22: 493–518.CrossRefGoogle Scholar
  27. Lim, J.S., and M.J. O’Connor. 1996. Judgemental forecasting with interactive forecasting support systems. Decision Support Systems 16: 339–357.CrossRefGoogle Scholar
  28. Makridakis, S. 1993. Accuracy measures: Theoretical and practical concerns. International Journal of Forecasting 9: 527–529.CrossRefGoogle Scholar
  29. Mintzberg, H., D. Raisinghani, and A. Theoret. 1976. The structure of unstructured decision process. Administration Science Quarterly 21(2): 246–275.CrossRefGoogle Scholar
  30. Moteleb, A.A., and M. Woodman. 2007. Notions of knowledge management systems: A gap analysis. The Electronic Journal of Knowledge Management 5(1): 55–62.Google Scholar
  31. Nonaka, I. 1998. The knowledge-creating company. In Harvard Business Review on Knowledge Management, Harvard Business School Press, Boston.Google Scholar
  32. Nonaka, I., and H. Takeuchi. 1995. The knowledge creating company: How Japanese companies create the dynamics of innovation. New York: Oxford University Press.Google Scholar
  33. O’Leary, D.E. 2003. Technologies for knowledge storage and assimilation. In Handbook on knowledge management, vol. 2, ed. C.W. Holsapple, and C.W. Holsapple, 29–46. Berlin: Springer.Google Scholar
  34. Poston, R.S., and C. Speier. 2005. Effective use of knowledge management systems: A process model of content ratings and credibility indicators. MIS Quarterly 29(2): 221–244.Google Scholar
  35. Ravishankar, M.N., and S.L. Pan. 2008. The influence of organizational identification on organizational knowledge management (KM). Omega 36: 221–234.CrossRefGoogle Scholar
  36. Remus, W. 1996. Will behavioural research on managerial decision making generalise to managers? Managerial and Decision Economics 17: 93–101.CrossRefGoogle Scholar
  37. Remus, W., O’Connor, M., and K. Griggs. 1996. Does feedback improve the accuracy of recurrent judgemental forecasts. Working paper, University of Hawaii.Google Scholar
  38. Sambamurthy, V., and M. Subramani. 2005. Special issue on information technologies and knowledge management. MIS Quarterly 29(1): 1–7.Google Scholar
  39. Sanders, N.R., and K.B. Manrodt. 2003. The efficacy of using judgmental versus quantitative forecasting methods in practice. Omega 31: 511–522.CrossRefGoogle Scholar
  40. Shanks, G. 2001. The impact of data quality tagging on decision outcomes. In Proceedings of 12th Australasian Conference on Information Systems, Coffs Harbour, 2001.Google Scholar
  41. Stair, R.W., and G.W. Reynolds. 2003. Principles of information systems, 6th ed. Boston: Course Technology.Google Scholar
  42. Whitecotton, S.M. 1996. The effects of experience and a decision aid on the slope, scatter, and bias of earnings forecasts. Organisational Behaviour and Human Decision Processes 66(1): 111–121.CrossRefGoogle Scholar
  43. Zuboff, S. 1988. In the age of the smart machine: The future of work and power. New York: Basic Books.Google Scholar

Copyright information

© Springer Science+Business Media, LLC 2009

Authors and Affiliations

  1. 1.Sarajevo School of Science and TechnologySarajevoHerzegovina

Personalised recommendations