Systematically diagnosing and improving the perceived usefulness of organizational memories

  • Klaus-Dieter Althoff
  • Markus Nick
  • Carsten Tautz
Chapter 2: Methodology
Part of the Lecture Notes in Computer Science book series (LNCS, volume 1756)


The benefits of an organizational memory are ultimately determined by the usefulness of the organizational memory as perceived by its users. There-fore, an improvement of an organizational memory should be measured in the added perceived usefulness. Unfortunately, the perceived usefulness has many impact factors. Hence, it is difficult to identify good starting points for improvement.

This paper presents the goal-oriented method OMI (Organizational Memory Improvement) for improving an organizational memory incrementally from the user's point of view. It has been developed through several case studies and consists of a general usage model, a set of indicators for improvement potential, and a cause-effect model. At each step of the general usage model of OMI, the indicators are used to pinpoint improvement potential for increasing the perceived usefulness and asking the user for specific improvement suggestions where feasible.


Conceptual Knowledge Project Schedule Organizational Memory Software Reuse Experience Item 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Andreas Abecker, Stefan Decker, and Otto Kühn. Organizational memory (in German). Informatik-Spektrum, 21(4):213–214, August 1998.CrossRefGoogle Scholar
  2. 2.
    K.-D. Althoff and S. Wess. Case-based knowledge acquisition, learning and problem solving in diagnostic real world tasks. Proceedings of the Fifth European Knowledge Acquisition for Knowledge-Based Systems Workshop, pages 48–67, 1991.Google Scholar
  3. 3.
    Klaus-Dieter Althoff. Evaluating Case-Based Reasoning systems. LNAI. Springer-Verlag, 2000. to appear.Google Scholar
  4. 4.
    Klaus-Dieter Althoff and Agnar Aamodt. Relating case-based problem solving and learning methods to task and domain characteristics: Towards an analytic framework. AICom-Artificial Intelligence COmmunications, 9(3):109–116, September 1996.Google Scholar
  5. 5.
    Klaus-Dieter Althoff, Andreas Birk, Susanne Hartkopf, Wolfgang Müller, Markus Nick, Dagmar Surmann, and Carsten Tautz. Systematic population, utilization, and maintenance of a repository for comprehensive reuse. elsewhere in this book, 1999.Google Scholar
  6. 6.
    Klaus-Dieter Althoff, Frank Bomarius, and Carsten Tautz. Using case-based reasoning technology to build learning organizations. In Proceedings of the Workshop on Organizational Memories at the European Conference on Artificial Intelligence '98, Brighton, England, August 1998.Google Scholar
  7. 7.
    Klaus-Dieter Althoff, Markus Nick, and Carsten Tautz. Cbr-peb: An application implementing reuse concepts of the experience factory for the transfer of cbr system know-how. In Proceedings of the Seventh Workshop on Case-Based Reasoning during Expert Systems '99 (XPS-99), Würzburg, Germany, March 1999.Google Scholar
  8. 8.
    Klaus-Dieter Althoff, Markus Nick, and Carsten Tautz. Improving organizational memories through user feedback. In Workshop on Learning Software Organisations at SEKE'99, Kaiserslautern, Germany, June 1999.Google Scholar
  9. 9.
    Bruce H. Barnes and Terry B. Bollinger. Making reuse cost effective. IEEE Software, 8(1):13–24, January 1991.CrossRefGoogle Scholar
  10. 10.
    Brigitte Bartsch-Spörl, Klaus-Dieter Althoff, and Alexandre Meissonnier. Learning from and reasoning about case-based reasoning systems. In Proceedings of the Fourth German Conference on Knowledge-Based Systems (XPS97), March 1997.Google Scholar
  11. 11.
    Victor R. Basili, Gianluigi Caldiera, and H. Dieter Rombach. Experience Factory. In John J. Marciniak, editor, Encyclopedia of Software Engineering, volume 1, pages 469–476. John Wiley & Sons, 1994.Google Scholar
  12. 12.
    Victor R. Basili and H. Dieter Rombach. The TAME Project: Towards improvement-oriented software environments. IEEE Transactions on Software Engineering, SE-14(6):758–773, June 1988.CrossRefGoogle Scholar
  13. 13.
    Andreas Birk and Felix Kröschel. A knowledge management lifecycle for experience packages on software engineering technologies. In Frank Bomarius, editor, Workshop on Learning Software Organisations at SEKE'99, pages 115–126, Kaiserslautern, Germany, June 1999. Fraunhofer IESE.Google Scholar
  14. 14.
    Lionel C. Briand, Christiane M. Differding, and H. Dieter Rombach. Practical guidelines for measurement-based process improvement. Software Process, 2(4):253–280, December 1996.CrossRefGoogle Scholar
  15. 15.
    P. R. Cohen. Evaluation and case-based reasoning. In K. Hammond, editor, Proceedings of the Second DARPA Workshop on Case-Based Reasoning, pages 168–172. Morgan Kaufman, 1989.Google Scholar
  16. 16.
    William S. Cooper. On selecting a measure of retrieval effectiveness. In K.S. Jones and P. Willet, editors, Readings in Information Retrieval, pages 191–204. Morgan Kaufmann Publishers, 1997.Google Scholar
  17. 17.
    Leela Damodaran. Development of a user-centered IT strategy: A case study. Behavior and Information Technology, 17(3):127–134, 1998.CrossRefGoogle Scholar
  18. 18.
    J. Gaschnig, P. Klahr, H. Pople, E. Shortliffe, and A. Terry. Evaluation of expert systems: Issues and case studies. In F. Hayes-Roth, D.A. Waterman, and D.B. Lenat, editors, Building Expert Systems, pages 241–282. Addison-Wesley, Reading, Mass., USA, 1983.Google Scholar
  19. 19.
    Avelino Gonzales, Lingli Xu, and Uma Gupta. Validation techniques for case-based reasoning systems. IEEE Transactions on Systems, Man, and Cybernetics, 28(4):465–477, July 1998. Part A: Systems and Humans.CrossRefGoogle Scholar
  20. 20.
    Stephen P. Harter. Psychological relevance and information science. Journal of the American Society for Information Science, 43(9):602–615, October 1992.CrossRefGoogle Scholar
  21. 21.
    B. Henderson-Sellers. The economics of reusing library classes. Journal of Object-Oriented Programming, (4):43–50, 1993.Google Scholar
  22. 22.
    Scott Henninger. An evolutionary approach to constructing effective software reuse repositories. ACM Transactions on Software Engineering and Methodlogy, 6(2):111–140, April 1997.CrossRefGoogle Scholar
  23. 23.
    Matthias Jarke and Ralf Klamma. Innovation based on computer-aided failure management: Results of the BMBF project FOQUS (in German). In Proc. Wirtschaftsinformatik, 1998.Google Scholar
  24. 24.
    S. Kirchhoff Mapping Quality of Knowledge-Bases Systems: A Methodology for Evaluation (in German): Josef Eul Verlag, Bergisch-Gladbach, Germany, 1994.Google Scholar
  25. 25.
    Wayne C. Lim. Reuse economics: A comparison of seventeen models and directions for future research. In Murali Sitaraman, editor, Proceedings of the Fourth International Conference on Software Reuse, pages 41–50, Orlando, Florida, USA, April 1996. IEEE Computer Society Press.CrossRefGoogle Scholar
  26. 26.
    Michael G. Morris and Andrew Dillon. How user perceptions influence software use. IEEE Software, 14(4):58–64, July/August 1997.CrossRefGoogle Scholar
  27. 27.
    Markus Nick. Implementation and Evaluation of an Experience Base. Diploma thesis, Fraunhofer IESE, University of Kaiserslautern, 1998.Google Scholar
  28. 28.
    Markus Nick, Klaus-Dieter Althoff, and Carsten Tautz. Facilitating the practical evaluation of organizational memories using the goal-question-metric technique. In Proceedings of the Twelfth Workshop on Knowledge Acquisition, Modeling and Management, Banff, Alberta, Canada, October 1999.Google Scholar
  29. 29.
    Markus Nick and Carsten Tautz. Practical evaluation of an organizational memory using the goal-question-metric technique. Technical Report IESE-Report No. 063.98/E, Fraunhofer Institute for Experimental Software Engineering, Kaiserslautern (Germany), 1998.Google Scholar
  30. 30.
    Markus Nick and Carsten Tautz. Practical evaluation of an organizational memory using the goal-question-metric technique. In XPS'99: Knowledge-Based Systems-Survey and Future Directions. Springer Verlag, Würzburg, Germany, March 1999. LNAI Nr. 1570.Google Scholar
  31. 31.
    T. Pfeifer, editor. Knowledge-Based Systems in Quality Management (in German). Springer-Verlag, 1996.Google Scholar
  32. 32.
    T. Pfeifer and T. Zenner. Using experience during failure analysis—the application of case-based techniques (in German). In R. Grob and J. Spickermann, editors, Workshop at the Third German Conference on Expert Systems, pages V1–V12. Technical Report LSA-95-04, University of Kaiserslautern, 1996.Google Scholar
  33. 33.
    Gerard Salton and Michael J. McGill. Introduction to Modern Information Retrieval. McGraw-Hill Book Co., New York, 1983.zbMATHGoogle Scholar
  34. 34.
    J. R. Slagle and M. R. Wick. A method for evaluating candidate expert system applications. AI Magazine, 9(4):44–53, 1988.Google Scholar
  35. 35.
    Carsten Tautz. Customizing Software Engineering Experience Management Systems to Organizational Needs. PhD thesis, University of Kaiserslautern, Kaiserslautern, Germany, 2000. to appear.Google Scholar
  36. 36.
    Bert van Wegen. Impacts of KBS on Cost and Structure of Production. PhD thesis, 1996.Google Scholar
  37. 37.
    Christiane Gresse von Wangenheim, Klaus-Dieter Althoff, and Ricardo M. Barcia. Goal-oriented and similarity-based retrieval of software engineering experienceware. elsewhere in this book, 1999.Google Scholar
  38. 38.
    Stephan Weibelzahl and Gerhard Weber. User modeling of customer demands through Case-Based Reasoning (in German). In Stefan Wrobel et al., editor, Proceedings of the Workshop Days on Learning, Knowledge Discovery, and Adaptivity (LWA '99), pages 295–300, Ottovon-Guericke-Universität Magdeburg, Germany, September 1999.Google Scholar
  39. 39.
    S. Wess. Case-Based Reasoning in Knowledge-Based Systems for Decision Support and Diagnostics (in German). PhD thesis, University of Kaiserslautern, 1995.Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2000

Authors and Affiliations

  • Klaus-Dieter Althoff
    • 1
  • Markus Nick
    • 1
  • Carsten Tautz
    • 1
  1. 1.Fraunhofer Institute for Experimental Software Engineering (IESE)KaiserslauternGermany

Personalised recommendations