Skip to main content
SpringerLink
Log in

A framework for retrieval in case-based reasoning systems

  • Published:
Annals of Operations Research Aims and scope Submit manuscript

Abstract

A case-based reasoning (CBR) system supports decision makers when solving new decision problems (i.e., new cases) on the basis of past experience (i.e., previous cases). The effectiveness of a CBR system depends on its ability to retrieve useful previous cases. The usefulness of a previous case is determined by its similarity with the new case. Existing methodologies assess similarity by using a set of domain-specific production rules. However, production rules are brittle in ill-structured decision domains and their acquisition is complex and costly. We propose a framework of methodologies based on decision theory to assess the similarity of a new case with the previous case that allows amelioration of the deficiencies associated with the use of production rules. An empirical test of the framework in an ill-structured diagnostic decision environment shows that this framework significantly improves the retrieval performance of a CBR system.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. B.P. Allen, Case based reasoning, business applications, Communications of the ACM 37(1994) 40–42.

    Google Scholar 

  2. K.D. Ashley, Assessing similarity among cases: A position paper, Proceedings of DARPA Workshop on Case Based Reasoning, Morgan Kaufmann, San Mateo, CA, 1989, pp. 72–75.

    Google Scholar 

  3. K.D. Ashley and E.L. Rissland, A case-based approach to modeling legal expertise, IEEE Expert 3(1988)70–77.

    Google Scholar 

  4. K.D. Ashley and E.L. Rissland, Compare and contrast, a test of expertise, Proceedings of the 6th National Conference on AI, AAAI, Seattle, WA, 1987, pp. 273–278.

    Google Scholar 

  5. R. Bariess and J.A. King, Similarity assessment in case-based reasoning, Proceedings of DARPA Workshop on Case Based Reasoning, Morgan Kaufmann, San Mateo, CA, 1989, pp. 67–71.

    Google Scholar 

  6. N.J. Belkin and W.B. Croft, Information filtering and information retrieval, two sides of the same coin?, Communications of the ACM 35(1992)29–38.

    Google Scholar 

  7. C. Bento and E. Costa, Retrieval of cases imperfectly described and explained: A quantitative approach, Case-Based Reasoning, Papers from 1993 Workshop, Technical Report WS-93-01, AAAI Press, Menlo Park, CA, 1993, p. 156.

    Google Scholar 

  8. M.H. Bickhard and L. Terveen, Foundational Issues in Artificial Intelligence and Cognitive Science: Impasse and Solution, Elsevier, New York, 1995.

    Google Scholar 

  9. F. Bolger and G. Wright, Assessing the quality of expert judgement: Issues and analysis, Decision Support Systems 11(1994).

  10. T. Cain, M. Pazzani and G. Silverstein, Using domain knowledge to influence similarity judgments, Proceedings: Case-Based Reasoning Workshop, Washington, DC, May 1991, pp. 191–198.

  11. Cognitive Systems, REMIND Developers Reference Manual, Boston, MA, 1992.

  12. P.R. Cohen, Evaluation and case-based reasoning, Proceedings of DARPA Workshop on Case Based Reasoning, Morgan Kaufmann, San Mateo, CA, 1989, pp. 168–172.

    Google Scholar 

  13. L. Console and P. Torasso, A multi-level architecture for diagnostic problem solving, in: Computational Intelligence, Vol. 1, A. Martelli and G. Valle, eds., Elsevier Science, Amsterdam, The Netherlands, 1989, pp. 101–112.

    Google Scholar 

  14. G. DeJong and R. Mooney, Explanation-based learning: An alternative view, Machine Learning 1(1986)145–176.

    Google Scholar 

  15. T.G. Dietterich and R.Z. Michalski, A comparative review of selected methods for learning from examples, in: Machine Learning: An Artificial Intelligence Approach, R.Z. Michalski, J.G. Carbonell and T.M. Mitchell, eds., MIT Press, Cambridge, MA, 1990, pp. 41–81.

    Google Scholar 

  16. D. Donahue, OGRE: Generic reasoning from experience, Proceedings of DARPA Workshop on Case Based Reasoning, Morgan Kaufmann, San Mateo, CA, 1989, pp. 248–252.

    Google Scholar 

  17. R. Duda and P. Hart, Pattern Classification and Scene Analysis, Wiley, New York, 1973.

    Google Scholar 

  18. M.B. Eisenberg, Measuring relevance judgements, Information Processing and Management 24 (1988)373–389.

    Google Scholar 

  19. T.C. Eskeridge, Continuous analogical reasoning: A summary of current research, Proceedings of DARPA Workshop on Case Based Reasoning, Morgan Kaufmann, San Mateo, CA, 1989, pp. 253–257.

    Google Scholar 

  20. L. Festinger, Conflict, Decision and Dissonance, Tavistock Publications, London, UK, 1964.

    Google Scholar 

  21. D. Gentner, Structure mapping: A theoretical framework for analogy, Cognitive Science 7(1983) 155–170.

    Google Scholar 

  22. K.M. Gupta and A.R. Montazemi, A methodology for evaluating the retrieval performance of case-based reasoning systems, Research and Working Paper Series, # 398, School of Business, McMaster University, 1994.

  23. K.M. Gupta and A.R. Montazemi, Empirical evaluation of retrieval in case-based reasoning systems using modified cosine matching function, IEEE Transaction on Systems, Man, and Cybernetics, forthcoming.

  24. W.L. Hays, Statistics, Holt Rinehart and Wilson, New York, 1963.

    Google Scholar 

  25. T.R. Hinrichs, Problem Solving in Open Worlds: A Case Study in Design, Erlbaum, Northvale, NJ, 1992.

    Google Scholar 

  26. J. King and R. Bareiss, Similarity assessment in case-based reasoning, Proceedings of DARPA Workshop on Case Based Reasoning, Morgan Kaufmann, San Mateo, CA, 1989, pp. 67–77.

    Google Scholar 

  27. D.W. King and E.C. Bryant, The Evaluation of Information Services and Products, Information Resources Press, Washington, DC, 1971.

    Google Scholar 

  28. J.L. Kolodner and R.L. Simpson, The MEDIATOR: Analysis of an early case-based problem solver, Cognitive Science 13(1989)507–549.

    Google Scholar 

  29. J.L. Kolodner, Case-Based Reasoning, Morgan Kaufmann, San Mateo, CA, 1993.

    Google Scholar 

  30. J.L. Kolodner, Improving human decision making through case-based decision aiding, AI Magazine 12(1991)52–68.

    Google Scholar 

  31. J.L. Kolodner, Judging which is the best case for a case-based reasoner, Proceedings of DARPA Workshop on Case Based Reasoning, Morgan Kaufmann, San Mateo, CA, 1989, pp. 77–81.

    Google Scholar 

  32. J.L. Kolodner and W. Mark, Case-based reasoning, IEEE Expert 7(1992)5–6.

    Google Scholar 

  33. M. Kriegsman and R. Barletta, Building a case-based help desk application, IEEE Expert 8(1993) 18–26.

    Google Scholar 

  34. D.B. Lenat, R.V. Guha, K. Pittman, D. Pratt and M. Shepherd, CYC: Toward programs with common sense, Communications of the ACM 33(1990)30–49.

    Google Scholar 

  35. S. Minton, J.G. Carbonell, C.A. Knoblock, D.R. Kuokka, O. Etzioni and Y. Gil, Explanation-based learning: A problem solving perspective, in: Machine Learning: Paradigms and Methods, J.G. Carbonell, ed., MIT Press, Cambridge, MA, 1990, pp. 64–118.

    Google Scholar 

  36. A.R. Montazemi and K.M. Gupta, An adaptive agent for case description in diagnostic CBR systems, Journal of Computers in Industry 29(1996)209–224.

    Google Scholar 

  37. A. Newell, Unified Theories of Cognition, Harvard University Press, Cambridge, MA, 1994.

    Google Scholar 

  38. E. Ozakarahan, Database Machines and Database Management, Prentice-Hall, Englewood Cliffs, NJ, 1986.

    Google Scholar 

  39. Panel of CBR Workshop, Case-based reasoning from DARPA machine learning program, Proceedings of DARPA Workshop on Case Based Reasoning, Morgan Kaufmann, San Mateo, CA, 1989, pp. 1–14.

    Google Scholar 

  40. B.W. Porter, R. Bariess and R.C. Holte, Concept learning in weak theory domains, Artificial Intelligence 45(1990)229–264.

    Google Scholar 

  41. J. Preece, Y. Rogers, H. Sharp, D. Benyon, S. Holland and T. Carey, Human-Computer Interaction, Addison-Wesley, New York, 1994.

    Google Scholar 

  42. O. Raoult, A survey of diagnosis expert systems, in: Knowledge Based Systems for Test and Diagnosis, G. Saucier, A. Ambler and M.A. Breuer, eds., Elsevier Science, New York, 1989, pp. 153–167.

    Google Scholar 

  43. J.J. Regazzi, Performance measures for information retrieval systems — an experimental approach, Journal of American Society for Information Science 39(1988)235–251.

    Google Scholar 

  44. C.K. Riesbeck and R.C. Schank, Inside Case-Based Reasoning, Lawrence Erlbaum Associates, Hillside, NJ, 1989.

    Google Scholar 

  45. G. Salton, The state of retrieval system evaluation, Information Processing and Management 28(1992)441–449.

    Google Scholar 

  46. T.L. Satty, Thoughts on decision making, ORMS Today 23(1996).

  47. K.J. Schmucker, Fuzzy Sets, Natural Language Computations, and Risk Analysis, Computer Science Press, Rockville, MD, 1984.

    Google Scholar 

  48. H.S. Shinn, Abstractional analogy: A model of analogical reasoning, Proceedings of DARPA Workshop on Case Based Reasoning, Morgan Kaufmann, San Mateo, CA, 1988, pp. 370–389.

    Google Scholar 

  49. E. Simoudis and J. Miller, Validated retrieval in case-based reasoning, 8th National Conference on AI, AAAI, Vol. 1, 1990, pp. 310–315.

  50. E. Simoudis, Using case-based retrieval for customer technical support, IEEE Expert 7(1992) 7–11.

    Google Scholar 

  51. C. Stanfill and D.L. Waltz, Memory-based reasoning paradigm, Proceedings of DARPA Workshop on Case Based Reasoning, Morgan Kaufmann, San Mateo, CA 1988, pp. 414–424.

    Google Scholar 

  52. R.J. Sternberg, Component processes in analogical reasoning, Psychological Review 84(1977) 353–378.

    Google Scholar 

  53. R.H. Stottler, CBR for cost and sales prediction, AI Expert 9(1994)25–33.

    Google Scholar 

  54. R. Sun, A connectionist model for commonsense reasoning incorporating rules and similarities, Knowledge Acquisition 4(1992)293–332.

    Google Scholar 

  55. P. Thagard, K.J. Holyoak, G. Nelson and D. Gochfeld, Analog retrieval by constraint satisfaction, Artificial Intelligence 46(1990)259–310.

    Google Scholar 

  56. C. Tsatsoulis and R.L. Kashyap, Case-based reasoning in manufacturing with TOLTEC planner, IEEE Transactions on Systems, Man, and Cybernetics 23(1994)1010–1023.

    Google Scholar 

  57. M. Zeleny, Multiple Criteria Decision Making, McGraw-Hill, New York, 1982.

    Google Scholar 

Download references

Authors
  1. Ali Reza Montazemi
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Kalyan Moy Gupta
    View author publications

    You can also search for this author in PubMed Google Scholar

Rights and permissions

Reprints and permissions

About this article

Cite this article

Reza Montazemi, A., Moy Gupta, K. A framework for retrieval in case-based reasoning systems. Annals of Operations Research 72, 51–73 (1997). https://doi.org/10.1023/A:1018960607821

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1023/A:1018960607821

Keywords

Search

Navigation