Index Driven Selective Sampling for CBR

  • Nirmalie Wiratunga
  • Susan Craw
  • Stewart Massie
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 2689)


In real environments it is often difficult to obtain a collection of cases for the case base that would cover all the problem solving situations. Although it is often somewhat easier to generate potential problem cases that cover the domain tasks, acquiring the solutions for the problems captured by the cases may demand valuable time of a busy expert. This paper investigates how a Case-Based Reasoning system can be empowered to actively select a small number of useful cases from a pool of problem cases, for which the expert can then provide the solution. Past cases that are complete, containing both the problem and solution, together with partial cases containing just the problem, are clustered by exploiting a decision tree index built over the complete cases. We introduce a Cluster Utility Score ClUS and Case Utility Score CaUS, which then guide case selection from these clusters. Experimental results for six public domain datasets show that selective sampling techniques employing ClUS and CaUS are able to select cases that significantly improve the accuracy of the case base. There is further evidence to show that the influence of complete and partial cases utilised by these scores needs also to consider the number of partitions created by the case base index.


Case Base Leaf Node Utility Score Case Selection Selective Sampling 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Aha, D.W., Breslow, L.A.: Comparing simplification procedures for decision trees on an economics classification task. Technical Report AIC-98-009, Navy Center for Applied Research in AI, Washington DC, 1998Google Scholar
  2. 2.
    Blake, C., Keogh, E., Merz, C.: UCI repository of machine learning databases,1998.
  3. 3.
    Cohn, D., Ghahramani, Z., Jordan, M.I.: Active learning with statistical models. Journal of Artificial Intelligence Research, 4:129–145, 1996zbMATHGoogle Scholar
  4. 4.
    Craw, S., Wiratunga, N., Rowe, R.: Case-based design for tablet formulation. In Proceedings of the 4th European Workshop on Case-Based Reasoning, pages 358–369, Dublin, Eire, 1998. SpringerGoogle Scholar
  5. 5.
    Cunningham, P., Bonzano, A.: Knowledge engineering issues in developing a casebased reasoning application. Knowledge-Based Systems, 12:371–379, 1999CrossRefGoogle Scholar
  6. 6.
    Jarmulak, J., Craw, S., Rowe, R.: Genetic algorithms to optimise CBR retrieval. In Proceedings of the 5th European Workshop on Case-Based Reasoning, pages 136–147, Trento, Italy, 2000. SpringerGoogle Scholar
  7. 7.
    Lewis, D.D., Catlett, J.: Heterogeneous uncertainty sampling for supervised learning. In Machine Learning: Proceedings of the 11th International Conference, pages 148–156, New Brunswick, NJ, 1994. Morgan KauffmanGoogle Scholar
  8. 8.
    Lindenbaum, M., Markovich, S., Rusakov, D.: Selective sampling for nearest neighbour classifiers. In Proceedings of the 16th National Conference on Artificial Intelligence (AAAI 99), pages 366–371, Orlando, FL, 1999. AAAI PressGoogle Scholar
  9. 9.
    Liu, B., Wang, K., Mun, L.F., Qi, X.Z.: Using decision tree induction for discovering holes in data. In Proceedings of the 5th Pacific Rim International Conference on Artificial Intelligence (PRICAI-98), pages 182–193, 1998Google Scholar
  10. 10.
    McCallum, A., Nigam, K.: Employing em in pool-based active learning for text classification. In Proceedings of the 15th International Conference on Machine Learning, pages 359–367, 1998Google Scholar
  11. 11.
    McKenna, E., Smyth, B.: Competence-guided case discovery. In Proceedings of the 21st BCS SGES International Conference on Knowledge Based Systems and Applied Artificial Intelligence (ES 01), pages 97–108, Cambridge, UK, 2001. SpringerGoogle Scholar
  12. 12.
    McSherry, D.: Automating case selection in the construction of a case library. In Proceedings of the 19th BCS SGES International Conference on Knowledge Based Systems and Applied Artificial Intelligence (ES 99), pages 163–177, Cambridge, UK, 1999. SpringerGoogle Scholar
  13. 13.
    Smyth, B., Keane, M.T.: Remembering to forget. In Proceedings of the 14th International Joint Conference on Artificial Intelligence (IJCAI 95), pages 377–382, Montreal, Quebec. 1995. Morgan-KaufmannGoogle Scholar
  14. 14.
    Smyth, B., McClave, P.: Similarity vs. diversity. In Proceedings of the 4th International Conference on CBR, pages 347–361, Vancouver, BC, Canada, 2001. SpringerGoogle Scholar
  15. 15.
    Smyth, B., McKenna, E.: Competence models and the maintenance problem. Computational Intelligence, 17(2):235–249, 2001Google Scholar
  16. 16.
    Wiratunga, N., Craw, S., Rowe, R.: Learning to adapt for case-based design. In Proceedings of the 6th European Conference on Case-Based Reasoning, pages 421–435, Aberdeen, Scotland, 2002. SpringerGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2003

Authors and Affiliations

  • Nirmalie Wiratunga
    • 1
  • Susan Craw
    • 1
  • Stewart Massie
    • 1
  1. 1.School of ComputingThe Robert Gordon UniversityAberdeenScotland, UK

Personalised recommendations