Evaluating the Effectiveness of Exploration and Accumulated Experience in Automatic Case Elicitation
Non-learning problem solvers have been applied to many interesting and complex domains. Experience-based learning techniques have been developed to augment the capabilities of certain non-learning problem solvers in order to improve overall performance. An alternative approach to enhancing pre-existing systems is automatic case elicitation, a learning technique in which a case-based reasoning system with no prior domain knowledge acquires knowledge automatically through real-time exploration and interaction with its environment. In empirical testing in the domain of checkers, results suggest not only that experience can substitute for the inclusion of pre-coded model-based knowledge, but also that the ability to explore is crucial to the performance of automatic case elicitation.
Unable to display preview. Download preview PDF.
- 1.Schaeffer, J.: One Jump Ahead: Challenging Human Supremacy in Checkers. Springer, Heidelberg (1997)Google Scholar
- 3.Grefenstette, J.J., Ramsey, C.L.: An approach to anytime learning. In: Proceedings of the Ninth International Machine Learning Workshop, San Mateo, CA, pp. 189–195. Morgan Kaufmann, San Francisco (1992)Google Scholar
- 4.DeJong, K.A., Shultz, A.C.: Using experience-based learning in game-playing. In: Proceedings of the Fifth International Conference on Machine Learning, San Mateo, California, pp. 284–290. Morgan Kaufmann, San Francisco (1988)Google Scholar
- 5.Powell, J.H., Hauff, B.M., Hastings, J.D.: Utilizing case-based reasoning and automatic case elicitation to develop a self-taught knowledgeable agent. In: Fu, D., Orkin, J. (eds.) Challenges in Game Artificial Intelligence: Papers from the AAAI Workshop (Technical Report WS-04-04), pp. 77–81. AAAI Press, Menlo Park (2004)Google Scholar
- 6.Kaelbling, L.P., Littman, M.L., Moore, A.P.: Reinforcement learning: A survey. Journal of Artificial Intelligence Research 4, 237–285 (1996)Google Scholar
- 7.Smyth, B., Keane, M.T.: Remembering to forget: A competence-preserving case deletion policy for case-based reasoning systems. In: Proceedings of the 14th International Conference on Artificial Intelligence (IJCAI 1995), Montreal, Canada, pp. 377–382 (1995)Google Scholar
- 8.Watanabe, H., Okuda, K., Fukiwara, S.: A strategy for forgetting cases by restricting memory. IEICE Transactions on Information and Systems, 1324–1326 (1995)Google Scholar
- 14.Wendler, J., Lenz, M.: CBR for dynamic situation assessment in an agent-oriented setting. In: Aha, D.W., Daniels, J.J. (eds.) Case-Based Reasoning Integrations: Papers from the AAAI Workshop (Technical Report WS-98-15), Madison, WI. AAAI Press, Menlo Park (1998)Google Scholar
- 15.Fasciano, M.J.: Real-time case-based reasoning in a complex world. Technical Report TR-96-05, Computer Science Department, University of Chicago (1996)Google Scholar
- 16.Goodman, M.: Projective visualization: Acting from experience. In: Proceedings of the Eleventh National Conference on Artificial Intelligence (AAAI 1993), Menlo Park, Calif., pp. 54–59. AAAI Press, Menlo Park (1993)Google Scholar
- 17.Goodman, M.: Results on controlling action with projective visualization. In: Proceedings of the Twelfth National Conference on Artificial Intelligence (AAAI 1994), Menlo Park, Calif., pp. 1245–1250. AAAI Press, Menlo Park (1994)Google Scholar
- 20.Likhachev, M., Kaess, M., Arkin, R.C.: Learning behavioral parameterization using spatio-temporal case-based reasoning. In: Proceedings of the 2002 IEEE International Conference on Robotics and Automation, vol. 2, pp. 1282–1289 (2002)Google Scholar
- 21.Kira, Z., Arkin, R.C.: Forgetting bad behavior: Memory management for case-based navigation. In: Proceedings of the 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 3145–3152 (2004)Google Scholar