Abstract
While several researchers have applied case-based reasoning techniques to games, only Ponsen and Spronck (2004) have addressed the challenging problem of learning to win real-time games. Focusing on Wargus, they report good results for a genetic algorithm that searches in plan space, and for a weighting algorithm (dynamic scripting) that biases subplan retrieval. However, both approaches assume a static opponent, and were not designed to transfer their learned knowledge to opponents with substantially different strategies. We introduce a plan retrieval algorithm that, by using three key sources of domain knowledge, removes the assumption of a static opponent. Our experiments show that its implementation in the Case-based Tactician (CaT) significantly outperforms the best among a set of genetically evolved plans when tested against random Wargus opponents. CaT communicates with Wargus through TIELT, a testbed for integrating and evaluating decision systems with simulators. This is the first application of TIELT. We describe this application, our lessons learned, and our motivations for future work.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Aamodt, A., Plaza, E.: Case-based reasoning: Foundational issues, methodological variations, and system approaches. AI Communications 7, 39–59 (1994)
Aha, D.W., Molineaux, M.: Integrating learning in interactive gaming simulators. In: Fu, D., Orkin, J. (eds.) Challenges in Game AI: Papers of the AAAI 2004 Workshop (Technical Report WS-04-04). AAAI Press, San José (2004)
Buro, M.: Real-time strategy games: A new AI research challenge. In: Proceedings of the Eighteenth International Joint Conference on Artificial Intelligence, pp. 1534–1535. Morgan Kaufmann, Acapulco (2003)
Cheng, D.C., Thawonmas, R.: Case-based plan recognition for real-time strategy games. In: Proceedings of the Fifth Game-on International Conference, pp. 36–40. University of Wolverhampton Press, Reading (2004)
De Jong, K., Schultz, A.C.: Using experience-based learning in game playing. In: Proceedings of the Fifth International Conference on Machine Learning, pp. 284–290. Morgan Kaufmann, Ann Arbor (1988)
Díaz-Agudo, B., Gervás, P., Peinado, F.: A case based reasoning approach to story plot generation. In: Proceedings of the Seventh European Conference on Case-Based Reasoning, pp. 142–156. Springer, Madrid (2004)
Fagan, M., Cunningham, P.: Case-based plan recognition in computer games. In: Proceedings of the Fifth International Conference on Case-Based Reasoning, pp. 161–170. Springer, Trondheim (2003)
Fairclough, C.R., Cunningham, P.: AI structuralist storytelling in computer games. In: Proceedings of the International Conference on Computer Games: Artificial Intelligence, Design and Education. University of Wolverhampton Press, Reading (2004)
Fairclough, C., Fagan, M., Mac Namee, B., Cunningham, P.: Research directions for AI in computer games. In: Proceedings of the Twelfth Irish Conference on Artificial Intelligence & Cognitive Science, Maynooth, Ireland, pp. 333–344. Unknown publisher (2001)
Fasciano, M.J.: Everyday-world plan use (Technical Report TR-96-07). The University of Chicago, Computer Science Department, Chicago (1996)
Forbus, K., Mahoney, J., Dill, K.: How qualitative spatial reasoning can improve strategy game AIs. In: Laird, J., van Lent, M. (eds.) Artificial Intelligence and Interactive Entertainment: Papers from the AAAI Spring Symposium (Technical Report SS-01-02). AAAI Press, Stanford (2001)
Gabel, T., Veloso, M.: Selecting heterogeneous team players by case-based reasoning: A case study in robotic soccer simulation (Technical Report CMU-CS-01-165). Carnegie Mellon University, School of Computer Science, Pittsburgh (2001)
Goodman, M.: Results on controlling action with projective visualization. In: Proceedings of the Twelfth National Conference on Artificial Intelligence, pp. 1245–1250. AAAI Press, Seattle (1994)
Guestrin, C., Koller, D., Gearhart, C., Kanodia, N.: Generalizing plans to new environments in relational MDPs. In: Proceedings of the Eighteenth International Joint Conference on AI, pp. 1003–1010. Morgan Kaufmann, Acapulco (2003)
Karol, A., Nebel, B., Stanton, C., Williams, M.-A.: Case based game play in the RoboCup four-legged league: Part I the theoretical model. In: Polani, D., Browning, B., Bonarini, A., Yoshida, K. (eds.) RoboCup 2003. LNCS (LNAI), vol. 3020, pp. 739–747. Springer, Heidelberg (2004)
Kerner, Y.: Learning strategies for explanation patterns: Basic game patterns with applications to chess. In: Proceedings of the First International Conference on Case-Based Reasoning, pp. 491–500. Springer, Sesimbra (1995)
Laird, J.E., van Lent, M.: Interactive computer games: Human-level AI’s killer application. AI Magazine 22(2), 15–25 (2001)
Meehan, J.R.: Tale-spin and micro tale-spin. In: Schank, R.C., Riesbeck, C.K. (eds.) Inside computer understanding. Erlbaum, Hillsdale (1981)
Muñoz-Avila, H., Aha, D.W.: On the role of explanation for hierarchical case-based planning in real-time strategy games. In: Gervás, P., Gupta, K.M. (eds.) Proceedings of the ECCBR 2004 Workshops (Technical Report 142-04). Universidad Complutense Madrid, Departamento di Sistemos Informáticos y Programación, Madrid (2004)
Ponsen, M.J.V., Muñoz-Avila, H., Spronck, P., Aha, D.W.: Automatically acquiring domain knowledge for adaptive game AI using evolutionary learning. To appear in Proceedings of the Seventeenth Conference on Innovative Applications of Artificial Intelligence. AAAI Press, Pittsburgh (2005)
Ponsen, M., Spronck, P.: Improving adaptive game AI with evolutionary learning. In: Computer Games: Artificial Intelligence, Design and Education, pp. 389–396. University of Wolverhampton, Reading (2004)
Powell, J.H., Hauff, B.M., Hastings, J.D.: Utilizing case-based reasoning and automatic case elicitation to develop a self-taught knowledgeable agent. In: Fu, D., Orkin, J. (eds.) Challenges in Game Artificial Intelligence: Papers from the AAAI Workshop (Technical Report WS-04-04). AAAI Press, San Jose (2004)
Samuel, A.: Some studies in machine learning using the game of checkers. IBM Journal of Research and Development 3(3), 210–229 (1959)
Schaeffer, J.: A gamut of games. AI Magazine 22(3), 29–46 (2001)
Ulam, P., Goel, A., Jones, J.: Reflection in action: Model-based self-adaptation in game playing agents. In: Fu, D., Orkin, J. (eds.) Challenges in Game Artificial Intelligence: Papers from the AAAI Workshop (Technical Report WS-04-04). AAAI Press, San Jose (2004)
Wendler, J., Kaminka, G.A., Veloso, M.: Automatically improving team cooperation by applying coordination models. In: Bell, B., Santos, E. (eds.) Intent Inference for Collaborative Tasks: Papers from the AAAI Fall Symposium (Technical Report FS-01-05). AAAI Press, Falmouth (2001)
Wendler, J., Lenz, M.: CBR for dynamic situation assessment in an agent-oriented setting. In: Aha, D.W., Daniels, J.J. (eds.) Case-Based Reasoning Integrations: Papers from the AAAI Workshop (Technical Report WS-98-15). AAAI Press, Madison (1998)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Aha, D.W., Molineaux, M., Ponsen, M. (2005). Learning to Win: Case-Based Plan Selection in a Real-Time Strategy Game. In: Muñoz-Ávila, H., Ricci, F. (eds) Case-Based Reasoning Research and Development. ICCBR 2005. Lecture Notes in Computer Science(), vol 3620. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11536406_4
Download citation
DOI: https://doi.org/10.1007/11536406_4
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-28174-0
Online ISBN: 978-3-540-31855-2
eBook Packages: Computer ScienceComputer Science (R0)