Skip to main content

Opponent Type Adaptation for Case-Based Strategies in Adversarial Games

  • Conference paper
Case-Based Reasoning Research and Development (ICCBR 2012)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 7466))

Included in the following conference series:

Abstract

We describe an approach for producing exploitive and adaptive case-based strategies in adversarial games. We describe how adaptation can be applied to a precomputed, static case-based strategy in order to allow the strategy to rapidly respond to changes in an opponent’s playing style. The exploitive strategies produced by this approach tend to hover around a precomputed solid strategy and adaptation is applied directly to the precomputed strategy once enough information has been gathered to classify the current opponent type. The use of a precomputed, seed strategy avoids performance degradation that can take place when little is known about an opponent. This allows our approach an advantage over other exploitive strategies whose playing decisions rely on large, individual opponent models constructed from scratch. We evaluate the approach within the experimental domain of two-player Limit Texas Hold’em poker.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Similar content being viewed by others

References

  1. Ontañón, S., Mishra, K., Sugandh, N., Ram, A.: On-line case-based planning. Computational Intelligence 26(1), 84–119 (2010)

    Article  MathSciNet  Google Scholar 

  2. Sugandh, N., Ontañón, S., Ram, A.: On-line case-based plan adaptation for real-time strategy games. In: Proceedings of the Twenty-Third AAAI Conference on Artificial Intelligence, AAAI 2008, pp. 702–707 (2008)

    Google Scholar 

  3. Floyd, M.W., Esfandiari, B., Lam, K.: A case-based reasoning approach to imitating robocup players. In: Proceedings of the Twenty-First International Florida Artificial Intelligence Research Society Conference, pp. 251–256 (2008)

    Google Scholar 

  4. Rubin, J., Watson, I.: Similarity-Based Retrieval and Solution Re-use Policies in the Game of Texas Hold’em. In: Bichindaritz, I., Montani, S. (eds.) ICCBR 2010. LNCS, vol. 6176, pp. 465–479. Springer, Heidelberg (2010)

    Chapter  Google Scholar 

  5. Auslander, B., Lee-Urban, S., Hogg, C., Muñoz-Avila, H.: Recognizing the Enemy: Combining Reinforcement Learning with Strategy Selection Using Case-Based Reasoning. In: Althoff, K.-D., Bergmann, R., Minor, M., Hanft, A. (eds.) ECCBR 2008. LNCS (LNAI), vol. 5239, pp. 59–73. Springer, Heidelberg (2008)

    Chapter  Google Scholar 

  6. Gillespie, K., Karneeb, J., Lee-Urban, S., Muñoz-Avila, H.: Imitating Inscrutable Enemies: Learning from Stochastic Policy Observation, Retrieval and Reuse. In: Bichindaritz, I., Montani, S. (eds.) ICCBR 2010. LNCS, vol. 6176, pp. 126–140. Springer, Heidelberg (2010)

    Chapter  Google Scholar 

  7. Johanson, M., Zinkevich, M., Bowling, M.H.: Computing robust counter-strategies. In: Advances in Neural Information Processing Systems 20, Proceedings of the Twenty-First Annual Conference on Neural Information Processing Systems (2007)

    Google Scholar 

  8. Rubin, J., Watson, I.: On combining decisions from multiple expert imitators for performance. In: IJCAI 2011, Proceedings of the 22nd International Joint Conference on Artificial Intelligence, pp. 344–349 (2011)

    Google Scholar 

  9. Billings, D., Davidson, A., Schauenberg, T., Burch, N., Bowling, M., Holte, R.C., Schaeffer, J., Szafron, D.: Game-Tree Search with Adaptation in Stochastic Imperfect-Information Games. In: van den Herik, H.J., Björnsson, Y., Netanyahu, N.S. (eds.) CG 2004. LNCS, vol. 3846, pp. 21–34. Springer, Heidelberg (2006)

    Chapter  Google Scholar 

  10. Schauenberg, T.: Opponent modelling and search in poker. Master’s thesis. University of Alberta (2006)

    Google Scholar 

  11. Hammond, K.J.: Case-based planning: A framework for planning from experience. Cognitive Science 14(3), 385–443 (1990)

    Article  Google Scholar 

  12. Muñoz-Avila, H., Cox, M.T.: Case-based plan adaptation: An analysis and review. IEEE Intelligent Systems 23(4), 75–81 (2008)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2012 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Rubin, J., Watson, I. (2012). Opponent Type Adaptation for Case-Based Strategies in Adversarial Games. In: Agudo, B.D., Watson, I. (eds) Case-Based Reasoning Research and Development. ICCBR 2012. Lecture Notes in Computer Science(), vol 7466. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-32986-9_27

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-32986-9_27

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-32985-2

  • Online ISBN: 978-3-642-32986-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics