Opponent’s Style Modeling Based on Situations for Bayesian Poker

  • Ruobing Li
  • Wenkai Li
  • Lin Shang
  • Yang Gao
  • Mengjie Zhang
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7691)

Abstract

In a real poker game, one player can take actions of different styles in different situations. In this paper, a novel method is proposed to quantify and model the opponent’s style in corresponding situation of a hand. Based on the proposed representation of Action Pair, the value of the style can be calculated and stored as “experience”. When making a decision, the specific style will be obtained from the “experience”. The style and the observable information will be used to estimate the value of the opponent’s hand. In experiments, the obtained “experience” validates the correctness of our assumption that a player does not show an invariable style in all situations. The experimental results show that the agent player using our method can predict the value of the opponent’s hand and earn more money in fixed hands comparing with the original agent.

Keywords

Style Modeling Bayesian Poker Hold’em Poker 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Billings, D., Papp, D., Schaeffer, J., Szafron, D.: Opponent modeling in poker. In: Proceedings of the Fifteenth National AAAI Conference, pp. 493–499 (1998)Google Scholar
  2. 2.
    Davidson, A.: Opponent modeling in poker: Learning and acting in a hostile and uncertain environment. Master’s thesis, University of Alberta (2002)Google Scholar
  3. 3.
    Machado, M., Fantini, E., Chaimowicz, L.: Player Modeling: Towards a Common Taxonomy. In: 16th International Conference on Computer Games, pp. 50–57 (2011)Google Scholar
  4. 4.
    Lockett, A.J., Miikkulainen, R.: Evolving opponent models for Texas Hold’Em. In: IEEE Symposium on Computational Intelligence and Games, pp. 31–38 (2008)Google Scholar
  5. 5.
    Barone, L., While, L.: Adaptive learning for poker. In: Proceedings of the Genetic and Evolutionary Computation Conference, pp. 566–573 (2000)Google Scholar
  6. 6.
    Baker, R.J.S., Cowling, P.I.: Bayesian Opponent Modeling in a Simple Poker Environment. In: IEEE Symposium on Computational Intelligence and Games, pp. 125–131 (2007)Google Scholar
  7. 7.
    Davidson, A., Billings, D., Schaeffer, J., Szafron, D.: Improved opponent modeling in poker. In: International Conference on Artificial Intelligence, pp. 1467–1473 (2000)Google Scholar
  8. 8.
    Billings, D., Davidson, A., Schaeffer, J., Szafron, D.: The challenge of poker. Artificial Intelligence 134, 201–240 (2002)MATHCrossRefGoogle Scholar
  9. 9.
    Korb, K.B., Nicholson, A.E., Jitnah, N.: Bayesian poker. In: Proceedings of the Fifteenth Conference on Uncertainty in Artificial Intelligence, pp. 343–350 (1999)Google Scholar
  10. 10.
    Billings, D., Castillo, L., Schaeffer, J., Szafron, D.: Using probabilistic knowledge and simulation to play poker. In: Proceedings of the 16th National Conference on Artificial Intelligence, pp. 697–703 (1999)Google Scholar
  11. 11.
    Russell, S., Norvig, P.: Artificial Intelligence: A Modern Approach. Prentice Hall (2006)Google Scholar
  12. 12.
    Korb, K.B., Nicholson, A.E.: Bayesian Artificial Intelligence. Chapman and Hall/CRC, Boca Raton (2004)MATHGoogle Scholar
  13. 13.
    Tretyakov, K., Kamm, L.: Modeling texas hold’em poker strategies with bayesian networks (2009)Google Scholar
  14. 14.
    Annual Computer Poker Competition, http://www.computerpokercompetition.org/

Copyright information

© Springer-Verlag Berlin Heidelberg 2012

Authors and Affiliations

  • Ruobing Li
    • 1
  • Wenkai Li
    • 1
  • Lin Shang
    • 1
  • Yang Gao
    • 1
  • Mengjie Zhang
    • 2
  1. 1.State Key Laboratory for Novel Software TechnologyNanjing UniversityChina
  2. 2.School of Engineering and Computer ScienceVictoria University of WellingtonNew Zealand

Personalised recommendations