Skip to main content
Book cover

International Conference on Computers and Games

CG 2016: Computers and Games pp 22–33Cite as

Monte Carlo Approaches to Parameterized Poker Squares

  • 777 Accesses

Part of the Lecture Notes in Computer Science book series (LNTCS,volume 10068)

Abstract

Parameterized Poker Squares (PPS) is a generalization of Poker Squares where players must adapt to a point system supplied at play time and thus dynamically compute highly-varied strategies. Herein, we detail the top three performing AI players in a PPS research competition, all three of which make various use of Monte Carlo techniques.

Keywords

  • Point System
  • Faculty Mentor
  • Simulated Game
  • Monte Carlo Tree Search
  • Heuristic Calculation

These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

This is a preview of subscription content, access via your institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • DOI: 10.1007/978-3-319-50935-8_3
  • Chapter length: 12 pages
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
eBook
USD   44.99
Price excludes VAT (USA)
  • ISBN: 978-3-319-50935-8
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
Softcover Book
USD   59.99
Price excludes VAT (USA)
Learn about institutional subscriptions
Fig. 1.
Fig. 2.

Notes

  1. 1.

    Whereas DARPA has its “grand challenges”, ours are not so grand.

  2. 2.

    http://www.boardgamegeek.com/boardgame/41215/poker-squares,

    http://cs.gettysburg.edu/~tneller/games/pokersquares.

  3. 3.

    http://www.boardgamegeek.com/geeklist/152237/sequential-placement-optimization-games.

  4. 4.

    http://cs.gettysburg.edu/~tneller/games/pokersquares/eaai/results/.

  5. 5.

    The factor of 20 was chosen through limited empirical performance tuning. It is not necessarily optimal for this problem.

References

  1. Arrington, R., Langley, C., Bogaerts, S.: Using domain knowledge to improve monte-carlo tree search performance in parameterized poker squares. In: Proceedings of the 30th National Conference on Artificial Intelligence (AAAI 2016), pp. 4065–4070. AAAI Press, Menlo Park (2016)

    Google Scholar 

  2. Auer, P., Cesa-Bianchi, N., Fischer, P.: Finite-time analysis of the multiarmed bandit problem. Mach. Learn. 47(2–3), 235–256 (2002). http://dx.doi.org/10.1023/A:1013689704352

    CrossRef  MATH  Google Scholar 

  3. Browne, C., Powley, E., Whitehouse, D., Lucas, S., Cowling, P.I., Rohlfshagen, P., Tavener, S., Perez, D., Samothrakis, S., Colton, S.: A survey of Monte Carlo tree search methods. IEEE Trans. Comput. Intell. AI Games 4(1), 1–49 (2012). http://www.cameronius.com/cv/mcts-survey-master.pdf

    Google Scholar 

  4. Castro-Wunsch, K., Maga, W., Anton, C.: Beemo, a Monte Carlo simulation agent for playing parameterized poker squares. In: Proceedings of the 30th National Conference on Artificial Intelligence (AAAI 2016), pp. 4071–4074. AAAI Press, Menlo Park (2016)

    Google Scholar 

  5. Furtak, T., Buro, M.: Recursive Monte Carlo search for imperfect information games. In: 2013 IEEE Conference on Computational Inteligence in Games (CIG), Niagara Falls, ON, Canada, 11–13 August 2013, pp. 1–8 (2013). http://dx.doi.org/10.1109/CIG.2013.6633646

  6. Kocsis, L., Szepesvári, C., Willemson, J.: Improved monte-carlo search. Univ. Tartu, Estonia, Technical report 1 (2006)

    Google Scholar 

  7. Morehead, A.H., Mott-Smith, G.: The Complete Book of Solitaire & Patience Games, 1st edn. Grosset & Dunlap, New York (1949)

    Google Scholar 

  8. Neller, T.W., Messinger, C.M., Zuozhi, Y.: Learning and using hand abstraction values for parameterized poker squares. In: Proceedings of the 30th National Conference on Artificial Intelligence (AAAI 2016), pp. 4095–4100. AAAI Press, Menlo Park (2016)

    Google Scholar 

  9. Parlett, D.: The Penguin Book of Card Games. Penguin Books, updated edn. (2008)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Gettysburg College, Gettysburg, PA, USA

    Todd W. Neller, Zuozhi Yang & Colin M. Messinger

  2. MacEwan University, Edmonton, AB, Canada

    Calin Anton, Karo Castro-Wunsch & William Maga

  3. DePauw University, Greencastle, IN, USA

    Steven Bogaerts, Robert Arrington & Clay Langley

Authors
  1. Todd W. Neller
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Zuozhi Yang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Colin M. Messinger
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Calin Anton
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Karo Castro-Wunsch
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. William Maga
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Steven Bogaerts
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Robert Arrington
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Clay Langley
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Todd W. Neller .

Editor information

Editors and Affiliations

  1. Leiden Institute of Advanced Computer Science (LIACS), Leiden University, Leiden, Zuid-Holland, The Netherlands

    Aske Plaat

  2. Leiden Institute of Advanced Computer Science (LIACS), Leiden University, Leiden, Zuid-Holland, The Netherlands

    Walter Kosters

  3. Leiden Institute of Advanced Computer Science (LIACS), Leiden University, Leiden, Zuid-Holland, The Netherlands

    Jaap van den Herik

Rights and permissions

Reprints and Permissions

Copyright information

© 2016 Springer International Publishing AG

About this paper

Cite this paper

Neller, T.W. et al. (2016). Monte Carlo Approaches to Parameterized Poker Squares. In: Plaat, A., Kosters, W., van den Herik, J. (eds) Computers and Games. CG 2016. Lecture Notes in Computer Science(), vol 10068. Springer, Cham. https://doi.org/10.1007/978-3-319-50935-8_3

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-50935-8_3

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-50934-1

  • Online ISBN: 978-3-319-50935-8

  • eBook Packages: Computer ScienceComputer Science (R0)