, Volume 21, Issue 1, pp 95–114 | Cite as

General game playing with stochastic CSP

  • Frédéric Koriche
  • Sylvain Lagrue
  • Éric Piette
  • Sébastien Tabary


The challenge of General Game Playing (GGP) is to devise game playing programs that take as input the rules of any strategic game, described in the Game Description Language (GDL), and that effectively play without human intervention. The aim of this paper is to address the GGP challenge by casting GDL games (potentially with chance events) into the Stochastic Constraint Satisfaction Problem (SCSP). The stochastic constraint network of a game is decomposed into a sequence of µ SCSPs (also know as one-stage SCSP), each associated with a game round. Winning strategies are searched by coupling the MAC (Maintaining Arc Consistency) algorithm, used to solve each µ SCSP in turn, together with the UCB (Upper Confidence Bound) policy for approximating the values of those strategies obtained by the last µ SCSP in the sequence. Extensive experiments conducted on various GDL games with different deliberation times per round, demonstrate that the MAC-UCB algorithm significantly outperforms the state-of-the-art UCT (Upper Confidence bounds for Trees) algorithm.


Stochastic constraint satisfaction problem Stochastic games Game description language General game playing 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Auer, P., Cesa-Bianchi, N., & Fischer, P. (2002). Finite-time analysis of the multiarmed bandit problem. Machine Learning, 47(2–3), 235–256.MATHCrossRefGoogle Scholar
  2. 2.
    Balafoutis, T., & Stergiou, K. (2006). Algorithms for stochastic CSPs. In Proc. of CP’06 (pp. 44–58).Google Scholar
  3. 3.
    Bessiere, C., & Verger, G. (2006). Strategic constraint satisfaction problems. In Proc. of CP’06 workshop on modelling and reformulation (pp. 17–29).Google Scholar
  4. 4.
    Bowling, M., Burch, N., Johanson, M., & Tammelin, O. (2015). Heads-up limit hold’em poker is solved. Science, 347(6218), 145–149.CrossRefGoogle Scholar
  5. 5.
    Campbell, M., Hoane, A.J. Jr., & Hsu, F. (2002). Deep blue. Artificial Intelligence, 134(1–2), 57–83.MATHCrossRefGoogle Scholar
  6. 6.
    Cazenave, T., & Mehat, J. (2010). Ary, a general game playing program. In Proc. of board games studies colloquium.Google Scholar
  7. 7.
    Clune, J.E. III (2008). Heuristic evaluation functions for general game playing. PhD thesis, University of California, Los Angeles, USA. Adviser-Korf, Richard E.Google Scholar
  8. 8.
    Debruyne, R., & Bessiere, C. (1997). Some practical filtering techniques for the constraint satisfaction problem. In Proc. of IJCAI’97 (pp. 412–417) Springer.Google Scholar
  9. 9.
    Finnsson, H., & Björnsson, Y. (2008). Simulation-based approach to general game playing. In Proc. of AAAI’08 (pp. 259–264).Google Scholar
  10. 10.
    Genesereth, M., Love, N., & Pell, B. (2005). General game playing: overview of the AAAI competition. AAAI Magazine, 26(2), 62–72.Google Scholar
  11. 11.
    Gent, I.P., Nightingale, P., Rowley, A., & Stergiou, K. (2008). Solving quantified constraint satisfaction problems. Artificial Intelligence, 172(6-7), 738–77.MATHMathSciNetCrossRefGoogle Scholar
  12. 12.
    Hnich, B., Rossi, R., Tarim, S.A., & Prestwich, S.D. (2012). Filtering algorithms for global chance constraints. Artificial Intelligence, 189, 69–94.MATHMathSciNetCrossRefGoogle Scholar
  13. 13.
    Koriche, F., Lagrue, S., Piette, É., & Tabary, S. (2015). Compiling strategic games with complete information into stochastic csps. In AAAI workshop on planning, search, and optimization (PlanSOpt-15).Google Scholar
  14. 14.
    Love, N., Hinrichs, T., Haley, D., Schkufza, E., & Genesereth, M. (2008). General game playing: game description language specification. Technical report.Google Scholar
  15. 15.
    Mackworth, A. (1977). Consistency in networks of relations. Artificial Intelligence, 8, 99–118.MATHCrossRefGoogle Scholar
  16. 16.
    Mackworth, A. (1977). On reading sketch maps. In Proc. of IJCAI’77 (pp. 598–606). Springer.Google Scholar
  17. 17.
    Möller, M., Schneider, M.T., Wegner, M., & Schaub, T. (2011). Centurio, a general game player: parallel, Java- and ASP-based. Künstliche Intelligenz, 25(1), 17–24.CrossRefGoogle Scholar
  18. 18.
    Neyman, A., & Sorin, S (Eds.) (2003). Stochastic games and applications. Springer.Google Scholar
  19. 19.
    Nguyen, T.-V.-A., Lallouet, A., & Bordeaux, L. (2013). Constraint games: framework and local search solver. In Proc. of ICTAI’13, (pp. 8–12).Google Scholar
  20. 20.
    Sabin, D., & Freuder, E. (1994). Contradicting conventional wisdom in constraint satisfaction. In Proc. of CP’94 (pp. 10–20). Springer.Google Scholar
  21. 21.
    Sabin, D., & Freuder, E. (1997). Understanding and improving the mac algorithm. In Proc. of CP’97 (pp. 167–181). Springer.Google Scholar
  22. 22.
    Schaeffer, J., Burch, N., Björnsson, Y., Kishimoto, A., Müller, M., Lake, R., Lu, P., & Sutphen, S. (2007). Checkers is solved. Science, 317(5844), 1518–1522.MATHMathSciNetCrossRefGoogle Scholar
  23. 23.
    Shannon, C. (1950). Programming a computer for playing chess. Philosophical Magazine, 41, 256–275.MATHMathSciNetCrossRefGoogle Scholar
  24. 24.
    Shoham, Y., & Leyton-Brown, K (2009). Multiagent systems: algorithmic, game-theoretic, and logical foundations. Cambridge University Press.Google Scholar
  25. 25.
    Sturtevant, N.R. (2008). An analysis of uct in multi-player games. ICGA Journal, 31(4), 195–208.Google Scholar
  26. 26.
    Tarim, A., Manandhar, S., & Walsh, T. (2006). Stochastic constraint programming: a scenario-based approach. Constraints, 11(1), 53–80.MATHMathSciNetCrossRefGoogle Scholar
  27. 27.
    Tesauro, G. (2002). Programming backgammon using self-teaching neural nets. Artificial Intelligence, 134(1–2), 181–199.MATHCrossRefGoogle Scholar
  28. 28.
    Thielscher, M. (2005). Flux: a logic programming method for reasoning agents. Theory and Practice of Logic Programming, 5(4–5), 533–565.MATHCrossRefGoogle Scholar
  29. 29.
    Thielscher, M. (2010). A general game description language for incomplete information games. In Proc. of AAAI’10 (pp. 994–999).Google Scholar
  30. 30.
    Walsh, T. (2002). Stochastic constraint programming. In Proc. of ECAI’02 (pp. 111–115).Google Scholar

Copyright information

© Springer Science+Business Media New York 2015

Authors and Affiliations

  • Frédéric Koriche
    • 1
  • Sylvain Lagrue
    • 1
  • Éric Piette
    • 1
  • Sébastien Tabary
    • 1
  1. 1.Université Lille-Nord de France CRIL- CNRS UMR 8188LensFrance

Personalised recommendations