Abstract
Recently, a backgammon bot named Palamedes won the first prize in backgammon at the 16th Computer Olympiad. Palamedes is an ongoing work aimed at developing intelligent bots to play a variety of popular backgammon variants. Currently, the Greek variants Portes, Plakoto and Fevga are supported. A different neural network has been designed, trained and evaluated for each one of these variants. This paper presents the details of the architecture and the training procedure for each case. New expert features as inputs to the networks are also introduced, whereas experimental results demonstrate improvement over previous versions of Palamedes.
Keywords
References
Andrews, R., Diederich, J., Tickle, A.: Survey and critique of techniques for extractingrules from trained artificial neural networks. Knowledge-Based Systems 8(6), 373–389 (1995)
BackGammon Variants, http://www.bkgm.com/variants
GnuBg Mailing list post, http://lists.gnu.org/archive/html/bug-gnubg/2012-01/msg00034.html
Hauk, T., Buro, M., Schaeffer, J.: *-Minimax Performance in Backgammon. In: van den Herik, H.J., Björnsson, Y., Netanyahu, N.S. (eds.) CG 2004. LNCS, vol. 3846, pp. 51–66. Springer, Heidelberg (2006)
Michie, D.: Game-playing and game-learning automata. In: Fox, L. (ed.) Advances in Programming and Non-Numerical Computation, pp. 183–200 (1966)
Palamedes, http://csse.uom.gr/~nikpapa/software.html
Papahristou, N., Refanidis, I.: Training Neural Networks to Play Backgammon Variants Using Reinforcement Learning. In: Di Chio, C., Cagnoni, S., Cotta, C., Ebner, M., Ekárt, A., Esparcia-Alcázar, A.I., Merelo, J.J., Neri, F., Preuss, M., Richter, H., Togelius, J., Yannakakis, G.N. (eds.) EvoApplications 2011, Part I. LNCS, vol. 6624, pp. 113–122. Springer, Heidelberg (2011)
Papahristou, N., Refanidis, I.: Improving Temporal Difference Learning Performance in Backgammon Variants. In: van den Herik, H.J., Plaat, A. (eds.) ACG 2011. LNCS, vol. 7168, pp. 134–145. Springer, Heidelberg (2012)
Pubeval source code backgammon benchmark player, http://www.bkgm.com/rgb/rgb.cgi?view+610
Sutton, R.S.: Learning to predict by the methods of temporal differences. Machine Learning 3(1), 9–44 (1988)
Sutton, R.S., Barto, A.G.: Reinforcement Learning: An Indroduction. MIT Press (1998)
Tesauro, G.: Practical issues in temporal differnce learning. Machine Learning 4, 257–277 (1992)
Tesauro, G.: Programming backgammon using self-teching neural nets. Artificial Intelligence 134, 181–199 (2002)
Tesauro, G.: Td-gammon, http://www.scholarpedia.org/article/Td-gammon
Tesauro, G.: Temporal Difference Learning and TD-Gammon. Communications of the ACM 38(3), 58–68 (1995)
Wiering, M.A.: Self-Play and Using an Expert to Learn to Play Backgammon with Temporal Difference Learning. Journal of Intelligent Learning Systems and Applications 2, 57–68 (2010)
Wilson, D.R., Martinez, T.R.: The general inefficiency of batch training for gradient descent learning. Neural Networks 16(10), 1429–1451 (2003)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 IFIP International Federation for Information Processing
About this paper
Cite this paper
Papahristou, N., Refanidis, I. (2012). On the Design and Training of Bots to Play Backgammon Variants. In: Iliadis, L., Maglogiannis, I., Papadopoulos, H. (eds) Artificial Intelligence Applications and Innovations. AIAI 2012. IFIP Advances in Information and Communication Technology, vol 381. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-33409-2_9
Download citation
DOI: https://doi.org/10.1007/978-3-642-33409-2_9
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-33408-5
Online ISBN: 978-3-642-33409-2
eBook Packages: Computer ScienceComputer Science (R0)