Advertisement

Beyond Samuel: Evolving a Nearly Expert Checkers Player

  • David B. Fogel
Part of the Natural Computing Series book series (NCS)

Abstract

Evolutionary algorithms can be used to learn how to play complex games of strategy without relying on human expertise. Here I discuss the use of evolutionary computation and artificial neural networks in learning how to play checkers. Starting from neural networks that were created randomly, an evolutionary algorithm has been able to craft a network that can play checkers at a nearly expert level. No features beyond the positions of pieces on the board and the piece differential were provided. The evolutionary algorithm learned everything else on its own, simply by playing the game.

Keywords

Hide Layer Evolutionary Algorithm Output Node Sequential Rating Game Tree 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. [1]
    Fogel, D.B., Evolutionary Computation: Toward a New Philosophy of Machine Intelligence, 2nd ed., IEEE Press, Piscataway, NJ, 2000.Google Scholar
  2. [2]
    Schaeffer, J., One Jump Ahead: Challenging Human Supremacy in Checkers, Springer, Berlin, 1996.Google Scholar
  3. [3]
    Samuel, A.L., “Some studies in machine learning using the game of checkers,” IBM J. Res. Devlopment, 3(3), 1959, 210–219.CrossRefGoogle Scholar
  4. [4]
    Tesauro, G., “Practical issues in temporal Difference learning,” Machine Learning, 8, 1992, 257–277.zbMATHGoogle Scholar
  5. [5]
    Pollack, J.B. and Blair, A.D., “Coevolution in the successful learning of backgammon strategy,” Machine Learning, 32, 1998, 225–240.zbMATHCrossRefGoogle Scholar
  6. [6]
    Tesauro, G., “Comments on’ coevolution in the successful learning of backgammon strategy,” Machine Learning, 32, 1998, 241–243.zbMATHCrossRefGoogle Scholar
  7. [7]
    Minsky, M., “Steps toward artificial intelligence,” Proc. IRE, 49(1), 1961, 8–30.MathSciNetCrossRefGoogle Scholar
  8. [8]
    Chellapilla, K. and Fogel, D.B. “Evolving neural networks to play checkers without relying on expert knowledge,” IEEE Transactions on Neural Networks, 10(6), 1999, in press.Google Scholar
  9. [9]
    Chellapilla, K. and Fogel, D.B. “Evolution, neural networks, games, and intelligence,” Proc. IEEE, 87(9), 1999, 1471–1496.CrossRefGoogle Scholar
  10. [10]
    Kaindl, H., “Tree searching algorithms,” in Computers, Chess, and Cognition, T.A. Marsland and J. Schaeffer (eds.), Springer, NY, 1990, 133–168.CrossRefGoogle Scholar
  11. [11]
    Fogel, D.B. (ed.), Evolutionary Computation: The Fossil Record, IEEE Press, Piscataway, NJ, 1998.Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2003

Authors and Affiliations

  • David B. Fogel
    • 1
  1. 1.Natural Selection, Inc.La Jolla

Personalised recommendations