Evolving Blackjack Strategies Using Cultural Learning

  • Dara Curran
  • Colm O’Riordan
Conference paper


This paper presents a new approach to the evolution of blackjack strategies, that of cultural learning. Populations of neural network agents are evolved using a genetic algorithm and at each generation the best performing agents are selected as teachers. Cultural learning is implemented through a hidden layer in each teacher’s neural network that is used to produce utterances which are imitated by its pupils during many games of blackjack. Results show that the cultural learning approach outperforms previous work and equals the best known non-card counting human approaches.


Hide Layer Reinforcement Learning Artificial Life Cultural Learning Picture Card 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. [1]
    L. Steels. The synthetic modeling of language origins. In Evolution of Communication, pages 1–34, 1997.Google Scholar
  2. [2]
    H. Yanco and L. Stein. An adaptive communication protocol for cooperating mobile robots. In From Animals to Animats 2. Proceedings of the second International Conference on Simulation of Adaptive Behavior, pages 478–485. MIT Press, Cambridge Ma., 1993.Google Scholar
  3. [3]
    A. Cangelosi and D. Parisi. The emergence of a language in an evolving population of neural networks. Technical Report NSAL-96004, National Research Council, Rome, 1996.Google Scholar
  4. [4]
    L. Spector and S. Luke. Culture enhances the evolvability of cognition. In Cognitive Science (CogSci) 1996 Conference Proceedings, 1996.Google Scholar
  5. [5]
    E. Hutchins and B. Hazlehurst. Learning in the cultural process. In Artificial Life II, ed. C. Langton et al MIT Press, 1991.Google Scholar
  6. [6]
    A. Cangelosi. Evolution of communication using combination of grounded symbols in populations of neural networks. In Proceedings of IJCNN99 International Joint Conference on Neural Networks (vol. 6), pages 4365–4368, Washington, DC, 1999.Google Scholar
  7. [7]
    B. MacLennan and G. Burghardt. Synthetic ethology and the evolution of cooperative communication. In Adaptive Behavior 2(2), pages 161–188, 1993.Google Scholar
  8. [8]
    A. Billard and G. Hayes. Learning to communicate through imitation in autonomous robots. In 7th International Conference on Artificial Neural Networks, pages 763–738, 1997.Google Scholar
  9. [9]
    D. Denaro and D. Parisi. Cultural evolution in a population of neural networks. In M. Marinaro and R. Tagliaferri (eds), Neural Nets Wirn-96. New York: Springer, pages 100–111, 1996.Google Scholar
  10. [10]
    E. Hutchins and B. Hazlehurst. How to invent a lexicon: The development of shared symbols in interaction. In N. Gilbert and R. Conte, editors, Artificial Societies: The Computer Simulation of Social Life, pages 157–189. UCL Press: London, 1995.Google Scholar
  11. [11]
    D. K. Olson. Learning to Play Games from Experience: An Application of Artificial Neural Networks and Temporal Difference Learning. Pacific Lutheran University, 1993.Google Scholar
  12. [12]
    Andrs Prez-Uribe and Eduardo Sanchez. Blackjack as a test bed for learning strategies in neural networks. In International Joint Conference on Neural Networks, IJCNN’98, pages 2022–2027, 1998.Google Scholar
  13. [13]
    A. H. Morehead and G. M. Smith. Hoyle’s Rules of Games. Plume, 1963.Google Scholar
  14. [14]
    D. Curran and C. O’Riordan. On the design of an artificial life simulator. In V. Palade, R. J. Howlett, and L. C. Jain, editors, Proceedings of the Seventh International Conference on Knowledge-Based Intelligent Information & Engineering Systems (KES 2003), pages 549–555, University of Oxford, United Kingdom, 2003.Google Scholar
  15. [15]
    D. Curran and C. O’Riordan. Artificial life simulation using marker based encoding. In Proceedings of the 2003 International Conference on Artificial Intelligence (IC-AI 2003), volume II, pages 665–668, Las Vegas, Nevada, USA, 2003.Google Scholar

Copyright information

© Springer-Verlag/Wien 2005

Authors and Affiliations

  • Dara Curran
    • 1
  • Colm O’Riordan
    • 1
  1. 1.Dept. of Information TechnologyNational University of IrelandGalway

Personalised recommendations