Dealing with Noisy Fitness in the Design of a RTS Game Bot

  • Antonio M. Mora
  • Antonio Fernández-Ares
  • Juan-Julián Merelo-Guervós
  • Pablo García-Sánchez
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7248)

Abstract

This work describes an evolutionary algorithm (EA) for evolving the constants, weights and probabilities of a rule-based decision engine of a bot designed to play the Planet Wars game. The evaluation of the individuals is based on the result of some non-deterministic combats, whose outcome depends on random draws as well as the enemy action, and is thus noisy. This noisy fitness is addressed in the EA and then, its effects are deeply analysed in the experimental section. The conclusions shows that reducing randomness via repeated combats and re-evaluations reduces the effect of the noisy fitness, making then the EA an effective approach for solving the problem.

Keywords

Genetic Algorithm Evolutionary Algorithm Aggregate Number Human Player Decision Engine 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Lidén, L.: Artificial stupidity: The art of intentional mistakes. In: AI Game Programming Wisdom 2, pp. 41–48. Charles River Media, Inc. (2004)Google Scholar
  2. 2.
    Togelius, J., Karakovskiy, S., Koutnik, J., Schmidhuber, J.: Super mario evolution. In: Proceedings of the 5th IEEE Symposium on Computational Intelligence and Games (CIG 2009). IEEE Press, Piscataway (2009)Google Scholar
  3. 3.
    Martín, E., Martínez, M., Recio, G., Saez, Y.: Pac-mant: Optimization based on ant colonies applied to developing an agent for ms. pac-man. In: Yannakakis, G.N., Togelius, J. (eds.) IEEE Symposium on Computational Intelligence and Games, CIG 2010, pp. 458–464 (2010)Google Scholar
  4. 4.
    Onieva, E., Pelta, D.A., Alonso, J., Milanés, V., Pérez, J.: A modular parametric architecture for the torcs racing engine. In: Proceedings of the 5th IEEE Symposium on Computational Intelligence and Games (CIG 2009), pp. 256–262. IEEE Press, Piscataway (2009)CrossRefGoogle Scholar
  5. 5.
    Sweetser, P.: Emergence in Games. Game Development. Charles River Media, Boston (2008)Google Scholar
  6. 6.
    Hong, J.H., Cho, S.B.: Evolving reactive NPCs for the real-time simulation game. In: Proceedings of the 2005 IEEE Symposium on Computational Intelligence and Games, CIG 2005 (2005)Google Scholar
  7. 7.
    Falke-II, W., Ross, P.: Dynamic Strategies in a Real-Time Strategy Game. In: Cantú-Paz, E., Foster, J.A., Deb, K., Davis, L., Roy, R., O’Reilly, U.-M., Beyer, H.-G., Kendall, G., Wilson, S.W., Harman, M., Wegener, J., Dasgupta, D., Potter, M.A., Schultz, A., Dowsland, K.A., Jonoska, N., Miller, J., Standish, R.K. (eds.) GECCO 2003. LNCS, vol. 2724, pp. 1920–1921. Springer, Heidelberg (2003)CrossRefGoogle Scholar
  8. 8.
    Aha, D.W., Molineaux, M., Ponsen, M.: Learning to Win: Case-Based Plan Selection in a Real-Time Strategy Game. In: Muñoz-Ávila, H., Ricci, F. (eds.) ICCBR 2005. LNCS (LNAI), vol. 3620, pp. 5–20. Springer, Heidelberg (2005)CrossRefGoogle Scholar
  9. 9.
    Ontanon, S., Mishra, K., Sugandh, N., Ram, A.: Case-Based Planning and Execution for Real-Time Strategy Games. In: Weber, R.O., Richter, M.M. (eds.) ICCBR 2007. LNCS (LNAI), vol. 4626, pp. 164–178. Springer, Heidelberg (2007)CrossRefGoogle Scholar
  10. 10.
    Spronck, P., Sprinkhuizen-Kuyper, I., Postma, E.: Improving opponent intelligence through offline evolutionary learning. International Journal of Intelligent Games & Simulation 2(1), 20–27 (2003)Google Scholar
  11. 11.
    Fernández-Ares, A., Mora, A.M., Merelo, J.J., García-Sánchez, P., Fernandes, C.: Optimizing player behavior in a real-time strategy game using evolutionary algorithms. In: IEEE Congress on Evolutionary Computation, CEC 2011 (2011) (accepted for publication)Google Scholar
  12. 12.
    Herrera, F., Lozano, M., Sánchez, A.M.: A taxonomy for the crossover operator for real-coded genetic algorithms: An experimental study. International Journal of Intelligent Systems 18, 309–338 (2003)MATHCrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2012

Authors and Affiliations

  • Antonio M. Mora
    • 1
  • Antonio Fernández-Ares
    • 1
  • Juan-Julián Merelo-Guervós
    • 1
  • Pablo García-Sánchez
    • 1
  1. 1.Departamento de Arquitectura y Tecnología de ComputadoresUniversidad de GranadaSpain

Personalised recommendations