Designing and Evolving an Unreal TournamentTM 2004 Expert Bot
This work describes the design of a bot for the first person shooter Unreal TournamentTM 2004 (UT2K4), which behaves as a human expert player in 1 vs. 1 death matches. This has been implemented modelling the actions (and tricks) of this player, using a state-based IA, and supplemented by a database for ‘learning’ the arena. The expert bot yields excellent results, beating the game default bots in the hardest difficulty, and even being a very hard opponent for the human players (including our expert). The AI of this bot is then improved by means of three different approaches of evolutionary algorithms, optimizing a wide set of parameters (weights and probabilities) which the expert bot considers when playing. The result of this process yields an even better rival; however the noisy nature of the fitness function (due to the pseudo-stochasticity of the battles) makes the evolution slower than usual.
Unable to display preview. Download preview PDF.
- 1.Soni, B., Hingston, P.: Bots trained to play like a human are more fun. In: IEEE International Joint Conference on Neural Networks, IJCNN 2008, pp. 363–369 (2008)Google Scholar
- 2.Small, R., Bates-Congdon, C.: Agent Smith: Towards an evolutionary rule-based agent for interactive dynamic games. In: IEEE Congress on Evolutionary Computation, CEC 2009, pp. 660–666 (2009)Google Scholar
- 4.Goldberg, D.E.: Genetic Algorithms in search, optimization and machine learning. Addison Wesley (1989)Google Scholar
- 5.Mora, A.M., Moreno, M.A., Merelo, J.J., Castillo, P.A., Arenas, M.G., Laredo, J.L.J.: Evolving the cooperative behaviour in unreal; bots. In: Yannakakis, G.N., Togelius, J. (eds.) CIG, pp. 241–248. IEEE (2010)Google Scholar
- 6.Laird, J.E.: It knows what you’re going to do: Adding anticipation to a quakebot. In: Artificial Intelligence and Interactive Entertainment SS-00-02. AAAI 2000 Spring Symposium Series (2000)Google Scholar
- 7.Laird, J.E.: Using a computer game to develop advanced AI. Computer, 70–75 (2001)Google Scholar
- 8.Cole, N., Louis, S.J., Miles, C.: Using a genetic algorithm to tune first-person shooter bots. In: Proceedings of the IEEE Congress on Evolutionary Computation 2004, pp. 139–145 (2004)Google Scholar
- 9.Priesterjahn, S., Kramer, O., Weimer, A., Goebels, A.: Evolution of human-competitive agents in modern computer games. In: IEEE World Congress on Computational Intelligence, WCCI 2006, pp. 777–784 (2006)Google Scholar
- 10.2K-Games: The 2k botprize competition (2012), http://www.botprize.org