Abstract
Flocking strategies are sets of behavior rules for the interaction of agents that allow to devise controllers with reduced complexity that generate emerging behavior. In this paper, we present an application of genetic algorithms and flocking strategies to control the Ghost Team in the game Ms. Pac-Man. In particular, we define flocking strategies for the Ghost Team and optimize them for robustness with respect to the stochastic elements of the game and effectivity against different possible opponents by means of genetic algorithm. The performance of the methodology proposed is tested and compared with that of other standard controllers. The results show that flocking strategies are capable of modeling complex behaviors and produce effective and challenging agents.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Alhejali, A., Lucas, S.: Evolving diverse Ms. Pac-Man playing agents using genetic programming. In: Proceedings of the 2010 UK Workshop on Computational Intelligence (UKCI 2010), pp. 1–6 (2010)
Alhejali, A., Lucas, S.: Using a training camp with Genetic Programming to evolve Ms. Pac-Man agents. In: Proceedings of the 2011 IEEE Conference on Computational Intelligence and Games (CIG 2011), pp. 118–125 (2011)
Beni, G., Wang, J.: Swarm intelligence in cellular robotic systems. In: Robots and Biological Systems: Towards a New Bionics?. NATO ASI Series F: Computer and Systems Sciences, vol. 102, pp. 703–712 (1993)
Brandstetter, M., Ahmadi, S.: Reactive control of Ms. Pac Man using information retrieval based on Genetic Programming. In: Proceedings of the 2012 IEEE Conference on Computational Intelligence and Games (CIG 2012), pp. 250–256 (2012)
Burrow, P., Lucas, S.: Evolution versus Temporal Difference Learning for learning to play Ms. Pac-Man. In: Proceedings of the IEEE Symposium on Computational Intelligence and Games (CIG 2009), pp. 53–60 (2009)
Cardona, A., Togelius, J., Nelson, M.: Competitive coevolution in Ms. Pac-Man. In: Proceedings of the 2013 IEEE Congress on Evolutionary Computation (CEC 2013), pp. 1403–1410 (2013)
Gagne, D., Congdon, C.: FRIGHT: A flexible rule-based intelligent ghost team for Ms. Pac-Man. In: Proceedings of the 2012 IEEE Conference on Computational Intelligence and Games (CIG 2012), pp. 273–280 (2012)
Gallagher, M.: Learning to play Pac-Man: an evolutionary, rule-based approach. In: Proceedings of the 2003 Congress on Evolutionary Computation (CEC 2003), pp. 2462–2469 (2003)
Galván-López, E.: Comparing the performance of the evolvable \(\pi \)Grammatical Evolution genotype-phenotype map to Grammatical Evolution in the dynamic Ms. Pac-Man environment. In: Proceedings of the 2010 IEEE Congress on Evolutionary Computation (CEC 2010), pp. 1–8 (2010)
Jia-Yue, D., Yan, L., Jun-Fen, C., Feng, Z.: Evolutionary neural network for ghost in Ms. Pac-Man. In: Proceedings of the 2011 International Conference on Machine Learning and Cybernetics (ICMLC 2011), vol. 2, pp. 732–736 (2011)
Lucas, S.: Evolving a neural network location evaluator to play Ms. Pac-Man. In: Proceedings of the IEEE Symposium on Computational Intelligence and Games (CIG 2005), pp. 203–210 (2005)
Lucas, S.: Ms. Pac-Man versus ghost-team competition. In: Procedings of IEEE Symposium on Computational Intelligence and Games (CIG 2009), p. 1 (2009)
Mora, A.: Fernández-Ares, A., Guervós, J.M., García-Sánchez, P., Fernandes, C.: Effect of noisy fitness in real-time strategy games player behaviour optimisation using evolutionary algorithms. Journal of Computer Science and Technology 27(5), 1007–1023 (2012)
Nguyen, K., Thawonmas, R.: Applying Monte-Carlo Tree Search to collaboratively controlling of a Ghost Team in Ms. Pac-Man. In: Proceedings of the 2011 IEEE International Games Innovation Conference (IGIC 2011), pp. 8–11 (2011)
Nguyen, K., Thawonmas, R.: Monte Carlo Tree Search for collaboration control of ghosts in Ms. Pac-Man. IEEE Transactions on Computational Intelligence and AI in Games 5(1), 57–68 (2013)
Rabin, S.: Artificial Intelligence: Agents, Architecture, and Techniques. In: Introduction to Game Development, 2nd edn., pp. 521–557. Charles River Media (2010)
Reynolds, C.: Flocks, herds and schools: a distributed behavioral model. Computer Graphics 21(4), 25–34 (1987)
Rohlfshagen, P., Lucas, S.: Ms. Pac-Man versus Ghost Team CEC 2011 competition. In: Proceedings of the 2011 IEEE Congress on Evolutionary Computation (CEC 2011), pp. 70–77. IEEE Press (2011)
Scutt, T.: Simple swarms as an alternative to flocking. In: AI Game Programming Wisdom, pp. 202–208. Charles River Media (2002)
Sombat, W., Rohlfshagen, P., Lucas, S.: Evaluating the enjoyability of the ghosts in Ms. Pac-Man. In: Proceedings of the 2012 IEEE Conference on Computational Intelligence and Games (CIG 2012), pp. 379–387 (2012)
Spector, L., Klein, J., Perry, C., Feinstein, M.: Emergence of collective behavior in evolving populations of flying agents. In: Proceedings of the Genetic and Evolutionary Computation Conference (GECCO 2003), pp. 61–73 (2003)
Svensson, J., Johansson, S.: Influence Map-based controllers for Ms. PacMan and the ghosts. In: Proceedings of the 2012 IEEE Conference on Computational Intelligence and Games (CIG 2012), pp. 257–264 (2012)
Thawonmas, R.: Evolution strategy for optimizing parameters in Ms Pac-Man controller ICE Pambush 3. In: Proceedings of the 2010 IEEE Symposium on Computational Intelligence and Games (CIG 2010), pp. 235–240 (2010)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Liberatore, F., Mora, A.M., Castillo, P.A., Guervós, J.J.M. (2014). Evolving Evil: Optimizing Flocking Strategies Through Genetic Algorithms for the Ghost Team in the Game of Ms. Pac-Man. In: Esparcia-Alcázar, A., Mora, A. (eds) Applications of Evolutionary Computation. EvoApplications 2014. Lecture Notes in Computer Science(), vol 8602. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-662-45523-4_26
Download citation
DOI: https://doi.org/10.1007/978-3-662-45523-4_26
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-662-45522-7
Online ISBN: 978-3-662-45523-4
eBook Packages: Computer ScienceComputer Science (R0)