International Conference on Entertainment Computing

Entertainment Computing - ICEC 2015 pp 86-99 | Cite as

Advanced Dynamic Scripting for Fighting Game AI

Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9353)

Abstract

We present an advanced version of dynamic scripting, which we apply to an agent created for the Fighting Game AI Competition. In contrast to the original method, our new approach is able to successfully adapt an agent’s behavior in real-time scenarios. Based on a set of rules created with expert knowledge, a script containing a subset of these rules is created online to control our agent. Our method uses reinforcement learning to learn which rules to include in the script and how to arrange them. Results show that the algorithm successfully adapts the agent’s behavior in tests against three other agents, allowing our agent to win most evaluations in our tests and the CIG 2014 competition.

Keywords

Artificial Intelligence AI Computer Game Fighting Game Dynamic Scripting Code Monkey Real-Time Adaptive Reinforcement Learning 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Cho, B.H., Jung, S.H., Seong, Y.R., Oh, H.R.: Exploiting Intelligence in Fighting Action Games Using Neural Networks. IEICE - Trans. Inf. Syst. E89-D(3), 1249–1256 (2006)CrossRefGoogle Scholar
  2. 2.
    Cho, B.H., Park, C., Yang, K.: Comparison of AI Techniques for Fighting Action Games - Genetic Algorithms/Neural Networks/Evolutionary Neural Networks. In: Ma, L., Rauterberg, M., Nakatsu, R. (eds.) ICEC 2007. LNCS, vol. 4740, pp. 55–65. Springer, Heidelberg (2007)CrossRefGoogle Scholar
  3. 3.
    Cho, B., Jung, S., Shim, K.-H., Seong, Y., Oh, H.: Reinforcement Learning of Intelligent Characters in Fighting Action Games. In: Harper, R., Rauterberg, M., Combetto, M. (eds.) ICEC 2006. LNCS, vol. 4161, pp. 310–313. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  4. 4.
    Fighting Game Artificial Intelligence Competition (2015). http://www.ice.ci.ritsumei.ac.jp/~ftgaic (accessed: February 02, 2015)
  5. 5.
    Graepel, T., Herbrich, R., Gold, J.: Learning to fight. In: Proceedings of the International Conference on Computer Games: Artificial Intelligence, Design and Education, pp. 193–200 (2004)Google Scholar
  6. 6.
    IEEE Conference on Computational Intelligence and Games (2014). http://www.cig2014.de (accessed: February 02, 2015)
  7. 7.
    Lu, F., Yamamoto, K., Nomura, L., Mizuno, S., Lee, Y., Thawonmas, R.: Fighting game artificial intelligence competition platform. In: 2013 IEEE 2nd Global Conference on Consumer Electronics (GCCE), pp. 320–323 (October 2013)Google Scholar
  8. 8.
    Lueangrueangroj, S., Kotrajaras, V.: Real-time imitation based learning for commercial fighting games. In: 2nd Annual International Conference on Computer Games, Multimedia and Allied Technology (CGAT), pp. 1–3 (2009)Google Scholar
  9. 9.
    Osaka, S., Thawonmas, R., Shibazaki, T.: Investigation of Various Online Adaptation Methods of Computer-Game AI Rulebase in Dynamic Scripting. In: Proceedings of the 1st International Conference on Digital Interactive Media Entertainment and Arts (DIME-ARTS 2006) (October 2006)Google Scholar
  10. 10.
    Park, H., Kim, K.J.: Learning to play fighting game using massive play data. In: 2014 IEEE Conference on Computational Intelligence and Games (CIG), pp. 1–2 (August 2014)Google Scholar
  11. 11.
    Ponsen, M., Spronck, P., Muñoz Avila, H., Aha, D.W.: Knowledge Acquisition for Adaptive Game AI. Sci. Comput. Program. 67(1), 59–75 (2007)MathSciNetCrossRefMATHGoogle Scholar
  12. 12.
    Ricciardi, A., Thill, P.: Adaptive AI for fighting games (December 2008). http://cs229.stanford.edu/proj2008/RicciardiThill-AdaptiveAIForFightingGames.pdf (accessed: February 02, 2015)
  13. 13.
    Saini, S., Dawson, C., Chung, P.: Mimicking player strategies in fighting games. In: 2011 IEEE International Games Innovation Conference (IGIC), pp. 44–47 (November 2011)Google Scholar
  14. 14.
    Spronck, P., Ponsen, M., Sprinkhuizen-Kuyper, I., Postma, E.: Adaptive game AI with dynamic scripting. Machine Learning 63(3), 217–248 (2006)CrossRefGoogle Scholar
  15. 15.
    Szita, I., Ponsen, M., Spronck, P.: Effective and Diverse Adaptive Game AI. IEEE Transactions on Computational Intelligence and AI in Games 1(1), 16–27 (2009)CrossRefGoogle Scholar
  16. 16.
    Thawonmas, R., Osaka, S.: A Method for Online Adaptation of Computer-game AI Rulebase. In: Proceedings of the 2006 ACM SIGCHI International Conference on Advances in Computer Entertainment Technology. ACM (2006)Google Scholar
  17. 17.
    Thunputtarakul, W., Kotrajaras, V.: Data Analysis for Ghost AI Creation in Commercial Fighting Games. In: GAMEON, pp. 37–41 (2007)Google Scholar
  18. 18.
    Timuri, T., Spronck, P., van den Herik, H.J.: Automatic Rule Ordering for Dynamic Scripting. In: 2007 AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment (AIIDE), pp. 49–54 (2007)Google Scholar
  19. 19.
    Yamamoto, K., Mizuno, S., Chu, C.Y., Thawonmas, R.: Deduction of fighting-game countermeasures using the k-nearest neighbor algorithm and a game simulator. In: 2014 IEEE Conference on Computational Intelligence and Games (CIG), pp. 1–5 (August 2014)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2015

Authors and Affiliations

  • Kevin Majchrzak
    • 1
  • Jan Quadflieg
    • 1
  • Günter Rudolph
    • 1
  1. 1.Chair of Algorithm EngineeringTU DortmundDortmundGermany

Personalised recommendations