Evaluating Human-like Behaviors of Video-Game Agents Autonomously Acquired with Biological Constraints
Designing the behavioral patterns of video game agents (Non-player character: NPC) is a crucial aspect in developing video games. While various systems that have aimed at automatically acquiring behavioral patterns have been proposed and some have successfully obtained stronger patterns than human players, those patterns have looked mechanical. When human players play video games together with NPCs as their opponents/supporters, NPCs’ behavioral patterns have not only to be strong but also to be human-like. We propose the autonomous acquisition of NPCs’ behaviors, which emulate the behaviors of human players. Instead of implementing straightforward heuristics, the behaviors are acquired using techniques of reinforcement learning with Q-Learning and pathfinding through an A* algorithm, where biological constraints are imposed. Human-like behaviors that imply human cognitive processes were obtained by imposing sensory error, perceptual and motion delay, physical fatigue, and balancing between repetition and novelty as the biological constraints in computational simulations using “Infinite Mario Bros.”. We evaluated human-like behavioral patterns through subjective assessments, and discuss the possibility of implementing the proposed system.
KeywordsAutonomously strategy acquisition Machine learning Biological constraints Video game agent Infinite Mario Bros
Unable to display preview. Download preview PDF.
- 3.Hoki, K.: Optimal control of minimax search results to learn positional evaluation. In: Game Programming Workshop 2006, pp. 78–83 (2006)Google Scholar
- 5.Cabrera, J.L., Milton, J.G.: On-off intermittency in a human balancing task. Physical Review Letters 89(15) (September 2002)Google Scholar
- 8.Minsky, M.: The Emotion Machine: Commonsense Thinking, Artificial Intelligence, and the Future of the Human Mind, reprint edition. Simon and Schuster (2007)Google Scholar
- 10.Schrum, J., Karpov, I.V., Miikkulainen, R.: Human-like behavior via neuroevolution of combat behavior and replay of human traces. In: 2011 IEEE Conference, CIG 2011, pp. 329–336 (2011)Google Scholar
- 11.Soni, B., Hingston, P.: Bots trained to play like a human are more fun. In: 2008 IEEE International Joint Conference on Neural Networks, pp. 363–369 (2008)Google Scholar
- 13.Togelius, J., Karakovskiy, S., Baumgarten, R.: The 2009 mario AI competition. In: 2010 IEEE Evolutionary Computation (CEC), pp. 1–8 (2010)Google Scholar
- 14.Watkins, C.: Learning from delayed rewards. PhD thesis, Cambridge University, Cambridge, England (1989)Google Scholar