Towards Imitation of Human Driving Style in Car Racing Games

Chapter

Abstract

In this chapter we focus on creating believable drivers for car racing games. We describe some racing controllers from the commercial games and the academic researchers, their particular features, what are the main problems they want to deal with and how they approach them. Besides, we identify which are the key properties and behaviours required to consider a racing non-player character (NPC) as believable or not, always from the point of view of an external human player that competes against the NPC. Then, we analyze why the current controllers lack what we understand as a believable behaviour and propose a new approach based on imitation learning to create the racing NPCs. We describe this new approach and analyze its advantages and disadvantages compared with other controllers in order to solve the key problems to achieve the desired believability.

Keywords

Trajectory Point Target Speed Speed Model Human Driver Human Player 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Notes

Acknowledgments

We would like to thank the reviewers and the editor of the book for their constructive comments. We have done our best to include all the comments and to improve the quality of the chapter.

References

  1. 1.
    Bates, J.: SCIENCE., C.M.U.P.P.D.O.C.: The role of emotion in believable agents. Commun. ACM 37(7), 122–125 (1994)Google Scholar
  2. 2.
    Biasillo, G.: Racing AI Logic. AI Game Programming Wisdom, pp. 444–454. Charles River Media, Hingham (2002)Google Scholar
  3. 3.
    Bishop, C.: Neural networks and their applications. Rev. Sci. Instrum. 65(6), 1803–1832 (2009)Google Scholar
  4. 4.
    Buckland, M.: Colin McRae Rally 2.0. Interview with Jeff Hannan. http://ai-junkie.com/misc/hannan/hannan.html. Accessed Nov 2010
  5. 5.
    Cardamone, L., Loiacono, D., Lanzi, P.L.: Learning to drive in theopen racing car simulator using online neuroevolution. Computational Intelligence and AI in Games. IEEE Trans. 2(3), 176–190 (2010). doi: 10.1109/TCIAIG.2010.2052102 Google Scholar
  6. 6.
    Chaperot, B., Fyfe, C.: Improving artificial intelligence in a motocross game. In: 2006 IEEE Symposium on Computational Intelligence and Games, pp. 181–186 (2006)Google Scholar
  7. 7.
    Cutumisu, M., Szafron, D.: An architecture for game behavior AI: behavior multi-queues. In: Artificial Intelligence for Interactive Digital entertainment Conference (2009)Google Scholar
  8. 8.
    Gallego, F., Llorens, F., Pujol, M., Rizo, R.: Driving-Bots with a Neuroevolved Brain: Screaming Racers. Inteligencia Artificial, Revista Iberoamericana de Inteligencia Artificial 9(28), 9–16 (2005)Google Scholar
  9. 9.
    Hingston, P.: The 2K BotPrize. In: IEEE Symposium on Computational Intelligence and Games. IEEE (2009). http://www.botprize.org
  10. 10.
    Ho, D., Garibaldi, J.: A fuzzy approach for the 2007 CIG simulated car racing competition. In: IEEE Symposium On Computational Intelligence and Games, 2008. CIG’08, pp. 127–134. IEEE (2009)Google Scholar
  11. 11.
    Hunicke, R.: The case for dynamic difficulty adjustment in games. In: Proceedings of the 2005 ACM SIGCHI International Conference on Advances in Computer Entertainment Technology, pp. 429–433. ACM (2005)Google Scholar
  12. 12.
    Klir, G., Yuan, B.: Fuzzy Sets and Fuzzy Logic: Theory and Applications. Prentice Hall PTR Upper Saddle River (1995)Google Scholar
  13. 13.
    Koza, J., Poli, R.: Genetic programming. Search Methodologies, pp. 127–164 (2005)Google Scholar
  14. 14.
    Laird, J., VanLent, M.: Human-level AI’s killer application: interactive computer games. AI Mag. 22(2), 15 (2001)Google Scholar
  15. 15.
    Li, H., Zhang, Q.: Multiobjective optimization problems with complicated Pareto sets, MOEA/D and NSGA-II. Evolutionary Computation, IEEE Trans. 13(2), 284–302 (2009)Google Scholar
  16. 16.
    Loiacono, D., Lanzi, P., Togelius, J., Onieva, E., Pelta, D., Butz, M., Lonneker, T., Cardamone, L., Perez, D., Sáez, Y., et al.: The 2009 simulated car racing championship. IEEE Trans. Comput. Intell. AI in Games 2(2), 131–147 (2010)Google Scholar
  17. 17.
    Lum, R., Meighan, M., Alfaro, H.: Using NEAT to Train a Player for the Iterated Prisoner Dilemma. Machine Learning (2008)Google Scholar
  18. 18.
    Mac Namee, B.: Proactive Persistent Agents-Using Situational Intelligence to Create Support Characters in Character-Centric Computer Games. Ph.D. thesis, Department of Computer Science, University of Dublin, Trinity College (2004)Google Scholar
  19. 19.
    Matthews, J.: Colin McRae Rally 2.0. Interview with Jeff Hannan (2001). http://www.generation5.org/content/2001/hannan.asp. Accessed Nov 2010
  20. 20.
    Microsoft Corporation: Drivatar. http://research.microsoft.com/en-us/projects/drivatar/forza.aspx. Accessed June 2011
  21. 21.
    Millington, I., Funge, J.: Artificial Intelligence for Games. Morgan Kaufmann, San Francisco (2009)Google Scholar
  22. 22.
    Muñoz, J., Gutierrez, G., Sanchis, A.: Controller for TORCS created by imitation. In: Proceedings 2009 IEEE Symposium on Computational Intelligence and Games, pp. 271–278 (2009)Google Scholar
  23. 23.
    Muñoz, J., Gutierrez, G., Sanchis, A.: A human-like TORCS controller for the Simulated Car Racing Championship. In: Proceedings 2010 IEEE Conference on Computational Intelligence and Games, pp. 473–480 (2010)Google Scholar
  24. 24.
    Nintendo: Mario Kart. http://www.mariokart.com/. Accessed Nov 2010
  25. 25.
    Onieva, E., Cardamone, L., Loiacono, D., Lanzi, P.: Overtaking opponents with blocking strategies using fuzzy logic. In: IEEE Symposium on Computational Intelligence and Games, pp. 123–130. IEEE (2010)Google Scholar
  26. 26.
    Polyphony Digital Inc.: Gran Turismo 5. The real driving simulator. http://www.gran-turismo.com/. Accessed Nov 2010
  27. 27.
    Rao, R., Shon, A., Meltzoff, A.: A Bayesian Model of Imitation in Infants and Robots. Imitation and social learning in robots, humans, and, animals (2005)Google Scholar
  28. 28.
    Reeves, C.: Genetic algorithms. Handbook of Metaheuristics, pp.109–139. Springer, New York (2010)Google Scholar
  29. 29.
    Tencé, F., Buche, C., De Loor, P., Marc, O.: The Challenge of Believability in Video Games: Definitions, Agents Models and Imitation Learning. Arxiv, preprint arXiv:1009.0451 (2010)Google Scholar
  30. 30.
    Thurau, C., Paczian, T., Bauckhage, C.: Is Bayesian imitation learning the route to believable gamebots, pp. 3–9. Proc. GAME-ON North, America (2005)Google Scholar
  31. 31.
    Tipping, M., Hatton, M.: Drivatars\(^{{\rm TM}}\) and Forza Motorsport (2006). http://www.vagamelabs.com/drivatars-trade-and-forza-motorsport.htm. Accessed Sept 2010
  32. 32.
    Tipping, M., Hatton, M.: Drivatars\(^{{\rm TM}}\) theory (2006). http://research.microsoft.com/en-us/projects/drivatar/theory.aspx. Accessed Nov 2010
  33. 33.
    TORCS (The Open Racing Car Simulator). http://torcs.sourceforge.net/ (2011). Accessed June 2011
  34. 34.
    Turing, A.: Computing Machinery and Intelligence, pp. 23–65. Epstein et al., Parsing the Turing Test, Springer (2009)Google Scholar
  35. 35.
    Van Hoorn, N., Togelius, J., Wierstra, D., Schmidhuber, J.: Robust player imitation using multiobjective evolution. In: Proceedings of the IEEE Congress on Evolutionary Computation (2009)Google Scholar
  36. 36.
    Yang, X., Zheng, J.: Artificial Neural Networks. Handbook of Research on Geoinformatics. p. 122 (2009)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2013

Authors and Affiliations

  • Jorge Muñoz
    • 1
  • German Gutierrez
    • 1
  • Araceli Sanchis
    • 1
  1. 1.University Carlos III of Madrid Leganes, MadridSpain

Personalised recommendations