Skip to main content

Real Time In-Game Playstyle Classification Using a Hybrid Probabilistic Supervised Learning Approach

  • Conference paper
  • First Online:
Artificial Intelligence Research (SACAIR 2022)

Abstract

In interactive digital media, such as video games, bringing about an adaptive or personalised experience requires a mechanism for correctly classifying or identifying the player style, before attempting to modify the experience in some way that improves player interest and immersion. This work presents a framework for solving this problem of in-game real time playstyle classification. We propose a hybrid probabilistic supervised learning approach, using Bayesian Inference informed by a K-Nearest Neighbors based likelihood, that is able to classify players in real time at every step within a given game level using only the latest player action or state observation. This improves on current approaches dependent on previous episodic player action trajectories in order to classify the player. Furthermore, we highlight the effect that this representation of the player state-action observation has on the in-game playstyle classification’s accuracy, prediction stability, and generalisability. We apply and test our framework using MiniDungeons, a rogue-like dungeon exploration game, and further evaluate our framework using a natural dataset containing human player action data from the platforming game Super Mario Bros. The experimental results obtained from our approach outperforms existing work in both domains. Furthermore, the evaluation results highlights the ability of our framework to generalise to unseen levels, without the need for additional retraining. Additionally, the Super Mario evaluation results illustrates the scalability of our framework to a more complex game environment with human player data.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 69.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 89.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    https://github.com/ganyariya/gym-md.

  2. 2.

    http://guzdial.com/datasets.html.

  3. 3.

    https://github.com/ganyariya/gym-md/blob/main/README/resources/md_stages_screenshots/README.md.

  4. 4.

    https://github.com/LJArendse/playstyle_classification_using_hybrid_probabilistic_supervised_learning.

References

  1. Bakkes, S., Spronck, P., Lankveld, G.V.: Player behavioural modelling for video games. Entertainment Comput. 3, 71–79 (2012). https://doi.org/10.1016/j.entcom.2011.12.001

    Article  Google Scholar 

  2. Bontchev, B.: Holistic player modeling for controling adaptation in video games. In: Proceedings of the 14th International Conference e-Society 2016 (2016)

    Google Scholar 

  3. Charles, D., Black, M.: Dynamic player modelling: a framework for player-centred digital games. In: Proceedings of the International Conference on Computer Games: Artificial Intelligence, Design and Education (2004)

    Google Scholar 

  4. Gonzalez-Duque, M., Palm, R.B., Risi, S.: Fast game content adaptation through Bayesian-based player modelling. In: 2021 IEEE Conference on Games (CoG), pp. 01–08 (2021). https://doi.org/10.1109/CoG52621.2021.9619018

  5. Gow, J., Baumgarten, R., Cairns, P., Colton, S., Miller, P.: Unsupervised modeling of player style with LDA. IEEE Trans. Comput. Intell. AI Games 4(3), 152–166 (2012). https://doi.org/10.1109/TCIAIG.2012.2213600

    Article  Google Scholar 

  6. Guzdial, M., Riedl, M.O.: Game level generation from gameplay videos. In: Proceedings of the Twelfth AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment, vol. 12, pp. 44–50 (2016). https://aaai.org/ocs/index.php/AIIDE/AIIDE16/paper/view/14008/13593

  7. Hernandez-Leal, P., Taylor, M.E., Rosman, B., Sucar, L.E., de Cote, E.M.: Identifying and tracking switching, non-stationary opponents: a Bayesian approach. In: AAAI Workshop: Multiagent Interaction without Prior Coordination (2016)

    Google Scholar 

  8. Holmgard, C., Liapis, A., Togelius, J., Yannakakis, G.: Monte-Carlo tree search for persona based player modeling. In: Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment, vol. 11, no. 5, pp. 8–14 (2021). https://ojs.aaai.org/index.php/AIIDE/article/view/12849

  9. Holmgard, C., Liapis, A., Togelius, J., Yannakakis, G.N.: Evolving personas for player decision modeling. In: 2014 IEEE Conference on Computational Intelligence and Games, pp. 1–8 (2014). https://doi.org/10.1109/CIG.2014.6932911

  10. Holmgård, C., Liapis, A., Togelius, J., Yannakakis, G.N.: Personas versus clones for player decision modeling. In: Pisan, Y., Sgouros, N.M., Marsh, T. (eds.) ICEC 2014. LNCS, vol. 8770, pp. 159–166. Springer, Heidelberg (2014). https://doi.org/10.1007/978-3-662-45212-7_20

    Chapter  Google Scholar 

  11. Hunter, J.D.: Matplotlib: a 2D graphics environment. Comput. Sci. Eng. 9(3), 90–95 (2007). https://doi.org/10.1109/MCSE.2007.55

    Article  Google Scholar 

  12. Iawasaki, Y., Hasebe, K.: Identifying playstyles in games with neat and clustering. In: 2021 IEEE Conference on Games (CoG), pp. 1–4 (2021). https://doi.org/10.1109/CoG52621.2021.9619024

  13. Ingram, B.: Generating tailored advice in video games through play-style identification and player modelling. In: Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment, vol. 17, no. 1, pp. 228–231 (2021). https://ojs.aaai.org/index.php/AIIDE/article/view/18913

  14. Ingram, B., Rosman, B., van Alten, C., Klein, R.: Play-style identification through deep unsupervised clustering of trajectories. In: 2022 IEEE Conference on Games (CoG), pp. 393–400 (2022). https://doi.org/10.1109/CoG51982.2022.9893680

  15. Iwasaki, Y., Hasebe, K.: A framework for generating playstyles of game AI with clustering of play logs. In: Proceedings of the 14th International Conference on Agents and Artificial Intelligence, ICAART, vol. 3, pp. 605–612. INSTICC, SciTePress (2022). https://doi.org/10.5220/0010869500003116

  16. Kodinariya, T., Makwana, P.: Review on determining of cluster in k-means clustering. Int. J. Adv. Res. Comput. Sci. Manag. Stud. 1, 90–95 (2013)

    Google Scholar 

  17. Normoyle, A., Jensen, S.: Bayesian clustering of player styles for multiplayer games. In: Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment, vol. 11, no. 1, pp. 163–169 (2021). https://ojs.aaai.org/index.php/AIIDE/article/view/12805

  18. Pedersen, C., Togelius, J., Yannakakis, G.: Modeling player experience in super mario bros, pp. 132–139 (2009). https://doi.org/10.1109/CIG.2009.5286482

  19. Pedregosa, F., et al.: Scikit-learn: machine learning in Python. J. Mach. Learn. Res. 12 (2011)

    Google Scholar 

  20. Russell, S.J., Norvig, P.: Artificial Intelligence: A Modern Approach, 3rd edn. Pearson, London (2009)

    MATH  Google Scholar 

  21. Scott, G., Khosmood, F.: Complementary companion behavior in video games. Master’s thesis, School of Computer Science, California Polytechnic State University, San Luis Obispo (2017). https://digitalcommons.calpoly.edu/theses/1744. https://doi.org/10.15368/theses.2017.55. arXiv Short Paper Version https://arxiv.org/abs/1808.09079

  22. Togelius, J., Nardi, R.D., Lucas, S.M.: Making racing fun through player modeling and track evolution (2006)

    Google Scholar 

  23. Tremblay, J., Verbrugge, C.: Adaptive companions in FPS games. In: FDG (2013)

    Google Scholar 

  24. Tychsen, A., Canossa, A.: Defining personas in games using metrics. In: Future Play (2008). https://doi.org/10.1145/1496984.1496997

  25. Valls-Vargas, J., Ontañón, S., Zhu, J.: Exploring player trace segmentation for dynamic play style prediction. In: Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment, vol. 11, no. 1, pp. 93–99 (2021). https://ojs.aaai.org/index.php/AIIDE/article/view/12782

  26. Waskom, M.L.: Seaborn: statistical data visualization. J. Open Source Softw. 6 (2021). https://doi.org/10.21105/joss.03021

  27. Yannakakis, G., Spronck, P., Loiacono, D., Andre, E.: Player Modeling. Dagstuhl Follow-Ups, vol. 6, pp. 45–59. Dagstuhl Publishing (2013)

    Google Scholar 

  28. Zhang, M., Verbrugge, C.: Modelling player understanding of non-player character paths. In: Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment, vol. 14, no. 1 (2018). https://dl.acm.org/doi/abs/10.5555/3505378.3505415

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Lindsay John Arendse .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Arendse, L.J., Ingram, B., Rosman, B. (2022). Real Time In-Game Playstyle Classification Using a Hybrid Probabilistic Supervised Learning Approach. In: Pillay, A., Jembere, E., Gerber, A. (eds) Artificial Intelligence Research. SACAIR 2022. Communications in Computer and Information Science, vol 1734. Springer, Cham. https://doi.org/10.1007/978-3-031-22321-1_5

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-22321-1_5

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-22320-4

  • Online ISBN: 978-3-031-22321-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics