Abstract
Digital games are played by a large variety of players with different profiles and backgrounds. Understanding their reactions and experiences while playing is crucial to support game expansion or creation. This paper presents a tool to support affective states assessment based on facial analysis. It allows the configuration of different testing scenarios to gather in-game information as well as webcam feed for the facial expressions analysis and further affective reaction processing. Also, it outputs all the data collected and processed into three different formats: graphs, videos and CSV files. Experimental tests with a 2D puzzle game were made to demonstrate that the tool is able to gather and properly provide information about players’ affective experience.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Unity. https://unity.com/. Accessed 15 Jan 2020
Unreal engine. https://www.unrealengine.com/en-US/. Accessed 15 Jan 2020
Opencv (2018). https://opencv.org/about.html. Accessed 15 Jan 2020
Aboulafia, A., Bannon, L.J.: Understanding affect in design: an outline conceptual framework. Theor. Issues Ergon. Sci. 5(1), 4–15 (2004). https://doi.org/10.1080/1463922031000086708
Blom, P.M., Bakkes, S., Spronck, P.: Modeling and adjusting in-game difficulty based on facial expression analysis. Entertain. Comput. 31, 100307 (2019)
Cacioppo, J.T., Gardner, W.L.: Emotion. Annu. Rev. Psychol. 50, 191–214 (1999)
Dalgleish, T., Power, M.: Handbook of Cognition and Emotion. Wiley Interscience, New York (2005)
Damásio, A.R.: O Erro de Descartes: Emoção. Razão e o Cérebro Humano, Companhia das Letras, November 2012
El-nasr, M.S., Drachen, A., Canossa, A.: Game Analytics. Springer, London (2013). https://doi.org/10.1007/978-1-4471-4769-5
Gualeni, S., Janssen, D., Calvi, L.: How psychophysiology can aid the design process of casual games: a tale of stress, facial muscles, and paper beasts. In: Proceedings of the International Conference on the Foundations of Digital Games, FDG 2012, pp. 149–155. ACM, New York (2012). https://doi.org/10.1145/2282338.2282369
IJsselsteijn, W., de Kort, Y., Poels, K.: The Game Experience Questionnaire. Technische Universiteit Eindhoven (2013)
Inventado, P.S., Legaspi, R., Numao, M., Suarez, M.: Observatory: a tool for recording, annotating and reviewing emotion-related data. In: 2011 Third International Conference on Knowledge and Systems Engineering, pp. 261–265, October 2011. https://doi.org/10.1109/KSE.2011.48
Keltner, D.: Toward a consensual taxonomy of emotions. Cogn. Emot. 33(1), 14–19 (2019)
Klabnik, S., Nichols, C.: The Rust Programming Language, 2nd edn. No Starch Press, San Francisco (2018)
Moraes, M., et al.: Lumen: puzzle tridimensional de raciocínio lógico. Workshop G2 : Games na Graduação. In: XV Brazilian Symposium on Computer Games and Digital Entertainment (2016)
Nacke, L.E.: Introduction to biometric measures for games user research. In: Drachen, A., Mirza-Babaei, P., Nacke, L.E. (eds.) Games User Research, pp. 281–299. Oxford University Press, Oxford (2018)
Schell, J.: The Art of Game Design: A Book of Lenses. Morgan Kaufmann Publishers Inc., San Francisco (2008)
Scherer, K.R.: What are emotions? and how can they be measured? Soc. Sci. Inf. 44(4), 695–729 (2005). https://doi.org/10.1177/0539018405058216
Tan, C.T., Bakkes, S., Pisan, Y.: Inferring player experiences using facial expressions analysis. In: Proceedings of the 2014 Conference on Interactive Entertainment, IE 2014, pp. 7:1–7:8. ACM, New York (2014). https://doi.org/10.1145/2677758.2677765
Tangnimitchok, S., O-larnnithipong, N., Ratchatanantakit, N., Barreto, A.: Affective monitor: a process of data collection and data preprocessing for building a model to classify the affective state of a computer user. In: Kurosu, M. (ed.) HCII 2019. LNCS, vol. 11567, pp. 179–190. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-22643-5_14
Vieira, L.C.: Assessment of fun from the analysis of facial images. Ph.D. thesis, Universidade de São Paulo (2017)
Williams, D., Yee, N., Caplan, S.E.: Who plays, how much, and why? Debunking the stereotypical gamer profile. J. Comput. Med. Commun. 13(4), 993–1018 (2008)
Yoshida, R., Sugaya, M.: Influence of EQ on the difference of biometric emotion and self-evaluated emotion. In: Kurosu, M. (ed.) HCII 2019. LNCS, vol. 11567, pp. 191–200. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-22643-5_15
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Fleury, M.C., e Silva, T.B.P., Sarmet, M.M., Castanho, C.D. (2020). A Tool to Support Players Affective States Assessment Based on Facial Expressions Analysis. In: Fang, X. (eds) HCI in Games. HCII 2020. Lecture Notes in Computer Science(), vol 12211. Springer, Cham. https://doi.org/10.1007/978-3-030-50164-8_3
Download citation
DOI: https://doi.org/10.1007/978-3-030-50164-8_3
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-50163-1
Online ISBN: 978-3-030-50164-8
eBook Packages: Computer ScienceComputer Science (R0)