Automatic Recognition of Affective Body Movement in a Video Game Scenario
This study aims at recognizing the affective states of players from non-acted, non-repeated body movements in the context of a video game scenario. A motion capture system was used to collect the movements of the participants while playing a Nintendo Wii tennis game. Then, a combination of body movement features along with a machine learning technique was used in order to automatically recognize emotional states from body movements. Our system was then tested for its ability to generalize to new participants and to new body motion data using a sub-sampling validation technique. To train and evaluate our system, online evaluation surveys were created using the body movements collected from the motion capture system and human observers were recruited to classify them into affective categories. The results showed that observer agreement levels are above chance level and the automatic recognition system achieved recognition rates comparable to the observers’ benchmark.
KeywordsBody movement automatic emotion recognition exertion game
Unable to display preview. Download preview PDF.
- 1.Kim, J.H., Gunn, D.V., Schuh, E., Phillips, B., Pagulayan, R.J., Wixon, D.: Tracking real-time user experience (TRUE): a comprehensive instrumentation solution for complex systems. In: Proceedings of the 26th Annual SIGCHI Conference On Human Factors In Computing Systems, pp. 443–452. ACM, New York (2008)Google Scholar
- 4.Mandler, G.: History of Psychology. Emotion, vol. 1, ch. 8. Wiley (2002) Google Scholar
- 7.Kleinsmith, A., Fushimi, T., Bianchi-Berthouze, N.: An incremental and interactive affective posture recognition system. In: Carberry, S., De Rosis, F. (eds.) International Workshop on Adapting the Interaction Style to Affective Factors, in conjunction with the International Conference on User Modeling (2005)Google Scholar
- 12.Mandler, G.: History of Psychology. Emotion, vol. 1, ch. 8. Wiley (2002)Google Scholar
- 13.Kitagawa, M., Windsor, B.: MoCap for Artists: Workflow and Techniques for Motion Capture, pp. 190–194. Focal Press (2008)Google Scholar
- 14.Roether, C., Omlor, L., Christensen, A., Giese, M.A.: Critical features for the perception of emotion from gait. Journal of Vision 8(6), 15, 1–32 (2009)Google Scholar
- 16.Haykin, S.: Neural Networks: A Comprehensive Foundation, 2nd edn., pp. 754–777. Prentice-Hall (1999)Google Scholar
- 17.Bodén, M.: A guide to recurrent neural networks and backpropagation, in The DALLAS project. Report from the NUTEK-supported project AIS-8: Application of Data Analysis with Learning Systems, 1999-2001. Holst, A. (ed.), SICS Technical Report T2002:03, SICS, Kista, Sweden (2001)Google Scholar
- 19.Kleinsmith, A., Bianchi-Berthouze, N., Steed, A.: Automatic Recognition of Non-Acted Affective Postures. IEEE Transactions on Systems, Man and Cybernetics, Part B (2011)Google Scholar
- 21.Muller, F., Bianchi-Berthouze, N.: Evaluating Exertion Games Experiences from Investigating Movement Based. Human-Computer Interaction Series, Part 4, pp. 187–207. Springer, Heidelberg (2010)Google Scholar
- 22.Pasch, M., Bianchi-Berthouze, N., van Dijk, B., Nijholt, A.: Movement-based Sports Video Games: Investigating Motivation and Gaming Experience. Entertainment Computing 9(2), 169–180 (2009)Google Scholar