Full Body Interaction with Virtual Characters in an Interactive Storytelling Scenario
This paper presents a full body interaction approach developed for Traveller, an intercultural training game for young adults based on an interactive storytelling scenario. Traveller involves virtual characters interacting with the users on a large display screen. The users interact with a Kinect, performing full body gestures and controlling a freehand swipe menu to trigger navigation and dialogue actions in the game. A first evaluation proved the recognition capabilities of our system and the comparison with a mouse interface in terms of usability and user experience showed higher positive affect with the Kinect, but a tendency for higher usability and flow with the mouse.
Keywordsfull body interaction intercultural training freehand Kinect
Unable to display preview. Download preview PDF.
- 1.Aylett, R., Vannini, N., Andre, E., Paiva, A., Enz, S., Hall, L.: But that was in another country: Agents and intercultural empathy. In: Proc. AAMAS 2009, pp. 329–336. IFAAMAS (2009)Google Scholar
- 2.Dias, J., Mascarenhas, S., Paiva, A.: Fatima modular: Towards an agent architecture with a generic appraisal framework. In: Proc. Workshop on Standards for Emotion Modeling (2011)Google Scholar
- 3.Dow, S., Mehta, M., Harmon, E., MacIntyre, B., Mateas, M.: Presence and engagement in an interactive drama. In: Proc. CHI 2007, pp. 1475–1484. ACM, New York (2007)Google Scholar
- 4.Hofstede, G.J.: Role playing with synthetic cultures: the evasive rules of the game. Experimental Interactive Learning in Industrial Management: New approaches to Learning, Studying and Teaching p. 49 (2005)Google Scholar
- 5.Janowski, K., Kistler, F., André, E.: Gestures or speech? comparing modality selection for different interaction tasks in a virtual environment. In: Proc. Tilburg Gesture Research Meeting 2013 (2013), http://tiger.uvt.nl
- 6.Kadobayashi, R., Nishimoto, K., Mase, K.: Design and evaluation of gesture interface of an immersive walk-through application for exploring cyberspace. In: Proc. Automatic Face and Gesture Recognition, pp. 534–539 (1998)Google Scholar
- 8.Kistler, F., Endrass, B., Damian, I., Dang, C., André, E.: Natural interaction with culturally adaptive virtual characters. Journal on Multimodal User Interfaces 6, 39–47 (2012); 10.1007/s12193-011-0087-zGoogle Scholar
- 9.Raybourn, E.M., Deagle, M.E., Mendini, K., Heneghan, J.: Adaptive thinking & leadership simulation game training for special forces officers. In: Proc. I/ITSEC 2005. NTSA (2005)Google Scholar