Impact of Varying Vocabularies on Controlling Motion of a Virtual Actor
An ideal verbally controlled virtual actor would allow the same interaction as instructing a real actor with a few words. Our goal is to create virtual actors that can be controlled with natural language instead of a predefined set of commands. In this paper, we present results related to a questionnaire where people described videos of human locomotion using verbs and modifiers. The verbs were used almost unanimously for many motions, while modifiers had more variation. The descriptions from only one person were found to cover less than half of the vocabulary of other participants. Further analysis of the vocabularies against the numerical descriptors calculated from the captured motions shows that verbs appeared in closed areas while modifiers could be scattered to disconnected clusters. Based on these findings, we propose modeling verbs with a hierarchical vocabulary and modifiers as transitions in the space defined by the numerical qualities of motions.
Keywordsmotion capture natural language virtual actors
Unable to display preview. Download preview PDF.
- 1.Ahad, M., Tan, J., Kim, H., Ishikawa, S.: Action dataset - A survey. In: Proc. of SICE Annual Conference 2011 (SICE 2011), pp. 1650–1655 (2011)Google Scholar
- 3.Blumberg, B., Galyean, T.: Multi-level direction of autonomous creatures for real- time virtual environments. In: Mair, S.G., Cook, R. (eds.) Proc. of SIGGRAPH 1995, pp. 47–54. ACM, New York (1995)Google Scholar
- 4.Perlin, K., Goldberg, A.: Improv: a system for scripting interactive actors in virtual worlds. In: Proc. of SIGGRAPH 1996, pp. 205–216. ACM, New York (1996)Google Scholar
- 6.Hachimura, K., Takashina, K., Yoshimura, M.: Analysis and evaluation of dancing movement based on LMA. In: IEEE International Workshop on Robot and Human Interactive Communication 2005 (ROMAN 2005), pp. 294–299. IEEE (2005)Google Scholar
- 8.Honkela, T.: Raitio, j., Lagus, K., Nieminen, I., Honkela, N., Pantzar, M.: Subjects on objects in contexts: Using GICA method to quantify epistemological subjectivity. In: Proc. of International Joint Conference on Neural Networks (IJCNN 2012), pp. 2875–2883 (2012)Google Scholar
- 12.Kovar, L., Gleicher, M.: Automated Extraction and Parameterization of Motions in Large Data Sets. In: Marks, J. (ed.) Proc. of SIGGRAPH 2004, pp. 559–568. ACM, New York (2004)Google Scholar
- 14.Lindén, K., Carlson, L.: FinnWordNet - WordNet på finska via översättning (In English: FinnWordNet - Finnish WordNet by Translation). LexicoNordica - Nordic Journal of Lexicography 17, 119–140 (2010)Google Scholar