Abstract
Dancing is an entertaining form of taskless interaction. When interacting with a dancing Embodied Conversational Agent (ECA), the lack of a clear task presents the challenge of eliciting an interaction between user and ECA in a different way. In this paper we describe our Virtual Dancer, which is an ECA that invites a user to dance. In our system the user is monitored using global movement characteristics from a camera and a dance pad. The characteristics are used to select and adapt movements for the Virtual Dancer. This way, the user can dance together with the Virtual Dancer. Any interaction patterns and implicit relations between the dance behaviour of the human and the Virtual Dancer should be evoked intuitively without explicit appeal. The work described in this paper can be used as a platform for research into natural animation and user invitation behavior. We discuss future work on both topics.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Perlin, K.: Real time responsive animation with personality. IEEE Transactions on Visualization and Computer Graphics 1(1), 5–15 (1995)
Mataric, M., Zordan, V., Williamson, M.: Making complex articulated agents dance. Autonomous Agents and Multi-Agent Systems 2(1), 23–43 (1999)
Shiratori, T., Nakazawa, A., Ikeuchi, K.: Rhythmic motion analysis using motion capture and musical information. In: Proceedings of the IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems, pp. 89–94 (2003)
Nakazawa, A., Nakaoka, S., Kudoh, S., Ikeuchi, K.: Digital archive of human dance motions. In: Proceedings of the International Conference on Virtual Systems and Multimedia (2002)
Kim, T., Park, S.I., Shin, S.Y.: Rhythmic-motion synthesis based on motion-beat analysis. ACM Transactions on Graphics 22(3), 392–401 (2003)
Chen, J., Li, T.: Rhythmic character animation: Interactive chinese lion dance. In: Proceedings of the International Conference on Computer Animation and Social Agents (2005)
Ren, L., Shakhnarovich, G., Hodgins, J.K., Pfister, H., Viola, P.: Learning silhouette features for control of human motion. ACM Transcactions on Graphics 24(4), 1303–1331 (2005)
Kosuge, K., Hayashi, T., Hirata, Y., Tobiyama, R.: Dance partner robot –ms dancer–. In: Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 3459–3464 (2003)
Gouyon, F., Klapuri, A., Dixon, S., Alonso, M., Tzanetakis, G., Uhle, C., Cano, P.: An experimental comparison of audio tempo induction algorithms. IEEE Transactions on Speech and Audio Processing (in press, 2006)
Klapuri, A., Eronen, A., Astola, J.: Analysis of the meter of acoustic musical signals. IEEE transactions on Speech and Audio Processing 14(1), 342–355 (2006)
Scheirer, E.D.: Tempo and beat analysis of acoustic musical signals. Journal of the Acoustical Society of America 103(1), 558–601 (1998)
Kuper, J., Saggion, H., Cunningham, H., Declerck, T., de Jong, F., Reidsma, D., Wilks, Y., Wittenburg, P.: Intelligent multimedia indexing and retrieval through multi-source information extraction and merging. In: International Joint Conference of Artificial Intelligence, Acapulco, Mexico, February 2003, pp. 409–414 (2003)
Meredith, M., Maddock, S.: Using a half-jacobian for real-time inverse kinematics. In: Proceedings of the International Conference on Computer Games: Artificial Intelligence, Design and Education, pp. 81–88 (2004)
Meredith, M., Maddock, S.: Adapting motion capture using weighted real-time inverse kinematics. ACM Computers in Entertainment 3(1) (2005) (This is a Web-based journal)
Kovar, L., Gleicher, M., Pighin, F.H.: Motion graphs. ACM Trans. Graph. 21(3), 473–482 (2002)
Pullen, K., Bregler, C.: Motion capture assisted animation: texturing and synthesis. In: Proceedings of the annual conference on Computer graphics and interactive techniques, pp. 501–508 (2002)
Safonova, A., Hodgins, J.K., Pollard, N.S.: Synthesizing physically realistic human motion in low-dimensional, behavior-specific spaces. ACM Trans. Graph. 23(3), 514–521 (2004)
Liu, K.C., Hertzmann, A., Popovic, Z.: Learning physics-based motion style with nonlinear inverse optimization. ACM Trans. Graph. 24(3), 1071–1081 (2005)
Boker, S., Rotondo, J.: In: Symmetry building and symmetry breaking in synchronized movement, pp. 163–171 (2003)
Peters, C.: Direction of attention perception for conversation initiation in virtual environments. In: Proceedings of the Intelligent Virtual Agents, International Working Conference, pp. 215–228. Springer, Heidelberg (2005)
Shell, J., Selker, T., Vertegaal, R.: Interacting with groups of computers. Special Issue on Attentive User Interfaces. Communications of ACM 46(3), 40–46 (2003)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 IFIP International Federation for Information Processing
About this paper
Cite this paper
Reidsma, D., van Welbergen, H., Poppe, R., Bos, P., Nijholt, A. (2006). Towards Bi-directional Dancing Interaction. In: Harper, R., Rauterberg, M., Combetto, M. (eds) Entertainment Computing - ICEC 2006. ICEC 2006. Lecture Notes in Computer Science, vol 4161. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11872320_1
Download citation
DOI: https://doi.org/10.1007/11872320_1
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-45259-1
Online ISBN: 978-3-540-45261-4
eBook Packages: Computer ScienceComputer Science (R0)