Abstract
In this paper we present a new character animation technique in which the animation adapts itself based on the change in the user’s perspective, so that when the user moves and their point of viewing the animation changes, then the character animation adapts itself in response to that change. The resulting animation, generated in real-time, is a blend of key animations provided a priori by the animator. The blending is done with the help of efficient dual-quaternion transformation blending. The user’s point of view is tracked using either computer vision techniques or a simple user-controlled input modality, such as mouse-based input. This tracked point of view is then used to suitably select the blend of animations. We show a way to author and use such animations in both virtual as well as augmented reality scenarios and demonstrate that it significantly heightens the sense of presence for the users when they interact with such self adaptive animations of virtual characters.
Similar content being viewed by others
References
Alexa, M.: Linear combination of transformations. ACM Trans. Graph. 21(3), 380–387 (2002)
Arikan, O., Forsyth, D.A., O’Brien, J.F.: Motion synthesis from annotations. ACM Trans. Graph. 22(3), 402–408 (2003)
Balcisoy, S., Kallmann, M., Torre, R., Fua, P., Thalmann, D.: Interaction techniques with virtual humans in mixed environments. In: Proceedings of the 2nd International Symposium on Mixed Reality (Yokohama, Japan) (2001)
Barakonyi, I., Schmalstieg, D.: Augmented reality in the character animation pipeline. In: ACM SIGGRAPH 2006 Sketches. ACM Press, Boston, MA (2006)
Barakonyi, I., Schmalstieg, D.: Ubiquitous animated agents for augmented reality. In: ISMAR 2006 – IEEE/ACM International Symposium on Mixed and Augmented Reality, pp. 145–154. IEEE Computer Society, Santa Barbara, CA (2006)
Bregler, C., Malik, J.: Tracking people with twists and exponential maps. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 8–15. IEEE Computer Society, Santa Barbara, CA (1998)
Buck, I., Finkelstein, A., Jacobs, C., Klein, A., Salesin, D.H., Seims, J., Szeliski, R., Toyama, K.: Performance-driven hand-drawn animation. In: NPAR 2000: First International Symposium on Non Photorealistic Animation and Rendering, pp. 101–108. ACM Press, Annecy, France (2000)
Buss, S.R., Fullmore, J.P.: Spherical averages and applications to spherical splines and interpolation. ACM Trans. Graph. 20(2), 95–126 (2001)
Cavazza, M., Charles, F., Mead, S.J.: Character-based interactive storytelling. IEEE Intell. Syst. 17(4), 17–24 (2002)
Chaudhuri, P., Kalra, P., Banerjee, S.: View-Dependent Character Animation. Springer, London (2007)
Clifford, W.: Mathematical Papers. Macmillan, London (1882)
Encarnação, J., Gross, M., Reiner, M., Slater, M., Stork, A., Stricker, D., de Velde, W.V.: Presence and interaction in mixed reality environments. FET Proactive initiative (2004). Ftp://ftp.cordis.lu/pub/ist/docs/fet/pr2-37.pdf
Fitzgibbon, A., Zisserman, A.: Automatic camera tracking. In: Shah, M., Kumar, R. (eds.) Video Registration, pp. 18–35. Kluwer Academic (2003)
Igarashi, T., Moscovich, T., Hughes, J.F.: Spatial keyframing for performance-driven animation. In: Proceedings of the 2005 ACM SIGGRAPH/Eurographics Symposium on Computer Animation, pp. 107–115. ACM Press, Los Angeles, CA (2005)
Kato, H.: Human Interface Technology Laboratory: ARToolkit (2007). http://artoolkit.sourceforge.net
Kavan, L., Collins, S., Zara, J., O’Sullivan, C.: Skinning with dual quaternions. In: 2007 ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games, pp. 39–46. ACM Press, Seattle, WA (2007)
Kovar, L., Gleicher, M., Pighin, F.: Motion graphs. ACM Trans. Graph. (Proceedings of SIGGRAPH ’02) 21(3), 473–482 (2002)
Lewis, J.P., Cordner, M., Fong, N.: Pose space deformation: A unified approach to shape interpolation and skeleton-driven deformation. In: SIGGRAPH ’00: Proceedings of the 27th Annual Conference on Computer Graphics and Interactive Techniques, pp. 165–172. ACM Press/Addison-Wesley Publishing Co., New York, NY (2000)
Li, Y., Wang, T., Shum, H.Y.: Motion texture: A two-level statistical model for character motion synthesis. In: SIGGRAPH ’02: Proceedings of the 29th Annual Conference on Computer Graphics and Interactive Techniques, pp. 465–472. ACM Press, San Antonio, TX (2002)
Loyall, A.B., Reilly, W.S.N., Bates, J., Weyhrauch, P.: System for authoring highly interactive, personality-rich interactive characters. In: SCA ’04: Proceedings of the 2004 ACM SIGGRAPH/Eurographics Symposium on Computer Animation, pp. 59–68. Eurographics Association, Grenoble, France (2004)
Masuko, S., Hoshino, J.: Head-eye animation corresponding to a conversation for cg characters. Comput. Graph. Forum (Proceedings of Eurographics 2007) 26(3), 303–312 (2007)
McCarthy, J.M.: Introduction to Theoretical Kinematics. MIT Press, Cambridge, MA (1990)
Ngo, T., Cutrell, D., Dana, J., Donald, B., Loeb, L., Zhu, S.: Accessible animation and customizable graphics via simplicial configuration modeling. In: SIGGRAPH ’00: Proceedings of the 27th Annual Conference on Computer Graphics and Interactive Techniques, pp. 403–410. ACM Press/Addison-Wesley Publishing Co., New Orleans, LA (2000)
OSG: OpenSceneGraph 2.0 (2007). http://www.openscenegraph.org
Papagiannakis, G., Schertenleib, S., O’Kennedy, B., Arevalo-Poizat, M., Magnenat-Thalmann, N., Stoddart, A., Thalmann, D.: Mixing virtual and real scenes in the site of ancient pompeii. Comput. Animation Virtual Worlds 16(1), 11–24 (2005)
Piekarski, W., Thomas, B.: ARQuake: The outdoor augmented reality gaming system. Commun. ACM 45(1), 36–38 (2002)
Rademacher, P.: View-dependent geometry. In: SIGGRAPH ’99: Proceedings of the 26th Annual Conference on Computer Graphics and Interactive Techniques, pp. 439–446. ACM Press/Addison-Wesley Publishing Co., Los Angeles, CA (1999)
Ren, L., Shakhnarovich, G., Hodgins, J.K., Pfister, H., Viola, P.: Learning silhouette features for control of human motion. ACM Trans. Graph. 24(4), 1303–1331 (2005)
Shao, W., Terzopoulos, D.: Autonomous pedestrians. In: SCA ’05: Proceedings of the 2005 ACM SIGGRAPH/Eurographics symposium on Computer animation, pp. 19–28. ACM, Los Angeles, CA (2005)
Shin, H.J., Lee, J., Shin, S.Y., Gleicher, M.: Computer puppetry: An importance-based approach. ACM Trans. Graph. 20(2), 67–94 (2001)
Shoemake, K.: Animating rotation with quaternion curves. In: SIGGRAPH ’85: Proceedings of the 12th Annual Conference on Computer Graphics and Interactive Techniques, pp. 245–254. ACM Press, San Francisco, CA (1985)
Simon, G., Fitzgibbon, A., Zisserman, A.: Markerless tracking using planar structures in the scene. In: Proceedings of International Symposium on Augmented Reality, pp. 120–128. IEEE Computer Society, Munich (2000)
Vinayagamoorthy, V., Gillies, M., Steed, A., Tanguy, E., Pan, X., Loscos, C., Slater, M.: Building expression into virtual characters. In: Eurographics – State of the Art Reports, pp. 21–61. Eurographics Association, Vienna, Austria (2006)
Wagner, D., Billinghurst, M., Schmalstieg, D.: How real should virtual characters be? In: Conference on Advances in Computer Entertainment Technology. ACM International Conference Proceeding Series, vol. 266, no. 57. ACM Press, Hollywood, CA (2006)
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Chaudhuri, P., Papagiannakis, G. & Magnenat-Thalmann, N. Self adaptive animation based on user perspective. Visual Comput 24, 525–533 (2008). https://doi.org/10.1007/s00371-008-0233-0
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00371-008-0233-0