Skip to main content
Log in

Self adaptive animation based on user perspective

  • Original Article
  • Published:
The Visual Computer Aims and scope Submit manuscript

Abstract

In this paper we present a new character animation technique in which the animation adapts itself based on the change in the user’s perspective, so that when the user moves and their point of viewing the animation changes, then the character animation adapts itself in response to that change. The resulting animation, generated in real-time, is a blend of key animations provided a priori by the animator. The blending is done with the help of efficient dual-quaternion transformation blending. The user’s point of view is tracked using either computer vision techniques or a simple user-controlled input modality, such as mouse-based input. This tracked point of view is then used to suitably select the blend of animations. We show a way to author and use such animations in both virtual as well as augmented reality scenarios and demonstrate that it significantly heightens the sense of presence for the users when they interact with such self adaptive animations of virtual characters.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Alexa, M.: Linear combination of transformations. ACM Trans. Graph. 21(3), 380–387 (2002)

    Article  MathSciNet  Google Scholar 

  2. Arikan, O., Forsyth, D.A., O’Brien, J.F.: Motion synthesis from annotations. ACM Trans. Graph. 22(3), 402–408 (2003)

    Article  Google Scholar 

  3. Balcisoy, S., Kallmann, M., Torre, R., Fua, P., Thalmann, D.: Interaction techniques with virtual humans in mixed environments. In: Proceedings of the 2nd International Symposium on Mixed Reality (Yokohama, Japan) (2001)

  4. Barakonyi, I., Schmalstieg, D.: Augmented reality in the character animation pipeline. In: ACM SIGGRAPH 2006 Sketches. ACM Press, Boston, MA (2006)

    Google Scholar 

  5. Barakonyi, I., Schmalstieg, D.: Ubiquitous animated agents for augmented reality. In: ISMAR 2006 – IEEE/ACM International Symposium on Mixed and Augmented Reality, pp. 145–154. IEEE Computer Society, Santa Barbara, CA (2006)

    Chapter  Google Scholar 

  6. Bregler, C., Malik, J.: Tracking people with twists and exponential maps. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 8–15. IEEE Computer Society, Santa Barbara, CA (1998)

    Google Scholar 

  7. Buck, I., Finkelstein, A., Jacobs, C., Klein, A., Salesin, D.H., Seims, J., Szeliski, R., Toyama, K.: Performance-driven hand-drawn animation. In: NPAR 2000: First International Symposium on Non Photorealistic Animation and Rendering, pp. 101–108. ACM Press, Annecy, France (2000)

    Chapter  Google Scholar 

  8. Buss, S.R., Fullmore, J.P.: Spherical averages and applications to spherical splines and interpolation. ACM Trans. Graph. 20(2), 95–126 (2001)

    Article  Google Scholar 

  9. Cavazza, M., Charles, F., Mead, S.J.: Character-based interactive storytelling. IEEE Intell. Syst. 17(4), 17–24 (2002)

    Article  Google Scholar 

  10. Chaudhuri, P., Kalra, P., Banerjee, S.: View-Dependent Character Animation. Springer, London (2007)

    Google Scholar 

  11. Clifford, W.: Mathematical Papers. Macmillan, London (1882)

    Google Scholar 

  12. Encarnação, J., Gross, M., Reiner, M., Slater, M., Stork, A., Stricker, D., de Velde, W.V.: Presence and interaction in mixed reality environments. FET Proactive initiative (2004). Ftp://ftp.cordis.lu/pub/ist/docs/fet/pr2-37.pdf

  13. Fitzgibbon, A., Zisserman, A.: Automatic camera tracking. In: Shah, M., Kumar, R. (eds.) Video Registration, pp. 18–35. Kluwer Academic (2003)

  14. Igarashi, T., Moscovich, T., Hughes, J.F.: Spatial keyframing for performance-driven animation. In: Proceedings of the 2005 ACM SIGGRAPH/Eurographics Symposium on Computer Animation, pp. 107–115. ACM Press, Los Angeles, CA (2005)

    Chapter  Google Scholar 

  15. Kato, H.: Human Interface Technology Laboratory: ARToolkit (2007). http://artoolkit.sourceforge.net

  16. Kavan, L., Collins, S., Zara, J., O’Sullivan, C.: Skinning with dual quaternions. In: 2007 ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games, pp. 39–46. ACM Press, Seattle, WA (2007)

    Chapter  Google Scholar 

  17. Kovar, L., Gleicher, M., Pighin, F.: Motion graphs. ACM Trans. Graph. (Proceedings of SIGGRAPH ’02) 21(3), 473–482 (2002)

    Google Scholar 

  18. Lewis, J.P., Cordner, M., Fong, N.: Pose space deformation: A unified approach to shape interpolation and skeleton-driven deformation. In: SIGGRAPH ’00: Proceedings of the 27th Annual Conference on Computer Graphics and Interactive Techniques, pp. 165–172. ACM Press/Addison-Wesley Publishing Co., New York, NY (2000)

    Chapter  Google Scholar 

  19. Li, Y., Wang, T., Shum, H.Y.: Motion texture: A two-level statistical model for character motion synthesis. In: SIGGRAPH ’02: Proceedings of the 29th Annual Conference on Computer Graphics and Interactive Techniques, pp. 465–472. ACM Press, San Antonio, TX (2002)

    Chapter  Google Scholar 

  20. Loyall, A.B., Reilly, W.S.N., Bates, J., Weyhrauch, P.: System for authoring highly interactive, personality-rich interactive characters. In: SCA ’04: Proceedings of the 2004 ACM SIGGRAPH/Eurographics Symposium on Computer Animation, pp. 59–68. Eurographics Association, Grenoble, France (2004)

    Chapter  Google Scholar 

  21. Masuko, S., Hoshino, J.: Head-eye animation corresponding to a conversation for cg characters. Comput. Graph. Forum (Proceedings of Eurographics 2007) 26(3), 303–312 (2007)

    Article  Google Scholar 

  22. McCarthy, J.M.: Introduction to Theoretical Kinematics. MIT Press, Cambridge, MA (1990)

    Google Scholar 

  23. Ngo, T., Cutrell, D., Dana, J., Donald, B., Loeb, L., Zhu, S.: Accessible animation and customizable graphics via simplicial configuration modeling. In: SIGGRAPH ’00: Proceedings of the 27th Annual Conference on Computer Graphics and Interactive Techniques, pp. 403–410. ACM Press/Addison-Wesley Publishing Co., New Orleans, LA (2000)

    Chapter  Google Scholar 

  24. OSG: OpenSceneGraph 2.0 (2007). http://www.openscenegraph.org

  25. Papagiannakis, G., Schertenleib, S., O’Kennedy, B., Arevalo-Poizat, M., Magnenat-Thalmann, N., Stoddart, A., Thalmann, D.: Mixing virtual and real scenes in the site of ancient pompeii. Comput. Animation Virtual Worlds 16(1), 11–24 (2005)

    Article  Google Scholar 

  26. Piekarski, W., Thomas, B.: ARQuake: The outdoor augmented reality gaming system. Commun. ACM 45(1), 36–38 (2002)

    Article  Google Scholar 

  27. Rademacher, P.: View-dependent geometry. In: SIGGRAPH ’99: Proceedings of the 26th Annual Conference on Computer Graphics and Interactive Techniques, pp. 439–446. ACM Press/Addison-Wesley Publishing Co., Los Angeles, CA (1999)

    Chapter  Google Scholar 

  28. Ren, L., Shakhnarovich, G., Hodgins, J.K., Pfister, H., Viola, P.: Learning silhouette features for control of human motion. ACM Trans. Graph. 24(4), 1303–1331 (2005)

    Article  Google Scholar 

  29. Shao, W., Terzopoulos, D.: Autonomous pedestrians. In: SCA ’05: Proceedings of the 2005 ACM SIGGRAPH/Eurographics symposium on Computer animation, pp. 19–28. ACM, Los Angeles, CA (2005)

    Chapter  Google Scholar 

  30. Shin, H.J., Lee, J., Shin, S.Y., Gleicher, M.: Computer puppetry: An importance-based approach. ACM Trans. Graph. 20(2), 67–94 (2001)

    Article  Google Scholar 

  31. Shoemake, K.: Animating rotation with quaternion curves. In: SIGGRAPH ’85: Proceedings of the 12th Annual Conference on Computer Graphics and Interactive Techniques, pp. 245–254. ACM Press, San Francisco, CA (1985)

    Chapter  Google Scholar 

  32. Simon, G., Fitzgibbon, A., Zisserman, A.: Markerless tracking using planar structures in the scene. In: Proceedings of International Symposium on Augmented Reality, pp. 120–128. IEEE Computer Society, Munich (2000)

    Google Scholar 

  33. Vinayagamoorthy, V., Gillies, M., Steed, A., Tanguy, E., Pan, X., Loscos, C., Slater, M.: Building expression into virtual characters. In: Eurographics – State of the Art Reports, pp. 21–61. Eurographics Association, Vienna, Austria (2006)

    Google Scholar 

  34. Wagner, D., Billinghurst, M., Schmalstieg, D.: How real should virtual characters be? In: Conference on Advances in Computer Entertainment Technology. ACM International Conference Proceeding Series, vol. 266, no. 57. ACM Press, Hollywood, CA (2006)

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Parag Chaudhuri.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Chaudhuri, P., Papagiannakis, G. & Magnenat-Thalmann, N. Self adaptive animation based on user perspective. Visual Comput 24, 525–533 (2008). https://doi.org/10.1007/s00371-008-0233-0

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00371-008-0233-0

Keywords

Navigation