An Animation System for Imitation of Object Grasping in Virtual Reality

  • Matthias Weber
  • Guido Heumer
  • Heni Ben Amor
  • Bernhard Jung
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4282)


Interactive virtual characters are nowadays commonplace in games, animations, and Virtual Reality (VR) applications. However, relatively few work has so far considered the animation of interactive object manipulations performed by virtual humans. In this paper, we first present a hierarchical control architecture incorporating plans, behaviors, and motor programs that enables virtual humans to accurately manipulate scene objects using different grasp types. Furthermore, as second main contribution, we introduce a method by which virtual humans learn to imitate object manipulations performed by human VR users. To this end, movements of the VR user are analyzed and processed into abstract actions. A new data structure called grasp events is used for storing information about user interactions with scene objects. High-level plans are instantiated based on grasp events to drive the virtual humans’ animation. Due to their high-level representation, recorded manipulations often naturally adapt to new situations without losing plausibility.


Virtual Reality Motor Program Virtual Character Smart Object Virtual Human 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Jung, B., Ben Amor, H., Heumer, G., Weber, M.: From Motion Capture to Action Capture: A Review of Imitation Learning Techniques and their Application to VRbased Character Animation. In: Proceedings ACM VRST 2006, Cyprus (2006)Google Scholar
  2. 2.
    Kallmann, M., Thalmann, D.: Direct 3D Interaction with Smart Objects. In: Proceedings ACM VRST 1999, London (1999)Google Scholar
  3. 3.
    Sanso, R.M., Thalmann, D.: A Hand Control and Automatic Grasping System for Synthetic Actors. Computer Graphics Forum 13(3), 167–177 (1994)CrossRefGoogle Scholar
  4. 4.
    Kuffner, J., Latombe, J.: Interactive Manipulation Planning for Animated Characters. In: Proceedings of Pacific Graphics (2000) Google Scholar
  5. 5.
    Yamane, K., Kuffner, J.J., Hodgins, J.K.: Synthesizing Animations of Human Manipulation Tasks. ACM Trans. Graph. 23(3), 532–539 (2004)CrossRefGoogle Scholar
  6. 6.
    Douville, B., Levison, L., Badler, N.: Task-level Object Grasping for Simulated Agents. Presence 5(4), 416–430 (1996)CrossRefGoogle Scholar
  7. 7.
    Pollard, N., Zordan, V.B.: Physically Based Grasping Control from Example. In: Proceedings of the ACM SIGGRAPH/Eurographics Symposium on Computer Animation (2005)Google Scholar
  8. 8.
    Tramberend, H.: Avocado: A Distributed Virtual Reality Framework. In: Proceedings of IEEE Virtual Reality, vol. 14 (1999)Google Scholar
  9. 9.
    Hudson, T., Lin, M., Cohen, J., Gottschalk, S., Manocha, D.: V-COLLIDE: Accelerated Collision Detection for VRML. In: Proceedings of VRML 1997 (1997)Google Scholar
  10. 10.
    Cutkosky, M.: On Grasp Choice, Grasp Models and the Design of Hands for Manufacturing Tasks. IEEE Trans. on Robotics and Automation 5(3) (1989)Google Scholar
  11. 11.
    Schlesinger, G.: Der Mechanische Aufbau der Künstlichen Glieder. In: Borchardt, M., et al. (eds.) Ersatzglieder und Arbeitshilfen für Kriegsbeschädigte und Unfallverletzte, pp. 321–661. Springer, Berlin (1919)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Matthias Weber
    • 1
  • Guido Heumer
    • 1
  • Heni Ben Amor
    • 1
  • Bernhard Jung
    • 1
  1. 1.VR and Multimedia GroupTU Bergakademie FreibergFreibergGermany

Personalised recommendations