Natural User Interface for Physics-Based Character Animation

Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7060)


Using natural user interface to interact with digital worlds is becoming commonplace in our daily life, as evidenced by the high demand for Microsoft Kinect since its launch in 2010. However, comparatively little research effort has focused in the past on harnessing these capabilities to create great applications. In this paper, we introduce unified framework for combining natural user interface and physics-based character animation. Our framework takes the form of a continuous controllable space for the combination of the two techniques. We also propose a human-in-the-loop control paradigm which allows a player or performer to sense and act for the character. With the information encapsulated in the human performance, the proposed framework accomplishes its goal in two steps: first, by recognizing and potentially modifying the performance such that it is appropriate for the given scenario; and second, by balancing interactivity and control in order to maintain both physical responsivity to the virtual world and faithfulness to the human performance.


Virtual Environment Virtual World Motion Capture Joint Torque Input Motion 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Karen Liu, C., Hertzmann, A., Popović, Z.: Composition of complex optimal multi-character motions. In: 2006 ACM SIGGRAPH / Eurographics Symposium on Computer Animation (September 2006)Google Scholar
  2. 2.
    O’Brien, J.F., Zordan, V.B., Hodgins, J.K.: Combining active and passive simulations for secondary motion. IEEE Computer Graphics & Applications 20(4) (2000)Google Scholar
  3. 3.
    Shin, H.J., Lee, J., Gleicher, M., Shin, S.Y.: Computer puppetry: An importance-based approach. ACM Trans. on Graphics 20(2), 67–94 (2001)CrossRefGoogle Scholar
  4. 4.
    Shinar, T., Schroeder, C., Fedkiw, R.: Two-way coupling of rigid and deformable bodies. In: 2008 ACM SIGGRAPH / Eurographics Symposium on Computer Animation (July 2008)Google Scholar
  5. 5.
    Shiratori, T., Hodgins, J.K.: Accelerometer-based user interfaces for the control of a physically simulated character. ACM Trans. on Graphics 27(5), 123:1–123:9 (2008)CrossRefGoogle Scholar
  6. 6.
    Yin, K., Cline, M.B., Pai, D.K.: Motion perturbation based on simple neuromotor control models. In: Pacific Graphics, p. 445 (2003)Google Scholar
  7. 7.
    Zordan, V.B., Hodgins, J.K.: Motion capture-driven simulations that hit and react. In: Eurographics/SIGGRAPH Symposium on Computer Animation, pp. 89–96 (2002)Google Scholar
  8. 8.
    Zordan, V.B., Majkowska, A., Chiu, B., Fast, M.: Dynamic response for motion capture animation. ACM Trans. on Graphics (SIGGRAPH) 24(3), 697–701 (2005)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2011

Authors and Affiliations

  1. 1.Georgia Institute of TechnologyUSA
  2. 2.University of CaliforniaRiversideUSA

Personalised recommendations