User Interfaces for Character Animation and Character Interaction

  • Takaaki Shiratori
Conference paper
Part of the Mathematics for Industry book series (MFI, volume 1)


The heart of visual storytelling is the performances of characters. Through their performances, they express the story, demonstrate their emotions, personality and motivation, and ultimately entertain people. However, design of appealing performances for characters and interaction with the animated characters are key for artists to enhance the experience of the storytelling. In this paper, we present user interfaces that allow efficient creation of animated content and the enhancement of the interactive experience. Specifically, we will describe recent progress on three main issues of character animation and interaction: motion capture, animation design, and interactive control.


Motion capture Structure from motion Animation design" and 3D modeling Performance interface Iterative design 


  1. 1.
    Thomas, F., Johnson, O.: The Illusion of Life: Disney Animation. Disney Editions, NY, USA (1995)Google Scholar
  2. 2.
    Block, B.: The Visual Story—Creating the Visual Structure of Film, TV and Digital Media. Focal Press, Elsevier Inc, MA, USA (2008)Google Scholar
  3. 3.
    Shiratori, T., Park, H.S., Sigal, L., Sheikh, Y., Hodgins, J.K.: Motion capture from body-mounted cameras. ACM Trans. Graph. 31, 1–10 (2011)
  4. 4.
    Park, H.S., Shiratori, T., Matthews, I., Sheikh, Y.: 3D reconstruction of a moving point from a series of 2D projections. In: Proceedings of European Conference on Computer Vision (2010)Google Scholar
  5. 5.
    Shiratori, T., Mahler, M., Trezevant, W., Hodgins, J.K.: Expressing animated performances through puppeteering. In: Proceedings of IEEE Symposium on 3D User Interfaces. IEEE (2013).
  6. 6.
    Numaguchi, N., Nakazawa, A., Shiratori, T., Hodgins, J.K.: A puppet interface for retrieval of motion capture data. In: Proceedings of ACM SIGGRAPH/Eurographics Symposium on Computer Animation (2011)Google Scholar
  7. 7.
    Shiratori, T., Hodgins, J.K.: Accelerometer-based user interfaces for the control of a physically simulated character. ACM Trans. Graph. 123, 1–9 (2008)Google Scholar
  8. 8.
    Willis, K.D.D., Poupyrev, I., Shiratori, T.: MotionBeam: A metaphor for character interaction with handheld projectors. In: Proceedings of ACM SIGCHI Conference on Human Factors in Computing Systems (2011)Google Scholar
  9. 9.
    Willis, K.D.D., Shiratori, T., Mahler, M.: HideOut: Mobile projector interaction with tangible objects and surfaces. In: Proceedings of International Conference on Tangible, Embedded and Embodied Interaction (2013)Google Scholar
  10. 10.
    Zhang, Y., Han, T., Ren, Z., Umetani, N., Tong, X., Liu, Y., Shiratori, T., Cao, X.: BodyAvatar: Creating freeform 3D Avatars using first-person body gestures. In: Proceedings of ACM Symposium on User Interface Software and Technology. ACM Inc (2013).
  11. 11.
    Welch, G., Foxlin, E.: Motion tracking: no silver bullet, but a respectable Arsenal. IEEE Comput. Graph. Appl. 22(6), 24–38 (2002)Google Scholar
  12. 12.
    Vlasic, D., Adelsberger, R., Vannucci, G., Barnwell, J., Gross, M., Matusik, W., Popović, J.: Practical motion capture in everyday surroundings. ACM Trans. Graph. 35, 1–9 (2007)Google Scholar
  13. 13.
    Hartley, R.I.: A Multiple View Geometry in Computer Vision. Cambridge University Press, Zisserman (2004)Google Scholar
  14. 14.
    Snavely, N., Seitz, S.M., Szeliski, R.: Photo tourism: exploring photo collections in 3D. ACM Trans. Graph. 25(3), 835–846 (2006)Google Scholar
  15. 15.
    O’Brien, J.F., Bodenheimer, R.E., Brostow, G.J., Hodgins, J.K.: Automatic joint parameter estimation from magnetic motion capture data. In: Proceedings of Graphics Interface (2000)Google Scholar
  16. 16.
    Barnes, C., Jacobs, D.E., Sanders, J., Goldman, D.B., Rusinkiewicz, S., Finkelstein, A., Agrawala, M.: Video puppetry: a performative interface for cutout animation. ACM Trans. Graph. 124, 1–9 (2008)Google Scholar
  17. 17.
    Shin, H.J., Lee, J., Shin, S.Y., Gleicher, M.: Computer puppetry: an importance-based approach. ACM Trans.Graph. 20(2), 67–94 (2001)Google Scholar
  18. 18.
    Nielsen, J.: Iterative user-interface design. Computer 26(11), 32–41 (1993)Google Scholar
  19. 19.
    Oore, S., Terzopoulos, D., Hinton, G.: A desktop input device and interface for interactive 3D character animation. In: Proceedings of Graphics Interface (2002)Google Scholar
  20. 20.
    Dontcheva, M., Yngve, G., Popović, Z.: Layered acting for character animation. ACM Trans. Graph. 22(3), 409–416 (2003)Google Scholar
  21. 21.
    Schkolne, S., Pruett, M., Schroeder, P.: Surface drawing: Creating organic 3D shapes with the hand and tangible tools. In: Proceedings of ACM SIGCHI Conference on Human Factors in Computing Systems, pp. 261–268 (2001)Google Scholar
  22. 22.
    Sheng, J., Balakrishnan, R., Singh, K.: An interface for 3D sculpting via physical proxy. In: Proceedings of GRAPHITE (2006)Google Scholar
  23. 23.
    Kelley, J.F.: An iterative design methodology for user-friendly natural language office information applications. ACM Trans. Inf. Syst. 2(1) (1984)Google Scholar
  24. 24.
    Nishimura, H., Hirai, M., Kawai, T., Kawata, T., Shirakawa, I., Omura, K.: Object modeling by distribution function and a method of image generation. Trans. Inst. Electron. Commun. Eng. Jpn 68(4), 718–725 (1985)Google Scholar
  25. 25.
    Bloomenthal, J.: Polygonization of implicit surfaces. Comput. Aided Geom. Des. 5(4), 341–355 (1988)Google Scholar

Copyright information

© Springer Japan 2014

Authors and Affiliations

  1. 1.Visual Computing GroupMicrosoft ResearchBeijingPeople’s Republic of China

Personalised recommendations