The Visual Computer

, Volume 30, Issue 2, pp 213–227 | Cite as

Sketching human character animations by composing sequences from large motion database

  • Innfarn Yoo
  • Juraj Vanek
  • Maria Nizovtseva
  • Nicoletta Adamo-Villani
  • Bedrich Benes
Original Article

Abstract

Quick creation of 3D character animations is an important task in game design, simulations, forensic animation, education, training, and more. We present a framework for creating 3D animated characters using a simple sketching interface coupled with a large, unannotated motion database that is used to find the appropriate motion sequences corresponding to the input sketches. Contrary to the previous work that deals with static sketches, our input sketches can be enhanced by motion and rotation curves that improve matching in the context of the existing animation sequences. Our framework uses animated sequences as the basic building blocks of the final animated scenes, and allows for various operations with them such as trimming, resampling, or connecting by use of blending and interpolation. A database of significant and unique poses, together with a two-pass search running on the GPU, allows for interactive matching even for large amounts of poses in a template database. The system provides intuitive interfaces, an immediate feedback, and poses very small requirements on the user. A user study showed that the system can be used by novice users with no animation experience or artistic talent, as well as by users with an animation background. Both groups were able to create animated scenes consisting of complex and varied actions in less than 20 minutes.

Keywords

Sketching Character animation Interactive systems 

Supplementary material

(MOV 33.1 MB)

References

  1. 1.
    Arikan, O., Forsyth, D.A.: Interactive motion generation from examples. ACM Trans. Graph. 21(3), 483–490 (2002) CrossRefMATHGoogle Scholar
  2. 2.
    Chao, M.-W., Lin, C.-H., Assa, J., Lee, T.-Y.: Human motion retrieval from hand-drawn sketch. IEEE Trans. Vis. Comput. Graph. 18(5), 729–740 (2012) CrossRefGoogle Scholar
  3. 3.
    Chaudhuri, P., Kalra, P., Banerjee, S.: A system for view-dependent animation. Comput. Graph. Forum 23(3), 411–420 (2004) CrossRefGoogle Scholar
  4. 4.
    Choi, M.G., Yang, K., Igarashi, T., Mitani, J., Lee, J.: Retrieval and visualization of human motion data via stick figures. Comput. Graph. Forum 21(7), 2057–2065 (2012). Pacific Graphics, 2012 CrossRefGoogle Scholar
  5. 5.
    Davis, J., Agrawala, M., Chuang, E., Popović, Z., Salesin, D.: A sketching interface for articulated figure animation. In: Proceedings of the 2003 ACM SIGGRAPH/Eurographics Symposium on Computer Animation, SCA ’03, pp. 320–328. Eurographics Association, Aire-la-Ville (2003) Google Scholar
  6. 6.
    Forbes, K., Fiume, E.: An efficient search algorithm for motion data using weighted pca. In: Proceedings of the 2005 ACM SIGGRAPH/Eurographics Symposium on Computer Animation, SCA ’05, pp. 67–76. ACM, New York (2005) CrossRefGoogle Scholar
  7. 7.
    Gingold, Y., Igarashi, T., Zorin, D.: Structured annotations for 2d-to-3d modeling. ACM Trans. Graph. 28(5), 148 (2009) CrossRefGoogle Scholar
  8. 8.
    Hecker, C., Raabe, B., Enslow, R.W., DeWeese, J., Maynard, J., van Prooijen, K.: Real-time motion retargeting to highly varied user-created morphologies. In: ACM SIGGRAPH 2008 Papers, SIGGRAPH ’08, pp. 27:1–27:11. ACM, New York (2008) Google Scholar
  9. 9.
    Ho, E.S.L., Komura, T., Tai, C.-L.: Spatial relationship preserving character motion adaptation. ACM Trans. Graph. 29(4), 33 (2010) CrossRefGoogle Scholar
  10. 10.
    Igarashi, T., Matsuoka, S., Tanaka, H.: Teddy: a sketching interface for 3d freeform design. In: Proceedings of the 26th Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH ’99, pp. 409–416. ACM/Addison-Wesley, New York (1999) CrossRefGoogle Scholar
  11. 11.
    Igarashi, T., Moscovich, T., Hughes, J.F.: Spatial keyframing for performance-driven animation. In: Proceedings of the 2005 ACM SIGGRAPH/Eurographics Symposium on Computer Animation, SCA ’05, pp. 107–115. ACM, New York (2005) CrossRefGoogle Scholar
  12. 12.
    Ishigaki, S., White, T., Zordan, V.B., Karen Liu, C.: Performance-based control interface for character animation. In: ACM SIGGRAPH 2009 Papers, SIGGRAPH ’09, pp. 61:1–61:8. ACM, New York (2009) Google Scholar
  13. 13.
    Jain, E., Sheikh, Y., Hodgins, J.: Leveraging the talent of hand animators to create three-dimensional animation. In: Proceedings of the 2009 ACM SIGGRAPH/Eurographics Symposium on Computer Animation, SCA ’09, pp. 93–102. ACM, New York (2009) CrossRefGoogle Scholar
  14. 14.
    Kovar, L., Gleicher, M., Pighin, F.: Motion graphs. In: Proceedings of the 29th Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH ’02, pp. 473–482. ACM, New York (2002) CrossRefGoogle Scholar
  15. 15.
    Krüger, B., Tautges, J., Weber, A., Zinke, A.: Fast local and global similarity searches in large motion capture databases. In: 2010 ACM SIGGRAPH/Eurographics Symposium on Computer Animation, SCA ’10, pp. 1–10. Eurographics Association, Aire-la-Ville (2010) Google Scholar
  16. 16.
    Lau, M., Chai, J., Xu, Y.-Q., Shum, H.-Y.: Face poser: interactive modeling of 3d facial expressions using facial priors. ACM Trans. Graph. 29(1), 3 (2009) CrossRefGoogle Scholar
  17. 17.
    Lee, Y.J., Zitnick, C.L., Cohen, M.F.: Shadowdraw: real-time user guidance for freehand drawing. ACM Trans. Graph. 30(4), 27 (2011) CrossRefGoogle Scholar
  18. 18.
    Li, Q.L., Geng, W.D., Yu, T., Shen, X.J., Lau, N., Yu, G.: Motionmaster: authoring and choreographing kung-fu motions by sketch drawings. In: Proceedings of the 2006 ACM SIGGRAPH/Eurographics Symposium on Computer Animation, SCA ’06, pp. 233–241. Eurographics Association, Aire-la-Ville (2006) Google Scholar
  19. 19.
    Lin, Y.: 3d character animation synthesis from 2d sketches. In: Proceedings of the 4th International Conference on Computer Graphics and Interactive Techniques in Australasia and Southeast Asia, GRAPHITE ’06, pp. 93–96. ACM, New York (2006) CrossRefGoogle Scholar
  20. 20.
    Lo, W.-Y., Zwicker, M.: Bidirectional search for interactive motion synthesis. Comput. Graph. Forum 29(2), 563–573 (2010) CrossRefGoogle Scholar
  21. 21.
    Mao, C., Qin, S.F., Wright, D.K.: A sketch-based gesture interface for rough 3D stick figure animation. In: Proceedings of Eurographics Workshop on Sketch Based Interfaces and Modeling, Dublin, pp. 175–183 (2005) Google Scholar
  22. 22.
    Mao, C., Qin, S.F., Wright, D.K.: Sketching-out virtual humans: from 2d storyboarding to immediate 3d character animation. In: Proceedings of the 2006 ACM SIGCHI International Conference on Advances in Computer Entertainment Technology, ACE ’06. ACM, New York (2006) Google Scholar
  23. 23.
    Min, J., Chen, Y.-L., Chai, J.: Interactive generation of human animation with deformable motion models. ACM Trans. Graph. 29(1), 9 (2009) CrossRefGoogle Scholar
  24. 24.
    Muico, U., Popović, J., Popović, Z.: Composite control of physically simulated characters. ACM Trans. Graph. 30(3), 16 (2011) CrossRefGoogle Scholar
  25. 25.
    Parameswaran, V., Chellappa, R.: View independent human body pose estimation from a single perspective image. In: Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR 2004, 27 June–2 July, vol. 2, pp. II-16–II-22 (2004) CrossRefGoogle Scholar
  26. 26.
    Pullen, K., Bregler, C.: Motion capture assisted animation: texturing and synthesis. ACM Trans. Graph. 21(3), 501–508 (2002) CrossRefGoogle Scholar
  27. 27.
    Rivers, A., Durand, F., Igarashi, T.: 3d modeling with silhouettes. In: ACM SIGGRAPH 2010 Papers, SIGGRAPH ’10, pp. 109:1–109:8. ACM, New York (2010) Google Scholar
  28. 28.
    Sakamoto, Y., Kuriyama, S., Kaneko, T.: Motion map: image-based retrieval and segmentation of motion data. In: Proceedings of the 2004 ACM SIGGRAPH/Eurographics Symposium on Computer Animation, SCA ’04, pp. 259–266. Eurographics Association, Aire-la-Ville (2004) CrossRefGoogle Scholar
  29. 29.
    Seol, Y., Seo, J., Kim, P.H., Lewis, J.P., Noh, J.: Artist friendly facial animation retargeting. ACM Trans. Graph. 30(6), 162 (2011) CrossRefGoogle Scholar
  30. 30.
    Shoemake, K.: Animating rotation with quaternion curves. SIGGRAPH Comput. Graph. 19(3), 245–254 (1985) CrossRefGoogle Scholar
  31. 31.
    Thorne, M., Burke, D., van de Panne, M.: Motion doodles: an interface for sketching character motion. In: ACM SIGGRAPH 2004 Papers, SIGGRAPH ’04, pp. 424–431. ACM, New York (2004) CrossRefGoogle Scholar
  32. 32.
    Ulicny, B., de Heras Ciechomski, P., Thalmann, D.: Crowdbrush: interactive authoring of real-time crowd scenes. In: Proceedings of the 2004 ACM SIGGRAPH/Eurographics Symposium on Computer Animation, SCA ’04, pp. 243–252. Eurographics Association, Aire-la-Ville (2004) CrossRefGoogle Scholar
  33. 33.
    Wang, J., Bodenheimer, B.: Synthesis and evaluation of linear motion transitions. ACM Trans. Graph. 27(1), 1 (2008) Google Scholar
  34. 34.
    Wei, X., Chai, J.: Intuitive interactive human-character posing with millions of example poses. IEEE Comput. Graph. Appl. 31, 78–88 (2011) CrossRefGoogle Scholar
  35. 35.
    Williams, R.: The Animator’s Survival Kit, 2nd edn. Faber & Faber, London (2009) Google Scholar
  36. 36.
    Zeleznik, R.C., Herndon, K.P., Hughes, J.F.: Sketch: an interface for sketching 3d scenes. In: Proceedings of the 23rd Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH ’96, pp. 163–170. ACM, New York (1996) CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2013

Authors and Affiliations

  • Innfarn Yoo
    • 1
  • Juraj Vanek
    • 1
  • Maria Nizovtseva
    • 1
  • Nicoletta Adamo-Villani
    • 1
  • Bedrich Benes
    • 1
  1. 1.Purdue UniversityWest LafayetteUSA

Personalised recommendations