Skip to main content

Real-Time Synthesis of 3D Animations by Learning Parametric Gaussians Using Self-Organizing Mixture Networks

  • Conference paper
Neural Information Processing (ICONIP 2006)

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 4233))

Included in the following conference series:

Abstract

In this paper, we present a novel real-time approach to synthesizing 3D character animations of required style by adjusting a few parameters or scratching mouse cursor. Our approach regards learning captured 3D human motions as parametric Gaussians by the self-organizing mixture network (SOMN). The learned model describes motions under the control of a vector variable called the style variable, and acts as a probabilistic mapping from the low-dimensional style values to high-dimensional 3D poses. We have designed a pose synthesis algorithm and developed a user friendly graphical interface to allow the users, especially animators, to easily generate poses by giving style values. We have also designed a style-interpolation method, which accepts a sparse sequence of key style values and interpolates it and generates a dense sequence of style values for synthesizing a segment of animation. This key-styling method is able to produce animations that are more realistic and natural-looking than those synthesized by the traditional key-framing technique.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Li, Y., Wang, T., Shum, H.Y.: Motion texture: A two-level statistical model for character motion synthesis. In: Proc. ACM SIGGRAPH, pp. 465–472 (2002)

    Google Scholar 

  2. Grochow, K., Martin, S.L., Hertzmann, A., Popović, Z.: Style-based inverse kinematics. In: Proc. ACM SIGGRAPH, pp. 522–531 (2004)

    Google Scholar 

  3. Brand, M., Hertzmann, A.: Style machines. In: Proc. ACM SIGGRAPH, pp. 183–192 (2000)

    Google Scholar 

  4. Ostendorf, M., Digalakis, V.V., Kimball, O.A.: From HMM’s to segment models: a unified view of stochastic modeling for speech recognition. IEEE Transactions on Speech and Audio Processing 4(5), 360–378 (1996)

    Article  Google Scholar 

  5. Gales, M., Young, S.: The theory of segmental hidden Markov models. Technical report, Cambridge Univ. Eng. Dept (1993)

    Google Scholar 

  6. Lawrence, N.D.: Gaussian process latent variable models for visualisation of high dimensional data. In: Proc. 16th NIPS (2004)

    Google Scholar 

  7. Wilson, A.D., Bobick, A.: Parametric hidden markov models for gesture recognition. IEEE Trans. Pattern Analysis Machine Intelligence 21(9), 884–900 (1999)

    Article  Google Scholar 

  8. Brand, M.: Pattern discovery via entropy minimization. In: Heckerman, D., Whittaker, C. (eds.) Artificial Intelligence and Statistics, vol. 7, Morgan Kaufmann, Los Altos (1999)

    Google Scholar 

  9. Yin, H., Allinson, N.M.: Self-organizing mixture networks for probability density estimation. IEEE Trans. Neural Networks 12, 405–411 (2001)

    Article  Google Scholar 

  10. Ormoneit, D., Tresp, V.: Averaging, maximum penalised likelihood and bayesian estimation for improving gaussian mixture probability density estimates. IEEE Trans. Neural Networks 9, 639–650 (1998)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2006 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Wang, Y., Yin, H., Zhou, LZ., Liu, ZQ. (2006). Real-Time Synthesis of 3D Animations by Learning Parametric Gaussians Using Self-Organizing Mixture Networks. In: King, I., Wang, J., Chan, LW., Wang, D. (eds) Neural Information Processing. ICONIP 2006. Lecture Notes in Computer Science, vol 4233. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11893257_75

Download citation

  • DOI: https://doi.org/10.1007/11893257_75

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-46481-5

  • Online ISBN: 978-3-540-46482-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics