Motion Capture Synthesis with Adversarial Learning

  • Qi WangEmail author
  • Thierry Artières
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10498)


We propose a new statistical modeling approach that we call Sequential Adversarial Auto-encoder (SAAE) for learning a synthesis model for motion sequences. This model exploits the adversarial idea that has been popularized in the machine learning field for learning accurate generative models. We further propose a conditional variant of this model that takes as input an additional information such as the activity which is performed in a sequence, or the emotion with which it is performed, and which allows to perform synthesis in context.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Denton, E., Chintala, S., Szlam, A., Fergus, R.: Deep Generative Image Models using a Laplacian Pyramid of Adversarial Networks. Arxiv, pp. 1–10 (2015)Google Scholar
  2. 2.
    Ding, Y., Prepin, K., Huang, J., Pelachaud, C., Artières, T.: Laughter animation synthesis. In: AAMAS (2014)Google Scholar
  3. 3.
    Fourati, N., Pelachaud, C.: Emilya: emotional body expression in daily actions database. In: LREC, pp. 3486–3493 (2014)Google Scholar
  4. 4.
    Goodfellow, I., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A., Bengio, Y.: Generative adversarial nets. In: Advances in Neural Information Processing Systems 27, pp. 2672–2680 (2014)Google Scholar
  5. 5.
    Grochow, K., Martin, S.L., Hertzmann, A., Popovic, Z.: Style-based inverse kinematics. ACM Transactions on Graphics 23(3), 522–531 (2004)CrossRefGoogle Scholar
  6. 6.
    Hofer, G., Shimodaira, H.: Automatic head motion prediction from speech data. In: INTERSPEECH, pp. 722–725 (2007)Google Scholar
  7. 7.
    Holden, D., Saito, J., Komura, T.: A deep learning framework for character motion synthesis and editing. ACM Transactions on Graphics 35(4), 1–11 (2016)CrossRefGoogle Scholar
  8. 8.
    Huang, J., Wang, Q., Fratarcangeli, M., Yan, K., Pelachaud, C.: Multi-variate gaussian-based inverse kinematics. In: Computer Graphics Forum (2017)Google Scholar
  9. 9.
    Makhzani, A., Shlens, J., Jaitly, N., Goodfellow, I.: Adversarial Autoencoders, pp. 1–10 (2015). arXiv:
  10. 10.
    Sutskever, I., Vinyals, O., Le, Q.V.: Sequence to sequence learning with neural networks. In: NIPS, pp. 3104–3112 (2014)Google Scholar

Copyright information

© Springer International Publishing AG 2017

Authors and Affiliations

  1. 1.Ecole Centrale MarseilleMarseilleFrance
  2. 2.LIF, Université d’Aix Marseille and CNRSMarseilleFrance

Personalised recommendations