Skip to main content

Advertisement

SpringerLink
Log in

Optimization-based key frame extraction for motion capture animation

  • Original Article
  • Published:
The Visual Computer Aims and scope Submit manuscript

Abstract

In this paper, we present a new solution for extracting key frames from motion capture data using an optimization algorithm to obtain compact and sparse key frame data that can represent the original dense human body motion capture animation. The use of the genetic algorithm helps determine the optimal solution with global exploration capability while the use of a probabilistic simplex method helps expedite the speed of convergence. By finding the chromosome that maximizes the fitness function, the algorithm provides the optimal number of key frames as well as the low reconstruction error with an ordinary interpolation technique. The reconstruction error is computed between the original motion and the reconstruction one by the weighted differences of joint positions and velocities. The resulting set of key frames is obtained by iterative application of the algorithm with initial populations generated randomly and intelligently. We also present experiments which demonstrate that the method can effectively extract key frames with a high compression ratio and reconstruct all other non key frames with high quality.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

References

  1. Liu, F., Zhuang, Y.T., Wu, F., et al.: 3D motion retrieval with motion index tree. Comput. Vis. Image Underst. 92(2), 265–284 (2003)

    Article  Google Scholar 

  2. Park, M.J., Shin, S.Y.: Example-based motion cloning. Comput. Animat. Virtual Worlds 15(3/4), 245–257 (2004)

    Article  Google Scholar 

  3. Lim, I.S., Thalmann, D.: Key-posture extraction out of human motion data by curve simplification. In: Proceedings of the 23rd Annual International Conference of the IEEE, Engineering in Medicine and Biology Society, vol. 2(2), pp. 1167–1169 (2001)

    Google Scholar 

  4. Shen, J., Sun, S., Pan, Y.: Key-frame extraction from motion capture data. J. Comput.-Aided Des. Comput. Graph. 16(5), 719–723 (2004)

    Google Scholar 

  5. Yang, T., Xiao, J., Wu, F., Zhuang, Y.: Extraction of keyframe of motion capture data based on layered curve simplification. J. Comput.-Aided Des. Comput. Graph. 18(11), 1691–1697 (2006)

    Google Scholar 

  6. Eyuphan, B., Tolga, C.: Key frame extraction from motion capture data by curve saliency. In: Computer Animation and Social Agents (2007)

    Google Scholar 

  7. Gong, Y., Liu, X.: Video summarization using singular value decomposition. In: Proceedings IEEE Conference on Computer Vision and Pattern Recognition, Hilton Head Island, SC, USA, pp. 174–180 (2000)

    Google Scholar 

  8. Cooper, M., Foote, J.: Summarizing video using non-negative similarity matrix factorization. In: IEEE Workshop on Multimedia Signal Processing, St. Thomas, Virgin Islands, USA, 2002, pp. 25–28 (2002)

    Google Scholar 

  9. Huang, K.S., Chang, C.F., Hsu, Y.Y., Yang, S.N.: Keyprobe: a technique for animation keyframe extraction. Vis. Comput. 21(8–10), 532–541 (2005)

    Article  Google Scholar 

  10. Lee, T.-Y., Lin, C.-H., Wang, Y.-S., Chen, T.-G.: Animation key-frame extraction and simplification using deformation analysis. IEEE Trans. Circuits Syst. Video Technol. 18(4), 478–486 (2008)

    Article  Google Scholar 

  11. Yen, J., Liao, J.C., Lee, B., Randolph, D.: A hybrid approach to modeling metabolic systems using genetic algorithm and simplex method. IEEE Trans. Syst. Man Cybern. 28(2), 173–191 (1998)

    Google Scholar 

  12. Ren, Z.-W., San, Y., Chen, J.-F.: Hybrid simplex-improved genetic algorithm for global numerical optimization. Acta Autom. Sin., 33(1), 91–96 (2007)

    Article  MathSciNet  Google Scholar 

  13. Zhu, D., Wang, Z.: Extraction of keyframe from motion capture data based on motion sequence segmentation. J. Comput.-Aided Des. Comput. Graph. 20(6), 787–792 (2008)

    Google Scholar 

  14. Barbic, J., Safonova, A., Pan, J., Faloutsos, C., Hodgins, J.K., Pollard, N.S.: Segmenting motion capture data into distinct behaviors. In: Proceedings of Graphics Interface 2004, Canadian Human-Computer Communications Society, London, pp. 185–194 (2004)

    Google Scholar 

  15. Lee, J., Chai, J., Reitsma, P.S.A., Hodgins, J.K., Pollard, N.S.: Interactive control of avatars animated with human motion data. ACM Trans. Graph. 21(3), 491–500 (2002)

    Google Scholar 

  16. Arikan, O.: Compression of motion capture databases. In: Proceedings of ACM SIGGRAPH 2006, pp. 1–8 (2006)

    Google Scholar 

Download references

Acknowledgements

This work is supported and funded by the State Key Program of National Natural Science of China (No. 60533070), the Special Foundation of the “211 Project” Subject Construction for Young Researcher at the Beijing University of Technology, the Beijing Municipal Commission of Education of Science and Technology Program (No. KM200910005020). We would like to acknowledge the help of the CMU Graphics Lab, who provided us with the human motion capture data. We also would like to thank the anonymous reviewers for their helpful comments and suggestions.

Author information

Authors and Affiliations

  1. State Key Laboratory of Virtual Reality Technology and System, Beihang University, Beijing, 100083, China

    Xian-mei Liu & Ai-min Hao

  2. School of Computer and Information Technology, Northeast Petroleum University, Daqing, 163318, China

    Xian-mei Liu & Dan Zhao

Authors
  1. Xian-mei Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ai-min Hao
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Dan Zhao
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Xian-mei Liu.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Liu, Xm., Hao, Am. & Zhao, D. Optimization-based key frame extraction for motion capture animation. Vis Comput 29, 85–95 (2013). https://doi.org/10.1007/s00371-012-0676-1

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00371-012-0676-1

Keywords

Search

Navigation