Skip to main content
SpringerLink
Log in

2D/3D Model-Based Facial Video Coding/Decoding at Ultra-Low Bit-Rate

  • Conference paper
Book cover Advances in Multimedia Modeling

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 7733))

Abstract

For facial video coding/decoding in mobile communication, a 2D/3D model-based system was proposed: (1)Online appearance model and cylinder head model were combined to track 3D facial motion in particle filter; (2)3D facial animation was produced combining parameterized model and muscular model; (3)3D hair was synthesized by hair detection and 3D hair model; (4)3D coding/decoding of foreground and 2D coding/decoding of background were stitched. At ultra-low bit-rate, the object experiment confirmed the advantage between coding efficiency and decoding quality of it, and the between subjects experiment indicated the suitability of subjective face identification by it.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Liu, Y.C., et al.: A virtual teleconferencing system based on face detection and 3d animation in a low bandwidth environment. JIST 20(4), 323–332 (2010)

    MathSciNet  Google Scholar 

  2. Wang, M., Hong, R., et al.: Movie2comics: Towards a lively video content presentation. IEEE Trans. on Multimedia 14(3), 858–870 (2012)

    Article  Google Scholar 

  3. Zhang, W., Wang, Q., Tang, X.: Real Time Feature Based 3-D Deformable Face Tracking. In: Forsyth, D., Torr, P., Zisserman, A. (eds.) ECCV 2008, Part II. LNCS, vol. 5303, pp. 720–732. Springer, Heidelberg (2008)

    Chapter  Google Scholar 

  4. Wang, Q., et al.: Real-time bayesian 3-d pose tracking. TCSVT 16(12), 1533–1541 (2006)

    Google Scholar 

  5. Cascia, M.L., et al.: Fast, reliable head tracking under varying illumination: an approach based on registration of texture mapped 3d models. TPAMI 22(4), 322–336 (2000)

    Article  Google Scholar 

  6. Ahlberg, J.: Model-based coding: Extraction, coding, and evaluation of face model parameters. PhD thesis, Linköping University, Sweden (2002)

    Google Scholar 

  7. Matthews, I., et al.: 2d vs. 3d deformable face models: Representational power, construction, and real-time fitting. IJCV 75(1), 93–113 (2007)

    Article  Google Scholar 

  8. Jepson, A.D., et al.: Robust online appearance models for visual tracking. TPAMI 25(10), 1296–1311 (2003)

    Article  Google Scholar 

  9. Lui, Y.M., et al.: Adaptive appearance model and condensation algorithm for robust face tracking. TSMC 40(3), 437–448 (2010)

    Google Scholar 

  10. Dornaika, F., Davoine, F.: Simultaneous facial action tracking and expression recognition in the presence of head motion. IJCV 76(3), 257–281 (2008)

    Article  Google Scholar 

  11. Zhou, S., et al.: Visual tracking and recognition using appearance-adaptive models in particle filters. TIP 13(11), 1491–1506 (2004)

    Google Scholar 

  12. Wen, Z., Huang, T.S.: Capturing subtle facial motions in 3d face tracking. In: ICCV (2003)

    Google Scholar 

  13. Xiao, J., et al.: Robust full-motion recovery of head by dynamic templates and registration techniques. IJIST 13, 85–94 (2003)

    Google Scholar 

  14. Fidaleo, D., Medioni, G.G., Fua, P., Lepetit, V.: An Investigation of Model Bias in 3D Face Tracking. In: Zhao, W., Gong, S., Tang, X. (eds.) AMFG 2005. LNCS, vol. 3723, pp. 125–139. Springer, Heidelberg (2005)

    Chapter  Google Scholar 

  15. Parke, F.I., Waters, K.: Computer facial animation. Wellesley (1996)

    Google Scholar 

  16. Blanz, V., et al.: Reanimating faces in images and video. Computer Graph (2003)

    Article  Google Scholar 

  17. Wang, W.M., et al.: A physically-based modeling and simulation framework for facial animation. In: ICIG (2009)

    Google Scholar 

  18. Marcos, S., Bermejo, J.G.G., Zalama, E.: A realistic facial animation suitable for human-robot interfacing. In: ICIRS (2008)

    Google Scholar 

  19. Ward, K., et al.: A survey on hair modeling: styling, simulation, and rendering. TVCG 13(2), 213–234 (2007)

    Google Scholar 

  20. Eisert, P., et al.: Model-aided coding: a new approach to incorporate facial animation into motion-compensated video coding. TCSVT 10(3), 344–358 (2000)

    Google Scholar 

  21. Balc, K., et al.: Xface open source project and smil-agent scripting language for creating and animating embodied conversational agents. In: ICM (2007)

    Google Scholar 

  22. Kampmann, M.: Automatic 3-d face mode adaption for model-based coding of videophone sequences. TCSVT 12(3), 172–182 (2002)

    Google Scholar 

  23. Grassberger, P.: The pruned-enriched rosenbluth method: simulations of theta polymers of chain length up to 1, 000, 000. Physical Review E 56, 3682–3693 (1997)

    Article  Google Scholar 

  24. Yacoob, Y., Davis, L.S.: Detection and analysis of hair. TPAMI 28(7), 1164–1169 (2006)

    Article  Google Scholar 

  25. Levin, A., et al.: Spectral matting. In: CVPR (2007)

    Google Scholar 

  26. Kanade, T., et al.: Comprehensive database for facial expression analysis. In: International Conference on AFGR (2000)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. University of Science and Technology of China, Hefei, Anhui, P.R. China

    Jun Yu, Zengfu Wang & Yang Cao

Authors
  1. Jun Yu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Zengfu Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Yang Cao
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Microsoft Research Asia, 5 Danling Street, 100080, Beijing, China

    Shipeng Li  & Tao Mei  & 

  2. School of Electrical Engineering and Computer Science, University of Ottawa, 800 King Edward, K1N 6N5, Ottawa, ON, Canada

    Abdulmotaleb El Saddik

  3. School of Computer and Information, Hefei University of Technology, Road Tunxi 193#, 230009, Hefei, Anhui, China

    Meng Wang  & Richang Hong  & 

  4. Department of Information Engineering and Computer Science, University of Trento, ommarive 14, 38100, Trento, Italy

    Nicu Sebe

  5. Department of Electrical and Computer Engineering, National University of Singapore, 4 Engineering Drive 3, 117583, Singapore, Singapore

    Shuicheng Yan

  6. School of Computing, CLARITY: Centre for Sensor Web Technologies, Dublin City University, Glasnevin, 9, Dublin, Ireland

    Cathal Gurrin

Rights and permissions

Reprints and permissions

Copyright information

© 2013 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Yu, J., Wang, Z., Cao, Y. (2013). 2D/3D Model-Based Facial Video Coding/Decoding at Ultra-Low Bit-Rate. In: Li, S., et al. Advances in Multimedia Modeling. Lecture Notes in Computer Science, vol 7733. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-35728-2_2

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-35728-2_2

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-35727-5

  • Online ISBN: 978-3-642-35728-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation