Skip to main content
SpringerLink
Log in

An overview of 3D video representation and coding

  • 3DR Review
  • Published:
3D Research

Abstract

As the next generation of television, three-dimensional television (3DTV) is enkindling various new applications. Since the representation and coding of three-dimensional video has direct effect on successive transmission, synthesis and display, it becomes crucially important and receives a wide publicity. This paper gives an overview of existing 3D video representation, relevantly state-of-the-art coding standards and various coding approaches consisting of conventional stereo video, multi-view video, video plus depth, multi-view video plus depth and layered depth video.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. B. Haskell, A. Puri and A. Netrevali (1998) Digital video: an introduction to MPEG-2, Journal of Electronic Imaging 7: 265–266

    Article  Google Scholar 

  2. Generic coding of moving pictures and associated audio information-Part 2: video, ITU-T Rec. H.222.0|ISO/IEC 13818-1 (MPEG 2 Systems), ITU-T and ISO/IEC JTC1 (1994)

  3. M. Jose (2003) MPEG 3DAV AhG activities report, 65th MPEG Meeting, Trondheim, Norway

    Google Scholar 

  4. A. Smolic and D. McCutchen (2004) 3DAV exploration of video-based rendering technology in MPEG, IEEE Transactions on Circuits and Systems for Video Technology 14: 348–356

    Article  Google Scholar 

  5. Advanced video coding for generic audio-visual services, ITU-T Recommendation H.264 & ISO/IEC 14496-10 AVC (2003)

  6. P. Merkle, K. Müller, A. Smolic, and T. Wiegand (2006) Efficient compression of multi-view video exploiting interview dependencies based on H.264/MPEG4-AVC, IEEE International Conference on Multimedia and Exposition

  7. K-J. Oh and Y-S. Ho (2006) Multi-view video coding based on the lattice-like pyramid GOP structure, Picture Coding Symposium

  8. S. Shinya, K. Hideaki and Y. Ohtani (2009) Real-time free-viewpoint viewer from Multi-view video plus depth representation coded by H.264/AVC MVC extension, 3DTV Conference: The True Vision — Capture, Transmission and Display of 3D Video, 1–6

  9. Introduction to 3D video, ISO/IEC JTC1/SC29/WG11 coding of moving pictures and audio/N9784, Archamps, France (2008)

  10. Proposal to amendment MPEG-C Part 3. organization international de normalization, ISO/IEC JTC1/SC29/WG11 Coding Of Moving Pictures and Audio/M14700, Lausanne, Switzerland (2007)

  11. Vision on 3D video organization international de normalization, ISO/IEC JTC1/SC29/WG11MPEG 2009/N10357, Lausanne, Switzerland (2009)

  12. X. Chen and A. Luthra (1997) MPEG-2 multi-view profile and its application in 3D TV, Proceedings of SPIE, 3021: 212–223

    Article  Google Scholar 

  13. M. Flierl, A. Mavlankar, and B. Girod (2007) Motion and disparity compensated coding for multi-view video, IEEE Transactions on Circuits and Systems for Video Technology

  14. H. Schwarz, D. Marpe, and T. Wiegand (2006) Analysis of hierarchical B-pictures and MCTF, IEEE International Conference on Multimedia and Exposition

  15. A. Smolic, K. Mueller, N. Stefanoski, J. Ostermann, A. Gotchev, G.B. Akar, G. Triantafyllidis, and A. Koz (2007) Coding Algorithms for 3DTV-A Survey, IEEE Transactions on Circuits and Systems for Video Technology, 17:1606–1621

    Article  Google Scholar 

  16. Joint Draft 8.0 on Multiview video coding, Joint Video Team (JVT) of ISO/IEC MPEG & ITU-T VCEG/JVT-AB204, 28th Meeting: Hannover (2008)

  17. J. H. Kim, P. Lai, J. Lopez, A, Ortega, Y. Su, P. Yin, C. Gomila (2007) New coding tools for illumination and focus mismatch compensation in Multiview video coding, IEEE Transactions on Circuits and Systems for Video Technology, 17: 1519–1535

    Article  Google Scholar 

  18. H. Yang, Y. Chang and J. Huo (2009) Fine-granular motion matching for inter-view motion skip mode in Multi-view video coding, IEEE Transactions on Circuits and Systems for Video Technology, 19: 887–892

    Article  Google Scholar 

  19. X. Guo, Y. Lu, F. Wu, W. Gao (2006) Inter-view direct mode for Multiview video coding, IEEE Transactions on Circuits and Systems for Video Technology, 16:1527–1532

    Article  Google Scholar 

  20. P. Lai, A. Ortega, P. Pandit, Y. Peng and C. Gomila (2008) Adaptive reference filtering for bidirectional disparity compensation with focus mismatches, International Conference on Image Processing, 6: 2456–2459

    Google Scholar 

  21. Y. Sehoon, A. Vetro (2007) RD-optimized view synthesis prediction for multi-view video coding, International Conference on Image Processing, 1: 209–212

    Google Scholar 

  22. C. Fehn, P. Kauff, M. de Beeck, M. Ernst, W. IJsselsteijn, M. Pollefeys, L. Gool, E. Ofek, and I. Sexton (2002) An evolutionary and optimized approach on 3D-TV, Proceedings of International Broadcast Conference, 357–365

  23. C. Fehn, R. Delabarre. S. Pastoor (2006) Interactive 3DTVconcepts and key technologies, Proceedings of the IEEE, 94: 524–538

    Article  Google Scholar 

  24. Information technology — MPEG video technologies — Part 3: Representation of auxiliary video and supplemental information ISO/IEC 23002-3 (2007)

  25. H. Oh, Y-S. Ho (2006) H.264-based depth map sequence coding using motion information of corresponding texture video, PSIVT,898–907

  26. Y. Morvan, D. Farin and P. H.N. de With (2007) Depth image compression based on an R-D optimized quadtree decomposition for the transmission of multivew images, International Conference on Image Processing, 105–108

  27. B. Zhu, G. Y. Jiang, M. Yu, P. An, Zh. Y. Zhang (2009) Depth map compression for view synthesis in FTV, ISO/IEC JTC1/SC29/WG11 MPEG2008/M 16021

  28. N. Zhang, S. Ma and W. Gao (2009) Shape-based depth map coding, IEEE The Fifth International Conference on Intelligent Information Hiding and Multimedia Signal Processing

  29. T. Wiegand, G. Sullivan, J. Reichel, H. Schwarz, and M. Wien (2006) Joint draft 8 of SVC amendment, ISO/IECJTC1/SC29/WG11 and ITU-T SG16 Q.69 (JVTU201)

  30. M. Maitre, Y. Shinagawa and M. N. Do (2007) Rate-distortion optimal depth maps in the wavelet domain for free-viewpoint rendering, International Conference on Image Processing, 125–128

  31. S-T. Na, K-J. Oh, C. Lee and Y-S. Ho (2008) Multi-view depth video coding using depth view synthesis, International Symposium on Circuits and Systems, 1400–1403

  32. Y. Morvan, D. Farin and P. H. N. de (2007) Joint depth/texture bit-allocation for multi-view video compression, Proceedings of Picture Coding Symposium

  33. Y. Liu, Q. Huang, S. Ma, D. Zhao and W. Gao (2009) Joint video/depth rate allocation for 3D video coding based on view synthesis distortion model, Signal Processing: Image Communication, 24: 666–681

    Article  Google Scholar 

  34. Y. Liu, S. Ma, Q. Huang, D. Zhao, W. Gao, N. Zhang (2009) Compression-induced rendering distortion analysis for texture/depth rate allocation in 3D video compression, Proceedings of Data Compression Conference, 352–361

  35. X. Cheng, L. Sun and S. Yang (2007) A multi-view video coding approach using layered depth image, Multimedia Signal Processing, 143–146

  36. J. Shade, S. Gortler, L. Hey, and R. Szeliskiz (1998) Layered depth images, Proceedings of ACM SIGGRAPH, 231–242

  37. Project no. FP7-213349. D5.1-requirements and specifications for 3D video (2008)

  38. J. Duan and J. Li (2003) Compression of the layered depth image, IEEE Transactions on Image Processing, 12:365–372

    Article  Google Scholar 

  39. S.U. Yoon, S.Y. Kim, and Y.S. Ho (2004) Preprocessing of depth and color information for layered depth image coding, Lecture Notes Computer Science, 3333: 622–699

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. National Engineering Laboratory for Video Technology, School of EE & CS, Peking University, Beijing, China

    Lianlian Jiang, Jiangqian He & Tiejun Huang

  2. School of Biomedical Engineering, Capital Medical University, Beijing, China

    Nan Zhang

Authors
  1. Lianlian Jiang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jiangqian He
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Nan Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Tiejun Huang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Nan Zhang.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Jiang, L., He, J., Zhang, N. et al. An overview of 3D video representation and coding. 3D Res 1, 43–47 (2010). https://doi.org/10.1007/3DRes.01(2010)6

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/3DRes.01(2010)6

Keywords

Search

Navigation