3D Video Compression Using Depth Map Propagation

  • Sergey Matyunin
  • Dmitriy Vatolin
Part of the Communications in Computer and Information Science book series (CCIS, volume 368)

Abstract

We propose a method of 3D video compression based on 2D+depth representation. We use correlation between 2D video and depth map to reconstruct highly compressed depth map while decoding. Depth map is compressed with reduced spatial and temporal resolution. On decoding stage the algorithm restore original resolution using information from 2D video. We evaluated the influence of key frames’ resolution, compression ratio and density on the performance of the algorithm. The proposed technique was compared to depth map compression using H.264 in compression pipeline for stereo video.

Keywords

Stereo image processing video compression three dimensional TV 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Lukacs, M.E.: Predictive coding of multi-viewpoint image sets. In: International Conference on Acoustics, Speech, and Signal Processing (ICASSP), Tokyo, Japan, vol. 1, pp. 521–524 (1986)Google Scholar
  2. 2.
    Merkle, P., Muller, K., Smolic, A., Wiegand, T.: Efficient Compression of Multi-View Video Exploiting Inter-View Dependencies Based on H.264/MPEG4-AVC. In: Proc. IEEE International Conference on Multimedia and Expo., pp. 1717–1720 (2006)Google Scholar
  3. 3.
    ITU-T and ISO/IEC JTC 1, Final draft amendment 3, amendment 3 to ITU-T recommendation H.262 and ISO/IEC13818-2 (MPEG-2 Video), ISO/IEC JTC 1/SC29/WG 11 (MPEG) Doc. N 1366 (1996)Google Scholar
  4. 4.
    ITU-T and ISO/IEC JTC 1, Advanced video coding for generic audiovisual services, ITU-T Recommendation H.264 and ISO/IEC 14496-10, MPEG-4 AVC (2010)Google Scholar
  5. 5.
    Müller, K., Merkle, P., Wiegand, T.: 3D Video Representation Using Depth Maps. Proceedings of the IEEE, Special Issue on “3D Media and Displays” 99(4), 643–656 (2011)Google Scholar
  6. 6.
    Morvan, Y., de With, P., Farin, D.: Platelet-based coding of depth maps for the transmission of multiview images. In: Proc. Stereoscopic Displays and Applications, SPIE, vol. 6055, pp. 93–100 (2006)Google Scholar
  7. 7.
    Bosc, E., Jantet, V., Pressigout, M., Morin, L., Guillemot, C.: Bit-rate allocation for multi-view video plus depth. In: Proc. 3DTV Conference The True Vision Capture Transmission and Display of 3D Video 3DTVCON, pp. 1–4 (2011)Google Scholar
  8. 8.
    Choi, J., Min, D., Sohn, K.: 2D-plus-depth based resolution and frame-rate up-conversion technique for depth video. IEEE Transactions on Consumer Electronics 56, 2489–2497 (2010)CrossRefGoogle Scholar
  9. 9.
    De Silva, D.V.S.X., Fernando, W.A.C., Yasakethu, S.L.P.: Object based coding of the depth maps for 3D video coding. IEEE Transactions on Consumer Electronic 55, 1699–1706 (2009)CrossRefGoogle Scholar
  10. 10.
    Kim, W.-S., Ortega, A., Lai, P., Tian, D., Gomila, C.: Depth map distortion analysis for view rendering and depth coding. In: Proc. International Conference on Image Processing, pp. 721–724 (2009)Google Scholar
  11. 11.
    Hewage, C.T.E.R., Martini, M.G.: Reduced-reference quality evaluation for compressed depth maps associated with colour plus depth 3D video. In: 17th IEEE International Conference on Image Processing, ICIP (2010)Google Scholar
  12. 12.
    Wang, Z., Bovik, A.C., Sheikh, H.R., Simoncelli, E.P.: Image quality assessment: From error visibility to structural similarity. IEEE Transactions on Image Processing 13(4), 600–612 (2004)CrossRefGoogle Scholar
  13. 13.
    Lee, C., Jung, J.-I., Ho, Y.-S.: Inter-view Depth Pre-processing for 3D Video Coding. ISO/IEC JTC1/SC29/WG11, m22669, pp. 1–7 (November 2011)Google Scholar
  14. 14.
  15. 15.
  16. 16.
    Li, Y., Sun, L., Xue, T.: Fast frame-rate up-conversion of depth video via video coding. In: Proceedings of the 19th ACM International Conference on Multimedia, MM 2011, pp. 1317–1320. ACM, USA (2011)Google Scholar
  17. 17.
    Zhang, G., Jia, J., Wong, T.T., Bao, H.: Consistent depth maps recovery from a video sequence. IEEE Transactions on Pattern Analysis and Machine Intelligence 31(6), 974–988 (2009)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2013

Authors and Affiliations

  • Sergey Matyunin
    • 1
  • Dmitriy Vatolin
    • 1
  1. 1.Department of Computational Mathematics and CyberneticsLomonosov Moscow State UniversityMoscowRussia

Personalised recommendations