Advertisement

Non-regular homogenous block representation for low bit rate depth coding in 3D video

  • Lei Luo
  • Lun Wang
  • Zhuang Qian
  • Qiong Wang
Original Research
  • 62 Downloads

Abstract

In multi-view video plus depth (MVD) format based 3D video (3DV) systems, the quality of the rendered virtual views depends highly on the quality of the compressed depth maps. Therefore, depth coding technology is vital for 3DV applications. This paper proposed a superpixel based non-regular homogenous block (NRHB) representation for low bit rate depth map coding. At the encoder side, with the aid of the superpixel segmentation of the associated texture images and the synthesis distortion estimation of the virtual views, the original depth maps are partitioned into several NRHBs and represented with only a small amount of pixels. Then, the NRHB represented depth maps are compressed by using the standard video coding approach afterward. At the decoder side, the depth maps are reconstructed through position mapping of the superpixel segmentation of the decoded texture images, and enhanced by a false edge filter. The experimental results show that the proposed method could impressively increase both the coding efficiency of the depth maps and the rendering quality of the virtual views. It also can be seen that the proposed method significantly reduced the encoding computational complexity for depth maps, which makes it particularly useful for the low bandwidth mobile consumer devices with limited computational resources.

Keywords

3D video Multi-view video plus depth Superpixel Virtual view synthesis 

Notes

Acknowledgements

This work was supported in part by the National Natural Science Foundation of China under Grant no. 61501074, in part by the Fundamental and Advanced Technology Research Project of Chongqing under Grant no. cstc2015jcyjA40012, and in part by Science and Technology Research Project of Chongqing Municipal Education Commission under Grant no. KJ1500430.

References

  1. Aflaki P, Hannuksela M, Rusanovskyy D, Gabbouj M (2013) Non-linear depth map resampling for depth-enhanced 3-D video coding. IEEE Signal Process Lett 20(1):87–90CrossRefGoogle Scholar
  2. Chen Y, Hannuksela MM, Suzuki T, Hattori S (2014) Overview of the MVC+D 3D video coding standard. J Vis Commun Image Represent 25(4):679–688CrossRefGoogle Scholar
  3. Cho JH, Song W, Choi H, Kim T (2017) Hole filling method for depth image based rendering based on boundary decision. IEEE Signal Process Lett 24(3):329–333CrossRefGoogle Scholar
  4. Hartley R, Zisserman A (2003) Multiple view geometry in computer vision. Cambridge University Press, UKzbMATHGoogle Scholar
  5. Jager F (2015) Segment-wise prediction in 3D video coding. In: Proceedings of the 2015 IEEE International Conference on Consumer Electronics, pp 463–466Google Scholar
  6. Jing L, Barkowshy M, Callet PL (2015) Visual discomfort in 3DTV: definitions, causes, measurement, and modeling. Novel 3D Media Technologies. Springer, New YorkGoogle Scholar
  7. Kwon D, Yang S, Paek Y, Ko K (2017) Optimization techniques to enable execution offloading for 3D video games. Multimed Tools Appl 76(9):1–14CrossRefGoogle Scholar
  8. Leuven SV, Wallendael GV, Ballieul R, COck JD, de Walle RV (2015) Improving the coding performance of 3D video using guided depth filtering. In: Proceedings of the 2015 IEEE International Conference on Consumer Electronics, pp 60C61Google Scholar
  9. Liu YJ, Yu CC, Yu MJ, He Y (2016) Manifold SLIC: A Fast Method to Compute Content-Sensitive Superpixels. In: Proceedings of IEEE Computer Vision and Pattern Recognition, pp 651–659Google Scholar
  10. Lu X, Guo Y, Liu N, Wan L, Fang T (2017) Non-convex joint bilateral guided depth upsampling. Multimed Tools Appl 10(1):1–24Google Scholar
  11. Luo L, Jiang R, Tian X, Chen Y (2013) Rate-distortion based reference viewpoints selection for multi-view video plus depth coding. IEEE Trans Consumer Electron 59(3):657–665CrossRefGoogle Scholar
  12. Merkle P, Bartnik C, Muller K, Wiegand T (2012) 3D video: depth coding based on inter-component prediction of block partitions. In: Proceedings of the 2012 IEEE Picture Coding Symposium, pp 149–152Google Scholar
  13. Micallef BW, Debono CJ (2015) Reducing 3D video coding complexity through more efficient display estimation. IEEE Trans Consumer Electron 60(1):74–82CrossRefGoogle Scholar
  14. Oh KJ, Yea S, Vetro A, Ho YS (2009) Depth reconstruction filter and down/up sampling for depth coding in 3D video. IEEE Signal Process Lett 16(9):745–750Google Scholar
  15. Sullivan GJ, Ohm JR, Han WJ, Wiegand T (2012) Overview of the High efficiency video coding (HEVC) standard. IEEE Trans Circuits Syst Video Technol 22(12):1649–1668CrossRefGoogle Scholar
  16. Tanimoto M, Panahpour Tehrani M, Fujii T, Yendo T (2012) FTV for 3-D spatial communication. Proc IEEE 100(4):905–917CrossRefGoogle Scholar
  17. Xiao J, Tillo T, Yuan H, Zhao Y (2014) Macroblock level bits allocation for depth maps in 3-D video coding. J Signal Process Syst 74(1):127–135CrossRefGoogle Scholar
  18. Yuan Y, Cheung G, Callet PL, Frossard P, Zhao HV (2018) Object shape approximation and contour adaptive depth image coding for virtual view synthesis. IEEE Trans Circuits Syst Video Technol (99):1–1Google Scholar
  19. Zhu LW, Zhang Y, Wang X, Kwong S (2015) View synthesis distortion elimation filter for depth video coding in 3D video broadcasting. Multimed Tools Appl 74(15):5935–5954CrossRefGoogle Scholar

Copyright information

© Springer-Verlag GmbH Germany, part of Springer Nature 2018

Authors and Affiliations

  1. 1.School of Communication and Information EngineeringChongqing University of Posts and TelecommunicationsChongqingChina

Personalised recommendations