Non-regular homogenous block representation for low bit rate depth coding in 3D video
- 62 Downloads
In multi-view video plus depth (MVD) format based 3D video (3DV) systems, the quality of the rendered virtual views depends highly on the quality of the compressed depth maps. Therefore, depth coding technology is vital for 3DV applications. This paper proposed a superpixel based non-regular homogenous block (NRHB) representation for low bit rate depth map coding. At the encoder side, with the aid of the superpixel segmentation of the associated texture images and the synthesis distortion estimation of the virtual views, the original depth maps are partitioned into several NRHBs and represented with only a small amount of pixels. Then, the NRHB represented depth maps are compressed by using the standard video coding approach afterward. At the decoder side, the depth maps are reconstructed through position mapping of the superpixel segmentation of the decoded texture images, and enhanced by a false edge filter. The experimental results show that the proposed method could impressively increase both the coding efficiency of the depth maps and the rendering quality of the virtual views. It also can be seen that the proposed method significantly reduced the encoding computational complexity for depth maps, which makes it particularly useful for the low bandwidth mobile consumer devices with limited computational resources.
Keywords3D video Multi-view video plus depth Superpixel Virtual view synthesis
This work was supported in part by the National Natural Science Foundation of China under Grant no. 61501074, in part by the Fundamental and Advanced Technology Research Project of Chongqing under Grant no. cstc2015jcyjA40012, and in part by Science and Technology Research Project of Chongqing Municipal Education Commission under Grant no. KJ1500430.
- Jager F (2015) Segment-wise prediction in 3D video coding. In: Proceedings of the 2015 IEEE International Conference on Consumer Electronics, pp 463–466Google Scholar
- Jing L, Barkowshy M, Callet PL (2015) Visual discomfort in 3DTV: definitions, causes, measurement, and modeling. Novel 3D Media Technologies. Springer, New YorkGoogle Scholar
- Leuven SV, Wallendael GV, Ballieul R, COck JD, de Walle RV (2015) Improving the coding performance of 3D video using guided depth filtering. In: Proceedings of the 2015 IEEE International Conference on Consumer Electronics, pp 60C61Google Scholar
- Liu YJ, Yu CC, Yu MJ, He Y (2016) Manifold SLIC: A Fast Method to Compute Content-Sensitive Superpixels. In: Proceedings of IEEE Computer Vision and Pattern Recognition, pp 651–659Google Scholar
- Lu X, Guo Y, Liu N, Wan L, Fang T (2017) Non-convex joint bilateral guided depth upsampling. Multimed Tools Appl 10(1):1–24Google Scholar
- Merkle P, Bartnik C, Muller K, Wiegand T (2012) 3D video: depth coding based on inter-component prediction of block partitions. In: Proceedings of the 2012 IEEE Picture Coding Symposium, pp 149–152Google Scholar
- Oh KJ, Yea S, Vetro A, Ho YS (2009) Depth reconstruction filter and down/up sampling for depth coding in 3D video. IEEE Signal Process Lett 16(9):745–750Google Scholar
- Yuan Y, Cheung G, Callet PL, Frossard P, Zhao HV (2018) Object shape approximation and contour adaptive depth image coding for virtual view synthesis. IEEE Trans Circuits Syst Video Technol (99):1–1Google Scholar