ISVC 2014: Advances in Visual Computing pp 376-385 | Cite as
Layered Depth Image Based HEVC Multi-view Codec
Abstract
Multi-view video has gained widespread popularity in the recent years. 3DTV, surveillance, immersive teleconferencing and free view-point television are few notable applications of multi-view video. Excessive storage and transmission bandwidth requirements are the major challenges faced by the industry in facilitating multi-view video applications. This paper presents efficient tools for coding of multi-view video based on the state of the art single view video coding standard H.265/HEVC (High Efficiency Video Coding). Our approach employs the LDI (Layered Depth Image) representation technique which is capable of compactly representing 3D scene content. We propose techniques and algorithms for LDI construction, view synthesis, efficient coding of LDI layers and associated auxiliary information. Subjective assessments indicate that our approach offers more than 50% reduction in bitrate compared to HEVC simulcast for the same subjective quality under practical operating bitrates.
Keywords
Video Code High Efficiency Video Code Object Contour View Synthesis Multiview VideoPreview
Unable to display preview. Download preview PDF.
References
- 1.Vetro, A., Wiegand, T., Sullivan, G.: Overview of the stereo and multiview video coding extensions of the h.264/mpeg-4 avc standard. Proceedings of the IEEE 99, 626–642 (2011)CrossRefGoogle Scholar
- 2.Stankowski, J., Domanski, M., Stankiewicz, O., Konieczny, J., Siast, J., Wegner, K.: Extensions of the hevc technology for efficient multiview video coding. In: 2012 19th IEEE International Conference on Image Processing (ICIP), pp. 225–228 (2012)Google Scholar
- 3.Gautier, J., Bosc, E., Morin, L.: Representation and coding of 3d video data. Perceptual Patterns 2D and 3D Video Coding (2010)Google Scholar
- 4.Yoon, S.U., Lee, E.K., Kim, S.Y., Ho, Y.S., Yun, K., Cho, S., Hur, N.: Coding of layered depth images representing multiple viewpoint video. In: Proceedings of Picture Coding Symposium (PCS) SS3-2, 1–6 (2006)Google Scholar
- 5.Yoon, S.U., Lee, E.K., Kim, S.Y., Ho, Y.S.: A framework for representation and processing of multi-view video using the concept of layered depth image. VLSI Signal Processing 46, 87–102 (2007)CrossRefGoogle Scholar
- 6.Jantet, V.: Layered Depth Images for Multi-view Coding. PhD thesis, University of Rennes 1, Rennes, France (2012)Google Scholar
- 7.Duan, J., Li, J.: Compression of the layered depth image. IEEE Transactions on Image Processing 12, 365–372 (2003)CrossRefGoogle Scholar
- 8.Nguyen, C.V., Izadi, S., Lovell, D.: Modeling kinect sensor noise for improved 3d reconstruction and tracking. In: IEEE 3DIMPVT, pp. 524–530 (2012)Google Scholar
- 9.Fukushima, N., Inoue, T., Ishibashi, Y.: Removing depth map coding distortion by using post filter set. In: 2013 IEEE International Conference on Multimedia and Expo (ICME), 1–6 (2013)Google Scholar
- 10.Muller, K., Merkle, P., Tech, G., Wiegand, T.: 3d video coding with depth modeling modes and view synthesis optimization. In: Proceedings of APSIPA Annual Summit and Conference 2012 (2012)Google Scholar
- 11.Sullivan, G.J., Ohm, J.R., Han, W., Wiegand, T.: Overview of the high efficiency video coding (hevc) standard. IEEE Trans. Circuits Syst. Video Techn. 22, 1649–1668 (2012)CrossRefGoogle Scholar
- 12.Perona, P., Malik, J.: Scale-space and edge detection using anisotropic diffusion. IEEE Transactions on Pattern Analysis and Machine Intelligence 12, 629–639 (1990)CrossRefGoogle Scholar
- 13.Zitnick, C.L., Kang, S.B., Uyttendaele, M., Winder, S.A.J., Szeliski, R.: High-quality video view interpolation using a layered representation. ACM Trans. Graph. 23, 600–608 (2004)CrossRefGoogle Scholar
- 14.Seshadrinathan, K., Soundararajan, R., Bovik, A., Cormack, L.: Study of subjective and objective quality assessment of video. IEEE Transactions on Image Processing 19, 1427–1441 (2010)CrossRefMathSciNetGoogle Scholar
- 15.Laboratories, N.N.T.: Video quality assessment methods. ntt.co.jp. http://www.ntt.co.jp/qos/qoe/eng/technology/visual/01_5.html (accessed:2014 )