Content-Aware Bit Allocation in Scalable Multi-view Video Coding
We propose a new scalable multi-view video coding (SMVC) method with content-aware bit allocation among multiple views. The video is encoded off-line with a predetermined number of temporal and SNR scalability layers. Content-aware bit allocation among the views is performed during bitstream extraction by adaptive selection of the number of temporal and SNR scalability layers for each group of pictures (GOP) according to motion and spatial activity of that GOP. The effect of bit allocation among the multiple views on the overall video quality has been studied on a number of training sequences by means of both quantitative quality measures as well as qualitative visual tests. The number of temporal and SNR scalability layers selected as a function of motion and spatial activity measures for the actual test sequences are “learned” from these bit allocation vs. video quality studies on the training sequences. SMVC with content-aware bit allocation among views can be used for multi-view video transport over the Internet for interactive 3DTV. Experimental results are provided on stereo video sequences.
KeywordsVideo Quality Scalable Video Code Spatial Activity Stereoscopic Video Multiview Video
Unable to display preview. Download preview PDF.
- 1.Smolic, A., Kauff, P.: Interactive 3-D Video Representation and Coding Technologies. Proc. of the IEEE 93(1) (January 2005)Google Scholar
- 2.Vetro, A., Matusik, W., Pfister, H., Xin, J.: Coding Approaches for End-to-End 3D TV Systems. In: Picture Coding Symposium (PCS) (December 2004)Google Scholar
- 3.Balasubramaniyam, B., Edirisinghe, E., Bez, H.: An Extended H.264 CODEC for Stereoscopic Video Coding. In: Proceedings of SPIE (2004)Google Scholar
- 5.Fecker, U., Kaup, A.: H.264/AVC-Compatible Coding of Dynamic Light Fields Using Transposed Picture Ordering. In: EUSIPCO 2005, Antalya, Turkey (September 2005)Google Scholar
- 7.Kimata, H., Kitahara, M., Kamikura, K., Yashima, Y.: Free-viewpoint video communication using multi-view video coding. NTT Tech. Review (August 2004)Google Scholar
- 8.Bilen, C., Aksay, A., Bozdagı Akar, G.: A Multi-View Codec Based on H.264. In: IEEE Int. Conf. on Image Processing (ICIP) (accepted, 2006)Google Scholar
- 9.Reichel, J., Schwarz, H., Wien, M. (eds.): Scalable Video Coding – Working Draft 1. Joint Video Team (JVT), Doc. JVT-N020, Hong-Kong (January 2005)Google Scholar
- 10.Reichel, J., Schwarz, H., Wien, M.: Joint Scalable Video Model JSVM-4., Doc. JVT-Q202 (October 2005)Google Scholar
- 11.Schwarz, H., Marpe, D., Schierl, T., Wiegand, T.: Combined Scalability Support for the Scalable Extension of H.264/AVC. In: IEEE Int. Conf. on Multimedia & Expo. (ICME), Amsterdam, The Netherlands (July 2005)Google Scholar
- 12.Ozbek, N., Tekalp, A.M.: Scalable Multi-View Video Coding for Interactive 3DTV. In: IEEE Int. Conf. on Multimedia & Expo. (ICME), Toronto, Canada (July 2006) (accepted)Google Scholar
- 14.MSU Graphics & Media Lab, Video Quality Measurement Tool, http://compression.ru/video/quality_measure/video_measurement_tool_en.html