Abstract
We propose a new scalable multi-view video coding (SMVC) method with content-aware bit allocation among multiple views. The video is encoded off-line with a predetermined number of temporal and SNR scalability layers. Content-aware bit allocation among the views is performed during bitstream extraction by adaptive selection of the number of temporal and SNR scalability layers for each group of pictures (GOP) according to motion and spatial activity of that GOP. The effect of bit allocation among the multiple views on the overall video quality has been studied on a number of training sequences by means of both quantitative quality measures as well as qualitative visual tests. The number of temporal and SNR scalability layers selected as a function of motion and spatial activity measures for the actual test sequences are “learned” from these bit allocation vs. video quality studies on the training sequences. SMVC with content-aware bit allocation among views can be used for multi-view video transport over the Internet for interactive 3DTV. Experimental results are provided on stereo video sequences.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Smolic, A., Kauff, P.: Interactive 3-D Video Representation and Coding Technologies. Proc. of the IEEE 93(1) (January 2005)
Vetro, A., Matusik, W., Pfister, H., Xin, J.: Coding Approaches for End-to-End 3D TV Systems. In: Picture Coding Symposium (PCS) (December 2004)
Balasubramaniyam, B., Edirisinghe, E., Bez, H.: An Extended H.264 CODEC for Stereoscopic Video Coding. In: Proceedings of SPIE (2004)
Guo, X., Huang, Q.: Multiview Video Coding Based on Global Motion Model. In: Aizawa, K., Nakamura, Y., Satoh, S. (eds.) PCM 2004. LNCS, vol. 3333, pp. 665–672. Springer, Heidelberg (2004)
Fecker, U., Kaup, A.: H.264/AVC-Compatible Coding of Dynamic Light Fields Using Transposed Picture Ordering. In: EUSIPCO 2005, Antalya, Turkey (September 2005)
Lim, J.E., Ngan, K.N., Yang, W., Sohn, K.: A multiview sequence CODEC with view scalability. Sig. Proc.: Image Comm. 19(3), 239–365 (2004)
Kimata, H., Kitahara, M., Kamikura, K., Yashima, Y.: Free-viewpoint video communication using multi-view video coding. NTT Tech. Review (August 2004)
Bilen, C., Aksay, A., Bozdagı Akar, G.: A Multi-View Codec Based on H.264. In: IEEE Int. Conf. on Image Processing (ICIP) (accepted, 2006)
Reichel, J., Schwarz, H., Wien, M. (eds.): Scalable Video Coding – Working Draft 1. Joint Video Team (JVT), Doc. JVT-N020, Hong-Kong (January 2005)
Reichel, J., Schwarz, H., Wien, M.: Joint Scalable Video Model JSVM-4., Doc. JVT-Q202 (October 2005)
Schwarz, H., Marpe, D., Schierl, T., Wiegand, T.: Combined Scalability Support for the Scalable Extension of H.264/AVC. In: IEEE Int. Conf. on Multimedia & Expo. (ICME), Amsterdam, The Netherlands (July 2005)
Ozbek, N., Tekalp, A.M.: Scalable Multi-View Video Coding for Interactive 3DTV. In: IEEE Int. Conf. on Multimedia & Expo. (ICME), Toronto, Canada (July 2006) (accepted)
Stelmach, L., Tam, W.J., Meegan, D., Vincent, A.: Stereo Image Quality: Effects of Mixed Spatio-Temporal Resolution. IEEE Transactions on Circuits and Systems for Video Technology 10(2), 188–193 (2000)
MSU Graphics & Media Lab, Video Quality Measurement Tool, http://compression.ru/video/quality_measure/video_measurement_tool_en.html
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Özbek, N., Tekalp, A.M. (2006). Content-Aware Bit Allocation in Scalable Multi-view Video Coding. In: Gunsel, B., Jain, A.K., Tekalp, A.M., Sankur, B. (eds) Multimedia Content Representation, Classification and Security. MRCS 2006. Lecture Notes in Computer Science, vol 4105. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11848035_91
Download citation
DOI: https://doi.org/10.1007/11848035_91
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-39392-4
Online ISBN: 978-3-540-39393-1
eBook Packages: Computer ScienceComputer Science (R0)