Content-Aware Bit Allocation in Scalable Multi-view Video Coding

  • Nükhet Özbek
  • A. Murat Tekalp
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4105)


We propose a new scalable multi-view video coding (SMVC) method with content-aware bit allocation among multiple views. The video is encoded off-line with a predetermined number of temporal and SNR scalability layers. Content-aware bit allocation among the views is performed during bitstream extraction by adaptive selection of the number of temporal and SNR scalability layers for each group of pictures (GOP) according to motion and spatial activity of that GOP. The effect of bit allocation among the multiple views on the overall video quality has been studied on a number of training sequences by means of both quantitative quality measures as well as qualitative visual tests. The number of temporal and SNR scalability layers selected as a function of motion and spatial activity measures for the actual test sequences are “learned” from these bit allocation vs. video quality studies on the training sequences. SMVC with content-aware bit allocation among views can be used for multi-view video transport over the Internet for interactive 3DTV. Experimental results are provided on stereo video sequences.


Video Quality Scalable Video Code Spatial Activity Stereoscopic Video Multiview Video 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Smolic, A., Kauff, P.: Interactive 3-D Video Representation and Coding Technologies. Proc. of the IEEE 93(1) (January 2005)Google Scholar
  2. 2.
    Vetro, A., Matusik, W., Pfister, H., Xin, J.: Coding Approaches for End-to-End 3D TV Systems. In: Picture Coding Symposium (PCS) (December 2004)Google Scholar
  3. 3.
    Balasubramaniyam, B., Edirisinghe, E., Bez, H.: An Extended H.264 CODEC for Stereoscopic Video Coding. In: Proceedings of SPIE (2004)Google Scholar
  4. 4.
    Guo, X., Huang, Q.: Multiview Video Coding Based on Global Motion Model. In: Aizawa, K., Nakamura, Y., Satoh, S. (eds.) PCM 2004. LNCS, vol. 3333, pp. 665–672. Springer, Heidelberg (2004)CrossRefGoogle Scholar
  5. 5.
    Fecker, U., Kaup, A.: H.264/AVC-Compatible Coding of Dynamic Light Fields Using Transposed Picture Ordering. In: EUSIPCO 2005, Antalya, Turkey (September 2005)Google Scholar
  6. 6.
    Lim, J.E., Ngan, K.N., Yang, W., Sohn, K.: A multiview sequence CODEC with view scalability. Sig. Proc.: Image Comm. 19(3), 239–365 (2004)CrossRefGoogle Scholar
  7. 7.
    Kimata, H., Kitahara, M., Kamikura, K., Yashima, Y.: Free-viewpoint video communication using multi-view video coding. NTT Tech. Review (August 2004)Google Scholar
  8. 8.
    Bilen, C., Aksay, A., Bozdagı Akar, G.: A Multi-View Codec Based on H.264. In: IEEE Int. Conf. on Image Processing (ICIP) (accepted, 2006)Google Scholar
  9. 9.
    Reichel, J., Schwarz, H., Wien, M. (eds.): Scalable Video Coding – Working Draft 1. Joint Video Team (JVT), Doc. JVT-N020, Hong-Kong (January 2005)Google Scholar
  10. 10.
    Reichel, J., Schwarz, H., Wien, M.: Joint Scalable Video Model JSVM-4., Doc. JVT-Q202 (October 2005)Google Scholar
  11. 11.
    Schwarz, H., Marpe, D., Schierl, T., Wiegand, T.: Combined Scalability Support for the Scalable Extension of H.264/AVC. In: IEEE Int. Conf. on Multimedia & Expo. (ICME), Amsterdam, The Netherlands (July 2005)Google Scholar
  12. 12.
    Ozbek, N., Tekalp, A.M.: Scalable Multi-View Video Coding for Interactive 3DTV. In: IEEE Int. Conf. on Multimedia & Expo. (ICME), Toronto, Canada (July 2006) (accepted)Google Scholar
  13. 13.
    Stelmach, L., Tam, W.J., Meegan, D., Vincent, A.: Stereo Image Quality: Effects of Mixed Spatio-Temporal Resolution. IEEE Transactions on Circuits and Systems for Video Technology 10(2), 188–193 (2000)CrossRefGoogle Scholar
  14. 14.
    MSU Graphics & Media Lab, Video Quality Measurement Tool,

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Nükhet Özbek
    • 1
  • A. Murat Tekalp
    • 2
  1. 1.International Computer InstituteEge UniversityBornova, İzmirTurkey
  2. 2.College of EngineeringKoç UniversitySarıyer, İstanbulTurkey

Personalised recommendations