SVC bitstream adaptation in MPEG-21 multimedia framework

Abstract

Scalable video coding (SVC) is the most promising video format for applications of collaborative communication. MPEG-21 standard has newly emerged to enable the interoperability of multimedia delivery in heterogeneous environments. In this paper we study adaptation of SVC bitstream in the context of MPEG-21 multimedia framework. For interfacing SVC bitstream with MPEG-21 based adaptation system, we propose three SVC specific adaptation operators. Based on our previous work with multidimensional video adaptation, we present an effective approach, using MPEG-21 DIA AdaptationQoS description tool, to model QoS control for SVC adaptation. Then we show how the operator values could be computed from that representation. For the actual adaptation at bitstream level, we propose a procedure to remove the unnecessary NAL units from an SVC bitstream. The result of this study enables QoS management of SVC streaming in an efficient and standardized manner.

This is a preview of subscription content, access via your institution.

References

  1. Chang, S.F., Vetro, A., 2005. Video adaptation: concepts, technologies, and open issues. Proceedings of the IEEE, 93(1):148–158. [doi:10.1109/JPROC.2004.839600]

    Article  Google Scholar 

  2. ISO/IEC IS 15938-5:2001, 2003. Information Technology—Multimedia Content Description Interface—Multimedia Description Schemes.

  3. Joint Scalable Video Model (JSVM) 3.0 ITU-T VCEQ JVT-P202, 2005. Poznan, Poland.

  4. Jung, Y.J., Ro, Y.M., 2004. Joint control for hybrid transcoding using multidimensional rate distortion modeling. Proc. ICIP2004. Singapore.

  5. Jung, Y.J., Thang, T.C., Lee, J., Ro, Y.M., 2003. Visual Media Adaptation System for Active Media. Proc. 2003 Int. Conf. on Imaging Sci., Syst., and Tech..

  6. Jung, Y.J., Kim, Y.S., Kim, D.Y., Kim, J.G., Hong, J.W., Ro, Y.M., 2005a. Analysis of Human Perception for Semantic Concept-based Video Transcoding. Int. Workshop Advanced Image Tech. (IWAIT2005), 1:251–256.

    Google Scholar 

  7. Jung, Y.J., Thang, T.C., Ro, Y.M., 2005b. Distortion Measures in MPEG-Compressed Domain for Multidimensional Transcoding. Proc. IEEE MMSP2005. Shanghai.

  8. Mukherjee, D., Delfosse, E., Kim, J.G., Wang, Y., 2005. Optimal adaptation decision-taking for terminal and network quality-of-service. IEEE Trans. Multimedia, 7(3):454–462. [doi:10.1109/TMM.2005.846798]

    Article  Google Scholar 

  9. Schwarz, H., Marpe, D., Wiegand, T., 2004. SNR-Sclable Extension of H.264/AVC. Proc. ICIP 2004. Singapore.

  10. Thang, T.C., Bae, T.M., Jung, Y.J., Ro, Y.M., Kang, J.W., Choi, H., Kim, J.G., 2005a. SVC CE8: Spatial Scalability of Multiple ROIs. ITU-T VCEG JVT-O042. Poznan, Poland.

  11. Thang, T.C., Jung, Y.J., Ro, Y.M., 2005b. Effective adaptation of multimedia documents with modality conversion. EURASIP Signal Processing: Image Communication Journal, 20(5):413–434. [doi:10.1016/j.image.2005.03.004]

    Google Scholar 

  12. Thang, T.C., Kim, Y.S., Kang, J.W., Ro, Y.M., Kim, J.G., 2005c. SVC Video Adaptation with MPEG-21 DIA AdaptationQoS. ISO/IEC JTC1/SC29/WG11 m12638. Nice, France.

  13. Vetro, A., 2004. MPEG-21 Digital item adaptation: enabling universal multimedia access. IEEE Multimedia, 11(1):84–87. [doi:10.1109/MMUL.2004.1261111]

    Article  Google Scholar 

  14. Wang, Y.K., Thang, T.C., 2005. Revised Signaling of Scalability Information. ITU-T VCEQ JVT-P113. Poznan.

Download references

Author information

Affiliations

Authors

Corresponding author

Correspondence to Yong Man Ro.

Rights and permissions

Reprints and Permissions

About this article

Cite this article

Thang, T.C., Kim, Y.S., Ro, Y.M. et al. SVC bitstream adaptation in MPEG-21 multimedia framework. J. Zhejiang Univ. - Sci. A 7, 764–772 (2006). https://doi.org/10.1631/jzus.2006.A0764

Download citation

Key words

  • Multidimensional video adaptation
  • Scalable video coding (SVC)
  • MPEG-21 DIA (Digital Item Adaptation)
  • QoS

CLC number

  • TN919.8