Abstract
The scalable extension of H.264/AVC, known as scalable video coding or SVC, is currently the main focus of the Joint Video Team’s work. In its present working draft, the higher level syntax of SVC follows the design principles of H.264/AVC. Self-contained network abstraction layer units (NAL units) form natural entities for packetization. The SVC specification is by no means finalized yet, but nevertheless the work towards an optimized RTP payload format has already started. RFC 3984, the RTP payload specification for H.264/AVC has been taken as a starting point, but it became quickly clear that the scalable features of SVC require adaptation in at least the areas of capability/operation point signaling and documentation of the extended NAL unit header. This paper first gives an overview of the history of scalable video coding, and then reviews the video coding layer (VCL) and NAL of the latest SVC draft specification. Finally, it discusses different aspects of the draft SVC RTP payload format, including the design criteria, use cases, signaling and payload structure.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Baugher, M., McGrew, D., Naslund, M., Carrara, E., Norrman, K., 2004. The Secure Real-time Transport Protocol (SRTP). RFC 3711, available from http://www.ietf.org/rfc/rfc3711.txt.
Fenner, W., 1997. Internet Group Management Protocol, Version 2. RFC 2236, available from http://www.ietf.org/rfc/rfc2236.txt.
Handley, M., 1998. GeRM: Generic RTP Multiplexing. Internet Draft, Work in Progress, Expired. Available from http://www.ietf.org/proceedings/98dec/I-D/draft-ietf-avtgerm-00.txt.
Handley, M., Jacobson, V., 1998. SDP: Session Description Protocol. RFC 2327, available from http://www.ietf.org/rfc/rfc2327.txt.
Handley, M., Jacobson, V., Perkins, C., 2005. SDP: Session Description Protocol. Internet Draft, Work in Progress. Available from http://www.ietf.org/internet-drafts/draftietf-mmusic-sdp-new-25.txt.
ISO/IEC JTC1, 1992. Information Technology—Coding of Audio-visual Objects, Part 2: Visual. ISO/IEC 11176-2 (MPEG-1).
ISO/IEC JTC1, 1998. Information Technology—Coding of Audio-visual Objects, Part 2: Visual. ISO/IEC 14496-2 (MPEG-4).
ISO/IEC MPEG, 2005. SVC Requirements Specified by MPEG. JVT-N026, available from http://ftp3.itu.ch/avarch/jvt-site/2005_01_HongKong/jvt-n026.doc.
ITU-T, 1998. Video Coding for Low Bitrate Communication. ITU-T Recommendation H.263, Version 2.
ITU-T, 2003. Advanced Video Coding for Generic Audiovisual Services. ITU-T Recommendation H.264.
ITU-T and ISO/IEC JTC1, 1994. Generic Coding of Moving Pictures and Associated Audio Information, Part 2: Video. ITU-T Recommendation H.262, ISO/IEC 13818-2 (MPEG-2).
ITU-T VCEG, 2005. SVC Requirements Specified by VCEG. JVT-N027, available from http://ftp3.itu.ch/av-arch/jvt-site/2005_01_HongKong/jvt-n027.doc.
Jacobson, V., McCanne, S., Vetterli, M., 1996. Receiver-Driven Layered Multicast. Proc. of ACM SIGCOMM’96. Stanford, CA, p. 117–130.
Joint Video Team, 2005a. Scalable Video Coding—Working Draft 1. Available from http://ftp3.itu.ch/av-arch/jvt-site/2005_01_HongKong/JVT-N020d1.zip.
Joint Video Team, 2005b. Scalable Video Coding—Working Draft 4. Available from http://ftp3.itu.ch/av-arch/jvt-site/2005_10_Nice/JVT-Q201d1.zip.
Joint Video Team, 2005c. Joint Scalable Video Model—JSVM-4. Available from http://ftp3.itu.ch/av-arch/jvt-site/2005_10_Nice/JVT-Q202.zip.
Jones, H.W., 1979. A comparison of theoretical and experimental video compression designs. IEEE Trans. on Electromag. Compat., 21(1):50–56.
Li, W., 2001. Overview of fine granular scalability in MPEG-4 video standard. IEEE CSVT, 11(3):301–317.
Li, A., 2005. FEC Grouping Semantics in SDP. Internet Draft, Work in Progress. Available from http://www.ietf.org/internet-drafts/draft-ietf-mmusic-fec-grouping-02.txt.
Ohm, J.R., 2005. Advances in scalable video coding. Proceeding of the IEEE, 93(1):42–56.
Reader, C., 2002. History of Video Compression. Draft Version 2.0, JVT-D-068, available from http://ftp3.itu.ch/av-arch/jvt-site/2002_07_Klagenfurt/JVT-D068.doc.
Rosenberg, J., Schulzrinne, H., Gamarillo, G., Johnston, A., Peterson, J., Sparks, R., Handley, M., Schooler, E., 2002. SIP: Session Initiation Protocol. RFC 3261, available from http://www.ietf.org/rfc/rfc3261.txt.
Schierl, T., Wiegand, T., Kampmann, M., 2005. 3GPP Compliant Adaptive Wireless Video Streaming Using AVC. Proc. of IEEE International Conference on Image Processing.
Schulzrinne, H., Rao, A., Lanphier, R., 1998. Real Time Streaming Protocol. RFC2326, available from http://www.ietf.org/rfc/rfc2326.txt.
Schulzrinne, H., Casner, S., Frederick, R., Jacobson, V., 2003. RTP: A Transport Protocol for Real-Time Applications. RFC 3550, STD 64, available from http://www.ietf.org/rfc/rfc3550.txt.
Schwarz, H., Hinz, T., Marpe, D., Wiegand, T., 2005. Constrained Inter-Layer Prediction for Single-Loop Decoding in Spatial Scalability. Proc. of IEEE International Conference on Image Processing.
Thompson, B., Koren, T., Wing, D., 2005. Tunneling Multiplexed Compressed RTP (TCRTP). RFC 4170, available from http://www.ietf.org/rfc/rfc/rfc4170.txt.
Tian, D., Hannuksela, M.M., Gabbouj, M., 2005a. Subsequence Video Coding for Improved Temporal Scalability. Proc. of IEEE Int. Symposium on Circuits and Systems (ISCAS).
Tian, D., Malamal Vadakital, V.K., Hannuksela, M.M., Wenger, S., Gabbouj, M., 2005b. Improved H.264/AVC Video Broadcast/Multicast. Proc. of Visual Communications and Image Processing (VCIP).
Vitali, A., Fumagalli, M., 2005. Standard-compatible Multiple-Description Coding (MDC) and Layered Coding (LC) of Audio/Video Streams. Internet Draft, Work in Progress. Available from http://www.ietf.org/internet-drafts/draftvtali-ietf-avt-mdc-lc-00.txt.
Wenger, S., Wang, Y.K., 2005. RTP Payload Format for SVC Video. Internet Draft, Work in Progress. Available from http://www.ietf.org/internet-drafts/draft-wenger-avt-rtpsvc-00.txt.
Wenger, S., Hannuksela, M.M., Stockhammer, T., Westerlund, M., Singer, D., 2005. RTP Payload Format for H.264 Video. RFC 3984, available from http://www.ietf.org/rfc/rfc3984.txt.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Wenger, S., Wang, Yk. & Hannuksela, M.M. RTP payload format for H.264/SVC scalable video coding. J. Zhejiang Univ. - Sci. A 7, 657–667 (2006). https://doi.org/10.1631/jzus.2006.A0657
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1631/jzus.2006.A0657
Key words
- H.264
- Advanced video coding (AVC)
- Scalable video coding (SVC)
- Scalability
- Real-time transport protocol (RTP)
- Packetization