Abstract
The inter-layer prediction (ILP) including intra, residual, and motion up-sampling operation in Scalable Video Coding (SVC) significantly increases the compression ratio compared to simulcast. The SVC Codec capable of processing the inter-layer prediction among multiple layers, however, requires much more memory and computational power than single-layer MPEG-4 AVC/H.264 Codec. This paper presents a fast and memory-efficient multithreading architecture for real-time MPEG-4 AVC/H.264 Scalable High profile decoder. Unlike existing approaches where multi-threaded video encoding and decoding have been performed within a frame or among frames, the designed algorithm utilizes inter-layer parallelism based on a group of macroblocks (GOM). Also, improved buffer management can be achieved by the proposed access unit (AU) based decoding architecture for enabling GOM-based inter-layer multithreading architecture. The proposed multithreading architecture has three properties: (1) scalable to the number of SVC layers, (2) no additional coding delay, and (3) no additional memory requirement. Experimental results show that the proposed multithreading architecture speeds up the decoding time of 3-layer extended spatial scalability sequences by about 36% on average, 3-layer coarse grain scalability 50%, and 5-layer medium grain scalability by about 102%, respectively, compared to a single-threaded SVC decoder.
Chapter PDF
Similar content being viewed by others
References
Wiegand, T., Noblet, L., Rovati, F.: Scalable Video Coding for IPTV services. IEEE Trans. Broadcasting 55(2), 527–538 (2009)
Schierl, T., Stockhammer, T., Wiegand, T.: Mobile video transmission using Scalable Video Coding. IEEE Trans. Circuits Syst. Video Technol. 17(9), 1204–1217 (2007)
ATSC Mobile DTV Standard, Part 7 - AVC and SVC Video System Characteristics: A/153 Part7:2009, ATSC (2009)
Choi, H., Shin, I.H., Lim, J.-S., Hong, J.W.: SVC application in advanced T-DMB. IEEE Trans. Broadcasting 55(1), 51–61 (2009)
Tan, P., Slevinsky, J.: Multi-screen IPTV enabling technologies and challenges. In: Proc. IEEE Int. Conf. Consumer Electronics, pp. 1–2 (2011)
Advanced video coding for generic audiovisual services: ITU-T Rec. H.264 and ISO/IEC 14496-10, ITU-T and ISO/IEC JTC 1 (2010)
Schwarz, H., Marpe, D., Wiegand, T.: Overview of the Scalable Video Coding extension of the H.264/AVC standard. IEEE Trans. Circuits Syst. Video Technol. 17(9), 1103–1120 (2007)
Generic Coding of Moving Pictures and Associated Audio Information Video: ITU-T Rec. H.262 and ISO/IEC 13818-2, ITU-T and ISO/IEC JTC 1 (2000)
Video Coding for Low Bit Rate Communication: ITU-T Rec. H.263, ITU-T (2005)
Coding of Audio-Visual Objects - Part 2 Visual: ISO/IEC 14496-2, ISO/IEC JTC 1 (2004)
Liu, H., Wang, Y.-K., Li, H.: A comparison between SVC and transcoding. IEEE Trans. Consumer Electronics 54(3), 1439–1446 (2008)
Kim, Y.-H., Yi, J.-Y., Choi, B.: Fast and memory-efficient up-sampling methods for H.264/AVC SVC with extended spatial scalability. IEEE Trans. Consumer Electronics 56(2) (2010)
Yi, J.-Y., Kim, Y.-H., Choi, B.: Fast and memory-efficient AU-based decoding method for H.264/AVC SVC. In: Proc. CEWIT, Incheon, Korea (2010)
Chuang, T.-D., Tsung, P.-K., Lin, P.-C., Chang, L.-M., Ma, T.-C., Chen, Y.-H., Chen, L.-G.: Low bandwidth decoder framework for H.264/AVC Scalable Extension. In: Proc. IEEE Int. Symp. Circuits and Systems, pp. 2960–2963 (2010)
van der Tol, E.B., Jaspers, E.G.T., Gelderblom, R.H.: Mapping of H.264 decoding on a multiprocessor architecture. In: Proc. SPIE Conf. on Image and Video Communications and Processing, pp. 707–718 (2003)
Chong, J., Satish, N., Catanzaro, B., Ravindran, K., Keutzer, K.: Efficient parallelization of H.264 decoding with macro block level scheduling. In: Proc. IEEE ICME, pp. 1874–1877 (2007)
Yang, S.-S., Wang, S.-W., Wu, J.-L.: A parallel algorithm for H.264/AVC deblocking filter based on limited error propagation effect. In: Proc. IEEE ICME, pp. 1858–1861 (2007)
Nishihara, K., Hatabu, A., Moriyoshi, T.: Parallelization of H.264 video decoder for embedded multicore processor. In: Proc. IEEE ICME, pp. 329–332 (2008)
Sihn, K.-H., Baik, H., Kim, J.-T., Bae, S., Song, H.J.: Novel approaches to parallel H.264 decoder on symmetric multicore systems. In: Proc. IEEE ICASSP, pp. 2017–2020 (2009)
Kim, D., Lee, V.W., Chen, Y.-K.: Image processing on multicore x86 architecture. IEEE Signal Processing Magazine 27(2), 97–107 (2010)
Su, Y.-C., Tsai, S.-F., Chuang, T.-D., Tsao, Y.-M., Chen, L.-G.: Mapping Scalable Video Coding decoder on multi-core stream processors. In: Proc. Picture Coding Symposium, pp. 1–4 (2009)
Reichel, J., Schwarz, H., Wien, M.: Joint Scalable Video Model 11 (JSVM 11): JVT, Geneva, CH, Doc. JVT-X202 (2007)
Lappalainen, V., Hallapuro, A., Hamalainen, T.D.: Complexity of optimized H.26L video decoder implementation. IEEE Trans. CSVT 13(7), 717–725 (2003)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Kim, YH., Park, J., Kim, JW. (2011). Multithreading Architecture for Real-Time MPEG-4 AVC/H.264 SVC Decoder. In: Ho, YS. (eds) Advances in Image and Video Technology. PSIVT 2011. Lecture Notes in Computer Science, vol 7088. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-25346-1_2
Download citation
DOI: https://doi.org/10.1007/978-3-642-25346-1_2
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-25345-4
Online ISBN: 978-3-642-25346-1
eBook Packages: Computer ScienceComputer Science (R0)