Skip to main content
SpringerLink
Log in

Fast mode decision algorithm for H.264/SVC enhancement layer

  • Special Issue Paper
  • Published:
Journal of Real-Time Image Processing Aims and scope Submit manuscript

Abstract

Scalable video coding (SVC) has been standardized to extend the capabilities of the H.264 advanced video coding (AVC). The SVC can compress several video sequences of various resolutions as a single bit-stream. In the SVC enhancement layer, for Joint Scalable Video Model (JSVM) software implementation, an exhaustive mode decision process based on the base layer mode predictions is performed to obtain the best mode for each macroblock (MB). This technique may achieve a higher coding efficiency; however, it induces a significant computational complexity in the encoding engine. In order to speedup the SVC encoder, a fast mode decision algorithm was proposed in this paper. In other words, our aim was to decrease the number of candidate modes to reduce the computational complexity and maintain the same level of coding efficiency, this approach used the spatial and temporal correlation between MB situated at the enhancement layer and its co-located MB at the base layer. Our statistical analyses were made using several HD sequences with different motion characteristics. Experimental results show a significant improvement in terms of time encoding which is a major constraint for any real-time implementation. However, this gain is accompanied with an acceptable loss in video quality and a tolerable bit rate increase for most media supports. In fact, our proposed algorithm permits a major improvement that can reach up to 64.9 % in terms of computational effort. This gain will induce an average loss yield to 10.5 or 13.87 % that is comparable to the 13.12 % of the He Li’s algorithm with an acceptable loss in terms of subjective video quality.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

Similar content being viewed by others

References

  1. Wiegand, T., Sullivan, G.J., Bjontegaard, G., Luthra, A.: Overview of the H.264/AVC video coding standard. In: Proceedings of the IEEE Transactions on Circuits and Systems for Video Technology, vol. 13, pp. 560–576

  2. Richardson, L.E.G.: H.264 and MPEG-4 video compression: video coding for next-generation multimedia. Wiley, New York

  3. Schwarz, H., Marpe, D., Wiegand, T.: SVC Core Experiment 2.1: inter-layer prediction of motion and residual data. In: ISO/IEC JTC1/SC29/WG11 M11043 (2004)

  4. Reichel, J., Schwarz, H., Wien, M.: Joint Scalable Video Model (JSVM) 2.0 Reference Encoding Algorithm Description. ISO/IEC JTC1/SC29/WG11 N7084, Busan (2005)

  5. Schwarz, H., Marpe, D., Wiegand, T.: Constrained inter-layer prediction for single-loop decoding in spatial scalability. In: Proceedings of the IEEE International on Image Processing (ICIP), Genoa, vol. 2, pp. 870–873 (2005)

  6. Li, X., Amon, P., Hutter, A., Kaup, A.: Performance analysis of inter-layer prediction in scalable video coding extension of H.264/AVC. In: Proceedings of the IEEE Transactions on Broadcasting, vol. 57, no. 1 (2011)

  7. Ohm, J.-R.: Advances in scalable video coding. In: Proceedings of IEEE, vol. 93, no. 1, pp. 42–56; 2005

  8. Kessentini, A., Werda, I., Samet, A., Ben Ayed, M.A., Masmoudi, N.: H.264/SVC performance and encoder bit-stream analysis. In: Proceedings of the International Journal of Computer Applications (0975-8887), vol. 36, no. 8 (2011)

  9. Schwarz, H., Marpe, D., Wiegand, T.: Overview of the scalable video coding extension of the H.264/AVC standard. In: Proceedings of the IEEE Transactions on Circuits and Systems for video Technology (2007)

  10. Segall, C.A., Sullvian, G.J.: Spatial scalability within the H.264/AVC scalable video coding extension. In: Proceedings of the IEEE Transactions on Circuits and Systems for Video Technology, vol. 17, no. 9 (2007)

  11. Wien, M., Schwarz, H., Oelbaum, T.: Performance analysis of SVC. In: Proceedings of the IEEE Transactions on Circuits and Systems for video Technology, vol. 17, no. 9 (2007)

  12. Wang, T.-H., Chen, M.-J., Chi, M.-C.: Computation-scalable algorithm for scalable video coding. In: Proceedings of the IEEE Transactions on Consumer Electronics, vol. 57, no. 3 (2011)

  13. Jung, S.W., Baek, S.J., Park, C.S., Ko, S.J.: Fast mode decision using all-zero block detection for fidelity and spatial scalable video coding. In: Proceedings of the IEEE Transactions on Circuits and Systems for Video Technology, vol. 20, no. 4, pp. 201–206 (2010)

  14. Lin, H.C., Peng, W.H., Hang, H.M.: Fast context-adaptive mode decision algorithm for scalable video coding with combined coarse-grain quality scalability (CGS) and temporal scalability. In: Proceedings of the IEEE Transactions Circuits and Systems for Video Technology, vol. 20, no. 5, pp. 732–748 (2010)

  15. Park, C.S., Baek, S.J., Yoon, M.S., Kim, H.K., Ko, S.J.: Selective inter-layer residual prediction for SVC-based video streaming. In: Proceedings of the IEEE Transactions on Consumer Electronics, vol. 55, no. 1, pp. 235–239 (2009)

  16. Yeh, C.H., Fan, K.J., Chen, M.J., Li, G.L.: Fast mode decision algorithm for scalable video coding using Bayesian theorem detection and Markov process. In: Proceedings of the Transactions Circuits and Systems for Video Technology, vol. 20, no. 4, pp. 563–574 (2010)

  17. Lee, B.S., Kim, M.C., Hahm, S.J., Park, C.S., Park, K.S.: A fast mode selection scheme in inter-layer prediction of H.264 scalable extension coding. In: Proceedings of the IEEE International Symposium on Broadband Multimedia Systems Broadcasting, pp. 1–5 (2008)

  18. Na, S., Kyung, C.M.: A multi-layer motion estimation scheme for spatial scalability in H.264/AVC scalable extension. In: Proceedings of the IEEE International Conference on Multimedia and Expo, pp. 69–72 (2009)

  19. Zhou, X., Yuan, C., Li, C., Zhong, Y.: Fast mode decision for P-slices in H.264/AVC based on probabilistic learning. In: Proceedings of the 11th International Conference on Advanced Communication Technology, pp. 1180–1184 (2009)

  20. Jo, Y., You, J., Kim, W., Jeong, J.: Fast mode decision algorithm using efficient block skip techniques for H.264 P slices. In: Proceedings of the First International Conference on Advances in Multimedia, pp. 92–97 (2009)

  21. Zeng, H., Cai, C., Ma, K.-K.: Fast mode decision for H.264/AVC based on macroblock motion activity. In: Proceeding of the IEEE Transactions, vol. 19, no. 4, pp. 1–11 (2009)

  22. Li, H., Li, Z.G., Wen, C.: Fast mode decision algorithm for inter-frame coding in fully scalable video coding. In: Proceedings of IEEE Transactions on Circuits and Systems for Video Technology, vol. 16, no. 7 (2006)

  23. Sun, X., Xiao, S., Du, J., Hu, M.: Fast mode decision algorithm for H.264/SVC based on motion vector relation analysis. In: Proceedings of the 7th International Conference on Intelligent Information Hiding and Multimedia Signal Processing (2011)

  24. Lim, S., Yang, J., Jeon, B.: Fast coding mode decision for scalable video coding. In: Proceedings of the 10th International Conference on Advanced Communication Technology, ICACT (2008)

  25. Kim, S.-T., Konda, K.R., Cho, C.-S.: Fast mode decision algorithm for spatial and SNR scalable video coding. In: Proceedings of the IEEE International Symposium on Circuits and systems, ISCAS (2009)

  26. Huang, A., Lin, X., Chen, Y.: Fast mode decision algorithm for spatial and coarse grain quality scalable video coding. In: Proceedings of the Computer Network and Multimedia Technology, CNMT (2009)

  27. Kim, T.-J., Kim, B.-G., Cha, E.-J., Suh, J.-W.: Fast mode decision for H.264/AVC SE with combined scalability. In: Proceedings of the IEEE International Conference on Consumer Electronics, ICCE (2011)

  28. Chang, K., Qin, T., Zheng, J.: Fast mode decision for scalable video coding with spatial scalability. In: Proceedings of the 7th International Conference on Wireless Communications, Networking and Mobile Computing, WICOM (2011)

  29. Van Leuven, S., Van Wallendael, G., De wolf, K., De Cock, J., Lambert, P., Van de Walle, R.: An enhanced fast mode decision model for spatial enhancement layers in scalable video coding. In: Proceedings of Springer Journal on Multimedia Tools and Applications, vol. 58, no. 1, pp. 215–237 (2012)

  30. Lee, B., Kim, M.: An efficient inter-prediction mode decision method for temporal scalability coding with hierarchical B-picture structure. In: Proceedings of the IEEE transactions on Broadcasting, vol 58, no. 2 (2012)

  31. Kim, T.-J., Hong, J.-E., Suh, J.W.: Fast mode decision for combined scalable video coding based on the block complexity function. In: Proceedings of the IEEE Transactions on Consumer Electronics, vol. 57, no. 1 (2011)

  32. Lu, X., Martin, G.R.: A hierarchical mode decision scheme for fast implementation of spatially scalable video coding. In: Proceedings of the IEEE International Conference visual Communications and Image Processing (VCIP), pp. 1–6 (2012)

  33. Lee, B., Kim, M.: A low complexity mode decision method for spatial scalability coding. In: Proceedings of the IEEE Transactions on Circuits and Systems for Video Technology, vol. 21, no. 1 (2011)

  34. Joint Scalable Video Model (JSVM) 9.17 Software, JVT of ITU-T VCEG and ISO/IEC MPEG, March 2009 (Online Hong) garcon.ient.rwth-aachen.de

  35. Wien, M., Schwarz, H.: Testing conditions for SVC coding efficiency and JSVM performance evaluation, Joint Video Team (JVT) of ISO/IEC MPEG & ITU-T VCEG, Doc. JVT-Q205 (2005)

  36. Scwarz, H., Wiegand, T.: Further results for an RD-optimized multi-loop SVC encoder (JVT-W071). In: JVT Meeting (Joint Video Team of ISO/IEC MPEG & ITU-T VCEG, San Jose (2007)

  37. Bjontegaard, G.: Calculation of average PSNR differences between RD-curves Doc. VCEG-M33, Austin (2001)

Download references

Author information

Authors and Affiliations

  1. Electronics and Information Technology Laboratory, National Engineering School of Sfax, University of Sfax, Sfax, Tunisia

    Amina Kessentini, Amine Samet, Mohamed Ali Ben Ayed & Nouri Masmoudi

  2. High Institute of Electronics and Communication Sfax, University of Sfax, Sfax, Tunisia

    Amine Samet & Mohamed Ali Ben Ayed

Authors
  1. Amina Kessentini
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Amine Samet
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Mohamed Ali Ben Ayed
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Nouri Masmoudi
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Amina Kessentini.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Kessentini, A., Samet, A., Ben Ayed, M.A. et al. Fast mode decision algorithm for H.264/SVC enhancement layer. J Real-Time Image Proc 11, 385–400 (2016). https://doi.org/10.1007/s11554-013-0362-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11554-013-0362-1

Keywords

Search

Navigation