Skip to main content
SpringerLink
Log in

Fast and effective CU size decision based on spatial and temporal homogeneity detection

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

High-Efficiency Video Coding (HEVC) is the latest video coding standard of the Joint Collaborative Team on Video Coding (JCT-VC). HEVC noticeably improves compression performance when compared with previous standards such as H264, and represents a major step forward in video compression technology. However, this improvement is achieved by increasing the complexity of the encoding process. HEVC employs a novel flexible quad-tree coding block partitioning structure that enables the use of large and multi-sized coding, prediction, and transform blocks. This system is more efficient but also more computationally demanding. In this article an optimized CU size decision algorithm is proposed to reduce the computational cost of quad-tree partitioning by means of spatial and temporal homogeneity analysis and classification, which are directly applied to the input image. If a CU is classified as spatially or temporally homogeneous the quad-tree recursive process is stopped. Furthermore, this image pre-analysis is performed using logic units and embedded hardware on a GPU, thus avoiding unnecessary waiting states, so the computational cost associated with this process is zero for the processor in charge of the encoding process. In comparison with the reference HM16.2 test model, the encoding time is reduced by up to 32.69%, with negligible quality loss and a maximum BD-Rate increase of 1.2% for low-delay P configuration.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

Similar content being viewed by others

References

  1. Ahn S, Lee B, Kim M (2015) A novel fast CU encoding scheme based on spatio-temporal encoding parameters for HEVC inter coding. IEEE Trans Circuits Syst Video Technol 25(3):422–435

    Article  Google Scholar 

  2. Angelescu N (2015) Objective video quality assessment: using H264 and H265 codecs for 4K transmissions. In: Scientific Bulletin of the Electrical Engineering Faculty 1(29)

  3. Bjontegarrd G (2001) Calculation of average PSNR differences between RD curves. ITU-T SC16/Q6 13th VCEG meeting, Austin.

  4. Bossen F (2012) Common test conditions and software reference configurations. JCT-VC Document, JCTVC-K1100.

  5. Cho S, Kim M (2013) Fast CU splitting and pruning for suboptimal CU partitioning in HEVC intra coding. IEEE Trans Circuits Syst Video Technol 23(9):1555–1564

    Article  Google Scholar 

  6. Das I (1999) On characterizing the ‘knee’ of the Pareto curve based on normal-boundary intersection. Struct Multidiscip Optim 18:107

    Article  Google Scholar 

  7. He G, Zhou D, Goto S (2013) Transform-based fast mode and depth decision algorithm for hevc intra prediction. IEEE 10th International Conference on ASIC (ASICON), pp 1–4

  8. Intel Corporation (2016) Introduction to Advance Motion Extension for OpenCL https://software.intel.com/en-us/articles/intro-to-advanced-motion-estimation-extension-for-opencl

  9. Intel Corporation White Paper (2016) Performance Interactions of OpenCL* Code and Intel® Quick Sync Video on Intel® HD Graphics 4000.

  10. Jiang W, Ma H, Chen Y (2012) Gradient based fast mode decision algorithm for intra prediction in hevc. In: 2nd International Conference on Consumer Electronics, Communications and Networks (CECNet), pp 1836–1840

  11. Khan MUK, Shafique M, Grellert M, Henkel J (2013) Hardware-software collaborative complexity reduction scheme for the emerging hevc intra encoder. Design, Automation test in Europe Conference Exhibition (DATE), pp 125–128

  12. Khronos OpenCL Working Group (2016a) Online documentation for cl_intel_advaanced_motion_estimation https://www.khronos.org/registry/cl/extensions/intel/cl_intel_advanced_motion_estimation.txt

  13. Khronos OpenCL Working Group (2016b) The OpenCL Specification Version 1.1. Revision 44.

  14. Koumaras H, Kourtis M, Martakos D (2012) Benchmarking the encoding efficiency of h.265/hevc and h.264/avc. In: Future Network Mobile Summit (FutureNetw), July 2012

  15. Lee JH, Park CS, Kim BG, Jun DS, Jung SH, Choi JS (2013) Novel fast PU decision algorithm for the HEVC video standard. IEEE International Conference on Image Processing (ICIP).

  16. Lim K, Lee J, Kim S, Lee S (2015) Fast PU skip and split termination algorithm for HEVC intra. IEEE Transactions on Circuits Systems for Video Technology 25(8):1335

    Article  Google Scholar 

  17. X. Liu, Y. Liu, P. Wang, C. Lai, and H. Chao (2016) An adaptive mode decision algorithm based on video texture characteristics for HEVC intra prediction. IEEE Transactions on Circuits Systems for Video Technology, PP(99):1

  18. Mallikarachchi T, Fernando A, Arachchi H (2014) Efficient coding unit size selection based on texture analysis for hevc intra prediction. IEEE International Conference on Multimedia and Expo (ICME), pp 1–6

  19. McCann K, Rosewarne C, Bross B, Naccari M, Sharman K, Sullivan G (2014) High efficiency video coding (HEVC) encoder description 0v16 (HM16). JCT-VC High Efficiency Video Coding N14 703

  20. Mejia-Ocana A, de Frutos-Lopez M, Sanz-Rodriguez S, del Ama-Esteban O, Pelaez-Moreno C, Diaz-de Maria F (2011) Low-complexity motion-based saliency map estimation for perceptual video coding. In: 2nd National Conference on Telecommunications (CONATEL), pp 1–6

  21. Min B, Cheung R (2014) A fast cu size decision algorithm for hevc intra encoder. IEEE Trans Circ Syst Video Technol 25(99):1–1

    Google Scholar 

  22. Na S, Lee W, Yoo K (2014) Edge-based fast mode decision algorithm for intra prediction in hevc. IEEE International Conference on Consumer Electronics (ICCE), pp 11–14

  23. Shang X, Wang G, Fan T, Li Y (2015) Fast CU size decision and PU mode decision algorithm in HEVC intra coding. IEEE International Conference on Image Processing (ICIP)

  24. Shen L, Liu Z, Zhang Z, Shi X (2008) Fast inter mode decision using spatial property of motion field. IEEE Trans Multimedia 10(6):1208

    Article  Google Scholar 

  25. Shen L, Liu Z, Liu S, Zhang Z, An P (2009) Selective disparity estimation and variable size motion estimation based on motion homogeneity for multi-view coding. IEEE Trans Broadcast 55(4):761

    Article  Google Scholar 

  26. Shen L, Liu Z, Yan T, Zhang Z, An P (2010) View-adaptive motion estimation and disparity estimation for low complexity Multiview video coding. IEEE Trans Circ Syst Video Technol 20(6):925

    Article  Google Scholar 

  27. Shen L, Zhang Z, An P (2013a) Fast CU size decision and mode decision algorithm for HEVC intra coding. IEEE Trans Consum Electron 59(1):207

    Article  Google Scholar 

  28. Shen L, Liu Z, Zhang X, Zhao W, Zhang Z (2013b) An effective CU size decision method for HEVC encoders. IEEE Trans Multimedia 15(2):465

    Article  Google Scholar 

  29. Shen L, Zhang Z, Liu Z (2014) Effective CU size decision for HEVC intra coding. IEEE Trans Image Process 23(10):4232

    Article  MathSciNet  MATH  Google Scholar 

  30. Smith SW (1997) The scientist and Engineer's guide to digital signal processing, second edn. California Technical Publishing, San Diego

    Google Scholar 

  31. Sullivan G, Ohm J, Han W-J, Wiegand T (2012) Overview of the high efficiency video coding (hevc) standard. IEEE Trans Circuits Syst Video Technol 22(12):1649–1668

    Article  Google Scholar 

  32. Sze V, Budagavi M, Sullivan GJ (2014) High Efficiency Video Coding (HEVC), 1st ed. Springer International Publishing, [Online]. Available: http://www.springer.com/gp/book/9783319068947f

  33. Tian G, Goto S (2012) Content adaptive prediction unit size decision algorithm for hevc intra coding. In: Picture Coding Symposium (PCS), pp 405–408

  34. Ting Y-C, Chang T-S (2014) Gradient-based pu size selection for hevc intra prediction. IEEE International Symposium on Circuits and Systems (ISCAS), pp 1929–1932

  35. Wang H-M, Lin J-K, Yang J-F (2006) Fast inter mode decision based on hierarchical homogeneous detection and cost analysis for h.264/avc coders. In: IEEE International Conference on Multimedia and Expo, pp 709–712

  36. Wu D, Pan F, Lim K, Wu S, Li Z, Lin X, Rahardja S, Ko C (2005) Fast intermode decision in h.264/avc video coding. IEEE Trans Circ Syst Video Technol 15(7):953–958

    Article  Google Scholar 

  37. Xiong J, Li H, Wu Q, Meng F (2014a) A fast HEVC inter CU selection method based on pyramid motion divergence. IEEE Trans Multimedia 16(2):559

    Article  Google Scholar 

  38. Xiong J, Li H, Meng F, Zhu S, Wu Q, Zeng B (2014b) MRF-based fast HEVC inter CU decision with the variance of absolute differences. IEEE Trans Multimedia 16(8):2141–2153

    Article  Google Scholar 

  39. Xiong J, Li H, Meng F, Wu Q, Ngan KN (2015) Fast HEVC inter CU decision based on latent SAD estimation. IEEE Trans Multimedia 17(12):2147–2159

    Article  Google Scholar 

  40. xiph.Org (2017) Derf’s test media collection. https://media.xiph.org/video/derf/

  41. Ye T, Zhang D, Dai F, Zhang Y (2013) Fast mode decision algorithm for intra prediction in hevc. Proceedings of the Fifth International Conference on Internet Multimedia Computing and Service, In, pp 300–304

    Google Scholar 

  42. Zhang H, Ma Z (2014) Fast intra mode decision for high efficiency video coding (HEVC). IEEE Trans Circ Syst Video Technol 24(4):660–668

    Article  Google Scholar 

  43. Zhang H, Ma Z (2016) Fast intra mode and CU size decision for HEVC. IEEE Trans Circ Syst Video Technol 99:1–7

    Google Scholar 

  44. Zhang Y, Li Z, Li B (2012) Gradient-based fast decision for intra prediction in hevc. In: Visual Communications and Image Processing (VCIP), pp 1–6

Download references

Acknowledgements

This paper has been supported by the EU (FEDER) and the Spanish MINECO, under grants TIN 2015-65277-R and TIN2012-32180.

Author information

Authors and Affiliations

  1. Video Processing Department, Procesamiento Digital y Sistemas S.L (Prodys), Madrid, Spain

    D. G. Fernández

  2. Computer Architecture and Automation Department, Universidad Complutense de Madrid, Jose Garcia Santesmases 9, 28040, Madrid, Spain

    A. A. Del Barrio, G. Botella & C. García

Authors
  1. D. G. Fernández
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. A. A. Del Barrio
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. G. Botella
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. C. García
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to A. A. Del Barrio.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Fernández, D.G., Del Barrio, A.A., Botella, G. et al. Fast and effective CU size decision based on spatial and temporal homogeneity detection. Multimed Tools Appl 77, 5907–5927 (2018). https://doi.org/10.1007/s11042-017-4503-6

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-017-4503-6

Keywords

Search

Navigation