Skip to main content

Fast Coding Unit Partition Decision for Intra Prediction in Versatile Video Coding

  • Conference paper
  • First Online:
Image and Graphics (ICIG 2021)

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 12888))

Included in the following conference series:

Abstract

In recent years, the state-of-the-art video coding standard – Versatile Video Coding (VVC) has been widely investigated. VVC achieves impressive performance by adopting more flexible partitioning method compared to its predecessor High Efficiency Video Coding (HEVC). However, the superior performance is realized at the expense of huge time consumption and increasing hardware costs, which obstructs its applications in real-time scenarios. To address this problem, we present a fast implementation for the decision process of the nested multi-type tree (QTMT) partitioning, and it significantly reduces the run-time of encoder while maintaining almost the same coding performance. Firstly, the inherent texture property of source frame is utilized to identify the prediction depth for Coding Tree Unit (CTU). Then, the spatial correlation is used to further narrow the depth range down. Finally, we skip unnecessary partition types according to the predicted Coding Unit (CU) depth, which is determined by the above predicted CTU depth and adjacent CU’s depth together. Experimental results demonstrate the effectiveness of our proposed method in VVC Test Model (VTM). Compared with the original implementation of the VTM4.0 anchor, the proposed algorithm achieves an average of 49.01% encoding time savings, accompanied by only an increase of 2.18% in Bj \(\phi\) ntegaard delta Bitrate (BDBR) and a loss of 0.138 dB in Bj \(\phi\) ntegaard delta PSNR (BDPSNR).

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 109.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 139.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Bross, B., Chen, J., Liu, S., Wang, Y.K.: versatile video coding editorial refinements on (Draft10). Document JVET-T2001. In: Joint Video Exploration Team (JVET), Teleconference (2020)

    Google Scholar 

  2. Bossen, F., Li, X., Suehring, K., Norkin, A.: AHG report: test model software development (AHG3). Document JVET-N0003. In: Joint Video Exploration Team (JVET), Geneva, CH (2019)

    Google Scholar 

  3. Shen, L., Zhang, Z., Liu, Z.: Effective CU size decision for HEVC intracoding. IEEE Trans. Image Process. 23(10), 4232–4241 (2014)

    Article  MathSciNet  Google Scholar 

  4. Lei, J., Li, D., Pan, Z., Sun, S., Kwong, S., Hou, C.: Fast intra prediction based on content property analysis for low complexity HEVC-based screen content coding. IEEE Trans. Broad. 63(1), 48–58 (2017)

    Article  Google Scholar 

  5. Min, B., Cheung, R.C.C.: A fast CU size decision algorithm for the HEVC intra encoder. IEEE Trans. Circuits Syst. Video Technol. 25(5), 892–896 (2015)

    Article  Google Scholar 

  6. Zhang, Y., Kwong, S., Wang, X., Yuan, H., Pan, Z., Xu, L.: Machine learning-based coding unit depth decisions for flexible complexity allocation in high efficiency video coding. IEEE Trans. Image Process. 24(7), 2225–2238 (2015)

    Article  MathSciNet  Google Scholar 

  7. Duanmu, F., Ma, Z., Wang, Y.: Fast mode and partition decision using machine learning for intra-frame coding in HEVC screen content coding extension. IEEE J. Emerg. Sel. Top. Circuits Syst. 6(4), 517–531 (2016). https://doi.org/10.1109/JETCAS.2016.2597698

    Article  Google Scholar 

  8. Grellert, M., Zatt, B., Bampi, S., da Silva Cruz, A.: Fast coding unit partition decision for HEVC using support vector machines. IEEE Trans. Circuits Syst. Video Technol. 29(6), 1741–1753 (2019)

    Article  Google Scholar 

  9. Liu, Z., Yu, X., Gao, Y., Chen, S., Ji, X., Wang, D.: CU partition mode decision for HEVC hardwired intra encoder using convolution neural network. IEEE Trans. Image Process. 25(11), 5088–5103 (2016)

    Article  MathSciNet  Google Scholar 

  10. Xu, M., Li, T., Wang, Z., Deng, X., Yang, R., Guan, Z.: Reducing complexity of HEVC: a deep learning approach. IEEE Trans. Image Process. 27(10), 5044–5059 (2018)

    Article  MathSciNet  Google Scholar 

  11. Yang, H., Shen, L., Dong, X., Ding, Q., An, P., Jiang, G.: Jiang: low-complexity CTU partition structure decision and fast intra mode decision for versatile video coding. IEEE Trans. Circuits Syst. Video Technol. 30(6), 1668–1682 (2020)

    Article  Google Scholar 

  12. Cui, J., Zhang, T., Gu, C., Zhang, X., Ma, S.: Gradient-based early termination of CU partition in VVC intra coding. In: Data Compression Conference (DCC), pp. 103–112. IEEE (2020)

    Google Scholar 

  13. Fan, Y., Chen, J., Sun, H., Katto, J., Jing, M.: A fast QTMT partition decision strategy for VVC intra prediction. IEEE Access 8, 107900–107911 (2020)

    Article  Google Scholar 

  14. Lu, X., Xiao, N., Hu, Y., Martin, G., Jin, X., Wu, Z.: A hierarchical fast coding unit depth decision algorithm for HEVC intra coding. In: Visual Communications and Image Processing (VCIP), pp. 1–4. IEEE (2016)

    Google Scholar 

  15. Bossen, F., Boyce, J., Suehring, K., Li, X., Seregin, V.: JVET common test conditions and software reference configurations for SDR video. Document JVET-N1010. In: Joint Video Exploration Team (JVET), Geneva, CH (2019)

    Google Scholar 

  16. Bjontegaard, G.: Calculation of average PSNR differences between rdcurves. Document VCEG-M33. In: ITU-T VCEG, Austin, Texas (2001)

    Google Scholar 

Download references

Acknowledgement

This work was supported in part by National Natural Science Foundation of China under Grant 61771170.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Menglu Zhang .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Zhang, M., Chen, Y., Lu, X., Chen, H., Zhang, Y. (2021). Fast Coding Unit Partition Decision for Intra Prediction in Versatile Video Coding. In: Peng, Y., Hu, SM., Gabbouj, M., Zhou, K., Elad, M., Xu, K. (eds) Image and Graphics. ICIG 2021. Lecture Notes in Computer Science(), vol 12888. Springer, Cham. https://doi.org/10.1007/978-3-030-87355-4_58

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-87355-4_58

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-87354-7

  • Online ISBN: 978-3-030-87355-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics