Abstract
In recent years, the state-of-the-art video coding standard – Versatile Video Coding (VVC) has been widely investigated. VVC achieves impressive performance by adopting more flexible partitioning method compared to its predecessor High Efficiency Video Coding (HEVC). However, the superior performance is realized at the expense of huge time consumption and increasing hardware costs, which obstructs its applications in real-time scenarios. To address this problem, we present a fast implementation for the decision process of the nested multi-type tree (QTMT) partitioning, and it significantly reduces the run-time of encoder while maintaining almost the same coding performance. Firstly, the inherent texture property of source frame is utilized to identify the prediction depth for Coding Tree Unit (CTU). Then, the spatial correlation is used to further narrow the depth range down. Finally, we skip unnecessary partition types according to the predicted Coding Unit (CU) depth, which is determined by the above predicted CTU depth and adjacent CU’s depth together. Experimental results demonstrate the effectiveness of our proposed method in VVC Test Model (VTM). Compared with the original implementation of the VTM4.0 anchor, the proposed algorithm achieves an average of 49.01% encoding time savings, accompanied by only an increase of 2.18% in Bj \(\phi\) ntegaard delta Bitrate (BDBR) and a loss of 0.138 dB in Bj \(\phi\) ntegaard delta PSNR (BDPSNR).
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Bross, B., Chen, J., Liu, S., Wang, Y.K.: versatile video coding editorial refinements on (Draft10). Document JVET-T2001. In: Joint Video Exploration Team (JVET), Teleconference (2020)
Bossen, F., Li, X., Suehring, K., Norkin, A.: AHG report: test model software development (AHG3). Document JVET-N0003. In: Joint Video Exploration Team (JVET), Geneva, CH (2019)
Shen, L., Zhang, Z., Liu, Z.: Effective CU size decision for HEVC intracoding. IEEE Trans. Image Process. 23(10), 4232–4241 (2014)
Lei, J., Li, D., Pan, Z., Sun, S., Kwong, S., Hou, C.: Fast intra prediction based on content property analysis for low complexity HEVC-based screen content coding. IEEE Trans. Broad. 63(1), 48–58 (2017)
Min, B., Cheung, R.C.C.: A fast CU size decision algorithm for the HEVC intra encoder. IEEE Trans. Circuits Syst. Video Technol. 25(5), 892–896 (2015)
Zhang, Y., Kwong, S., Wang, X., Yuan, H., Pan, Z., Xu, L.: Machine learning-based coding unit depth decisions for flexible complexity allocation in high efficiency video coding. IEEE Trans. Image Process. 24(7), 2225–2238 (2015)
Duanmu, F., Ma, Z., Wang, Y.: Fast mode and partition decision using machine learning for intra-frame coding in HEVC screen content coding extension. IEEE J. Emerg. Sel. Top. Circuits Syst. 6(4), 517–531 (2016). https://doi.org/10.1109/JETCAS.2016.2597698
Grellert, M., Zatt, B., Bampi, S., da Silva Cruz, A.: Fast coding unit partition decision for HEVC using support vector machines. IEEE Trans. Circuits Syst. Video Technol. 29(6), 1741–1753 (2019)
Liu, Z., Yu, X., Gao, Y., Chen, S., Ji, X., Wang, D.: CU partition mode decision for HEVC hardwired intra encoder using convolution neural network. IEEE Trans. Image Process. 25(11), 5088–5103 (2016)
Xu, M., Li, T., Wang, Z., Deng, X., Yang, R., Guan, Z.: Reducing complexity of HEVC: a deep learning approach. IEEE Trans. Image Process. 27(10), 5044–5059 (2018)
Yang, H., Shen, L., Dong, X., Ding, Q., An, P., Jiang, G.: Jiang: low-complexity CTU partition structure decision and fast intra mode decision for versatile video coding. IEEE Trans. Circuits Syst. Video Technol. 30(6), 1668–1682 (2020)
Cui, J., Zhang, T., Gu, C., Zhang, X., Ma, S.: Gradient-based early termination of CU partition in VVC intra coding. In: Data Compression Conference (DCC), pp. 103–112. IEEE (2020)
Fan, Y., Chen, J., Sun, H., Katto, J., Jing, M.: A fast QTMT partition decision strategy for VVC intra prediction. IEEE Access 8, 107900–107911 (2020)
Lu, X., Xiao, N., Hu, Y., Martin, G., Jin, X., Wu, Z.: A hierarchical fast coding unit depth decision algorithm for HEVC intra coding. In: Visual Communications and Image Processing (VCIP), pp. 1–4. IEEE (2016)
Bossen, F., Boyce, J., Suehring, K., Li, X., Seregin, V.: JVET common test conditions and software reference configurations for SDR video. Document JVET-N1010. In: Joint Video Exploration Team (JVET), Geneva, CH (2019)
Bjontegaard, G.: Calculation of average PSNR differences between rdcurves. Document VCEG-M33. In: ITU-T VCEG, Austin, Texas (2001)
Acknowledgement
This work was supported in part by National Natural Science Foundation of China under Grant 61771170.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Zhang, M., Chen, Y., Lu, X., Chen, H., Zhang, Y. (2021). Fast Coding Unit Partition Decision for Intra Prediction in Versatile Video Coding. In: Peng, Y., Hu, SM., Gabbouj, M., Zhou, K., Elad, M., Xu, K. (eds) Image and Graphics. ICIG 2021. Lecture Notes in Computer Science(), vol 12888. Springer, Cham. https://doi.org/10.1007/978-3-030-87355-4_58
Download citation
DOI: https://doi.org/10.1007/978-3-030-87355-4_58
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-87354-7
Online ISBN: 978-3-030-87355-4
eBook Packages: Computer ScienceComputer Science (R0)