Skip to main content
SpringerLink
Log in

Complexity assessment of the intra prediction in Versatile Video Coding

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

The Versatile Video Coding (VVC) was finalized in July 2020 by the Joint Video Experts Team (JVET). During the standardization process, many coding techniques were investigated in order to provide superior coding efficiency with high level of versatility over the High Efficiency Video Coding (HEVC). Indeed, VVC achieved about 40% of bitrate saving compared to its predecessor for the same objective visual quality. However, its encoding complexity has considerably increased due to the exhaustive Rate-Distortion (RD) search. In this paper, a complexity assessment of the intra mode decision of VVC is presented. Experimental results reveal that the intra coding tools and the steps of intra mode decision have various degrees of complexity. Thus, opening up several complexity reduction opportunities, that yield up to 43% of complexity reduction. Also, VVC tends usually to select the 6 Most Probable Modes (MPMs). However, this selection may depend on the used intra coding tool and video texture characteristics. These conclusions give clear openings to accelerate the intra mode decision.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14

Similar content being viewed by others

Data Availability

Data sharing not applicable to this article as no datasets were generated or analysed during the current study.

References

  1. Akramullah S (2014) Digital video concepts, methods, and metrics: quality, compression, performance, and power trade-off analysis Springer Nature

  2. Bjontegaard G (2001) Document vceg-m33: calculation of average psnr differences between rd-curves. In: ITU-T VCEG Meeting, Austin, Texas, Technical Report

  3. Cao J., Tang N., Wang J., Liang F (2020) Texture-based fast cu size decision and intra mode decision algorithm for vvc. In: International conference on multimedia modeling, pp 739–751. Springer

  4. Chen Y, Yu L, Wang H, Li T, Wang S (2020) A novel fast intra mode decision for versatile video coding. J Vis Commun Image Represent 71:102849

    Article  Google Scholar 

  5. Cisco (2018) Cisco visual networking index: forecast and trends, 2017 to 2022. [online] available at https://cloud.report/whitepapers/cisco-visual-networking-index-forecast-and-trends-2017-2022/9017

  6. De-Luxán-Hernández S, George V, Ma J, Nguyen T, Schwarz H, Marpe D, Wiegand T (2019) An intra subpartition coding mode for vvc. In: 2019 IEEE international conference on image processing (ICIP), pp 1203–1207. IEEE

  7. JVET (2018) Vvcsoftware_vtm 8.0 reference software. [online] available at https://vcgit.hhi.fraunhofer.de/jvet/VVCSoftware_VTM/

  8. JVET (2019) JVET common test conditions and software reference configurations for SDR videos. Joint Video Exploration Team of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, JVET-B1010 (14th Meeting: Geneva,CH, 19 to 27)

  9. JVET (2020) AHG report: test model software development (AHG3). Joint Video Exploration Team of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11 (18th Meeting: by teleconference, 15 to 24, JVET-R0003)

  10. JVET (2020) AHG report: test model software development (AHG3). Joint Video Exploration Team of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, JVET-B1010 (19th Meeting, teleconference, July, JVET-S0003)

  11. Lainema J, Bossen F, Han WJ, Min J, Ugur K (2012) Intra coding of the hevc standard. IEEE Trans Circuits Syst Video Technol 22(12):1792–1801

    Article  Google Scholar 

  12. JVET (January 2020) Algorithm description for Versatile Video Coding and Test Model 8. ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 17th Meeting: Brussels BE 17

  13. Li Xea (2016) Multi-Type-Tree,document JVET-D0117. 4th JVET meeting,Chengdu CN

  14. Li J, Li B, Xu J, Xiong R (2017) Intra prediction using multiple reference lines for video coding. In: 2017 data compression conference (DCC), pp. 221–230. IEEE

  15. Mercat A, Mäkinen A, Sainio J, Lemmetti A, Viitanen M, Vanne J (2021) Comparative rate-distortion-complexity analysis of vvc and hevc video codecs. IEEE Access 9:67813–67828

    Article  Google Scholar 

  16. Pakdaman F, Adelimanesh MA, Gabbouj M, Hashemi MR (2020) Complexity analysis of next-generation vvc encoding and decoding arXiv:2005.10801

  17. Pfaff J, Filippov A, Liu S, Zhao X, Chen J, De-Luxan-Hernandez S, Wiegand T, Rufitskiy V, Ramasubramonian AK, Van der Auwera G (2021) Intra prediction and mode coding in vvc. IEEE Trans Circuits Syst Video Technol 31(10):3834 to 3847

    Article  Google Scholar 

  18. Reuze K, Philippe P, Deforges O, Hamidouche W (2016) Enhanced intra prediction modes signalling in hevc. In: 2016 Picture coding symposium, PCS 2016. Nuremberg, Germany. https://doi.org/10.1109/PCS.2016.7906387https://hal-univ-rennes1.archives-ouvertes.fr/hal-01622528

  19. Said A, Zhao X, Karczewicz M, Chen J, Zou F (2016) Position dependent prediction combination for intra-frame video coding. In: 2016 IEEE international conference on image processing (ICIP), pp 534–538. IEEE

  20. Saldanha M, Sanchez G, Marcon C, Agostini L (2020) Complexity analysis of vvc intra coding. In: 2020 IEEE international conference on image processing (ICIP), pp 3119–3123. IEEE

  21. Saldanha M, Sanchez G, Marcon C, Agostini L (2021) Performance analysis of vvc intra coding. J Vis Commun Image Represent 79:103202

    Article  Google Scholar 

  22. Schäfer M, Stallenberger B, Pfaff J, Helle P, Schwarz H, Marpe D, Wiegand T (2019) An affine-linear intra prediction with complexity constraints. In: 2019 IEEE international conference on image processing (ICIP), pp 1089–1093. IEEE

  23. Siqueira I, Correa G, Grellert M (2021) Complexity and coding efficiency assessment of the versatile video coding standard. In: 2021 IEEE international symposium on circuits and systems (ISCAS), pp 1–5. IEEE

  24. Sullivan GJ, Wiegand T (1998) Rate-distortion optimization for video compression. IEEE Signal Proc Mag 15(6):74–90

    Article  Google Scholar 

  25. Tissier A, Mercat A, Amestoy T, Hamidouche W, Vanne J, Menard D (2019) Complexity reduction opportunities in the future vvc intra encoder. In: 2019 IEEE 21st international workshop on multimedia signal processing (MMSP), pp 1–6. IEEE

  26. Yang H, Shen L, Dong X, Ding Q, An P, Jiang G (2019) Low complexity ctu partition structure decision and fast intra mode decision for versatile video coding. IEEE Transactions on Circuits and Systems for Video Technology

  27. Zouidi N, Belghith F, Kessentini A, Masmoudi N (2019) Fast intra prediction decision algorithm for the qtbt structure. In: 2019 IEEE international conference on design & test of integrated micro & Nano-Systems (DTS), pp 1–6. IEEE

  28. Zouidi N, Kessentini A, Belghith F, Masmoudi N (2020) Statistical analysis of the qtmt structure: intra mode decision. In: 2020 IEEE 4th International conference on image processing, applications and systems (IPAS), pp 180–185. IEEE. https://doi.org/10.1109/IPAS50080.2020.9334954

  29. Zouidi N, Kessentini A, Belgith F, Masmoudi N (2019) Statistical analysis of qtbt structure of versatile video coding encoded videos. In: 2019 16th International multi-conference on systems, signals & devices (SSD), pp 18–21. IEEE

Download references

Acknowledgements

This work is supported by the France Campus, and within a co-supervised thesis between the Institute of Electronics and Telecommunications of Rennes, france (IETR), and the Laboratory of Electronics and Information Technology (LETI) of Sfax, Tunisia.

Author information

Authors and Affiliations

  1. ENI Sfax - LETI and INSA Rennes - IETR, 20 Avenue of Buttes de Coesmes, 35708 cedex 7, Rennes, France

    Naima Zouidi

  2. ENI Sfax - LETI and ISIM Gabes, Road of Soukra, 3038, Sfax, Tunisia

    Amina Kessentini

  3. INSA Rennes - IETR, 20 Avenue of Buttes de Coesmes, 35708 cedex 7, Rennes, France

    Wassim Hamidouche & Daniel Menard

  4. ENI Sfax - LETI, Road of Soukra, 3038, Sfax, Tunisia

    Nouri Masmoudi

Authors
  1. Naima Zouidi
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Amina Kessentini
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Wassim Hamidouche
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Nouri Masmoudi
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Daniel Menard
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Naima Zouidi.

Ethics declarations

Conflict of Interests

This study was funded by France Campus with the PHC Maghreb project Eco-VVC (grant number 45988WG). N. Zouidi, A. Kessentini, W. Hamidouche N. Masmoudi and D. Menard declare that they have no conflict of interest.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zouidi, N., Kessentini, A., Hamidouche, W. et al. Complexity assessment of the intra prediction in Versatile Video Coding. Multimed Tools Appl 82, 27751–27770 (2023). https://doi.org/10.1007/s11042-023-14442-w

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-023-14442-w

Keywords

Search

Navigation