Skip to main content
SpringerLink
Log in

Optimal CTU-level bit allocation in HEVC for low bit-rate applications

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

The coding efficiency of High Efficiency Video Coding (HEVC) outperforms all the past video coding standards. But for low bit-rate video applications, fewer bits cannot guarantee the reconstructed quality of each coding frame. Rate control is used to get better quality with fewer bits, while the bit allocation is the key of rate control. This paper proposes an optimal CTU-level bit allocation based on region classification in HEVC for low bit-rate applications. The motion regions are extracted in each frame from the CTU-level. The bits allocated to the CTUs belong to the motion regions will be calculated according to the motion vectors of CTUs and the overall frames to improve the quality of these CTUs. Finally, the R-lambda model rate control adopted in HM16.0 will be used to calculate QP of each CTU. Experimental results demonstrate that the proposed bit allocation approach can achieve an average improvement of 0.32 dB in objective quality compared with the conventional rate control adapted in HM16.0, and the subjective quality improves obviously and the accuracy of rate control is also good.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

Similar content being viewed by others

References

  1. Boyce JM, Ye Y, Chen J, Ramasubramonian AK (2016) Overview of SHVC: scalable extensions of the high efficiency video coding standard. IEEE Trans Circuits Syst Video Technol 26(1):20–34

    Article  Google Scholar 

  2. Choi H, Nam J, Yoo J, Sim D, Bajic I (2012) Rate control based on unified RQ model for HEVC, JCTVC-H0213, JCTVC of ISO/IEC and ITU-T, 8th meeting CA, USA

  3. Doulamis N (1998) A. Doulamis, D. Kalogeras and S. Kollias, low bit-rate coding of image sequence using adaptive regions of interest. IEEE Trans. Circuits Syst. Video Technol. 8(8):928–934

    Article  Google Scholar 

  4. Elkapelli SS, Damahe LB (2016) “A review: region of interest based image retrieval”, Online International Conference on Green Engineering and Technologies, pp. 1–6

  5. HEVC Reference Software (HM16.0). Available: https://hevc.hhi.fraunhofer.de/trac/hevc/browser#tags. Accessed Oct 2016

  6. Kim I, McCann K, Sugimoto K, Bross B, Han W (2012) “HM9: High Efficiency Video Coding (HEVC) Test Model 9 Encoder Description,” JCTVC-K1002, JCTVC of ISO/IEC and ITU-T, Shanghai, China

  7. Kuo C, Shih Y, Yang S (2016) Rate control via adjustment of Lagrange multiplier for video coding. IEEE Trans. Circuits Syst. Video Technol. 26(11):2069–2078

    Article  Google Scholar 

  8. Lan X, Ma AJ, Yuen PC (2014) “Multi-cue visual tracking using robust feature-level fusion based on joint sparse representation”, 2014 IEEE Conference on Computer Vision and Pattern Recognition, 1194–1201

  9. Lan X, Ma AJ, Yuen PC, Chellappa R (2015) Joint sparse representation and robust feature-level fusion for multi-cue visual tracking. IEEE Trans. Image Processing 24(12):5826–5841

    Article  MathSciNet  MATH  Google Scholar 

  10. Lan X, Zhang S, Yuen PC, Chellappa R (2018) Learning common and feature-specific patterns: a novel multiple-sparse-representation-based tracker. IEEE Trans. Image Processing 27(4):2022–2037

    Article  MathSciNet  MATH  Google Scholar 

  11. Lan X, Ye M, Shao R, Zhou H, Yuen PC Modality-correlation-aware sparse representation for RGB-intrared object tracking. Pattern Recognition Letter. https://doi.org/10.1016/j.patrec.2018.10.002

  12. Lan X, Ye M, Shao R, Zhong B Pong C. Yuen, H. Zhou, “learning modality-consistency feature templates: a robust RGB-infrared tracking system”. IEEE Trans Industrial Electronics. https://doi.org/10.1109/TIE.2019.2898618

  13. Lei J, Feng K, Wu M, Li S, Hou C (2014) Rate control of hierarchical B prediction structure for multiview video coding. IEEE Trans Multimedia Tools and Applications 72(1):825–842

    Article  Google Scholar 

  14. Li B, Li H, Li L, Zhang J (2012) “Rate control by R-lambda model for HEVC,” JCTVC-K0103, JCTVC of ISO/IEC and ITU-T, 11th meeting Shanghai, China

  15. Li B, Li HQ, Li L, Zhang JL (2014) λ domain rate control algorithm for high efficiency video coding. IEEE Trans Image Processing 23(9):3841–3854

    Article  MathSciNet  MATH  Google Scholar 

  16. Li L, Li B, Liu D, Li HQ (2016) Lambda-domain rate control algorithm for HEVC scalable extension. IEEE Trans. Multimedia 18(10):2023–2039

    Article  Google Scholar 

  17. Li S, Xu M, Wang Z, Sun X (2017) Optimal bit allocation for CTU level rate control in HEVC. IEEE Trans. Circuits Syst. Video Technol. 27(11):2409–2424

    Article  Google Scholar 

  18. Lu Z, Lin W, Yang X (2005) Modeling visual attention’s modulatory aftereffects on visual sensitivity and quality evaluation. IEEE Trans. Image Processing 14:1928–1942

    Article  Google Scholar 

  19. Park S, Park J, Jeon B (2011) “Report on the evaluation of HM versus JM,” JCTVC-D181, JCTVC of ISO/IEC and ITU-T, Daegu, Korea

  20. Shao F, Jiang G, Lin W, Yu M, Dai Q (2013) Joint bit allocation and rate control for coding multi-view video plus depth based 3D video. IEEE Trans Multimedia 15(8):1843–1854

    Article  Google Scholar 

  21. Si J, Ma S, Gao W (2013) “Efficient bit allocation and CTU level rate control for high efficiency video coding,” Picture Coding Symposium, 89–92

  22. Tian L, Zhou Y, Cao X (2014) “A new rate-complexity-QP algorithm (RCQA) for HEVC intra-picture rate control,” IEEE Internatianal Conference on Computing, Networking and Communications, Multimedia Computing and Communicaitons Symposium

  23. Wang H, Liang Y, El-Maleh K (2006) Real-time region-of-interest video coding using content-adaptive background skipping with dynamic bit reallocation. IEEE International Conference on Acoustics, Speech and Signal Processing 2:14–19

    Google Scholar 

  24. Won CS, Shirani S (2011) Size-controllable region-of-interest in scalable image representation. IEEE Trans Image Process 20(5):1273–1280

    Article  MathSciNet  MATH  Google Scholar 

  25. Zeng H, Yang A, Ngan KN, Wang M (2016) Perceptual sensitivity-based rate control method for high efficiency video coding. IEEE Trans. Multimedia Tools and Applications 75(17):10383–10396

    Article  Google Scholar 

  26. Zhang Z, Jing T, Han J, Xu Y, Zhang F (2017) A new rate control scheme for video coding based on region of interest. IEEE Access 5:13677–13688

    Article  Google Scholar 

  27. Zhou Y, Tian L, Ning X (2013) “Intra frame constant rate control scheme for high efficiency video coding,” IEEE Internatianal Conference on Computing, Networking and Communications, Multimedia Computing and Communicaitons Symposium

Download references

Funding

This work was supported by the National Science Fund for Distinguished Young Scholars, under Grant 61502277 and 61502278.

Author information

Authors and Affiliations

  1. School of Information Science and Electric Engineering, Shandong Jiao Tong University, Jinan, 250357, China

    Peng Wang, Cui Ni & Guangyuan Zhang

  2. Shandong Province Key Laboratory of Wisdom Mine Information Technology, Shandong University of Science and Technology, Qingdao, 266590, China

    Zhe Li

Authors
  1. Peng Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Cui Ni
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Zhe Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Guangyuan Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Cui Ni.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Wang, P., Ni, C., Li, Z. et al. Optimal CTU-level bit allocation in HEVC for low bit-rate applications. Multimed Tools Appl 78, 23733–23747 (2019). https://doi.org/10.1007/s11042-019-7680-7

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-019-7680-7

Keywords

Search

Navigation