Abstract
Conventional rate control algorithms allocate bits for every macroblock (MB) without consider whether it needs encoding, and they choose encoding mode only from the set provided by H.264/AVC standard. While, according to the human visual system (HVS) research, human eyes can only focus on one area in a frame, which is called region-of-interest (ROI). This phenomenon gives a chance to code all MBs unequally, especially for NROI MB, we may do not need encoded. In this paper, a ROI-based rate control algorithm for H.264/AVC video coding is proposed to improve the coding efficiency. After the ROI segmentation, the target bits are unequally allocated for each MB. For non-region-of-interest (NROI) MB coding, we proposed the Active MB Concealment (AMC) Mode in rate-distortion optimization (RDO). The AMC gives a tradeoff between the rate and distortion and improve the quality of the ROI MBs at the cost of the quality decreasing of the NROI MBs. Compared with the conventional rate control algorithms, the experimental results demonstrate that the proposed algorithm gives the better performance in terms of the average peak signal-to-noise ratio (PSNR) and the subjective evaluations, and maintains the smoothness of video quality.
Similar content being viewed by others
References
Bahri N, Masmoudi N (2012) Fast intra mode decision algorithm based on inter prediction mode for H264/AVC. Presented at 16th IEEE Mediterr Electrotechnical Conf pp. 848–851
Chen Z, Guillemot C (2010) Perceptually-friendly H.264/AVC video coding based on foveated just-noticeable-distortion model. IEEE Trans Circ Syst Vi Technol 20(6):806–819
Chiang JC, Hsieh CS, Chang G, Jou GD, Lie WN (2010) Region-of-interest based rate control scheme with flexible quality on demand. IEEE Int Conf Multimed Expo 238–242
Hrarti M, Saadane H, Larabi MC (2010) A macroblock-based perceptually adaptive bit allocation for H264 rate control. Presented at 5th Int Sympo I/V Commun Mob Netw 1–4
Hu HM, Li B, Lin W (2012) Region-based rate control for H.264/AVC for low bit-rate applications. IEEE Trans Circ Syst Vi Technol 22(11):1564–1576
Hu HM, Lin W, Li B, Sun MT (2011) A region-based rate control scheme using inter-layer information for H.264/SVC. J Vis Commun Image Represent 22(7):615–626
Kamaci N, AlRegib G (2011) Improved DCT coefficient distribution modeling for H.264-like video coders based on block classification. Presented at 18th IEEE Int Conf Image Process 1409–1412
Lee JY, Park HW (2012) A fast mode decision method based on motion cost and intra prediction cost for H.264/AVC. IEEE Trans Circ Syst Vi Technol 22(3):393–402
Li ZG, Pan F, Lim KP, Feng G, Lin X, Rahardja S (2003) Adaptive basic unit layer rate control for JVT. Presented at the 7th JVT Meeting, Pattaya II JVT-G012-rl Thailand
Li Z, Qin S, Itti L (2011) Visual attention guided bit allocation in video compression. Image Vis Comput 29(1):1–14
Li H, Wang Z, Cui HJ, Tang K (2006) An improved ROI-based rate control algorithm for H.264/AVC. Presented at the 8th Int Conf Signal Process 2
Li ZG, Xiao L, Zhu C, Feng P (2002) A novel rate control scheme for video over the internet. Proc IEEE Int Conf Acoust Speech Signal Process 2065–2068
Liu Y, Li ZG, Soh YC (2007) A novel rate control scheme for low delay video communication of H.264/AVC standard. IEEE Trans Circ Syst Vi Technol 17(1):68–78
Liu Y, Li ZG, Soh YC (2008) Region-of-interest based resource allocation for conversational video communication of H.264/AVC. IEEE Trans Circ Syst Vi Technol 18(1):134–139
Ma S, Li Z, Wu F (2003) Proposed draft of adaptive rate control. Presented at the 8th JVT Meeting, JVT-H017-r3 Geneva 20–26
Meng Q, Meng Q (2010) Improved macroblock-level rate control algorithm with visual properties. Presented at the 2nd Int Work Intel Syst Appl 1–5
Miao CH, Fan CP (2012) Boundary-aided extreme value detection based pre-processing algorithm for H.264/AVC fast intra mode prediction. IEEE Int Conf Commun Comput 623–627
Ou TS, Huang YH, Chen HH (2011) SSIM-based perceptual rate control for video coding. IEEE Trans Circ Syst Vi Technol 21(5):682–691
Jin R, Chen J (2009) The coding rate control of consistent perceptual video quality in H.264 ROI. Int Symp Comput Netw Multimed Technol 1–4
Shi YH, Yue SY, Yin BC (2008) A novel rate control scheme with region-of-interest concern. Presented at the 5th Int Conf Vis Inf Eng 634–637
Shi YH, Yue SY, Yin BC, Huo Y (2008) A novel ROI-based rate control scheme for h.264. Presented at the 9th Int Conf Young Comp Sci 77–81
Sun Y, Li DD, Ahmad I, Luo JC (2005) A rate control algorithm for wireless video transmission using perceptual tuning. Int Conf Inf Technol Coding Comput 1:109–114
Wang DY, Sun SX (2008) Region-based rate control and bit allocation on for video coding. Int Conf Apperceiving Comp IntellAnal 147–151
Wu GL, Fu YJ, Chien SY (2012) System design of perceptual quality-regulable H.264 video encoder. In Proc IEEE Int Conf Multimed Expo 509–514
Wu GL, Fu YJ, Chien SY (2012) Region-based perceptual quality regulable bit allocation and rate control for video coding applications. IEEE Vis Commun Image Process 1–6
Wu GL, Fu YJ, Huang SC (2013) Perceptual quality-regulable video coding system with region-based rate control scheme. IEEE Trans Image Proc 22(6):2247–2258
Zhang R, Regunathan SL, Rose K (2000) Video coding with optimal inter/intra-mode switching for packet loss resilience. IEEE J Sel Areas Commun 18(6):966–976
Acknowledgments
This study was supported in part by National Science Foundation of China 61372091, Natural Science Basic Research Plan in Shaanxi Province of China 2014JM8318, and the Fundamental Research Funds for the Central Universities.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Li, F., Li, N. Region-of-interest based rate control algorithm for H.264/AVC video coding. Multimed Tools Appl 75, 4163–4186 (2016). https://doi.org/10.1007/s11042-015-2465-0
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-015-2465-0