Abstract
The H.264/AVC video coding standard uses an intra prediction mode with 4×4 and 16×16 blocks for luma and 8×8 blocks for chroma. This standard uses the rate distortion optimization (RDO) method to determine the best coding mode based on the compression performance and video quality. This method offers a large improvement in coding efficiency compared to other compression standards, but the computational complexity is greater due to the various intra prediction modes. This paper proposes a fast intra mode decision algorithm for real-time encoding of H.264/AVC based on the dominant edge direction (DED). The DED is extracted using pixel value summation and subtraction in the horizontal and vertical directions. By using the DED, three modes instead of nine are chosen for RDO calculation to decide on the best mode in the 4×4 luma block. For the 16×16 luma and the 8×8 chroma, only two modes are chosen instead of four. Experimental results show that the entire encoding time saving of the proposed algorithm is about 67% compared to the full intra search method with negligible loss of quality.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Bjontegaard, G., 2001. Calculation of Average PSNR Difference between RDCurve. ITU-T Q.6/16, Doc. VCEGM33.
Chen, J.W., Chang, C.H., Lin, C.C., Ouyang, Y.H., Guo, J.I., Wang, J.S., 2006. A Condition-based Intra Prediction Algorithm for H.264/AVC. Proc. IEEE Int. Conf. on Multimedia and Expo, p.1077–1080. [doi:10.1109/ICME.2006.262721]
Gao, S, Lu, T.J., 2006. An Improved Fast Mode Decision Algorithm in H.264 for Video Communications. Int. Symp. on Systems and Control in Aerospace and Astronautics, p.57–60. [doi:10.1109/ISSCAA.2006.1627702]
Kim, J., Jeon, K., Jeong, J., 2006. H.264 Intra mode decision for reducing complexity using directional masks and neighboring modes. LNCS, 4319:959–968.
Lee, J., Jeon, B., 2004. Fast Mode Decision for H.264. Proc. IEEE Int. Conf. on Multimedia and Expo, 2:1131–1134.
Liao, N., Quan, Z.Y., Men, A.D., 2005. Enhanced Fast Mode Decision Based on Edge Map and Motion Detail Analysis for H.264/JVT. IEEE Int. Workshop on VLSI Design and Video Technology, p.187–190. [doi:10.1109/IWVDVT.2005.1504582]
Meng, B., Au, O.C., 2003. Fast Intra-prediction Mode Selection for 4×4 Blocks in H.264. IEEE Int. Conf. on Acoustics, Speech, and Signal Processing, 3:389–392.
Pan, F., Lin, X., Rahardja, S., Lim, K.P., Li, Z.G., Wu, D., Wu, S., 2005. Fast mode decision algorithm for intra prediction in H.264/AVC video coding. IEEE Trans. Circuits Syst. Video Technol., 15(7):813–822. [doi:10.1109/TCSVT.2005.848356].
Rehman, J., Zhang, Y., Kumarayapa, A., 2007. Fast Intra Prediction Mode Decision by Adaptively Selecting Fewer Number of Modes. Int. Conf. on Machine Learning and Cybernetics, p.2385–2389. [doi:10.1109/ICMLC.2007.4370544]
Richardson, I.E.G., 2004. H.264 and MPEG-4 Video Compression. The Robert Gordon University, Aberdeen.
Storey, D., Nasiopoulos, P., 2006. An Efficient Statistical Intra-mode Prediction Method for H.264. IEEE Int. Symp. on Signal Processing and Information Technology, p.803–806. [doi:10.1109/ISSPIT.2006.270908]
Su, R., Liu, G.Z., Zhang, T.Y., 2006. Fast Mode Decision Algorithm for Intra Prediction in H.264/AVC. Proc. IEEE Int. Conf. on Acoustics, Speech and Signal Processing, 2:921–924. [doi:10.1109/ICASSP.2006.1660494]
Sullivan, G.J., Wiegand, T., 1998. Rate-distortion optimization for video compression. IEEE Signal Processing Mag., 15(6):74–90. [doi:10.1109/79.733497].
Tseng, C.H., Wang, H.M., Yang, J.F., 2006. Enhanced intra-4×4 mode decision for H.264/AVC coders. IEEE Trans. Circuits Syst. Video Technol., 16(8):1027–1032. [doi:10.1109/TCSVT.2006.878146].
Wang, J.C., Wang, J.F., Yang, J.F., Chen, J.T., 2007. A fast mode decision algorithm and its VLSI design for H.264/AVC intra-prediction. IEEE Trans. Circuits Syst. Video Technol., 17(10):1414–1422. [doi:10.1109/TCSVT.2007.903786].
Wang, J.F., Wang, J.C., Chen, J.T., Tsai, A.C., Paul, A., 2006. A Novel Fast Algorithm for Intra Mode Decision in H.264/AVG Encoders. IEEE Int. Symp. on Circuits and Systems, p.3498–3501.
Wiegand, T., Sullivan, G.J., Bjontegaard, G., Luthra, A., 2003. Overview of the H.264/AVC video coding standard. IEEE Trans. Circuits Syst. Video Technol., 13(7):560–576. [doi:10.1109/TCSVT.2003.815165].
Xu, L.D., Lin, X.G., 2005. Fast Mode Decision for Inter Frames in H.264/AVC. IEEE Int. Symp. on Communications and Information Technology, 1:433–436. [doi:10.1109/ISCIT.2005.1566886]
Zhang, Y.D., Dai, F., Lin, S.X., 2004. Fast 4×4 Intraprediction Mode Selection for H.264. IEEE Int. Conf. on Multimedia and Expo, 2:1151–1154.
Author information
Authors and Affiliations
Corresponding author
Additional information
Project (No. IITA-2009-(C1090-0902-0011)) supported by the Ministry of Knowledge Economy of Korea under the ITRC Support Program supervised by the IITA
Expanded based on “Fast Mode Decision for Intra Prediction in H.264/AVC Encoder” by La et al., which appeared in the Proceedings of the 2007 IEEE International Conference on Image Processing
Rights and permissions
About this article
Cite this article
La, B., Eom, M. & Choe, Y. Dominant edge direction based fast intra mode decision in the H.264/AVC encoder. J. Zhejiang Univ. Sci. A 10, 767–777 (2009). https://doi.org/10.1631/jzus.A0820473
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1631/jzus.A0820473