Abstract
The hierarchical B picture (HBP) coding structure has been developed to improve the coding efficiency of multi-view video coding (MVC). HBP coding structure adopts temporal prediction and inter-view prediction to reduce the residual of the data in motion estimation. Since all the reference frames must be exhaustively searched for inter-view and temporal predictions, the encoder may take high computation time and need a large buffer size for the decoded picture. Hence, this paper proposes an effective reference frames determination method for motion estimation in HBP to reduce the computation time and buffer size. The proposed algorithm uses the relationship between the degree of motion and its predicted direction to select the prediction reference frame in the inter-view or temporal domain. The decoder buffer of the proposed algorithm only stores the reference region MBs instead of the entire reference picture, so that the decoder buffer size is significantly reduced. The experiment results show that the encoding time for the main views and the auxiliary views can be reduced by up to 65.39 % and 66.92 %, respectively. The decoder buffer size and bandwidth can be reduced by up to 70 % and 46.67 %, respectively. The results show that the proposed method not only achieves low computational complexity, but also reduces the decoded buffer size while maintaining high quality.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Merkle, P., Smolic, A., Muller, K., & Wiegand, T. (2007). Efficient Prediction Structure for Multi-view Video Coding. IEEE Transactions on Circuit and Systems for Video Technology, 17(11), 1461–1473.
Zhang, S., Wang, Y., Kang, J., & Li, H. (2008). A new approach to fast multiple reference frame motion estimation for H.264. Proc. of International Symposium on Computer Science and Computational Technology, 2, 254–358.
Lee, K., Jeon, G., & Jeong, J. (2009). Fast Reference Frame Selection Algorithm for H.264AVC. IEEE Transactions on Consumer Electronics, 55(2), 773–779.
Lee, K., Jeon, G., Falcon, R., Ha, C.W. & Jeong, J. (2009). An Adaptive Fast Multiple Reference Frame Selection Algorithm for H.264/AVC Using Reference Region Data. IEEE Workshop on Signal Processing Systems, 093–096.
Kuo, T. Y., & Lu, H. J. (2008). Efficient Reference Frame Selector for H.264. IEEE Transactions on Circuits and Systems for Video Technology, 18(3), 400–405.
Jun, D., & Park, H. (2010). An Efficient Priority-Based Reference Frame Selection Method for Fast Motion Estimation in H.264AVC. IEEE Transactions on Circuits and Systems for Video Technology, 20(8), 1156–1161.
Jeong, C. Y. & Hong, M. C., (2008). Fast Multiple Reference Frame Selection Method Using Inter-mode Correlation. 14th Asia-Pacific Conference on, Communications, 1–4.
Grellert, M., Sampaio, F., Hecktheuer, B., de Mattos, J. C. B., & Agostini, L. (2010). Memory-Aware Multiple Reference Frame Motion Estimation for the H.264AVC Standard. In Proc. of 17th IEEE International Conference on Electronics, Circuits, and Systems (pp. 575–578).
Wei, J., Wang, S. & Chen, L. (2009). Multi-View Video Coding with Adaptive Selection of Prediction Mode Based on Hierarchical B Picture. IET International Communication Conference on Wireless Mobile and Computing, 339–343
Zhang, Y., Kwong, S., Jiang, G. G., & Wang, H. (2011). Efficient Multi-Reference Frame Selection Algorithm for Hierarchical B Pictures in Multiview Video Coding. IEEE Transactions on Broadcasting, 57(1), 15–23.
Lin, J.P. & Tang, C.W. (2009). A Fast Direction Predictor of Inter Frame Prediction for Multi-View Video Coding. IEEE International Symposium on Circuits and Systems, 2589–2592.
Shen, L., Liu, Z., Liu, S., Zhang, Z. Y., & An, P. (2009). Selective Disparity Estimation and Variable Size Motion Estimation Based on Motion Homogeneity for Multi-View Coding. IEEE Transactions on Broadcasting, 761–766.
Shen, L., Liu, Z., Yan, T., Zhang, Z. Y., & An, P. (2010). View-Adaptive Motion Estimation and Disparity Estimation for Low Complexity Multiview Video Coding. IEEE Transactions on Circuits and Systems for Video Technology, 20(6), 925–930.
Chen, Y., Wang, Y. K. & Gabbouj, M. (2007). Buffer requirement analyses for multi-view video coding. The 26th Picture Coding Symposium, Lisbon, Portugal.
Woods, A., Docherty, T., & Koch, R. (1993). Image Distortions in Stereoscopic Video Systems. Stereoscopic Displays and Applications, 36–48.
Lee, C., Park, P.K. & Choi, B. (2006). Global Disparity Compensation for Multi-view Video Coding. Meeting of Joint Video Team (JVT), Hangzhou, China, Doc.JVT-U100.
Wiegand, T., Sullivan, G. J., Bjontegaard, G., & Luthra, A. (2003). Overview of the H. 264/AVC video coding standard. IEEE Transactions on Circuits and Systems for Video Technology, 13(7), 560–576.
ITU-T Recommendation H.264 (2009). Advanced video coding for generic audiovisual services.
JVT reference software, JMVC_4_1_1, downloaded from http://wftp3.itu.int/av-arch/jvt-site/2006_10_Hangzhou/
Bjontegaard G. (2001). Calculation of average PSNR differences between RD-curves. Joint Video Team (JVT) of ISO/IEC MPEG and ITU-T VCEG-M33.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Lee, PJ., Kuo, KT. & Huang, JS. MB-based Decoder Buffer Reduction for Multi-view Video Coding. J Sign Process Syst 80, 225–239 (2015). https://doi.org/10.1007/s11265-014-0869-0
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11265-014-0869-0