Abstract
The fundamental motion model of the conventional block-based motion compensation in High Efficiency Video Coding (HEVC) is a translational motion model. However, in the real world, the motion of an object exists in the form of combining many kinds of motions. In Versatile Video Coding (VVC), a block-based 4-parameter and 6-parameter affine motion compensation (AMC) is being applied. The AMC still has a limit to accurate complex motions in the natural video. In this paper, we design a perspective affine motion compensation (PAMC) method which can improve the coding efficiency and maintain low-computational complexity compared with existing AMC. Because the block with the perspective motion model is a rectangle without specific feature, the proposed PAMC shows effective encoding performance for the test sequence containing irregular object distortions or dynamic rapid motions in particular. Our proposed algorithm is implemented on VTM 2.0. The experimental results show that the BD-rate reduction of the proposed technique can be achieved up to 0.30%, 0.76%, and 0.04% for random access (RA) configuration and 0.45%, 1.39%, and 1.87% for low delay P (LDP) configuration on Y, U, and V components, respectively. Meanwhile, the increase of encoding complexity is within an acceptable range.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Draft, I.T.U.T.: Recommendation and final draft international standard of joint video specification (ITU-T Rec. H. 264—ISO/IEC 14496–10 AVC). Joint Video Team (JVT) of ISO/IEC MPEG and ITU-T VCEG, JVTG050 (2003)
Sze, V., Budagavi, M., Sullivan, G.J.: High efficiency video coding (HEVC). In: Integrated Circuit and Systems, Algorithms and Architectures, pp. 1–375 (2014)
Bross, B., Chen, J., Liu, S.: Versatile Video Coding (Draft 2), JVET-K1001 (2018)
Chen, J., Ye, Y., Kim, S.: Algorithm description for Versatile Video Coding and Test Model 2 (VTM 2), JVET-K1002 (2018)
Choi, Y.J., Kim, J.H., Lee, J.H., Kim, B.G.: Performance analysis of future video coding (FVC) standard technology. J. Multimedia Inf. Syst. 4(2), 73–78 (2018)
Seferidis, V., Ghanbari, M.: General approach to block-matching motion estimation. Opt. Eng. 32(7), 1464–1474 (1993)
Lee, O., Wang, Y.: Motion compensated prediction using nodal based deformable block matching. J. Vis. Commun. Image Represent. 6(1), 26–34 (1995)
Cheung, H.-K., Siu, W.-C.: Local affine motion prediction for H.264 without extra overhead. In: IEEE International Symposium on Circuits and Systems (ISCAS), pp. 1555–1558 (2010)
Narroschke, M., Swoboda, R.: Extending HEVC by an affine motion model. In: Picture Coding Symposium (PCS), pp. 321–324 (2013)
Huang, H., Woods, J.W., Zhao, Y., Bai, H.: Affine SKIP and DIRECT modes for efficient video coding. In: Visual Communications and Image Processing (VCIP), pp. 1–6 (2012)
Heithausen, C., Vorwerk, J.H.: Motion compensation with higher order motion models for HEVC. In: IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 1438–1442 (2015)
Choi, Y.J., Jun, D.S., Cheong, W.S., Kim, B.G.: Design of efficient perspective affine motion estimation/compensation for versatile video coding (VVC) standard. Electronics 8(9), 993 (2019)
Li, L., Li, H., Lv, Z., Yang, H.: An affine motion compensation framework for high efficiency video coding. In: IEEE International Symposium on Circuits and Systems (ISCAS), May 2015
Li, L., Li, H., Liu, D., Li, Z., Yang, H., Lin, S., Chen, H., Wu, F.: An efficient four-parameter affine motion model for video coding. IEEE Trans. Circ. Syst. Video Technol. 28(8), 1934–1948 (2018)
Lin, S., Chen, H., Zhang, H., Maxim, S., Yang, H., Zhou, J.: Affine transform prediction for next generation video coding, ITU-T SG16 Doc. COM16-C1016 (2015)
Chen, J., Qualcomm Inc., Alshina, E., Samsung Electronics, Sullivan, G.J., Microsoft Corp., Jens-Rainer Ohm, RWTH Aachen University, Boyce, J.: Intel: Algorithm Description of Joint Exploration Test Model 1, JVET-A1001 (2015)
Zhang, K., Chen, Y.-W., Zhang, L., Chien, W.-J., Karczewicz, M.: An improved framework of affine motion compensation in video coding. IEEE Trans. Image Process. 28(3), 1456–1469 (2019)
Versatile Video Coding (VVC) Test Model 2.0 (VTM 2.0). https://vcgit.hhi.fraunhofer.de/jvet/VVCSoftware_VTM.git. Accessed 1 Dec 2019
Bossen, F., Boyce, J., Suehring, K., Li, X., Seregin, V.: JVET common test conditions and software reference configurations for SDR video, JVET-K1010 (2018)
Bjøntegaard, G.: Calculation of average PSNR differences between RDcurves, ITU-T SG.16 Q.6, Document VCEG-M33 (2001)
Acknowledgement
This research was supported by Basic Science Research Program through the National Research Foundation of Korea (NRF) funded by the Ministry of Education (NRF-2016R1D1A1B04934750).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Choi, YJ., Lee, YW., Kim, BG. (2020). Design of Perspective Affine Motion Compensation for Versatile Video Coding (VVC). In: Blanc-Talon, J., Delmas, P., Philips, W., Popescu, D., Scheunders, P. (eds) Advanced Concepts for Intelligent Vision Systems. ACIVS 2020. Lecture Notes in Computer Science(), vol 12002. Springer, Cham. https://doi.org/10.1007/978-3-030-40605-9_33
Download citation
DOI: https://doi.org/10.1007/978-3-030-40605-9_33
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-40604-2
Online ISBN: 978-3-030-40605-9
eBook Packages: Computer ScienceComputer Science (R0)