Multi-hypothesis Temporal Prediction Using Template Matching Prediction and Block Motion Compensation for High Efficiency Video Coding

  • Chun-Chi Chen
  • Wen-Hsiao Peng
  • Shih-Chun Chou
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7674)


This paper introduces a multi-hypothesis temporal prediction technique that combines two motion vectors (MVs) derived respectively from template and block matching for overlapped block motion compensation (OBMC). It achieves similar prediction performance to bi-prediction while only one MV has to be sent. Based on two signal models, the template MV is shown to approximate the pixel true motion around the template centroid. We then find another MV to best complement the template MV from both deterministic and statistical viewpoints, the latter leading to the search of its optimal sampling location in the motion field. The result is a search criterion with OBMC window functions forming a geometry-like motion partitioning. To compromise between performance and complexity, generalizations to adaptive template design, multi-hypothesis prediction and motion merging are made. Extensive experiments conducted with the HM-3.0 software confirm the effectiveness of the proposed schemes.


Bi-prediction OBMC Template Matching 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Kamp, S., et al.: Decoder Side Motion Vector Derivation for Inter Frame Video Coding. In: Proc. Int’l Conf. on Image Processing (2008)Google Scholar
  2. 2.
    Suzuki, Y., et al.: Block-based reduced resolution inter frame coding with template matching prediction. In: Proc. Int’l Conf. on Image Processing (2006)Google Scholar
  3. 3.
    Kamp, S., et al.: Multihypothesis prediction using decoder side motion vector derivation in inter frame video coding. Visual Comm. and Image Processing (2009)Google Scholar
  4. 4.
    Huang, Y.W., et al.: TE1: Decoder-side motion vector derivation with switchable template matching. Doc. JCTVC-B076 (2011)Google Scholar
  5. 5.
    Lin, S., et al.: TE1: Huawei report on DMVD improvements (joint document with Peking University). Doc. JCTVC-B037 (2010)Google Scholar
  6. 6.
    Suzuki, Y., Boon, C.S.: An improved low delay inter frame coding using template matching averaging. In: Proc. Picture Coding Symposium (2010)Google Scholar
  7. 7.
    Lee, C.L., et al.: Bi-prediction Combining Template and Block Motion Compensations. In: Proc. Int’l Conf. on Image Processing (2011)Google Scholar
  8. 8.
    Wang, R., et al.: Combining Template Matching and Block Motion Compensation for Video Coding. In: Proc. Int’l Symp. on Intelligent Signal Processing and Communication Systems (2010)Google Scholar
  9. 9.
    Orchard, M.T., Sullivan, G.J.: Overlapped block motion compensation: An estimation-theoretic approach. IEEE Trans. on Image Processing 3(5), 693–699 (1994)CrossRefGoogle Scholar
  10. 10.
    Tao, B., Orchard, M.T.: A parametric solution for optimal overlapped block motion compensation. IEEE Trans. on Image Processing 10(3), 341–350 (2001)zbMATHCrossRefGoogle Scholar
  11. 11.
    Zheng, W., et al.: Analysis of space-dependent characteristics of motion-compensated frame differences based on a statistical motion distribution model. IEEE Trans. on Image Processing 11(4), 377–386 (2002)CrossRefGoogle Scholar
  12. 12.
    Bossen, F.: Common test conditions and software reference configurations. Doc. JCTVC-E700 (2011)Google Scholar
  13. 13.
    Winken, M., et al.: Description of Video Coding Technology Proposal by Fraunhofer HHI. Doc. JCTVC-A116 (2010)Google Scholar
  14. 14.
    Chen, Y.W., Peng, W.H.: Parametric OBMC for Pixel-Adaptive Temporal Prediction on Irregular Motion Sampling Grids. IEEE Trans. on Circuits and Systems for Video Technology 22(1), 113–127 (2012)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2012

Authors and Affiliations

  • Chun-Chi Chen
    • 1
  • Wen-Hsiao Peng
    • 1
  • Shih-Chun Chou
    • 2
  1. 1.Department of Computer ScienceNational Chiao Tung UniversityHsinchuTaiwan
  2. 2.The Innovative DigiTech-Enabled Applications & Services InstituteInstitute of Information IndustryTaipeiTaiwan

Personalised recommendations