Bidirectional Hierarchical Anchoring (BIHA) of Motion

Chapter
Part of the Springer Theses book series (Springer Theses)

Abstract

In the previous chapter, we introduced two motion field operations that can be used to perform a bidirectional interpolation of a target frame from only two reference frames, together with the motion linking the reference frames; we refer to this scheme as BOA-TFI. In this chapter, we propose a bidirectional hierarchical anchoring (BIHA) of motion for highly scalable video compression, which employs BOA-TFI as a fundamental building block. In Sect. 5.1, we present the BIHA scheme, and contrast it with the conventional anchoring of motion at target frames, as employed by all standardized video codecs. In Sect. 5.2, we detail the modifications to the motion-compensated temporal filtering motion-compensated temporal filtering (MCTF) process; in particular, we add an update step, which is beneficial in a video compression scenario. The utility of the proposed scheme increases with the number of temporal decompositions. Section 5.3 presents how to scalably allocate the rate for all the different spatio-temporal subbands of texture, motion, and breakpoints. To further improve the R-D performance of the proposed highly scalable video compression scheme, we present in Sect. 5.4 an extension to the temporal breakpoint warping procedure (see Sect.  4.1); the resulting HST-BPI can account for the presence of partial breakpoint fields at target frames, and proves particularly useful at medium to low bit-rates. In Sect. 5.5, we compare the R-D performance of the BIHA scheme with the traditional motion field anchoring at target frames. We further show comparisons with SHVC, the latest standardized scalable video codec, where the proposed scheme shows promising results.

References

  1. 1.
    D. Rüfenacht, R. Mathew, D. Taubman, Hierarchical anchoring of motion fields for fully scalable video coding, in IEEE International Conference on Image Processing (2014) (cited on pages vii, 77)Google Scholar
  2. 2.
    D. Rüfenacht, R. Mathew, D. Taubman, Bidirectional hierarchical anchoring of motion fields for scalable video coding, in IEEE 18th International Workshop on Multimedia Signal Processing (2014) (cited on pages vii, 77)Google Scholar
  3. 3.
    D. Rüfenacht, R. Mathew, D. Taubman, A novel motion field anchoring paradigm for highly scalable wavelet-based video coding. IEEE Trans. Image Proc. 25(1), 39–52 (2016) (cited on pages vii, 77)Google Scholar
  4. 4.
    T. Wiegand, G.J. Sullivan, G. Bjøntegaard, A. Luthra, Overview of the H.264/AVC video coding standard. IEEE Trans. Circ. Syst. Video Tech. 13(7), 560–576 (2003) (cited on pages 1, 15, 19, 21, 77)Google Scholar
  5. 5.
    G.J. Sullivan, J.-R. Ohm, W.-J. Han, T. Wiegand, Overview of the high efficiency video coding (HEVC) standard. IEEE Trans. Circ. Syst. Video Tech. 22(12), 1649–1668 (2012) (cited on pages 1, 15, 22, 77, 95)Google Scholar
  6. 6.
    A. Secker, D. Taubman, Lifting-based invertible motion adaptive transform (LIMAT) framework for highly scalable video compression. IEEE Trans. Image Proc. 12, 1530–1542 (2003) (cited on page 83)Google Scholar
  7. 7.
    A. Mavlankar, S.-E. Han, C.-L. Chang, B. Girod, A new update step for reduction of PSNR fluctuations in motion-compensated lifted wavelet video coding, in IEEE International Workshop on Multimedia Signal Processing (2005) (cited on page 83)Google Scholar
  8. 8.
    R. Mathew, D. Taubman, P. Zanuttigh, Scalable coding of depth maps with R-D optimized embedding. IEEE Trans. Image Proc. 22(5), 1982-1995 (2013) (cited on pages 3, 5, 33, 34, 36, 91, 93, 96)Google Scholar
  9. 9.
    D. Taubman, High performance scalable image compression with EBCOT. IEEE Trans. Image Proc. 9(7), 1158–1170 (2000) (cited on pages 14, 91)Google Scholar
  10. 10.
    D. Taubman, M.W. Marcellin, JPEG2000: Image Compression Fundamentals, Standards, and Practice (Kluwer Academic Publishers, Boston, 2002) (cited on pages 2, 9, 14, 93, 96)Google Scholar
  11. 11.
    P. Helle, H. Lakshman, M. Siekmann, J. Stegemann, T. Hinz, H. Schwarz, D. Marpe, T. Wiegand, A scalable video coding extension of HEVC, in Proceedings of the IEEE Data Compression Conference (2013) (cited on pages 2, 25, 39, 95)Google Scholar
  12. 12.
    L. Xu, J. Jia, Y. Matsushita, Motion detail preserving optical flow estimation, in IEEE Transactions on Pattern Analysis and Machine Intelligence (2012), pp. 1744–1757 (cited on pages 43, 44, 49, 73, 95, 102, 128, 130, 131, 134, 137, 139, 159, 185-187)Google Scholar
  13. 13.
    D. Rüfenacht, R. Mathew, D. Taubman, Motion blur modelling for hierarchically anchored motion with discontinuities, in IEEE International Workshop on Multimedia Signal Processing (2015) (cited on pages vii, 99)Google Scholar
  14. 14.
    J. Wulff, M.J. Black, Modeling blurred video with layers. Eur. Conf. Comput. Vis. 8694, 236–252 (2014) (cited on pages 43, 99)Google Scholar

Copyright information

© Springer Nature Singapore Pte Ltd. 2018

Authors and Affiliations

  1. 1.Electrical Engineering and TelecommunicationsUNSW SydneySydneyAustralia

Personalised recommendations