A New Generic Texture Synthesis Approach for Enhanced H.264/MPEG4-AVC Video Coding
A new generic texture synthesis approach, which is inspired by the work of Kwatra et al. , is presented in this paper. The approach is hierarchical, non-parametric, patch-based and for that applicable to a large class of spatio-temporal textures with and without local motion activity. In this work, it is shown, how the new texture synthesizer can be integrated into a content-based video coding framework. That is, the decoder reconstructs textures like water, grass, etc. that are usually very costly to encode. For that, the new texture synthesizer in conjunction with side information that is generated by the encoder is required. The reconstruction of above-mentioned textures at the decoder side basically corresponds to stuffing holes in a video sequence. Spurious edges are thereby avoided by using graph cuts to generate irregular contours at transitions between natural and synthetic textures and preferably place them (the contours) in high-frequency regions, where they are less visible.
KeywordsMotion Vector Video Code Side Information Texture Synthesis Video Codec
Unable to display preview. Download preview PDF.
- 1.Kwatra, V., et al.: Graphcut Textures: Image and Video Synthesis using Graph Cuts. In: Proc. SIGGRAPH, pp. 277–286 (2003)Google Scholar
- 2.Ndjiki-Nya, P., et al.: Improved H.264 Coding using Texture Analysis and Synthesis. In: Ndjiki-Nya, P., Stüber, C., Wiegand, T. (eds.) Proc. ICIP (2003)Google Scholar
- 3.Dumitraş, A., Haskell, B.G.: An Encoder-Decoder Texture Replacement Method with Application to Content-Based Movie Coding. IEEE Trans. on CSVT 14(6), 825–840 (2004)Google Scholar
- 4.ITU-T Rec. H.264 & ISO/IEC 14496-10 AVC: Advanced Video Coding for Generic Audiovisual Services. (2003)Google Scholar
- 5.De Bonet, J.S.: Multiresolution Sampling Procedure for Analysis and Synthesis of Texture Images. In: Proc. SIGGRAPH, pp. 361–368 (1997)Google Scholar
- 6.Boykov, Y., et al.: Fast Approximate Energy Minimization via Graph Cuts. In: Proc. ICCV, pp. 377–384 (1999)Google Scholar