A New Generic Texture Synthesis Approach for Enhanced H.264/MPEG4-AVC Video Coding

  • Patrick Ndjiki-Nya
  • Christoph Stüber
  • Thomas Wiegand
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3893)


A new generic texture synthesis approach, which is inspired by the work of Kwatra et al. [1], is presented in this paper. The approach is hierarchical, non-parametric, patch-based and for that applicable to a large class of spatio-temporal textures with and without local motion activity. In this work, it is shown, how the new texture synthesizer can be integrated into a content-based video coding framework. That is, the decoder reconstructs textures like water, grass, etc. that are usually very costly to encode. For that, the new texture synthesizer in conjunction with side information that is generated by the encoder is required. The reconstruction of above-mentioned textures at the decoder side basically corresponds to stuffing holes in a video sequence. Spurious edges are thereby avoided by using graph cuts to generate irregular contours at transitions between natural and synthetic textures and preferably place them (the contours) in high-frequency regions, where they are less visible.


Motion Vector Video Code Side Information Texture Synthesis Video Codec 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Kwatra, V., et al.: Graphcut Textures: Image and Video Synthesis using Graph Cuts. In: Proc. SIGGRAPH, pp. 277–286 (2003)Google Scholar
  2. 2.
    Ndjiki-Nya, P., et al.: Improved H.264 Coding using Texture Analysis and Synthesis. In: Ndjiki-Nya, P., Stüber, C., Wiegand, T. (eds.) Proc. ICIP (2003)Google Scholar
  3. 3.
    Dumitraş, A., Haskell, B.G.: An Encoder-Decoder Texture Replacement Method with Application to Content-Based Movie Coding. IEEE Trans. on CSVT 14(6), 825–840 (2004)Google Scholar
  4. 4.
    ITU-T Rec. H.264 & ISO/IEC 14496-10 AVC: Advanced Video Coding for Generic Audiovisual Services. (2003)Google Scholar
  5. 5.
    De Bonet, J.S.: Multiresolution Sampling Procedure for Analysis and Synthesis of Texture Images. In: Proc. SIGGRAPH, pp. 361–368 (1997)Google Scholar
  6. 6.
    Boykov, Y., et al.: Fast Approximate Energy Minimization via Graph Cuts. In: Proc. ICCV, pp. 377–384 (1999)Google Scholar
  7. 7.
    Black, M.J., Anandan, P.: The Robust Estimation of Multiple Motions: Parametric and Piecewise-smooth Flow Fields. Computer Vision and Image Understanding 63(1), 75–104 (1996)CrossRefGoogle Scholar
  8. 8.
    Ohm, J.-R.: Multimedia Communication Technology. Springer, Heidelberg (2004)CrossRefMATHGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Patrick Ndjiki-Nya
    • 1
  • Christoph Stüber
    • 1
  • Thomas Wiegand
    • 1
  1. 1.Image Communication Group, Image Processing DepartmentFraunhofer Heinrich-Hertz-InstitutBerlinGermany

Personalised recommendations