Abstract
Dynamic textures are image sequences recording texture in motion. Given a sample video, the goal of synthesis is to create a new sequence enlarged in spatial and/or temporal domain, which looks perceptually similar to the input. Most synthesis methods are mainly focused on extending sequences only in the temporal domain. In this paper, we propose a dynamic texture synthesis approach for spatial domain, where we aim to enlarge the frame size while preserving the aspect and motion of the original video. For this purpose, we use a patch-based synthesis method based on LBP-TOP features. In our approach, 3D patch regions from the input are selected and copied to an output sequence. Usually, in other patch-based approaches, the selection of the patches is based only in the color, which cannot capture the spatial and temporal information, causing an unnatural look in the output. In contrast, we propose to use the LBP-TOP operator, which implicitly represents information about appearance, dynamics and correlation between frames. The experiments show that the use of the LBP-TOP improves the performance of other methods giving a good description of the structure and motion of dynamic textures without generating visible discontinuities or artifacts.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Bar-Joseph, Z., El-Yaniv, R., Lischinski, D., Werman, M.: Texture mixing and texture movie synthesis using statistical learning. IEEE Trans. on Visualization and Computer Graphics 7, 120–135 (2001)
Chetverikov, D., Peteri, R.: A brief survey of dynamic texture description and recognition. In: Proc. of the CORES 2005, vol. 30, pp. 17–26 (2005)
Constantini, R., Sbaiz, L., Susstrunk, S.: Higher order SVD analysis for dynamic texture synthesis. IEEE Trans. on Image Processing 17, 42–52 (2008)
Doretto, G., Jones, E., Soatto, S.: Spatially Homogeneous Dynamic Textures. In: Pajdla, T., Matas, J(G.) (eds.) ECCV 2004. LNCS, vol. 3022, pp. 591–602. Springer, Heidelberg (2004)
Ghanem, B., Ahuja, N.: Phase PCA for dynamic texture video compression. In: Proc. of the IEEE ICIP 2007, vol. 3, pp. 425–428 (2007)
Guo, Y., Zhao, G., Chen, J., Pietikäinen, M., Xu, Z.: Dynamic texture synthesis using a spatial temporal descriptor. In: Proc. of the IEEE ICIP 2009, pp. 2277–2280 (2009)
Kwatra, V., Schodl, A., Essa, I., Turk, G., Bobick, A.: Graphcut textures: Image and video synthesis using graph cuts. ACM Trans. on Graphics 22, 277–286 (2003)
Liu, C.B., Lin, R.S., Ahuja, N., Yang, M.H.: Dynamic textures synthesis as non- linear manifold learning and traversing. In: Proc. of the BMVC 2006, pp. 859–868 (2006)
Ojala, T., Pietikäinen, M., Mäenpää, T.: Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. IEEE Trans. on Pattern Analysis and Machine Intelligence 24, 971–987 (2002)
Peteri, R., Fazekas, S., Huiskes, M.J.: DynTex: A comprehensive database of dynamic textures. Pattern Recognition Letters 31, 1627–1632 (2010)
Schodl, A., Szeliski, R., Salesin, D., Essa, I.: Video textures. In: Proc. of the ACM SIGGRAPH 2000, pp. 489–498 (2000)
Szeliski, R., Shum, H.Y.: Creating full view panoramic image mosaics and environment maps. In: Proc. of the ACM SIGGRAPH 1997, pp. 251–258 (1997)
Wei, L.Y., Lefebvre, S., Kwatra, V., Turk, G.: State of the art in example-based texture synthesis. In: Eurographics 2009, EG-STAR, pp. 93–117 (2009)
Wei, L.Y., Levoy, M.: Fast texture synthesis using tree-structured vector quantization. In: Proc. of the ACM SIGGRAPH 2000, pp. 479–488 (2000)
Yuan, L., Wen, F., Liu, C., Shum, H.-Y.: Synthesizing Dynamic Texture with Closed-Loop Linear Dynamic System. In: Pajdla, T., Matas, J(G.) (eds.) ECCV 2004. LNCS, vol. 3022, pp. 603–616. Springer, Heidelberg (2004)
Zhao, G., Pietikäinen, M.: Dynamic texture recognition using local binary patterns with an application to facial expressions. IEEE Trans. on Pattern Analysis and Machine Intelligence 29, 915–928 (2007)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Lizarraga-Morales, R.A., Guo, Y., Zhao, G., Pietikäinen, M. (2013). Dynamic Texture Synthesis in Space with a Spatio-temporal Descriptor. In: Park, JI., Kim, J. (eds) Computer Vision - ACCV 2012 Workshops. ACCV 2012. Lecture Notes in Computer Science, vol 7728. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-37410-4_4
Download citation
DOI: https://doi.org/10.1007/978-3-642-37410-4_4
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-37409-8
Online ISBN: 978-3-642-37410-4
eBook Packages: Computer ScienceComputer Science (R0)