Abstract
Exemplar-based texture synthesis is defined as the process of generating, from an input texture sample, new texture images that are perceptually equivalent to the input. In the present work, we model texture self-similarity with conditional Gaussian distributions in the patch space in order to extend the use of stitching techniques. Then, a multiscale texture synthesis algorithm is introduced, where texture patches are modeled at each scale as spatially variable Gaussian vectors in the patch space. The Gaussian distribution for each patch is inferred from the set of its nearest neighbors in the patch space obtained from the input sample. This approach is tested over several real and synthetic texture images, and its results show the effectiveness of the proposed technique for a wide range of textures.
Similar content being viewed by others
References
Aguerrebere, C., Gousseau, Y., Tartavel, G.: Exemplar-based texture synthesis: the efros-leung algorithm. Image Process. On Line 2013, 213–231 (2013)
Ashikhmin, M.: Synthesizing natural textures. In: Proceedings of the 2001 Symposium on Interactive 3D Graphics, pp. 217–226. ACM, New York (2001)
Barnes, C., Shechtman, E., Finkelstein, A., Goldman, D.: Patchmatch: a randomized correspondence algorithm for structural image editing. ACM Trans. Graph. TOG 28(3), 24 (2009)
Briand, T., Vacher, J., Galerne, B., Rabin, J.: The Heeger & Bergen pyramid based texture synthesis algorithm. Image Process. On Line 4, 276–299 (2014)
Efros, A., Leung, T.K., et al.: Texture synthesis by non-parametric sampling. In: The Proceedings of the Seventh IEEE International Conference on Computer Vision, 1999, vol. 2, pp. 1033–1038. IEEE, Washington, DC(1999)
Efros, A.A., Freeman, W.T.: Image quilting for texture synthesis and transfer. In: Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques, pp. 341–346. ACM, New York (2001)
Fedorov, V., Facciolo, G., Arias, P.: Variational framework for non-local inpainting. Image Process. On Line 5, 362–386 (2015). doi:10.5201/ipol.2015.136
Galerne, B., Gousseau, Y., Morel, J.M.: Micro-texture synthesis by phase randomization. Image Process. On Line (2011). doi:10.5201/ipol.2011.ggm_rpn
Galerne, B., Gousseau, Y., Morel, J.M.: Random phase textures: theory and synthesis. IEEE Trans. Image Process. 20(1), 257–267 (2011)
Gatys, L.A., Ecker, A.S., Bethge, M.: Texture synthesis and the controlled generation of natural stimuli using convolutional neural networks. arXiv preprint arXiv:1505.07376 (2015)
Heeger, D.J., Bergen, J.R.: Pyramid-based texture analysis/synthesis. In: Proceedings of the 22nd Annual Conference on Computer Graphics and Interactive Techniques, pp. 229–238. ACM, New York (1995)
Julesz, B.: Visual pattern discrimination. IRE Trans. Inf. Theory 8(2), 84–92 (1962)
Kwatra, V., Essa, I., Bobick, A., Kwatra, N.: Texture optimization for example-based synthesis. ACM Trans. Graph. (TOG) 24, 795–802 (2005)
Kwatra, V., Schödl, A., Essa, I., Turk, G., Bobick, A.: Graphcut textures: image and video synthesis using graph cuts. ACM Trans. Graph. (TOG) 22, 277–286 (2003)
Lebrun, M., Buades, A., Morel, J.M.: Implementation of the “Non-Local Bayes” (NL-Bayes) image denoising algorithm. Image Process. On Line 3, 1–42 (2013). doi:10.5201/ipol.2013.16
Lefebvre, S., Hoppe, H.: Parallel controllable texture synthesis. ACM Trans. Graph. (TOG) 24(3), 777–786 (2005)
Levina, E., Bickel, P.J.: Texture synthesis and nonparametric resampling of random fields. Ann. Stat. 34, 1751–1773 (2006)
Liang, L., Liu, C., Xu, Y.Q., Guo, B., Shum, H.Y.: Real-time texture synthesis by patch-based sampling. ACM Trans. Graph. (ToG) 20(3), 127–150 (2001)
Morrison, D.F.: Multivariate Statistical Methods. McGraw-Hill, New York (1990)
Peyré, G.: Sparse modeling of textures. J. Math. Imaging Vis. 34(1), 17–31 (2009)
Portilla, J., Simoncelli, E.P.: A parametric texture model based on joint statistics of complex wavelet coefficients. Int. J. Comput. Vis. 40(1), 49–70 (2000)
Raad, L., Desolneux, A., Morel, J.M.: Locally gaussian exemplar based texture synthesis. In: 2014 IEEE International Conference on Image Processing (ICIP), pp. 4667–4671. IEEE, Paris (2014)
Raad, L., Desolneux, A., Morel, J.M.: Conditional gaussian models for texture synthesis. In: Scale Space and Variational Methods in Computer Vision, pp. 474–485. Springer, Berlin (2015)
Raad, L., Desolneux, A., Morel, J.M.: Multiscale exemplar based texture synthesis by locally gaussian models. In: Iberoamerican Congress on Pattern Recognition (CIARP) (2015)
Tartavel, G., Gousseau, Y., Peyré, G.: Variational texture synthesis with sparsity and spectrum constraints. J. Math. Imaging Vis. 52(1), 124–144 (2014)
Wei, L.Y., Levoy, M.: Fast texture synthesis using tree-structured vector quantization. In: Proceedings of the 27th Annual Conference on Computer Graphics and Interactive Techniques, pp. 479–488. ACM Press/Addison-Wesley Publishing Co., New York (2000)
Wei, L.Y., Lefebvre, S., Kwatra, V., Turk, G.: State of the art in example-based texture synthesis. In: Eurographics 2009, State of the Art Report, EG-STAR, pp. 93–117. Eurographics Association, Munich (2009)
Acknowledgments
Work partly founded by the European Research Council (advanced Grant Twelve Labors) and the Office of Naval research (ONR Grant N00014-14-1-0023).
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Raad, L., Desolneux, A. & Morel, JM. A Conditional Multiscale Locally Gaussian Texture Synthesis Algorithm. J Math Imaging Vis 56, 260–279 (2016). https://doi.org/10.1007/s10851-016-0656-6
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10851-016-0656-6