Skip to main content
Log in

A Conditional Multiscale Locally Gaussian Texture Synthesis Algorithm

  • Published:
Journal of Mathematical Imaging and Vision Aims and scope Submit manuscript

Abstract

Exemplar-based texture synthesis is defined as the process of generating, from an input texture sample, new texture images that are perceptually equivalent to the input. In the present work, we model texture self-similarity with conditional Gaussian distributions in the patch space in order to extend the use of stitching techniques. Then, a multiscale texture synthesis algorithm is introduced, where texture patches are modeled at each scale as spatially variable Gaussian vectors in the patch space. The Gaussian distribution for each patch is inferred from the set of its nearest neighbors in the patch space obtained from the input sample. This approach is tested over several real and synthetic texture images, and its results show the effectiveness of the proposed technique for a wide range of textures.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

Similar content being viewed by others

References

  1. Aguerrebere, C., Gousseau, Y., Tartavel, G.: Exemplar-based texture synthesis: the efros-leung algorithm. Image Process. On Line 2013, 213–231 (2013)

    Google Scholar 

  2. Ashikhmin, M.: Synthesizing natural textures. In: Proceedings of the 2001 Symposium on Interactive 3D Graphics, pp. 217–226. ACM, New York (2001)

  3. Barnes, C., Shechtman, E., Finkelstein, A., Goldman, D.: Patchmatch: a randomized correspondence algorithm for structural image editing. ACM Trans. Graph. TOG 28(3), 24 (2009)

    Google Scholar 

  4. Briand, T., Vacher, J., Galerne, B., Rabin, J.: The Heeger & Bergen pyramid based texture synthesis algorithm. Image Process. On Line 4, 276–299 (2014)

    Article  Google Scholar 

  5. Efros, A., Leung, T.K., et al.: Texture synthesis by non-parametric sampling. In: The Proceedings of the Seventh IEEE International Conference on Computer Vision, 1999, vol. 2, pp. 1033–1038. IEEE, Washington, DC(1999)

  6. Efros, A.A., Freeman, W.T.: Image quilting for texture synthesis and transfer. In: Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques, pp. 341–346. ACM, New York (2001)

  7. Fedorov, V., Facciolo, G., Arias, P.: Variational framework for non-local inpainting. Image Process. On Line 5, 362–386 (2015). doi:10.5201/ipol.2015.136

    Article  MathSciNet  Google Scholar 

  8. Galerne, B., Gousseau, Y., Morel, J.M.: Micro-texture synthesis by phase randomization. Image Process. On Line (2011). doi:10.5201/ipol.2011.ggm_rpn

  9. Galerne, B., Gousseau, Y., Morel, J.M.: Random phase textures: theory and synthesis. IEEE Trans. Image Process. 20(1), 257–267 (2011)

    Article  MathSciNet  Google Scholar 

  10. Gatys, L.A., Ecker, A.S., Bethge, M.: Texture synthesis and the controlled generation of natural stimuli using convolutional neural networks. arXiv preprint arXiv:1505.07376 (2015)

  11. Heeger, D.J., Bergen, J.R.: Pyramid-based texture analysis/synthesis. In: Proceedings of the 22nd Annual Conference on Computer Graphics and Interactive Techniques, pp. 229–238. ACM, New York (1995)

  12. Julesz, B.: Visual pattern discrimination. IRE Trans. Inf. Theory 8(2), 84–92 (1962)

    Article  Google Scholar 

  13. Kwatra, V., Essa, I., Bobick, A., Kwatra, N.: Texture optimization for example-based synthesis. ACM Trans. Graph. (TOG) 24, 795–802 (2005)

    Article  Google Scholar 

  14. Kwatra, V., Schödl, A., Essa, I., Turk, G., Bobick, A.: Graphcut textures: image and video synthesis using graph cuts. ACM Trans. Graph. (TOG) 22, 277–286 (2003)

    Article  Google Scholar 

  15. Lebrun, M., Buades, A., Morel, J.M.: Implementation of the “Non-Local Bayes” (NL-Bayes) image denoising algorithm. Image Process. On Line 3, 1–42 (2013). doi:10.5201/ipol.2013.16

    Article  Google Scholar 

  16. Lefebvre, S., Hoppe, H.: Parallel controllable texture synthesis. ACM Trans. Graph. (TOG) 24(3), 777–786 (2005)

    Article  Google Scholar 

  17. Levina, E., Bickel, P.J.: Texture synthesis and nonparametric resampling of random fields. Ann. Stat. 34, 1751–1773 (2006)

    Article  MathSciNet  MATH  Google Scholar 

  18. Liang, L., Liu, C., Xu, Y.Q., Guo, B., Shum, H.Y.: Real-time texture synthesis by patch-based sampling. ACM Trans. Graph. (ToG) 20(3), 127–150 (2001)

    Article  Google Scholar 

  19. Morrison, D.F.: Multivariate Statistical Methods. McGraw-Hill, New York (1990)

    MATH  Google Scholar 

  20. Peyré, G.: Sparse modeling of textures. J. Math. Imaging Vis. 34(1), 17–31 (2009)

    Article  MathSciNet  Google Scholar 

  21. Portilla, J., Simoncelli, E.P.: A parametric texture model based on joint statistics of complex wavelet coefficients. Int. J. Comput. Vis. 40(1), 49–70 (2000)

    Article  MATH  Google Scholar 

  22. Raad, L., Desolneux, A., Morel, J.M.: Locally gaussian exemplar based texture synthesis. In: 2014 IEEE International Conference on Image Processing (ICIP), pp. 4667–4671. IEEE, Paris (2014)

  23. Raad, L., Desolneux, A., Morel, J.M.: Conditional gaussian models for texture synthesis. In: Scale Space and Variational Methods in Computer Vision, pp. 474–485. Springer, Berlin (2015)

  24. Raad, L., Desolneux, A., Morel, J.M.: Multiscale exemplar based texture synthesis by locally gaussian models. In: Iberoamerican Congress on Pattern Recognition (CIARP) (2015)

  25. Tartavel, G., Gousseau, Y., Peyré, G.: Variational texture synthesis with sparsity and spectrum constraints. J. Math. Imaging Vis. 52(1), 124–144 (2014)

    Article  MathSciNet  MATH  Google Scholar 

  26. Wei, L.Y., Levoy, M.: Fast texture synthesis using tree-structured vector quantization. In: Proceedings of the 27th Annual Conference on Computer Graphics and Interactive Techniques, pp. 479–488. ACM Press/Addison-Wesley Publishing Co., New York (2000)

  27. Wei, L.Y., Lefebvre, S., Kwatra, V., Turk, G.: State of the art in example-based texture synthesis. In: Eurographics 2009, State of the Art Report, EG-STAR, pp. 93–117. Eurographics Association, Munich (2009)

Download references

Acknowledgments

Work partly founded by the European Research Council (advanced Grant Twelve Labors) and the Office of Naval research (ONR Grant N00014-14-1-0023).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Lara Raad.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Raad, L., Desolneux, A. & Morel, JM. A Conditional Multiscale Locally Gaussian Texture Synthesis Algorithm. J Math Imaging Vis 56, 260–279 (2016). https://doi.org/10.1007/s10851-016-0656-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10851-016-0656-6

Keywords

Navigation