Advertisement

The Visual Computer

, Volume 31, Issue 11, pp 1447–1458 | Cite as

An iterated randomized search algorithm for large-scale texture synthesis and manipulations

  • Chuanyan Hao
  • Yadang Chen
  • Wen Wu
  • Enhua Wu
Original Article
  • 317 Downloads

Abstract

In this paper, we introduce a novel iterated random search method for large-scale texture synthesis and manipulations. Previous researches on texture synthesis and manipulation have reached a great achievement both on quality and performance. However, the cost of the popular exhaustive search-based methods is still high especially for large-scale and complex synthesis scenes. Our algorithm contributes great improvements on performances about 2–50 times over the typical patch-based synthesis methods. Texture patterns have been well-known formalized as a Markov Random Field (MRF) whose two hypotheses, stationarity and locality, drive our bold guess that a random sampling may just catch a good match and allows us to propagate the natural coherence in the neighborhood. Meanwhile, the iteration constantly updates the bad guesses to make our algorithm converge fast with the results in the state of the art. We also provide a simple theoretical analysis to compare our iterated randomized search model and the classical synthesis algorithms. Besides, this simple method turns out to work well in various applications as well, such as texture transfer, image completion and video synthesis.

Keywords

Texture synthesis Coherent propagation Random search Texture transfer Approximate match patch 

Notes

Acknowledgments

Thanks are given to my friends, Mr.Yuanzhang Chang, Mr.Gang Sun and Mr. Xiaosheng Li for their helps and discussions. Thanks also to Professor Li-Yi Wei and Dr.Vivek Kwatra for sharing their texture datasets via their respective web sites. The research has been supported by NSFC Grant (61202154) and the research grant of University of Macau. And last but not the least, thanks are given to my families.

References

  1. 1.
    Agarwala, A., Dontcheva, M., Agrawala, M., Drucker, S., Colburn, A., Curless, B., Salesin, D., Cohen, M.: Interactive digital photomontage. ACM Trans. Graph. 23(3), 294–302 (2004)CrossRefGoogle Scholar
  2. 2.
    Ashikhmin, M.: Synthesizing natural textures. In: Proceedings of the 2001 symposium on Interactive 3D graphics. I3D ’01, pp. 217–226. ACM, New York (2001)Google Scholar
  3. 3.
    Barnes, C., Shechtman, E., Finkelstein, A., Goldman, D.B.: Patchmatch: a randomized correspondence algorithm for structural image editing. ACM Trans. Graph. 28(3), 24:1–24:11 (2009)CrossRefGoogle Scholar
  4. 4.
    Barnes, C., Shechtman, E., Goldman, D.B., Finkelstein, A.: The generalized patchmatch correspondence algorithm. In: Proceedings of the 11th European conference on computer vision conference on computer vision: Part III. ECCV’10, pp. 29–43. Springer, Berlin, Heidelberg (2010)Google Scholar
  5. 5.
    Cohen, M.F., Shade, J., Hiller, S., Deussen, O.: Wang tiles for image and texture generation. ACM Trans. Graph. 22(3), 287–294 (2003)CrossRefGoogle Scholar
  6. 6.
    Criminisi, A., Perez, P., Toyama, K.: Region filling and object removal by exemplar-based image inpainting. Trans. Image Process. 13(9), 1200–1212 (2004)CrossRefGoogle Scholar
  7. 7.
    Darabi, S., Shechtman, E., Barnes, C., Goldman, D.B., Sen, P.: Image melding: combining inconsistent images using patch-based synthesis. ACM Trans. Graph. 31(4), 82:1–82:10 (2012)CrossRefGoogle Scholar
  8. 8.
    De Bonet, J.S.: Multiresolution sampling procedure for analysis and synthesis of texture images. In: Proceedings of the 24th annual conference on Computer graphics and interactive techniques. SIGGRAPH ’97, pp. 361–368. ACM Press/Addison-Wesley Publishing Co., New York (1997)Google Scholar
  9. 9.
    Drori, I., Cohen-Or, D., Yeshurun, H.: Fragment-based image completion. ACM Trans. Graph. 22(3), 303–312 (2003)CrossRefGoogle Scholar
  10. 10.
    Efros, A.A., Freeman, W.T.: Image quilting for texture synthesis and transfer. In: Proceedings of the 28th annual conference on computer graphics and interactive techniques. SIGGRAPH ’01, pp. 341–346. ACM, New York (2001)Google Scholar
  11. 11.
    Efros, A.A., Leung, T.K.: Texture synthesis by non-parametric sampling. In: Proceedings of the International Conference on Computer Vision, ICCV ’99, vol. 2, pp. 1033–1038. IEEE Computer Society, Washington, DC (1999)Google Scholar
  12. 12.
    Enrique, S., Koudelka, M., Belhumeur, P., Dorsey, J., Nayar, S., Ramamoorthi, R.: Time-varying textures: definition, acquisition, and synthesis. In: ACM SIGGRAPH 2005 Sketches, SIGGRAPH ’05. ACM, New York (2005). doi: 10.1145/1187112.1187269. http://doi.acm.org/10.1145/1187112.1187269
  13. 13.
    Heeger, D.J., Bergen, J.R.: Pyramid-based texture analysis/synthesis. In: Proceedings of the 22nd annual conference on computer graphics and interactive techniques. SIGGRAPH ’95, pp. 229–238. ACM, New York (1995)Google Scholar
  14. 14.
    Jianwei, H., Qing, W., Kun, Z.: Wang tiles based geometric texture synthesis. J. Softw. 20(12), 3254–3264 (2009). (in Chinese)CrossRefGoogle Scholar
  15. 15.
    Kwatra, V., Essa, I., Bobick, A., Kwatra, N.: Texture optimization for example-based synthesis. ACM Trans. Graph. 24(3), 795–802 (2005)CrossRefGoogle Scholar
  16. 16.
    Kwatra, V., Schödl, A., Essa, I., Turk, G., Bobick, A.: Graphcut textures: image and video synthesis using graph cuts. ACM Trans. Graph. 22(3), 277–286 (2003)CrossRefGoogle Scholar
  17. 17.
    Lefebvre, S., Hoppe, H.: Parallel controllable texture synthesis. ACM Trans. Graph. 24(3), 777–786 (2005). doi: 10.1145/1073204.1073261
  18. 18.
    Liang, L., Liu, C., Xu, Y.Q., Guo, B., Shum, H.Y.: Real-time texture synthesis by patch-based sampling. ACM Trans. Graph. 20(3), 127–150 (2001)CrossRefGoogle Scholar
  19. 19.
    Pérez, P., Gangnet, M., Blake, A.: Poisson image editing. ACM SIGGRAPH 2003 Papers. SIGGRAPH ’03, pp. 313–318. ACM, New York (2003)Google Scholar
  20. 20.
    Portilla, J., Simoncelli, E.P.: A parametric texture model based on joint statistics of complex wavelet coefficients. Int. J. Comput. Vision 40(1), 49–70 (2000)zbMATHCrossRefGoogle Scholar
  21. 21.
    Schödl, A., Szeliski, R., Salesin, D.H., Essa, I.: Video textures. In: Proceedings of the 27th annual conference on Computer graphics and interactive techniques. SIGGRAPH ’00, pp. 489–498. ACM Press/Addison-Wesley Publishing Co., New York (2000)Google Scholar
  22. 22.
    Szummer, M., Picard, R.W.: Temporal texture modeling. IEEE Int. Conf. Image Process. 3, 823–826 (1996)CrossRefGoogle Scholar
  23. 23.
    Wei, L.Y., Levoy, M.: Fast texture synthesis using tree-structured vector quantization. In: Proceedings of the 27th annual conference on Computer graphics and interactive techniques. SIGGRAPH ’00, pp. 479–488. ACM Press/Addison-Wesley Publishing Co., New York (2000)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2014

Authors and Affiliations

  1. 1.FSTUniversity of MacauMacaoChina
  2. 2.State Key Lab of CSInstitute of Software, Chinese Academy of SciencesBeijingChina

Personalised recommendations