Skip to main content
SpringerLink
Log in

Robust tile-based texture synthesis using artificial immune system

  • Original Article
  • Published:
Neural Computing and Applications Aims and scope Submit manuscript

Abstract

One significant problem in tile-based texture synthesis is the presence of conspicuous seams in the tiles. The reason is that sample patches employed as primary patterns of the tile set may not be well stitched if carelessly picked. In this paper, we introduce a robust approach that can stably generate an ω-tile set of high quality and pattern diversity. First, an extendable rule is introduced to increase the number of sample patches to vary the patterns in an ω-tile set. Second, in contrast to other concurrent techniques that randomly choose sample patches for tile construction, ours uses artificial immune system (AIS) to select the feasible patches from the input example. This operation ensures the quality of the whole tile set. Experimental results verify the high quality and efficiency of the proposed algorithm.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

Similar content being viewed by others

References

  1. Efros AA, Leung TK (1999) Texture synthesis by non-parametric sampling. In: ICCV ’99: Proceedings of the international conference on computer vision, vol 2. IEEE Computer Society, Washington, p 1033

  2. Wei LY, Levoy M (2000) Fast texture synthesis using tree-structured vector quantization. In: SIGGRAPH ’00: Proceedings of the 27th annual conference on computer graphics and interactive techniques. ACM Press, New York, pp 479–488

  3. Efros AA, Freeman WT (2001) Image quilting for texture synthesis and transfer. In: SIGGRAPH ’01: Proceedings of the 28th annual conference on Computer graphics and interactive techniques. ACM Press, New York, pp 341–346

  4. Kwatra V, Schödl A, Essa I, Turk G, Bobick A (2003) Graphcut textures: image and video synthesis using graph cuts. ACM Trans Graph 22:277–286

    Google Scholar 

  5. Heeger DJ, Bergen JR (1995) Pyramid-based texture analysis/synthesis. In: SIGGRAPH ’95: Proceedings of the 22nd annual conference on Computer graphics and interactive techniques. ACM Press, New York, pp 229–238

  6. Paget R, Longstaff ID (1998) Texture synthesis and unsupervised recognition with a nonparametric multiscale markov random field model. IEEE Trans Image Process 7:925–931

    Google Scholar 

  7. Portilla J, Simoncelli EP (2000) A parametric texture model based on joint statistics of complex wavelet coefficients. Int J Comput Vis 40:49–70

    MATH  Google Scholar 

  8. Freeman WT, Jones TR, Pasztor EC (2002) Example-based super-resolution. IEEE Comput Graph Appl 22:56–65

    Google Scholar 

  9. Kwatra V, Essa I, Bobick A, Kwatra N (2005) Texture optimization for example-based synthesis. ACM Trans Graph 24:795–802

    Google Scholar 

  10. Ng TY, Wen C, Tan TS, Zhang X, Kim YJ (2005) Generating an ω-tile set for texture synthesis. In: Proceedings of computer graphics international 2005 (CGI’05), Stone Brook, NY, USA, pp 177–184

  11. Cohen MF, Shade J, Hiller S, Deussen O (2003) Wang tiles for image and texture generation. ACM Trans Graph 22:287–294

    Google Scholar 

  12. Wei LY (2004) Tile-based texture mapping on graphics hardware. In: HWWS ’04: Proceedings of the ACM SIGGRAPH/EUROGRAPHICS conference on graphics hardware. ACM Press, New York, pp 55–63

  13. Dong W, Sun S, Paul JC (2005) Optimal sample patches selection for tile-based texture synthesis. In: CAD-CG ’05: Proceedings of the 9th international conference on computer aided design and computer graphics (CAD-CG’05). IEEE Computer Society, Washington, pp 503–508

  14. Dong W, Zhou N, Paul JC (2007) Optimized tile-based texture synthesis. In: GI ’07: Proceedings of graphics interface 2007. ACM, New York, pp 249–256

  15. Kim J, Bentley PJ (2001) Towards an artificial immune system for network intrusion detection: an investigation of clonal selection with a negative selection operator. In: Proceedings of the 2001 Congress on evolutionary computation CEC2001. IEEE Press, Seoul, pp 1244–1252

  16. de Castro LN, Zuben FJV (2002) Learning and optimization using the clonal selection principle. IEEE Trans Evol Comput 6:239–251

    Google Scholar 

  17. Du H, Jiao L, Gong M, Liu R (2004) Adaptive dynamic clone selection algorithms. In: Lecture notes in computer science (RSCTC’2004 proceedings) , vol 3066, pp 768–773

  18. Ishida Y (2004) Immunity-based systems: a design perspective. Springer, New York

    Google Scholar 

  19. Bonet JSD (1997) Multiresolution sampling procedure for analysis and synthesis of texture images. In: SIGGRAPH ’97: Proceedings of the 24th annual conference on Computer graphics and interactive techniques. ACM Press, New York, pp 361–368

  20. Ashikhmin M (2001) Synthesizing natural textures. In: SI3D ’01: Proceedings of the 2001 symposium on interactive 3D graphics. ACM Press, New York, pp 217–226

  21. Wu Q, Yu Y (2004) Feature matching and deformation for texture synthesis. ACM Trans Graph 23:364–367

    Google Scholar 

  22. Liu Y, Lin WC, Hays J (2004) Near-regular texture analysis and manipulation. ACM Trans Graph 23:368–376

    Google Scholar 

  23. Nealen A, Alexa M (2003) Hybrid texture synthesis. In: EGRW ’03: Proceedings of the 14th Eurographics workshop on rendering, Aire-la-Ville, Eurographics Association, Switzerland, pp 97–105

  24. Lefebvre S, Hoppe H (2005) Parallel controllable texture synthesis. ACM Trans Graph 24:777–786

    Google Scholar 

  25. Lefebvre S, Hoppe H (2006) Appearance-space texture synthesis. ACM Trans Graph 25:541–548

    Google Scholar 

  26. Zelinka S, Garland M (2002) Towards real-time texture synthesis with the jump map. In: EGRW ’02: Proceedings of the 13th Eurographics workshop on Rendering, Aire-la-Ville, Eurographics Association, Switzerland, pp 99–104

  27. Zelinka S, Garland M (2004) Jump map-based interactive texture synthesis. ACM Trans Graph 23:930–962

    Google Scholar 

  28. Liang L, Liu C, Xu YQ, Guo B, Shum HY (2001) Real-time texture synthesis by patch-based sampling. ACM Trans Graph 20:127–150

    Google Scholar 

  29. de Castro LN, Zuben FJV (2000) The clonal selection algorithm with engineering applications. In: Proceedings of GECCO’00: Workshop on Artificial Immune Systems and Their Applications, Las Vegas, Nevada, USA, pp 36–39

  30. de Castro LN, Timmis J (2002) Immune systems: a new computational intelligence approach. Springer, Berlin

    MATH  Google Scholar 

  31. de França FO, Zuben FJV, de Castro LN (2005) An artificial immune network for multimodal function optimization on dynamic environments. In: GECCO ’05: Proceedings of the 2005 conference on Genetic and evolutionary computation, ACM Press, New York, pp 289–296

  32. Pan Z, Kang L (1997) An adaptive evolutionary algorithm for numerical optimization. In: Simulated evolution and learning: First Asia-Pacific Conf. (SEAL’96), Selected papers, Springer, Berlin, pp 27–34

  33. Pérez P, Gangnet M, Blake A (2003) Poisson image editing. ACM Trans Graph 22:313–318

    Google Scholar 

  34. Arya S, Mount DM, Netanyahu NS, Silverman R, Wu AY (1998) An optimal algorithm for approximate nearest neighbor searching fixed dimensions. J ACM 45:891–923

    MATH  MathSciNet  Google Scholar 

  35. Gersho A, Gray RM (1991) Vector quantization and signal compression. Kluwer, Norwell

    Google Scholar 

  36. Kilthau SL, Drew MS, Möller T (2002) Full search content independent block matching based on the fast fourier transform. In: Proceedings of international conference on image processing 2002, vol 1. Vancouver, BC, Canada, pp 669–672

  37. Soler C, Cani MP, Angelidis A (2002) Hierarchical pattern mapping. ACM Trans Graph 21:673–680

    Google Scholar 

  38. Dellaert F, Kwatra V, Oh SM (2005) Mixture trees for modeling and fast conditional sampling with applications in vision and graphics. In: CVPR ’05: Proceedings of the 2005 IEEE Computer Society conference on computer vision and pattern recognition (CVPR’05) , vol 1. IEEE Computer Society, Washington, pp 619–624

  39. Nicoll A, Meseth J, Müller G, Klein R (2005) Fractional fourier texture masks: guiding near-regular texture synthesis. Comput Graph Forum 24:569–579

    Google Scholar 

  40. Boykov Y, Veksler O, Zabih R (2001) Fast approximate energy minimization via graph cuts. IEEE Trans Pattern Anal Mach Intell 23:1222–1239

    Google Scholar 

Download references

Acknowledgments

We thank Steve Zelinka, Vivek Kwatra and Tuen-Young Ng for sharing their results and texture samples on the web sites. Thank Professor Ramin Zabih and his students at Cornell University for sharing their code for computing graph min-cut [40]. This work is supported by National Natural Science Foundation of China projects no. 60073007, 60473110; by National High-Tech Research and Development Plan 863 of China under Grant No. 2006AA01Z301, and by the MOST International collaboration project no. 2007DFC10740.

Author information

Authors and Affiliations

  1. LIAMA-NLPR, CAS Institute of Automation, Beijing, China

    Weiming Dong

  2. Project ALICE, INRIA Lorraine/Loria, Nancy, France

    Weiming Dong

  3. Department of Computer Science and Technology, Tsinghua University, Beijing, China

    Ning Zhou

  4. INRIA/Tsinghua University, Beijing, China

    Jean-Claude Paul

Authors
  1. Weiming Dong
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ning Zhou
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jean-Claude Paul
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Weiming Dong.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Dong, W., Zhou, N. & Paul, JC. Robust tile-based texture synthesis using artificial immune system. Neural Comput & Applic 18, 223–235 (2009). https://doi.org/10.1007/s00521-008-0174-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00521-008-0174-6

Keywords

Search

Navigation