Abstract
We present a novel texture synthesis technique designed to reproduce at real-time frame-rates example texture images, with a special focus on patterns characterized by structural arrangements. Unlike current pixel-, patch- or texton-based schemes, that operate in image space, our approach is structural. We propose to assimilate texture images to corresponding 2D geometric meshes (called texture meshes). Our analysis mainly consists in generating automatically these meshes, while synthesis is then based on the creation of new vertex/polygon distributions matching some arrangement map. The output texture image is obtained by rasterizing the previously generated polygons using graphics hardware capabilities, which guarantees high speed performance. By operating in geometry space instead of image/pixel space, the proposed structural approach has a major advantage over current techniques: beyond pure texture reproduction, it allows us to define various tools, which allow users to further modify locally or globally and in real-time structural components of textures. By controlling the arrangement map, users can substitute new meshes in order to completely modify the structural appearance of input textures, yet maintaining a certain visual resemblance with the initial example image.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Ashikhmin, M.: Synthesizing natural textures. In: SI3D ’01: Proceedings of the 2001 Symposium on Interactive 3D Graphics, pp. 217–226. ACM, Boston (2001)
Bar-Joseph, Z., El-Yaniv, R., Lischinski, D., Werman, M.: Texture mixing and texture movie synthesis using statistical learning. IEEE Trans. Visual. Comput. Graph. 7(2), 120–135 (2001)
Dischler, J.M., Ghazanfarpour, D., Freydier, R.: Anisotropic solid texture synthesis using orthogonal 2D views. Comput. Graph. Forum 17(3), 87–96 (1998)
Dischler, J.M., Maritaud, K., Levy, B., Ghazanfarpour, D.: Texture particles. In: Eurographics 2002, Saarbrücken, Germany, pp. 401–410 (2002)
Efros, A.A., Freeman, W.T.: Image quilting for texture synthesis and transfer. In: SIGGRAPH ’01: Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques, pp. 341–346. ACM, Boston (2001)
Efros, A.A., Leung, T.K.: Texture synthesis by non-parametric sampling. In: ICCV ’99: Proceedings of the International Conference on Computer Vision, vol. 2, pp. 1033–1038. IEEE Computer Society, Washington, DC (1999)
Gonzalez, R.C., Woods, R.E.: Digital Image Processing. Addison-Wesley, Boston (1992)
Grigorescu, S., Petkov, N., Kruizinga, P.: Comparison of texture features based on Gabor filters. IEEE Trans. Image Process. 11(10), 1160–1167 (2002)
Heeger, D.J., Bergen, J.R.: Pyramid-based texture analysis/synthesis. In: SIGGRAPH, pp. 229–238 (1995)
Idrissa, M., Acheroy, M.: Texture classification using Gabor filters. Patt. Recogn. Lett. 23(9), 1095–1102 (2002)
Julesz, B.: Texton, the elements of texture perception, and their interactions. Nature 290(5802), 91–97 (1981)
Kwatra, V., Essa, I., Bobick, A., Kwatra, N.: Texture optimization for example-based synthesis. ACM Trans. Graph. (SIGGRAPH ’05) 24(3), 795–802 (2005)
Kwatra, V., Schödl, A., Essa, I., Turk, G., Bobick, A.: Graphcut textures: image and video synthesis using graph cuts. ACM Trans. Graph. 22(3), 277–286 (2003)
Lefebvre, L., Poulin, P.: Analysis and synthesis of structural textures. In: Graphics Interface, pp. 77–86 (2000)
Lefebvre, S., Hoppe, H.: Parallel controllable texture synthesis. ACM Trans. Graph. 24(3), 777–786 (2005)
Legakis, J., Dorsey, J., Gortler, S.: Feature-based cellular texturing for architectural models. In: SIGGRAPH ’01: Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques, pp. 309–316. ACM, Boston (2001)
Liang, L., Liu, C., Xu, Y.Q., Guo, B., Shum, H.Y.: Real-time texture synthesis by patch-based sampling. ACM Trans. Graph. 20(3), 127–150 (2001)
Liu, Y., Lin, W.C., Hays, J.: Near-regular texture analysis and manipulation. ACM Trans. Graph. 23(3), 368–376 (2004)
Liu, Z., Liu, C., Shum, H.Y., Yu, Y.: Pattern-based texture metamorphosis. In: 10th Pacific Conference on Computer Graphics and Applications (PG 2002), pp. 184–193. IEEE Computer Society, Washington, DC (2002)
Matusik, W., Zwicker, M., Durand, F.: Texture design using a simplicial complex of morphable textures. ACM Trans. Graph. 24(3), 787–794 (2005)
Miyata, K.: A method of generating stone wall patterns. In: SIGGRAPH ’90: Proceedings of the 17th Annual Conference on Computer Graphics and Interactive Techniques, pp. 387–394. ACM, Boston (1990)
Praun, E., Finkelstein, A., Hoppe, H.: Lapped textures. In: SIGGRAPH ’00: Proceedings of the 27th Annual Conference on Computer Graphics and Interactive Techniques, pp. 465–470. ACM Press/Addison-Wesley, Boston (2000)
Wei, L.Y.: Texture synthesis from multiple sources. In: GRAPH ’03: Proceedings of the SIGGRAPH 2003 Conference on Sketches and Applications, p. 1. ACM, Boston (2003)
Wei, L.Y., Levoy, M.: Fast texture synthesis using tree-structured vector quantization. In: SIGGRAPH ’00: Proceedings of the 27th Annual Conference on Computer Graphics and Interactive Techniques, pp. 479–488. ACM Press/Addison-Wesley, Boston (2000)
Worley, S.: A cellular texture basis function. In: SIGGRAPH ’96: Proceedings of the 23rd Annual Conference on Computer Graphics and Interactive Techniques, pp. 291–294. ACM, Boston (1996)
Wu, Q., Yu, Y.: Feature matching and deformation for texture synthesis. ACM Trans. Graph. 23(3), 364–367 (2004)
Zalesny, A., Ferrari, V., Caenen, G., Gool, L.V.: Composite texture synthesis. Int. J. Comput. Vis. 62(1,2), 161–176 (2004)
Zelinka, S., Garland, M.: Jump map-based interactive texture synthesis. ACM Trans. Graph. 23(4), 930–962 (2004)
Zhang, J., Zhou, K., Velho, L., Guo, B., Shum, H.Y.: Synthesis of progressively-variant textures on arbitrary surfaces. ACM Trans. Graph. 22(3), 295–302 (2003)