Abstract
We present and compare five approaches for capturing, synthesising and relighting real 3D surface textures. Unlike 2D texture synthesis techniques they allow the captured textures to be relit using illumination conditions that differ from those of the original. We adapted a texture quilting method due to Efros and combined this with five different relighting representations, comprising: a set of three photometric images; surface gradient and albedo maps; polynomial texture maps; and two eigen based representations using 3 and 6 base images.
We used twelve real textures to perform quantitative tests on the relighting methods in isolation. We developed a qualitative test for the assessment of the complete synthesis systems. Ten observers were asked to rank the images obtained from the five methods using five real textures. Statistical tests were applied to the rankings.
The six-base-image eigen method produced the best quantitative relighting results and in particular was better able to cope with specular surfaces. However, in the qualitative tests there were no significant performance differences detected between it and the other two top performers. Our conclusion is therefore that the cheaper gradient and three-base-image eigen methods should be used in preference, especially where the surfaces are Lambertian or near Lambertian.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Ashikhmin, M. 2001. Synthesizing natural textures. In the pro ceedings of 2001 ACM Symposium on Interactive 3D Graphics,Research Triangle Park, NorthCarolina March 19–21, pp. 217–226.
Bar-Joseph, Z. 1999. Statistical learning of multi-dinensioial textures. MSc thesis, Institute of Computer Scienei The Hebrew University of Jurusalem.
Basri, R. and Jacobs, D. 2001. Lambertian reflectance and linear subspaces. In Proceedings Eighth IEEE International Conference on Computer Vision ICCV2001vol. 2, pp. 383–390.
Blinn, J.F. 1978. Computer display of curved surfaces. Ph.D. Thesis, Uversity of Utah.
Cook, R.L. and Torrance, KE. 1982. A reflectance model for com-puter graphics. ACIM Transactions on Graphics (TOG), (1 ):7–24.
Copeland, A.C., Ravichandran, G., and Trivedi, M.M. 2001. ‘Tex-ture synthesis using gray-level co-occurrence models: Algorithms, experimental analysis, and psychophysical support. Opt. Eng.,40:2655.
Dana, K.J., Van Ginneken, B., Nayar, S.K., and Koenderink, J.J. 1999. Reflectance and texture of real-world surfaces. ACM T rans-actions on Graphics,18(1):1–34.
Dana, K.J. and Nayar, S.K. 1999. 3D Textured surface modeling. In Proceedings of UWIAGMOR Workshop CVPR ‘99,pp. 46–56.
Daniel, W.W. 1990. Applied Nonparameic Statistics, 2nd ed. PWS-LENT Publishing Company: Boston.
De Benet, J.S. 1997. Multiresolution sampling procedure for analysis and synthesis of texture images. In Computer Graphics Proceed-ings, SIGGRAPH 97.ACM, pp. 361–368.
Dong, J. 2003. ‘Three-dimensional surface texture synthesis. PhD thesis. Hleriot-Watt University, Edinburgh, UK.
Efros, A.A. and Freeman, W.T. 2001. Image quilting for texture synthesis and transfer In Proceedings of the 28th Annual Conference on Computer Graphics and Interactive 7Tchniques,Los Angeles, California, pp. 341–346.
Efros. A.A. and Leung, T.K. 1999. Texture synthesis by non-parametric sampling. In Proceedings of the Seventh IEEE Interna-tional Conference on Computer Vision.IEEE Comput. Soc. Part, vol. 2, pp. 1033–1038.
Epstein, R., Hallinan, P.W., and Yuille, A.L. 1995. 5/spl plusmn/2 eigenimages suffice: An empirical investigation of low-dimensional lighting models. In Proceedings of the Workshop on Physics-Based Modeling in Computer Vision,pp. 108–116.
Heeger, D.J. and Bergen, J.R. 1995. Pyramid-based texture analysis/synthesis. In Proceedings International Conference on Image Processing(Cat. No.95CB35819). IEEE Comput. Soc. Press. Part, vol. 3, pp. 648–651.
Hochberg, Y. and Tamhane, A.C. 1987. Multiple Comparison Pro-cedures.Wiley.
Leung, T. and Malik, J. 2001. Representing and recognizing the vi-sual appearance of materials using threedimensional textons. International journal of Computer Vision.43(1):7–27.
Liu, X., Yu, Y., and Shum, I.Y. 2001. Synthesizing bidirectional texture functions for real-wold surface. In Proceedings of the 28th Annual C onfere on Computer Graphics and Interactive Techniques, EosAngeles, California, pp. 97–106.
Malzbender. E, Gelb D., and Wolters, I. 2001. Polynomial texture maps, In Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques,Los Angeles, California, pp. 519–528.
Nayar S.K., Ikeuchi, K., and Kanade, T. 1991. Surface reflection: Physical and geometrical perspectives. IEEE 7iansactions on Pat-tern Analysis and Machine Intelligence,13(7):611–634.
Nishino, K., Sato, Y., and Ikeuchi, K. 2001. Eigen-’Texture method: Appearance compression and synthesis based on a 3D model. Pat-tern Analysis and Machine Intelligence, IEEE Transactions on,23(11):1257–1265.
Ramamoorthi, R. 2002. Analytic PCA construction for theoretical analysis of lighting variability in images of a Lambertian object. Pattern Analysis and Machine Intelligence, IEEE Iransactions on,24(10):1322–1333.
Rushmeier, H., Taubin, G., and Gueziec, A. 1997. Applying shape from lighting variation to bump map capture. In Proceedings of the Eighth Eurographics Rendering Workshop, J. Dorsey and P. Slussallek (Eds.). Saint-Etienne, France, pp. 35–44.
Shashua, A. 1992. Geometry and photometry in 3D visual recognition. PhD thesis, MIT.
Simoncelli, E.P and Portilla, J. 1998. Texture characterization via joint statistics of wavelet coefficient magnitudes In Proceedings. 1998 International Conference on,vol. 1, pp. 62–66.
Tong, X., Zhang, J., Liu L., Wang X., Guo B., and Shum, H.-Y. 2002. Synthesis of bidirectional texture functions on arbitrary surfaces. ACM Transactions on Graphics (TOG). In Proc. of the 29th annual conference on Computer Graphics and Interactive Techniques,vol. 21, Issue 3, pp. 665–672.
Wei, L. and Levoy, M. 2000. Fast texture synthesis using nree-structured vector quantization. In Computer Graphics Proceedings. Annual Conference Series 2000. SIGGRAPH 2000, Conference Proceedings,ACM, pp. 479–88.
NWoodham, R. 1981. Analysing images of curved surfaces. Artificial Intelligence,17:117–140.
Xu, Y., Zhu, S.C., Guo, B., and Shum, H.Y. 2001. Asymptotically admissible texture synthesis. In Proc. Second International Work-shop of Statistical and Computational Theories of Vision,Vancou-ver, Canada.
Zalesny, A. and Van Gool, L. 2000. A compact model for viewpoint dependent texture synthesis. SMILE 2000. Work-shop on 3D Structure from Images, Lecture Notes in Com-puter Science2018, M Pollefeys et. al. (Eds.), pp. 123–143.
Zalesny, A. and Van Gool, L. 2001. Multiview texture models. In Proc. IEEE Computer Soc. Conf on Computer Vision and Pattern Recognition,vol. 1, pp. 615–1180.
Zhang, Z. 1998. Modeling geometric structure and illumination vari-ation of a scene from real images, In Proc. International Confer-ence on Computer Vision (ICCV’98),Bombay, India, pp. 1041–1046.
Zhu, S.C., Liu, X.W., and Wu, Y.N. 2000. Exploring texture ensem-bles by efficient Markov chain Monte Carlo-Towad a “trichro-macy” theory of texture. IEEE Transactions on Pattern Analysis & Machine Intelligence, 22(6): 554–69.
Rights and permissions
About this article
Cite this article
Dong, J., Chantler, M. Capture and Synthesis of 3D Surface Texture. Int J Comput Vision 62, 177–194 (2005). https://doi.org/10.1023/B:VISI.0000046595.00028.f1
Issue Date:
DOI: https://doi.org/10.1023/B:VISI.0000046595.00028.f1