Retexturing Single Views Using Texture and Shading
We present a method for retexturing non-rigid objects from a single viewpoint. Without reconstructing 3D geometry, we create realistic video with shape cues at two scales. At a coarse scale, a track of the deforming surface in 2D allows us to erase the old texture and overwrite it with a new texture. At a fine scale, estimates of the local irradiance provide strong cues of fine scale structure in the actual lighting environment. Computing irradiance from explicit correspondence is difficult and unreliable, so we limit our reconstructions to screen printing — a common printing techniques with a finite number of colors. Our irradiance estimates are computed in a local manner: pixels are classified according to color, then irradiance is computed given the color. We demonstrate results in two situations: on a special shirt designed for easy retexturing and on natural clothing with screen prints. Because of the quality of the results, we believe that this technique has wide applications in special effects and advertising.
KeywordsScreen Print Texture Synthesis Single View Nonrigid Motion Explicit Correspondence
Unable to display preview. Download preview PDF.
- 1.Debevec, P.: Rendering synthetic objects into real scenes: Bridging traditional and image-based graphics with global illumination and high dynamic range photography. In: Proceedings of SIGGRAPH 1998. Computer Graphics Proceedings, Annual Conference Series, July 1998, pp. 189–198 (1998)Google Scholar
- 5.Haddon, J., Forsyth, D.A.: Shading primitives. Int. Conf. on Computer Vision (1997)Google Scholar
- 6.Haddon, J., Forsyth, D.: Shape representations from shading primitives. In: Burkhardt, H., Neumann, B. (eds.) ECCV 1998. LNCS, vol. 1407, pp. 415–431. Springer, Heidelberg (1998)Google Scholar
- 7.Lobay, A., Forsyth, D.A.: Recovering shape and irradiance maps from rich dense texton fields. In: Proceedings of Computer Vision and Pattern Recognition, CVPR (2004)Google Scholar
- 9.Pilet, J., Lepetit, V., Fua, P.: Real-time non-rigid surface detection. In: The IEEE Conference on Computer Vision and Pattern Recognition, CVPR (2005)Google Scholar
- 11.Yu, Y., Debevec, P., Malik, J., Hawkins, T.: Inverse global illumination: Recovering reflectance models of real scenes from photographs from. In: Rockwood, A. (ed.) Siggraph 1999, Annual Conference Series, Los Angeles, pp. 215–224. Addison Wesley Longman, Amsterdam (1999)Google Scholar