Creating Photorealistic Virtual Model with Polarization-based Vision System

  • Takushi Shibata
  • Toru Takahashi
  • Daisuke Miyazaki
  • Yoichi Sato
  • Katsushi Ikeuchi

Recently, 3D models are used in many fields such as education, medical services, entertainment, art, digital archive, etc., because of the progress of computational time and demand for creating photorealistic virtual model is increasing for higher reality. In the field of computer vision, a number of techniques have been developed for creating the virtual model by observing the real object in computer vision field. In this chapter, we propose the method for creating photorealistic virtual model by using laser range sensor and polarization based image capture system. We capture the range and color images of the object which is rotated on the rotary table. In geometrical aspects, an object surface shape is reconstructed by merging multiple range images of the object. In optical aspects, color images are captured under fixed point light source. By using reconstructed object shape and sequence of color images of the object, parameter of a reflection model are estimated in a robust manner. As a result, we can make photorealistic 3D model in consideration of surface reflection. The key point of the proposed method is that, first, the diffuse and specular reflection components are separated from the color image sequence, and then, reflectance parameters of each reflection component are estimated separately. In separation of reflection components, we use polarization filter. This approach enables estimation of reflectance properties of real objects whose surfaces show specularity as well as diffusely reflected lights. The recovered object shape and reflectance properties are then used for synthesizing object images with realistic shading effects under arbitrary illumination conditions.


Color Image Linear Polarization Geometrical Optic Range Image Object Surface 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. [1]
    T.E. Boult and L.B. Wolff, "Phisically based edge labeling," Proceedings of Computer Vision and Pattern Recognition ,pp.656-663,Maui,Hawaii,June 1991.CrossRefGoogle Scholar
  2. [2]
    P.Debevec, T.Hawkins, C.Tchou, H-P.Duiker, W.Sarokin and M.Sagar "Acquiring the Reflectance Field of a Human Face," Computer Graphics Proceedings, ACM SIGGRAPH’2000, Aug.2000Google Scholar
  3. [3]
    P.Debevec, A.Wenger, C.Tchou, A.Gardner, J.Waese and T.Hawkins "A Lighting Reproduction Approach to Live-Action Compositing," Computer Graphics Proceedings, ACM SIGGRAPH’2002, July.2002Google Scholar
  4. [4]
    A.S.Georghiades "Recovering 3-D Shape and Reflectance From a Small Number of Photographs," Eurographics Symposium on Rendering:14th Eurographics Workshop on Rendering, pp230-240, 2002Google Scholar
  5. [5]
    S.J.Gorter, R.Grzeszczuk, R.Szeliski and M.F.Cohen, "The Lumigraph," Computer Graphics Proceedings,ACM SIGGRAPH’96, pp.43-54,Aug.1996.Google Scholar
  6. [6]
    G.J. Klinker, S. AShafer and T. Kanade, "The measurement of highlights in color images," International Journal of Computer Vision, Vol.2, No.1,pp 7-32,1990.CrossRefGoogle Scholar
  7. [7]
    M.Levoy and P.Hanrahan, "Light Field Rendering," Computer Graphics Proceedings,ACM SIGGRAPH’96, pp.31-42,Aug.1996.Google Scholar
  8. [8]
    S.K. Nayer, K. Ikeuchi, T. Kanade, "Surafece Reflection: Physical and Geometrical Perspectives," IEEE Trans. on Patte5rn AAnalysis and Machine Intelligence, Vol.13, No.7, pp.611-634, July 1991.CrossRefGoogle Scholar
  9. [9]
    S.K. Nayer,X. Fang, T.E. Boult, "Removal of specularities using color and polarization,"Proceedings of Computer Vision and Pattern Recognition ’93, pp.583-590, New York City, NY, June 1993.Google Scholar
  10. [10]
    K. Nishino, Y. Sato and K. Ikeuchi, "Eigen-Texture Method: Appearance Compression and Synthesis based on a 3D Model," IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol.23,No.11,pp.1257-1265, Nov.2001.CrossRefGoogle Scholar
  11. [11]
    M. Saito,Y. Sato,K. Ikeuchi,H. Kashiwagi, "Measurement of Surface Orientations of Transparent Objects Using Polarization in Highlight," IEEE Trans.on Computer Vision and Pattern Recognition ’99, Vol.1,pp.381-386, Fort Collins,Colorado, June 1999.Google Scholar
  12. [12]
    Y. Sato and K. Ikeuchi, "Temporal-color space analysis of reflection," Journal of Optical Society of America A, vol.11, no.11,pp.2990-3002,November 1994.CrossRefGoogle Scholar
  13. [13]
    Y.Sato,M.D.Wheeler,K.Ikeuchi, "Object Shape and Reflectance Modeling from Observation," Computer Graphics Proceedings,ACM SIGGRAPH’97,pp. 379-387,Aug 1997.Google Scholar
  14. [14]
    Y.Y.Schechner, J.Shamir and N.Kiryati, "Polarization-based Decorrelation of Transparent Layers: The Inclination Angle of an Invisible Sur-face," Proceedings of International Conference on Computer Vision ’99,pp.814-819, 1999.Google Scholar
  15. [15]
    S. Shafer, "Using color to separate reflection components," Color Research and Applications, Vol.10,pp.210-218,1985.CrossRefGoogle Scholar
  16. [16]
    K.E. Torrance and E.M. Sparrow, "Theory of off-specular reflection from roughened surfaces," Journal of the Optical Society of America Vol.57, pp.1105-1114 , 1967.CrossRefGoogle Scholar
  17. [17]
    A.Wenger, A.Gardner, C.Tchou, J.Unger, T.Hawkins and P.Debevec "A Lighting Reproduction Approach to Live-Action Compositing," Computer Graphics Proceedings, ACM SIGGRAPH’2005, to be appear.Google Scholar
  18. [18]
    L.B. Wolff and T.E. Boult, "Constraining Object Features using a Polaization Reflectance Model," IEEE Trans. on Pattern Analysis and Machine Intelligence, Volo.13,No.7,pp.635-657, July 1991.CrossRefGoogle Scholar
  19. [19]
    D.N.Wood, D.I.Azuma, K.Aldinger, B.Curless, T.Duchamp, D.H.Salesin and W.Stuetzle, "Surface Light Fields for 3D Photography," Computer Graphics Proceedings,ACM SIGGRAPH’00, Aug.2000.Google Scholar

Copyright information

© Springer Science+Business Media, LLC 2008

Authors and Affiliations

  • Takushi Shibata
  • Toru Takahashi
  • Daisuke Miyazaki
  • Yoichi Sato
  • Katsushi Ikeuchi
    • 1
  1. 1.Institute of Industrial ScienceThe University of TokyoMeguro-kuJapan

Personalised recommendations