Abstract
Relighting techniques can achieve the photometric consistency in synthesizing a composite images. Relighting generally need the object’s shape and illumination environment. Recent research demonstrates possibilities of relighting for an unknown shape object or the relighting the object under unknown illumination environment. However, achieving both tasks are still challenging issue. In this paper, we propose a relighting method for an unknown shape object captured under unknown illumination environment by using an RGB-D camera. The relighted object can be rendered from pixel intensity, surface albedo and shape of the object and illumination environment. The pixel intensity and the shape of the object can simultaneously be obtained from an RGB-D camera. Then surface albedo and illumination environment are iteratively estimated from the pixel intensity and shape of the object. We demonstrate that our method can perform relighting for a dynamic shape object captured under unknown illumination using an RGB-D camera.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Debevec, P., Hawkins, T., Tchou, C., Duiker, H.P., Sarokin, W., Sagar, M.: Acquiring the reflectance field of a human face. In: ACM SIGGRAPH. ACM (2000)
Wenger, A., Gardner, A., Tchou, C., Unger, J., Hawkins, T., Debevec, P.: Performance relighting and reflectance transformation with time-multiplexed illumination. ACM Trans. Graph. 24(3), 756–764 (2005)
Zhen, W., Liu, Z., Huang, T.S.: Face relighting with radiance environment maps. In: IEEE Conference on Computer Vision and Pattern Recognition. IEEE (2003)
Aldrian, O., Smith, W.: Inverse rendering with a morphable model: A multilinear approach. In: Proceedings of the British Machine Vision Conference. BMVA Press (2011)
Wang, Y., Zhang, L., Liu, Z., Hua, G., Wen, Z., Zhang, Z., Samaras, D.: Face relighting from a single image under arbitrary unknown lighting conditions. IEEE Trans. Pattern Anal. Mach. Intell. 31, 1968–1984 (2009)
Ramamoorthi, R., Hanrahan, P.: A signal-processing framework for inverse rendering. In: Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques. ACM (2001)
Matsumoto, K., Song, C., de Sorbier, F., Saito, H.: Joint upsampling and noise reduction for real-time depth map enhancement. In: Proceedings of IS&T/SPIE Electronic Imaging, SPIE (2014)
Holzer, S., Rusu, R.B., Dixon, M., Gedikli, S., Navab, N.: Adaptive neighborhood selection for real-time surface normal estimation from organized point cloud data using integral images. In: IEEE/RSJ International Conference on Intelligent Robots and Systems. IEEE (2012)
Nowrouzezahrai, D., Simari, P., Fiume, E.: Sparse zonal harmonic factorization for efficient SH rotation. ACM Trans. Graph. 31, 23 (2012)
Zou, X., Kittler, J., Hamouz, M., Tena, J.R.: Robust albedo estimation from face image under unknown illumination. In: SPIE Defense and Security Symposium, SPIE (2008)
Ramamoorthi, R., Hanrahan, P.: An efficient representation for irradiance environment maps. In: ACM SIGGRAPH. ACM (2001)
Gruber, L., Richter-Trummer, T., Schmalstieg, D.: Real-time photometric registration from arbitrary geometry. In: IEEE International Symposium on Mixed and Augmented Reality. IEEE (2011)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this paper
Cite this paper
Ogura, Y., Saito, H. (2015). Relighting for an Arbitrary Shape Object Under Unknown Illumination Environment. In: Bebis, G., et al. Advances in Visual Computing. ISVC 2015. Lecture Notes in Computer Science(), vol 9475. Springer, Cham. https://doi.org/10.1007/978-3-319-27863-6_40
Download citation
DOI: https://doi.org/10.1007/978-3-319-27863-6_40
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-27862-9
Online ISBN: 978-3-319-27863-6
eBook Packages: Computer ScienceComputer Science (R0)