Abstract
Inverse rendering is a method for estimating object shapes and lighting conditions from a set of images. In the present paper, we propose an uncalibrated photometric stereo method that approximates the shapes of the target objects using quadric surfaces (ellipsoids or hyperboloids), and this shape representation allows us to use multiple cameras in order to reduce the GBR ambiguity. The proposed method uses the Levenberg-Marquardt method to minimize the differences between the input images and generated images calculated based on the estimated parameters and the image formation model. It is important to define each term in the cost function depending on the inside or outside of the contour of the estimated quadric surface and/or the target object. The proposed method has been verified on several sets of real images, namely, Vase, Grapes, and Snacks, and we found that the method required less than 100 iterations. On the other hand, there is room for improvement regarding the accuracy of the estimation by taking into account the shadows of the target objects and using a more advanced reflection model.
Supported by JSPS KAKENHI Grant Number 17K00239.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Ramamoorthi, R., Hanrahan, P.: A signal-processing framework for inverse rendering. In: SIGGRAPH 2001, pp. 117–128 (2001)
Woodham, R.J.: Photometric method for determining surface orientation from multiple images. Opt. Eng. 19(I), 139–144 (1980)
Shi, B., Mo, Z., Wu, Z., Duan, D., Yeung, S.-K., Tan, P.: A benchmark dataset and evaluation for non-lambertian and uncalibrated photometric stereo. IEEE Trans. Pattern Anal. Mach. Intell. (TPAMI) 41(2), 271–284 (2019)
Migita, T., Ogino, S., Shakunaga, T.: Direct bundle estimation for recovery of shape, reflectance property and light position. In: Forsyth, D., Torr, P., Zisserman, A. (eds.) ECCV 2008. LNCS, vol. 5304, pp. 412–425. Springer, Heidelberg (2008). https://doi.org/10.1007/978-3-540-88690-7_31
Belhumeur, P.N., Kriegman, D.J., Yuille, A.L.: The bas-relief ambiguity. Int. J. Comput. Vis. 35(1), 33–44 (1999)
Hartley, R., Zisserman, A.: Multiple View Geometry in Computer Vison, 2nd edn. Cambridge University Press, Cambridge (2003)
Koppal, S.J.: Lambertian reflectance. In: Ikeuchi, K. (ed.) Computer Vision. Springer, Boston (2014). https://doi.org/10.1007/978-0-387-31439-6
Levenberg, K.: A method for the solution of certain non-linear problems in least squares. Q. Appl. Math. 2(2), 164–168 (1944)
Marquardt, D.: An algorithm for least-squares estimation of nonlinear parameters. SIAM J. Appl. Math. 11(2), 431–441 (1963)
Diebel, J.: Representing Attitude: Euler Angles, Unit Quaternions, and Rotation Vectors. Technical report, Stanford University (2006)
Barr, A.H.: Superquadrics and angle-preserving transformations. IEEE Comput. Graph. Appl. 1(1), 11–23 (1981)
Matusik, W., Pfister, H., Brand, M., McMillan, L.: A data-driven reflectance model. ACM Trans. Graph. 22(3), 759–769 (2003)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Nasu, T., Migita, T., Shakunaga, T., Takahashi, N. (2020). Uncalibrated Photometric Stereo Using Quadric Surfaces with Two Cameras. In: Ohyama, W., Jung, S. (eds) Frontiers of Computer Vision. IW-FCV 2020. Communications in Computer and Information Science, vol 1212. Springer, Singapore. https://doi.org/10.1007/978-981-15-4818-5_24
Download citation
DOI: https://doi.org/10.1007/978-981-15-4818-5_24
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-15-4817-8
Online ISBN: 978-981-15-4818-5
eBook Packages: Computer ScienceComputer Science (R0)