Abstract
This paper presents a novel method for the registration of texture images with a 3D model of outdoor scenes. We pose image registration as an optimization problem that uses knowledge of the sun’s position to estimate shadows in a scene, and use the shadows produced as a cue to solve for the registration parameters. Results are presented on a controlled experiment and for a large scale model of an archaeological site in Sicily.
Similar content being viewed by others
References
Allen, P., Feiner, S., Troccoli, A., Benko, H., Ishak, E., Smith, B.: Seeing into the past: Creating a 3D modeling pipeline for archaeological visualization. In: Proceedings of 2nd International Symposium on 3D Data Processing, Visualization and Transmission (2004)
Ansar A., Daniilidis K. (2003). Linear pose estimation from points or lines. IEEE Trans. Pattern Anal. Mach. Intell. 25(5): 578–589. DOI http://dx.doi.org/10.1109/TPAMI.2003. 1195992
Bernardini F., Rushmeier H. (2002) The 3D model acquisition pipeline. Computer Graphics Forum 21(2): 149–172
Bernardini F., Rushmeier H., Martin I.M., Mittleman J., Taubin G. (2002) Building a digital model of Michelangelo’s Florentine Pietà. IEEE Comput. Graph. Appl. 22(1): 59–67
Bouguet, J.Y.: Camera calibration toolbox for Matlab. (2001). Http://www.vision.caltech.edu/bouguet/calib_doc
Curless, B., Levoy, M.: A volumetric method for building complex models from range images. In: Proceedings of the 23rd Annual Conference on Computer Graphics and Interactive Techniques, pp. 303–312. ACM Press (1996)
Daum, M., Dudek, G.: On 3-d surface reconstruction using shape from shadows. In: CVPR ’98: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, p. 461. IEEE Computer Society, Washington (1998)
Funka-Lea, G., Bajcsy, R.: Combining color and geometry for the active, visual recognition of shadows. In: ICCV ’95: Proceedings of the 5th International Conference on Computer Vision, p. 203. IEEE Computer Society, Washington (1995)
Hartley R., Zisserman A. (2000) Multiple View Geometry in Computer Vision. Cambridge University Press, Cambridge
Ikeuchi, K., Nakazawa, A., Nishino, K., Oishi, T.: Creating virtual buddha statues through observation. In: IEEE Workshop on Applications of Computer Vision in Architecture, vol.~1 (2003)
Ingber L. (1989) Very fast simulated re-annealing. Math. Comput. Modelling 12(8): 967–973
Irvin R.B., David M., McKeown J. (1989) Methods for exploiting the relationship between buildings and their shadows in aerial imagery. IEEE Trans. Syst. Man Cybern. 19(6): 1564–1575
Kriegman, D.J., Belhumeur, P.N.: What shadows reveal about object structure. In: ECCV ’98: Proceedings of the 5th European Conference on Computer Vision, vol. II, pp. 399–414. Springer, Berlin Heidelberg New York (1998)
Lensch H.P., Heidrich W., Seidel H.P. (2001) A silhouette-based algorithm for texture registration and stitching. Graph. Models 63(4): 245–262
Levoy, M., Pulli, K., Curless, B., Rusinkiewicz, S., Koller, D., Pereira, L., Ginzton, M., Anderson, S., Davis, J., Ginsberg, J., Shade, J., Fulk, D.: The digital Michelangelo project: 3D scanning of large statues. In: Proceedings of the 27th Annual Conference on Computer Graphics and Interactive Techniques, pp. 131–144 (2000)
Liu, L., Stamos, I.: Automatic 3d to 2d registration for the photorealistic rendering of urban scenes. In: CVPR ’05: Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR’05), vol. 2, pp. 137–143. IEEE Computer Society, Washington (2005). DOI http://dx.doi.org/10.1109/CVPR.2005.80
Pulli, K., Cohen, M., Duchamp, T., Hoppe, H., Shapiro, L., Stuetzle, W.: View-based rendering: Visualizing real objects from scanned range and color data. In: Rendering Techniques ’97, pp. 23–34. Springer, Berlin Heidelberg New York (1997)
Reda, I., Andreas, A.: Solar position algorithm for solar radiation applications. Tech. Rep., National Renewable Enery Laboratory, Golden, Colorado (2003)
Rocchini, C., Cignomi, P., Montani, C., Scopigno, R.: Multiple textures stitching and blending on 3D objects. In: Rendering Techniques ’99, Eurographics, pp. 119–130. Springer, Wien (1999)
Salvador E., Cavallaro A., Ebrahimi T. (2004). Cast shadow segmentation using invariant color features. Comput. Vis. Image Underst. 95(2): 238–259. DOI http://dx.doi.org/ 10.1016/j.cviu.2004.03.008
Sato I., Sato Y., Ikeuchi K. (2003). Illumination from shadows. IEEE Trans. Pattern Anal. Mach. Intell. 25(3): 290–300. DOI http://dx.doi.org/10.1109/TPAMI.2003.1182093
Segal, M., Korobkin, C., van Widenfelt, R., Foran, J., Haeberli, P.: Fast shadows and lighting effects using texture mapping. In: Proceedings of the 19th annual conference on Computer graphics and interactive techniques, pp. 249–252. ACM Press (1992)
Stamos, I., Allen, P.K.: Automatic registration of 2-D with 3-D imagery in urban environments. In: Proceedings of the 8th International Conference On Computer Vision (ICCV-01), pp. 731–737. IEEE Computer Society, Los Alamitos, CA (2001)
Yu Y., Chang J.T. (2005). Shadow graphs and 3d texture reconstruction. Int. J. Comput. Vis. 62(1–2): 35–60 DOI http:// dx.doi.org/ 10.1007/s11263-005-4634-5
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Troccoli, A., Allen, P. Shadow based texture registration for 3D modeling of outdoor scenes. Machine Vision and Applications 18, 65–72 (2007). https://doi.org/10.1007/s00138-006-0048-9
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00138-006-0048-9