The Visual Computer

, Volume 28, Issue 10, pp 983–993 | Cite as

Texturing 3D models from sequential photos

  • Ricardo Marroquim
  • Gustavo Pfeiffer
  • Felipe Carvalho
  • Antonio A. F. Oliveira
Original Article
  • 295 Downloads

Abstract

This paper proposes a methodology to texture 3D objects with low geometric features from sequentially taken photos. These models pose a challenge to current approaches since they are mainly driven by geometric features—such as contours—that can be extracted from the photographs and uniquely matched with the 3D model. However, when dealing with certain types of objects, such as vases or mechanical equipments, for example, it is not uncommon to find cases where the geometric information is insufficient.

Our method compensates for the lack of geometric features by using a variation of a contour-based approach that is guided not only by external contours, but also by the internal ones extracted directly from the photos. To align the features a custom-made optimization method is described that avoids common convergence pitfalls encountered in this scenario. In addition, pursuing a fully automatic solution, a linear approach based on feature matching is employed to generate a first guess for the nonlinear optimization. The overall goal is to facilitate an on-site registration process where the photos are taken in a sequential manner and aligned as they are acquired.

Keywords

Texture-to-geometry registration 3D virtual replica High-resolution texture mapping Least-squares minimization 

Notes

Acknowledgements

The authors would like to thank the colleagues from the Visual Computing Lab (CNR-Pisa) for their help and support on using their texture blending software, and the researches and technicians from MAST (Museum of Astronomy and Affine Sciences—Rio de Janeiro) for the collaboration in the digitalization process of the meridian circle.

This work was supported by Rio de Janeiro’s research funding agency—FAPERJ.

References

  1. 1.
    Bannai, N., Agathos, A., Fisher, R.B.: Fusing multiple color images for texturing models. In: Proceedings of the 3D Data Processing, Visualization, and Transmission, 2nd International Symposium, 3DPVT’04, pp. 558–565. IEEE Computer Society, Washington (2004) CrossRefGoogle Scholar
  2. 2.
    Billeter, M., Olsson, O., Assarsson, U.: Efficient stream compaction on wide SIMD many-core architectures. In: Proceedings of the Conference on High Performance Graphics 2009, HPG’09, pp. 159–166. ACM, New York (2009) CrossRefGoogle Scholar
  3. 3.
    Callieri, M., Cignoni, P., Corsini, M., Scopigno, R.: Masked photo blending: mapping dense photographic dataset on high-resolution 3d models. Comput. Graph. 32(4), 464–473 (2008) CrossRefGoogle Scholar
  4. 4.
    Chuang, M., Luo, L., Brown, B.J., Rusinkiewicz, S., Kazhdan, M.: Estimating the Laplace–Beltrami operator by restricting 3D functions. In: Proceedings of the Symposium on Geometry Processing, pp. 1475–1484. Eurographics Association, Geneva (2009) Google Scholar
  5. 5.
    Corsini, M., Dellepiane, M., Ponchio, F., Scopigno, R.: Image-to-geometry registration: a mutual information method exploiting illumination-related geometric properties. Comput. Graph. Forum 28(7), 1755–1764 (2009) CrossRefGoogle Scholar
  6. 6.
    DeCarlo, D., Finkelstein, A., Rusinkiewicz, S., Santella, A.: Suggestive contours for conveying shape. ACM Trans. Graph. 22, 848–855 (2003) CrossRefGoogle Scholar
  7. 7.
    Dellepiane, M., Marroquim, R., Callieri, M., Cignoni, P., Scopigno, R.: Flow-based local optimization for image-to-geometry projection. IEEE Trans. Vis. Comput. Graph. 18, 463–474 (2012) CrossRefGoogle Scholar
  8. 8.
    Felzenszwalb, P.F., Huttenlocher, D.P.: Distance transforms of sampled functions. Tech. rep., Cornell Computing and Information Science (2004) Google Scholar
  9. 9.
    Fiore, P.D.: Efficient linear solution of exterior orientation. IEEE Trans. Pattern Anal. Mach. Intell. 23(2), 140–148 (2001) MathSciNetCrossRefGoogle Scholar
  10. 10.
    Gal, R., Wexler, Y., Ofek, E., Hoppe, H., Cohen-Or, D.: Seamless montage for texturing models. Comput. Graph. Forum (Eurograph.) 29(2), 479–486 (2010) CrossRefGoogle Scholar
  11. 11.
    Guennebaud, G., Jacob, B., et al.: Eigen v3 (2010). http://eigen.tuxfamily.org
  12. 12.
    Harris, C., Stephens, M.: A combined corner and edge detection. In: Proceedings of the Fourth Alvey Vision Conference, pp. 147–151 (1988) Google Scholar
  13. 13.
    Lensch, H.P.A., Heidrich, W., Seidel, H.P.: A Silhouette-based algorithm for texture registration and stitching. Graph. Models 63(4), 245–262 (2001) MATHCrossRefGoogle Scholar
  14. 14.
    Liu, L., Stamos, I., Yu, G., Wolberg, G., Zokai, S.: Multiview geometry for texture mapping 2d images onto 3d range data. In: CVPR’06: Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 2293–2300. IEEE Computer Society, Washington (2006) Google Scholar
  15. 15.
    Lowe, D.G.: Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis. 60, 91–110 (2004) CrossRefGoogle Scholar
  16. 16.
    Madsen, K., Nielsen, H.B., Tingleff, O.: Methods for Non-linear Least Squares Problems, 2nd edn. (2004) Google Scholar
  17. 17.
    Matsushita, K., Kaneko, T.: Efficient and handy texture mapping on 3d surfaces. Comput. Graph. Forum 18(3), 349–358 (1999) CrossRefGoogle Scholar
  18. 18.
    Neugebauer, P.J., Klein, K.: Texturing 3d models of real world objects from multiple unregistered photographic views. Comput. Graph. Forum 18(3), 245–256 (1999) CrossRefGoogle Scholar

Copyright information

© Springer-Verlag 2012

Authors and Affiliations

  • Ricardo Marroquim
    • 1
  • Gustavo Pfeiffer
    • 1
  • Felipe Carvalho
    • 1
  • Antonio A. F. Oliveira
    • 1
  1. 1.Computer Graphics Lab (LCG)COPPE-UFRJRio de JaneiroBrazil

Personalised recommendations