Skip to main content
SpringerLink
Log in

Texturing 3D models from sequential photos

  • Original Article
  • Published:
The Visual Computer Aims and scope Submit manuscript

Abstract

This paper proposes a methodology to texture 3D objects with low geometric features from sequentially taken photos. These models pose a challenge to current approaches since they are mainly driven by geometric features—such as contours—that can be extracted from the photographs and uniquely matched with the 3D model. However, when dealing with certain types of objects, such as vases or mechanical equipments, for example, it is not uncommon to find cases where the geometric information is insufficient.

Our method compensates for the lack of geometric features by using a variation of a contour-based approach that is guided not only by external contours, but also by the internal ones extracted directly from the photos. To align the features a custom-made optimization method is described that avoids common convergence pitfalls encountered in this scenario. In addition, pursuing a fully automatic solution, a linear approach based on feature matching is employed to generate a first guess for the nonlinear optimization. The overall goal is to facilitate an on-site registration process where the photos are taken in a sequential manner and aligned as they are acquired.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

Similar content being viewed by others

References

  1. Bannai, N., Agathos, A., Fisher, R.B.: Fusing multiple color images for texturing models. In: Proceedings of the 3D Data Processing, Visualization, and Transmission, 2nd International Symposium, 3DPVT’04, pp. 558–565. IEEE Computer Society, Washington (2004)

    Chapter  Google Scholar 

  2. Billeter, M., Olsson, O., Assarsson, U.: Efficient stream compaction on wide SIMD many-core architectures. In: Proceedings of the Conference on High Performance Graphics 2009, HPG’09, pp. 159–166. ACM, New York (2009)

    Chapter  Google Scholar 

  3. Callieri, M., Cignoni, P., Corsini, M., Scopigno, R.: Masked photo blending: mapping dense photographic dataset on high-resolution 3d models. Comput. Graph. 32(4), 464–473 (2008)

    Article  Google Scholar 

  4. Chuang, M., Luo, L., Brown, B.J., Rusinkiewicz, S., Kazhdan, M.: Estimating the Laplace–Beltrami operator by restricting 3D functions. In: Proceedings of the Symposium on Geometry Processing, pp. 1475–1484. Eurographics Association, Geneva (2009)

    Google Scholar 

  5. Corsini, M., Dellepiane, M., Ponchio, F., Scopigno, R.: Image-to-geometry registration: a mutual information method exploiting illumination-related geometric properties. Comput. Graph. Forum 28(7), 1755–1764 (2009)

    Article  Google Scholar 

  6. DeCarlo, D., Finkelstein, A., Rusinkiewicz, S., Santella, A.: Suggestive contours for conveying shape. ACM Trans. Graph. 22, 848–855 (2003)

    Article  Google Scholar 

  7. Dellepiane, M., Marroquim, R., Callieri, M., Cignoni, P., Scopigno, R.: Flow-based local optimization for image-to-geometry projection. IEEE Trans. Vis. Comput. Graph. 18, 463–474 (2012)

    Article  Google Scholar 

  8. Felzenszwalb, P.F., Huttenlocher, D.P.: Distance transforms of sampled functions. Tech. rep., Cornell Computing and Information Science (2004)

  9. Fiore, P.D.: Efficient linear solution of exterior orientation. IEEE Trans. Pattern Anal. Mach. Intell. 23(2), 140–148 (2001)

    Article  MathSciNet  Google Scholar 

  10. Gal, R., Wexler, Y., Ofek, E., Hoppe, H., Cohen-Or, D.: Seamless montage for texturing models. Comput. Graph. Forum (Eurograph.) 29(2), 479–486 (2010)

    Article  Google Scholar 

  11. Guennebaud, G., Jacob, B., et al.: Eigen v3 (2010). http://eigen.tuxfamily.org

  12. Harris, C., Stephens, M.: A combined corner and edge detection. In: Proceedings of the Fourth Alvey Vision Conference, pp. 147–151 (1988)

    Google Scholar 

  13. Lensch, H.P.A., Heidrich, W., Seidel, H.P.: A Silhouette-based algorithm for texture registration and stitching. Graph. Models 63(4), 245–262 (2001)

    Article  MATH  Google Scholar 

  14. Liu, L., Stamos, I., Yu, G., Wolberg, G., Zokai, S.: Multiview geometry for texture mapping 2d images onto 3d range data. In: CVPR’06: Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 2293–2300. IEEE Computer Society, Washington (2006)

    Google Scholar 

  15. Lowe, D.G.: Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis. 60, 91–110 (2004)

    Article  Google Scholar 

  16. Madsen, K., Nielsen, H.B., Tingleff, O.: Methods for Non-linear Least Squares Problems, 2nd edn. (2004)

    Google Scholar 

  17. Matsushita, K., Kaneko, T.: Efficient and handy texture mapping on 3d surfaces. Comput. Graph. Forum 18(3), 349–358 (1999)

    Article  Google Scholar 

  18. Neugebauer, P.J., Klein, K.: Texturing 3d models of real world objects from multiple unregistered photographic views. Comput. Graph. Forum 18(3), 245–256 (1999)

    Article  Google Scholar 

Download references

Acknowledgements

The authors would like to thank the colleagues from the Visual Computing Lab (CNR-Pisa) for their help and support on using their texture blending software, and the researches and technicians from MAST (Museum of Astronomy and Affine Sciences—Rio de Janeiro) for the collaboration in the digitalization process of the meridian circle.

This work was supported by Rio de Janeiro’s research funding agency—FAPERJ.

Author information

Authors and Affiliations

  1. Computer Graphics Lab (LCG), COPPE-UFRJ, Rio de Janeiro, Brazil

    Ricardo Marroquim, Gustavo Pfeiffer, Felipe Carvalho & Antonio A. F. Oliveira

Authors
  1. Ricardo Marroquim
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Gustavo Pfeiffer
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Felipe Carvalho
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Antonio A. F. Oliveira
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Ricardo Marroquim.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Marroquim, R., Pfeiffer, G., Carvalho, F. et al. Texturing 3D models from sequential photos. Vis Comput 28, 983–993 (2012). https://doi.org/10.1007/s00371-012-0743-7

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00371-012-0743-7

Keywords

Search

Navigation