ECCV 2006: Computer Vision – ECCV 2006 pp 564-577 | Cite as

Carved Visual Hulls for Image-Based Modeling

  • Yasutaka Furukawa
  • Jean Ponce
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3951)

Abstract

This article presents a novel method for acquiring high-quality solid models of complex 3D shapes from multiple calibrated photographs. After the purely geometric constraints associated with the silhouettes found in each image have been used to construct a coarse surface approximation in the form of a visual hull, photoconsistency constraints are enforced in three consecutive steps: (1) the rims where the surface grazes the visual hull are first identified through dynamic programming; (2) with the rims now fixed, the visual hull is carved using graph cuts to globally optimize the photoconsistency of the surface and recover its main features; (3) an iterative (local) refinement step is finally used to recover fine surface details. The proposed approach has been implemented, and experiments with six real data sets are presented, along with qualitative comparisons with several state-of-the-art image-based-modeling algorithms.

Keywords

Image Discrepancy Surface Detail Visual Hull Frontier Point Apparent Contour 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
This is a preview of subscription content, log in to check access.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Baumgart, B.G.: Geometric modeling for computer vision. Stanford University (1974)Google Scholar
  2. 2.
    Boykov, Y., Kolmogorov, V.: Computing geodesics and minimal surfaces via graph cuts. In: ICCV, pp. 26–33 (2003)Google Scholar
  3. 3.
    Cheung, K.M., Baker, S., Kanade, T.: Visual hull alignment and refinement across time: A 3d reconstruction algorithm combining shape-from-silhouette with stereo. In: CVPR (June 2003)Google Scholar
  4. 4.
    Curless, B., Levoy, M.: A volumetric method for building complex models from range images. In: SIGGRAPH, pp. 303–312. ACM Press, New York (1996)Google Scholar
  5. 5.
    Delingette, H., Hebert, M., Ikeuchi, K.: Shape representation and image segmentation using deformable surfaces. IVC 10(3), 132–144 (1992)CrossRefGoogle Scholar
  6. 6.
    Faugeras, O., Keriven, R.: Variational principles, surface evolution, PDE’s, level set methods and the stereo problem. IEEE Trans. Im. Proc. 7(3), 336–344 (1998)MathSciNetCrossRefMATHGoogle Scholar
  7. 7.
    Hernández Esteban, C., Schmitt, F.: Silhouette and stereo fusion for 3D object modeling. CVIU 96(3), 367–392 (2004)Google Scholar
  8. 8.
    Huber, D.F., Hebert, M.: 3D modeling using a statistical sensormodel and stochastic search. In: CVPR, vol. 1, pp. 858–865 (2003)Google Scholar
  9. 9.
    Keriven, R.: A variational framework to shape from contours. Technical Report 2002-221, ENPC (2002)Google Scholar
  10. 10.
    Kolmogorov, V., Zabih, R.: Multi-camera scene reconstruction via graph cuts. In: Heyden, A., Sparr, G., Nielsen, M., Johansen, P. (eds.) ECCV 2002. LNCS, vol. 2352, pp. 82–96. Springer, Heidelberg (2002)CrossRefGoogle Scholar
  11. 11.
    Kutulakos, K.N., Seitz, S.M.: A theory of shape by space carving. IJCV 38(3) (2000)Google Scholar
  12. 12.
    Lachaud, J.-O., Montanvert, A.: Deformable meshes with automated topology changes for coarse-to-fine 3d surface extraction. Medical Image Analysis 3(2), 187–207 (1999)CrossRefGoogle Scholar
  13. 13.
    Lazebnik, S.: Projective visual hulls. Technical Report MS Thesis, UIUC (2002)Google Scholar
  14. 14.
    Levoy, M., Pulli, K., Curless, B., Rusinkiewicz, S., Koller, D., Pereira, L., Ginzton, M., Anderson, S., Davis, J., Ginsberg, J., Shade, J., Fulk, D.: The digital michelangelo project: 3D scanning of large statues. In: SIGGRAPH, pp. 131–144 (2000)Google Scholar
  15. 15.
    Matusik, W., Pfister, H., Ngan, A., Beardsley, P., Ziegler, R., McMillan, L.: Image-based 3D photography using opacity hulls. In: SIGGRAPH (2002)Google Scholar
  16. 16.
    Paris, S., Sillion, F., Quan, L.: A surface reconstruction method using global graph cut optimization. In: ACCV (January 2004)Google Scholar
  17. 17.
    Schaffalitzky, F., Zisserman, A.: Viewpoint invariant texture matching and wide baseline stereo. In: ICCV (2001)Google Scholar
  18. 18.
    Seitz, S.M., Dyer, C.R.: Photorealistic scene reconstruction by voxel coloring. In: CVPR, pp. 1067–1073 (1997)Google Scholar
  19. 19.
    Sinha, S., Pollefeys, M.: Visual hull reconstruction from uncalibrated and unsynchronized video streams. In: Int. Symp. on 3D Data Processing, Visualization & Transmission (2004)Google Scholar
  20. 20.
    Sinha, S., Pollefeys, M.: Multi-view reconstruction using photo-consistency and exact silhouette constraints: A maximum-flow formulation. In: ICCV (2005)Google Scholar
  21. 21.
    Soatto, S., Yezzi, A.J., Jin, H.: Tales of shape and radiance in multiview stereo. In: ICCV, pp. 974–981 (2003)Google Scholar
  22. 22.
    Uffenkamp, V.: State of the art of high precision industrial photogrammetry. In: Third International Workshop on Accelerator Alignment, Annecy, France (1993)Google Scholar
  23. 23.
    Vogiatzis, G., Torr, P.H.S., Cipolla, R.: Multi-view stereo via volumetric graph-cuts. In: CVPR, pp. 391–398 (2005)Google Scholar
  24. 24.
    Xu, C., Prince, J.L.: Gradient vector flow: A new external force for snakes. In: CVPR, pp. 66–71 (1997)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Yasutaka Furukawa
    • 1
  • Jean Ponce
    • 1
    • 2
  1. 1.Department of Computer ScienceUniversity of Illinois at Urbana ChampaignUSA
  2. 2.Département d’Informatique, Ecole Normale SupérieureParisFrance

Personalised recommendations