Abstract
A review of methods for volumetric scene reconstruction from multiple views is presented. Occupancy descriptions of the voxels in a scene volume are constructed using shape-from-silhouette techniques for binary images, and shape-from-photo-consistency combined with visibility testing for color images.
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
N. Ahuja and J. Veenstra. Generating octrees from object silhouettes in orthographic views. IEEE Trans. Pattern Analysis and Machine Intelligence, 11:137–149, 1989.
A. H. Andersen and A. C. Kak. Simultaneous Algebraic Reconstruction Technique (SART): A superior implementation of the ART algorithm. Ultrasonic Imaging, 6:81–94, 1984.
C. Baillard and A. Zisserman. A plane-sweep strategy for the 3D reconstruction of buildings from multiple images. In Proc. 19th ISP RS Congress and Exhibition, 2000.
S. Baker, R. Szeliski, and P. Anandan. A layered approach to stereo reconstruction. In Proc. Computer Vision and Pattern Recognition Conf., pages 434–441, 1998.
B. G. Baumgart. Geometric modeling for computer vision. Artificial Intelligence Laboratory Memo AIM-249, Stanford University, 1974.
P. A. Beardsley, P. H. S. Torr, and A. Zisserman. 3D model aquisition from extended image sequence. In B. Buxton and R. Cipolla, editors, Computer Vision — ECCV ′96 (Proc. 4th European Conf. on Computer Vision, volume II), volume 1065 of Lecture Notes in Computer Science, pages 683–695. Springer-Verlag, 1996.
A. Broadhurst and R. Cipolla. A statistical consistency check for the space carving algorithm. In Proc, 11th British Machine Vision Conf., pages 282–291, 2000.
Q. Chen and G. Medioni. A volumetric stereo matching method: Application to image-based modeling. In Proc. Computer Vision and Pattern Recognition Conf., volume 1, pages 29–34, 1999.
G. K. M. Cheung, T. Kanade, J-Y. Bouguet, and M. Holler. A real time system for robust 3D voxel reconstruction of human motions. In Proc. Computer Vision and Pattern Recognition Conf., volume 2, pages 714–720, 2000.
C. H. Chien and J. K. Aggarwal. Volume surface octrees for the representation of 3D objects. Computer Vision, Graphics and Image Processing, 36:100–113, 1986.
R. Cipolla and A. Blake. Surface shape from the deformation of apparent contours. Intl. J. Computer Vision, 9:83–112, 1992.
R. T. Collins. A space-sweep approach to true multi-image matching. In Proc. Computer Vision and Pattern Recognition Conf., pages 358–363, 1996.
S. Coorg and S. Teller. Extracting textured vertical facades from controlled close-range imagery. In Proc. Computer Vision and Pattern Recognition Conf., volume 1, pages 625–632, 1999.
G. Cross and A. Zisserman. Surface reconstruction from multiple views using apparent contours and surface texture. In A. Leonardis, F. Solina, and R. Bajcsy, editors, Confluence of Computer Vision and Computer Graphics, pages 25–47. Kluwer, 2000.
W. B. Culbertson, T. Malzbender, and G. Slabaugh. Generalized voxel coloring. In B. Triggs, A. Zisserman, and R. Szeliski, editors, Vision Algorithms: Theory and Practice (Proc. Intl. Workshop on Vision Algorithms), volume 1883 of Lecture Notes in Computer Science, pages 100–115. Springer-Verlag, 2000.
B. Curless and M. Levoy. A volumetric method for building complex models from range images. In Proc. SIGGRAPH, pages 303–312, 1996.
F. Dachille, K. Mueller, and A. Kaufman. Volumetric backprojection. In Proc. Volume Visualization and Graphics Symposium, pages 109–117, 2000.
J. S. DeBonet and P. Viola. Roxels: Responsibility weighted 3D volume reconstruction. In Proc. 7th Intl. Conf. on Computer Vision, pages 418–425, 1999.
P. Eisert, E. Steinbach, and B. Girod. Multi-hypothesis, volumetric reconstruction of 3-D objects from multiple calibrated camera views. In Proc. Intl. Conf. on Acoustics, Speech, and Signal Processing, pages 3509–3512, 1999.
O. Faugeras and R. Keriven. Complete dense stereovision using level set methods. In H. Burkhardt and B. Neumann, editors, Computer Vision — ECCV ′98 (Proc. 5th European Conf. on Computer Vision, volume I), volume 1406 of Lecture Notes in Computer Science, pages 379–393. Springer-Verlag, 1998.
D. T. Gering and W. M. Wells III. Object modeling using tomography and photography. In Proc. IEEE Workshop on Multi-View Modeling and Analysis of Visual Scenes, pages 11–18, 1999.
S. J. Gortler, R. Grzeszczuk, R. Szeliski, and M. F. Cohen. The lumigraph. In Proc. SIGGRAPH, pages 43–54, 1996.
T. H. Hong and M. Shneier. Describing a robot’s workspace using a sequence of views from a moving camera. IEEE Trans. Pattern Analysis and Machine Intelligence, 7:721–726, 1985.
S. S. Intille and A. F. Bobick. Disparity-space images and large occlusion stereo. In J-O. Eklundh, editor, Computer Vision — ECCV ′94 (Proc. 3rd European Conf. on Computer Vision, volume II), volume 801 of Lecture Notes in Computer Science, pages 179–186. Springer-Verlag, 1994.
M. Kimura, H. Saito, and T. Kanade. 3D voxel construction based on epipolar geometry. In Proc. Intl. Conf. on Image Processing, pages 135–139, 1999.
R. Koch, M. Pollefeys, and L. Van Gool. Multi viewpoint stereo from uncalibrated video sequences. In H. Burkhardt and B. Neumann, editors, Computer Vision — ECCV ′98 (Proc. 5th European Conf. on Computer Vision, volume I), volume 1406 of Lecture Notes in Computer Science, pages 55–71. Springer-Verlag, 1998.
K. N. Kutulakos. Shape from the light field boundary. In Proc. Computer Vision and Pattern Recognition Conf., pages 53–59, 1997.
K. N. Kutulakos. Approximate n-view stereo. In D. Vernon, editor, Computer Vision — ECCV 2000 (Proc. 6th European Conf. on Computer Vision, volume I), volume 1842 of Lecture Notes in Computer Science, pages 67–83. Springer-Verlag, 2000.
K. N. Kutulakos and S. M. Seitz. A theory of shape by space carving. Intl. J. of Computer Vision, 38:199–218, 2000.
M. S. Langer and S. W. Zucker. Shape-from-shading on a cloudy day. J. Opt. Soc. Am. A, 11:467–478, 1994.
A. Laurentini. The visual hull concept for silhouette-based image understanding. IEEE Trans. Pattern Analysis and Machine Intelligence, 16:150–162, 1994.
A. Laurentini. How far 3D shapes can be understood from 2D silhouettes. IEEE Trans. Pattern Analysis and Machine Intelligence, 17:188–195, 1995.
A. Laurentini. How many 2D silhouettes does it take to reconstruct a 3D object? Computer Vision and Image Understanding, 67:81–87, 1997.
Y. G. Leclerc, Q-T. Luong, and P. Fua. Characterizing the performance of multiple-image point-correspondence algorithms using self-consistency. In B. Triggs, A. Zisserman, and R. Szeliski, editors, Vision Algorithms: Theory and Practice (Proc. Intl. Workshop on Vision Algorithms), volume 1883 of Lecture Notes in Computer Science, pages 100–115. Springer-Verlag, 2000.
Y. G. Leclerc, Q-T. Luong, and P. Fua. Measuring the self-consistency of stereo algorithms. In D. Vernon, editor, Computer Vision — ECCV 2000 (Proc. 6th European Conf. Computer Vision, volume II), volume 1842 of Lecture Notes in Computer Science, pages 282–298. Springer-Verlag, 2000.
W. E. Lorensen and H. E. Cline. Marching cubes: A high resolution 3D surface construction algorithm. In Proc. SIGGRAPH, pages 163–169, 1987.
W. N. Martin and J. K. Aggarwal. Volumetric description of objects from multiple views. IEEE Trans. Pattern Analysis and Machine Intelligence, 5:150–158, 1983.
W. Matusik, C. Buehler, R. Raskar, S. J. Gortler, and L. McMillan. Image-based visual hulls. In Proc. SIGGRAPH, pages 369–374, 2000.
M. Meissner, J. Huang, D. Bartz, K. Mueller, and R. Crawfis. A practical evaluation of popular volume rendering algorithms. In Proc. Volume Visualization and Graphics Symposium, pages 81–90, 2000.
S. Moezzi, A. Katkere, D. Kuramura, and R. Jain. Reality modeling and visualization from multiple video sequences. IEEE Computer Graphics and Applications, 16(6):58–63, 1996.
S. Moezzi, L-C. Tai, and P. Gerard. Virtual view generation for 3D digital video. IEEE Multimedia, 4(1): 18–26, 1997.
W. Niem. Error analysis for silhouette-based 3D shape estimation from multiple views. In Proc. Intl. Workshop on Synthetic-Natural Hybrid Coding and Three-Dimensional Imaging, 1997.
H. Noborio, S. Fukada, and S. Arimoto. Construction of the octree approximating three-dimensional objects by using multiple views. IEEE Trans. Pattern Analysis and Machine Intelligence, 10:769–782, 1988.
M. Potmesil. Generating octree models of 3D objects from their silhouettes in a sequence of images. Computer Vision, Graphics and Image Processing, 40:1–20, 1987.
A. C. Prock and C. R. Dyer. Towards real-time voxel coloring. In Proc. Image Understanding Workshop, pages 315–321, 1998.
H. Saito and T. Kanade. Shape reconstruction in projective grid space from large number of images. In Proc. Computer Vision and Pattern Recognition Conf., volume 2, pages 49–54, 1999.
S. M. Seitz and C. R. Dyer. Photorealistic scene reconstruction by voxel coloring. Intl. J. Computer Vision, 35:151–173, 1999.
S. M. Seitz and K. N. Kutulakos. Plenoptic image editing. In Proc. 6th Intl. Conf. on Computer Vision, pages 17–24, 1998.
J. A. Sethian. Level Set Methods and Fast Marching Methods. Cambridge University Press, 2nd edition, 1999.
G. Slabaugh, B. Culbertson, T. Malzbender, and R. Schafer. Improved voxel coloring via volumetric optimization. Technical Report 3, Center for Signal and Image Processing, Georgia Institute of Technology, 2000.
G. Slabaugh, B. Culbertson, T. Malzbender, and R. Schafer. A survey of methods for volumetric scene reconstruction from photographs. Technical Report 1, Center for Signal and Image Processing, Georgia Institute of Technology, 2001.
G. G. Slabaugh, T. Malzbender, and W. B. Culbertson. Volumetric warping for voxel coloring on an infinite domain. In M. Pollefeys, L. Van Gool, A. Fitzgibbon, and A. Zisserman, editors, 3D Structure from Multiple Images of Large-Scale Environments and Applications to Virtual and Augmented Reality (Proc. SMILE 2000), Lecture Notes in Computer Science, pages 41–50. Springer-Verlag, 2001.
D. Snow, P. Viola, and R. Zabih. Exact voxel occupancy with graph cuts. In Proc. Computer Vision and Pattern Recognition Conf., volume 1, pages 345–352, 2000.
S. K. Srivastava and N. Ahuja. Octree generation from object silhouettes in perspective views. Computer Vision, Graphics and Image Processing, 49:68–84, 1990.
R. Szeliski. Rapid octree construction from image sequences. CVGIP: Image Understanding, 58:23–32, 1993.
R. Szeliski. Prediction error as a quality metric for motion and stereo. In Proc. 7th Intl. Conf. on Computer Vision, pages 781–788, 1999.
R. Szeliski. Stereo algorithms and representations for image-based rendering. In Proc. 10th British Machine Vision Conf., pages 314–328, 1999.
R. Szeliski and P. Golland. Stereo matching with transparency and matting. Intl. J. of Computer Vision, 32:45–61, 1999.
R. Vaillant and O.D. Faugeras. Using extremal boundaries for 3D object modelling. IEEE Trans. Pattern Analysis and Machine Intelligence, 14:157–173, 1992.
S. Vedula, S. Baker, S. Seitz, and T. Kanade. Shape and motion carving in 6D. In Proc. Computer Vision and Pattern Recognition Conf., volume 2, pages 592–598, 2000.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2001 Springer Science+Business Media New York
About this chapter
Cite this chapter
Dyer, C.R. (2001). Volumetric Scene Reconstruction from Multiple Views. In: Davis, L.S. (eds) Foundations of Image Understanding. The Springer International Series in Engineering and Computer Science, vol 628. Springer, Boston, MA. https://doi.org/10.1007/978-1-4615-1529-6_16
Download citation
DOI: https://doi.org/10.1007/978-1-4615-1529-6_16
Publisher Name: Springer, Boston, MA
Print ISBN: 978-1-4613-5599-1
Online ISBN: 978-1-4615-1529-6
eBook Packages: Springer Book Archive