Abstract
In this paper we examine the problem of synthesizing virtual views from scene points within the scene, i.e., from scene points which are imaged by the real cameras. On one hand this provides a simple way of defining the position of the virtual camera in an uncalibrated setting. On the other hand, it implies extreme changes in viewpoint between the virtual and real cameras. Such extreme changes in viewpoint are not typical of most New-View-Synthesis (NVS) problems.
In our algorithm the virtual view is obtained by aligning and comparing all the projections of each line-of-sight emerging from the “virtual camera” center in the input views. In contrast to most previous NVS algorithms, our approach does not require prior correspondence estimation nor any explicit 3D reconstruction. It can handle any number of input images while simultaneously using the information from all of them. However, very few images are usually enough to provide reasonable synthesis quality. We show results on real images as well as synthetic images with ground-truth.
Chapter PDF
Similar content being viewed by others
References
S. Avidan and A. Shashua. Novel view synthesis by cascading trilinear tensors. In IEEE Transactions on Visualization and Computer Graphics, 1998.
A. Criminisi, I. Reid, and A. Zisserman. Duality, rigidity and planar parallax. In ECCV, Freiburg, 1998.
O. Faugeras and L. Robert. What can two images tell us about a third one? In ECCV, pages 485–492, 1994.
S. Gortler, R. Grzeszczuk, R. Szeliski, and M. Cohen. The lumigraph. In SIGGRAPH, pages 43–54, 1996.
M. Irani, P. Anandan, and D. Weinshall. From reference frames to reference planes: Multi-view parallax geometry and applications. In ECCV, Freiburg, June 1998.
R. Kumar, P. Anandan, and K. Hanna. Direct recovery of shape from multiple views: a parallax based approach. In Proc 12th ICPR, pages 685–688, 1994.
K. N. Kutulakos. Approximate n-view stereo. In ECCV, 2000.
M. Levoy and P. Hanrahan. Light field rendering. In SIGGRAPH, 1996.
P. J. Narayanan, P. W. Rander, and T. Kanade. Constructing virtual worlds using dense stereo. In ICCV, 1998.
M. Orchard and C. Bouman. Color quantization of images. In IEEE Transactions on Signal Processing, volume 39, 1991.
P. Rander, P.J. Narayanan, and T. Kanade. Virtualized reality: constructing time-varying virtual worlds from real events. In Proc. IEEE Visualization, pages 277–283, October 1997.
H. Saito and T. Kanade. Shape reconstruction in projective grid space from a large number of images. In CVPR, 1999.
H. Sawhney. 3D geometry from planar parallax. In CVPR, 1994.
S. Seitz and C. Dyer. Photorealistic scene reconstruction by voxel coloring. In CVPR, 1997.
A. Shashua and N. Navab. Relative affine structure: Theory and application to 3D reconstruction from perspective views. In CVPR, pages 483–489, 1994.
R. Szeliski and P. Golland. Stereo matching with transparency and matting. In ICCV, pages 517–524, January 1998.
W. Triggs. Plane + parallax, tensors, and factorization. In ECCV, pages 522–538, June 2000.
S. Vedula, P. Rander, H. Saito, and T. Kanade. Modeling, combining, and rendering dynamic real-world events from image sequences. In Proceedings of the International Conference on Virtual Systems and Multimedia, 1998.
D. Weinshall, P. Anandan, and M. Irani. From ordinal to euclidean reconstruction with partial scene calibration. In Workshop on 3D Structure from Multiple Images of Large-Scale Environments, Freiburg, June 1998.
T. Werner, R.D. Hersch, and V. Hlaváč. Rendering real-world objects using view interpolation. In ICCV, pages 957–962, June 1995.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2002 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Irani, M., Hassner, T., Anandan, P. (2002). What Does the Scene Look Like from a Scene Point?. In: Heyden, A., Sparr, G., Nielsen, M., Johansen, P. (eds) Computer Vision — ECCV 2002. ECCV 2002. Lecture Notes in Computer Science, vol 2351. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-47967-8_59
Download citation
DOI: https://doi.org/10.1007/3-540-47967-8_59
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-43744-4
Online ISBN: 978-3-540-47967-3
eBook Packages: Springer Book Archive