New Techniques for Automated Architectural Reconstruction from Photographs
We investigate a strategy for reconstructing of buildings from multiple (uncalibrated) images. In a similar manner to the Facade approach we first generate a coarse piecewise planar model of the principal scene planes and their delineations, and then use these facets to guide the search for indentations and protrusions such as windows and doors. However, unlike the Facade approach which involves manual selection and alignment of the geometric primitives, the strategy here is fully automatic.
There are several points of novelty: first we demonstrate that the use of quite generic models together with particular scene constraints (the availability of several principal directions) is sufficiently powerful to enable successful reconstruction of the targeted scenes. Second, we develop and refine a technique for piecewise planar model fitting involving sweeping polygonal primitives, and assess the performance of this technique. Third, lines at infinity are constructed from image correspondences and used to sweep planes in the principal directions.
The strategy is illustrated on several image triplets of College buildings. It is demonstrated that convincing texture mapped models are generated which include the main walls and roofs, together with inset windows and also protruding (dormer) roof windows.
Unable to display preview. Download preview PDF.
- 3.C. Baillard, C. Schmid, A. Zisserman, and A. Fitzgibbon. Automatic line matching and 3D reconstruction of buildings from multiple views. In ISPRS Conference on Automatic Extraction of GIS Objects from Digital Imagery, IAPRS Vol.32, Part 3-2W5, pages 69–80, September 1999.Google Scholar
- 4.C. Baillard and A. Zisserman. Automatic reconstruction of piecewise planar models from multiple views. In Proc. IEEE Conference on Computer Vision and Pattern Recognition, pages 559–565, June 1999.Google Scholar
- 5.F. Bignone, O. Henricsson, P. Fua, and M. Stricker. Automatic extraction of generic house roofs from high resolution aerial imagery. In Proc. 4th European Conference on Computer Vision, Cambridge, pages 85–96, 1996.Google Scholar
- 7.C. Coelho, M. Straforini, and M. Campani. Using geometrical rules and a priori knowledge for the understanding of indoor scenes. In Proc. British Machine Vision Conference, pages 229–234, 1990.Google Scholar
- 8.R. T. Collins. A space-sweep approach to true multi-image matching. In Proc. IEEE Conference on Computer Vision and Pattern Recognition, pages 358–363, 1996.Google Scholar
- 10.R. T. Collins and R. S. Weiss. Vanishing point calculation as a statistical inference on the unit sphere. In Proc. 3rd International Conference on Computer Vision, Osaka, pages 400–403, December 1990.Google Scholar
- 11.S. Coorg and S. Teller. Extracting textured vertical facades from controlled close-range imagery. In Proc. IEEE Conference on Computer Vision and Pattern Recognition, Fort Collins, Colorado, pages 625–632, 1999.Google Scholar
- 12.A. R. Dick, P. H. S. Torr, Ruffle S. J., and R. Cipolla. Combining single view recognition and multiple view stereo for architectural scenes. In Int. Conf. Computer Vision, pages 268–280. IEEE Computer Society, 2001.Google Scholar
- 14.W. Förstner and E. Gülch. A fast operator for detection and precise location of distinct points, corners and center of circular features. In Proc. of ISPRS Inter-commission Conference on Fast Processing of Photogrammetric Data, Interlaken, Switzerland, pages 281–305, June 2–4 1987.Google Scholar
- 15.M. Fradkin, M. Roux, and H. Maître. Building detection from multiple views. In ISPRS Conference on Automatic Extraction of GIS Objects from Digital Imagery, September 1999.Google Scholar
- 16.A.W. Gruen. Adaptative least squares correlation: a powerful image matching technique. S. Afr. Journal of Photogrammetry, Remote Sensing and Cartography, 3(14):175–187, 1985.Google Scholar
- 17.R. I. Hartley and A. Zisserman. Multiple View Geometry in Computer Vision. Cambridge University Press, ISBN: 0521623049, 2000.Google Scholar
- 19.T. Moons, D. Frère, J. Vandekerckhove, and L. Van Gool. Automatic modelling and 3D reconstruction of urban house roofs from high resolution aerial imagery. In Proc. 5th European Conference on Computer Vision, Freiburg, Germany, pages 410–425, 1998.Google Scholar
- 20.S. Noronha and R. Nevatia. Detection and description of buildings from multiple images. In Proc. IEEE Conference on Computer Vision and Pattern Recognition, Puerto Rico, pages 588–594, 1997.Google Scholar
- 21.M. Pollefeys, R. Koch, and L. Van Gool. Self calibration and metric reconstruction in spite of varying and unknown internal camera parameters. In Proc. 6th International Conference on Computer Vision, Bombay, India, pages 90–96, 1998.Google Scholar
- 22.C. Rother. A new approach for vanishing point detection in architectual environments. In Proc. 11th British Machine Vision Conference, Bristol, pages 382–391, UK, September 2000.Google Scholar
- 24.C. Schmid and A. Zisserman. Automatic line matching across views. In Proc. IEEE Conference on Computer Vision and Pattern Recognition, pages 666–671, 1997.Google Scholar
- 25.J. A. Shufelt. Performance evaluation and analysis of vanishing point detection techniques. IEEE Transactions on Pattern Analysis and Machine Intelligence, 21(3):282–288, March 1999.Google Scholar
- 26.Hai Tao, Harpreet S. Sawhney, and Rakesh Kumar. A global matching framework for stereo computation. In Int. Conf. Computer Vision, pages 532–539. IEEE Computer Society, 2001.Google Scholar
- 27.C. Taylor, P. Debevec, and J. Malik. Reconstructing polyhedral models of architectural scenes from photographs. In Proc. 4th European Conference on Computer Vision, Cambridge. Springer-Verlag, 1996.Google Scholar
- 28.T. Tuytelaars, L. Van Gool, M. Proesmans, and T. Moons. The cascaded Hough transform as an aid in aerial image interpretation. In Proc. 6th International Conference on Computer Vision, Bombay, India, pages 67–72, January 1998.Google Scholar