Efficient City-Sized 3D Reconstruction from Ultra-High Resolution Aerial and Ground Video Imagery

  • Alexandru N. Vasile
  • Luke J. Skelly
  • Karl Ni
  • Richard Heinrichs
  • Octavia Camps
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6938)


This paper introduces an approach for geo-registered, dense 3D reconstruction of city-sized scenes using a combination of ultra-high resolution aerial and ground video imagery. While 3D reconstructions from ground imagery provide high-detail street-level views of a city, they do not completely cover the entire city scene and might have distortions due to GPS drift. Such a reconstruction can be complemented by aerial imagery to capture missing scene surfaces as well as improve geo-registration. We present a computationally efficient method for 3D reconstruction of city-sized scenes using both aerial and ground video imagery to obtain a more complete and self-consistent geo-registered 3D city model. The reconstruction results of a 1x1km city area, covered with a 66 Mega-pixel airborne system along with a 60 Mega-pixel ground camera system, are presented and validated to geo-register to within 3m to prior airborne-collected LiDAR data.


LiDAR Data Iterative Close Point Aerial Imagery Iterative Close Point Algorithm Photo Collection 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Agarwal, S., Snavely, N., Simon, I., Seitz, S.M., Szeliski, R.: Building Rome in a Day. In: ICCV (2009)Google Scholar
  2. 2.
    Frahm, J.-M., Georgel, P., Gallup, D., Johnson, T., Raguram, R., Wu, C., Jen, Y.-H., Dunn, E., Clipp, B., Lazebnik, S., Pollefeys, M.: Building Rome on a Cloudless Day. In: Daniilidis, K., Maragos, P., Paragios, N. (eds.) ECCV 2010, Part IV. LNCS, vol. 6314, pp. 368–381. Springer, Heidelberg (2010)CrossRefGoogle Scholar
  3. 3.
    Bujnak, M., Kukelova, Z., Pajdla, T.: 3D reconstruction from image collections with a single known focal length. In: ICCV (2009)Google Scholar
  4. 4.
    Strecha, C., Pylvanainen, T., Fua, P.: Dynamic and Scalable Large Scale Image Reconstruction. In: CVPR (2010)Google Scholar
  5. 5.
    Frahm, J.-M., Pollefeys, M., Lazebnik, S., Zach, C., Gallup, D., Clipp, B., Raguram, R., Wu, C., Johnson, T.: Fast Robust Large-scale Mapping from Video and Internet Photo Collections. In: ISPRS (2010)Google Scholar
  6. 6.
    Pollefeys, M., Nister, D., Frahm, J., Akbarzadeh, A., Mordo-hai, P., Clipp, B., Engels, C., Gallup, D., Kim, S., Merrell, P.: Detailed Real-Time Urban 3D Reconstruction from Video. IJCV 78(2-3), 143–167 (2008)CrossRefGoogle Scholar
  7. 7.
    Micusik, B., Kosecka, J.: Piecewise Planar City 3D Modeling from Street View Panoramic Sequences. In: CVPR (2009)Google Scholar
  8. 8.
    Lee, T.: Robust 3D Street-View Reconstruction using Sky Motion Estimation. In: 3DIM 2009 in conjunction with ICCV (2009)Google Scholar
  9. 9.
    Fruh, C., Zakhor, A.: An Automated Method for Large-scale, Ground-based City Model Acquisition. IJCV 60(1) (2004)Google Scholar
  10. 10.
    Agrawal, M., Konolige, K.: Real-time localization in outdoor environments using stereo vision and inexpensive GPS. In: ICPR, vol. 3, pp. 1063–1068 (2006)Google Scholar
  11. 11.
    Yokochi, Y., Ikeda, S., Sato, T., Yokoya, N.: Extrinsic Camera Parameter Based-on Feature Tracking and GPS Data. In: ICPR, pp. 369–378 (2006)Google Scholar
  12. 12.
    Modsching, M., Kramer, R., ten Hagen, K.: Field trial on GPS Accuracy in a medium size city: The influence of built-up. In: WPNC (2006)Google Scholar
  13. 13.
    Lowe, D.: Distinctive image features from scale-invariant keypoints. IJCV 60(2), 91–110 (2004)CrossRefGoogle Scholar
  14. 14.
    Hartley, R.I., Zisserman, A.: Multiple View Geometry. Cambridge University Press, Cambridge (2004)CrossRefzbMATHGoogle Scholar
  15. 15.
    Nistér, D.: An efficient solution to the five-point relative pose problem. IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI) 26(6), 756–770 (2004)CrossRefGoogle Scholar
  16. 16.
    Snavely, N.: Scene Reconstruction and Visualization from Internet Photo Collections, Doctoral thesis, University of Washington (2008)Google Scholar
  17. 17.
    Furukawa, Y., Ponce, J.: Accurate, Dense, and Robust Multi-View Stereopsis. IEEE Trans. on Pattern Analysis and Machine Intelligence (2009)Google Scholar
  18. 18.
    Furukawa, Y., Ponce, J.: Patch-based Multi-View Stereo Software,
  19. 19.
    Besl, P., McKay, N.: A method of registration of 3-D shapes. IEEE Trans. Pattern Analysis and Machine Intelligence 12(2), 239–256 (1992)CrossRefGoogle Scholar
  20. 20.
    Rusinkiewicz, S., Levoy, M.: Efficient variants of the ICP algorithm. In: Third International Conference on 3D Digital Imaging and Modeling (3DIM), pp. 145–152 (June 2001)Google Scholar
  21. 21.

Copyright information

© Springer-Verlag Berlin Heidelberg 2011

Authors and Affiliations

  • Alexandru N. Vasile
    • 1
  • Luke J. Skelly
    • 1
  • Karl Ni
    • 1
  • Richard Heinrichs
    • 1
  • Octavia Camps
    • 2
  1. 1.Massachusetts Institute of Technology - Lincoln LaboratoryLexingtonUSA
  2. 2.Dept. of Electrical and Computer EngineeringNortheastern UniversityBostonUSA

Personalised recommendations