Automatic Surface Patch Generation from a Video Image Sequence

  • Yixiang Tian
  • Markus Gerke
  • George Vosselman
  • Qing Zhu
Part of the Lecture Notes in Geoinformation and Cartography book series (LNGC)


Automatic 3D building reconstruction is becoming increasingly important for a number of applications. This paper aims to present a new approach for an automatic pipeline to reconstruct surface patches from a video image sequence, which can deal with images acquired with an uncalibrated hand held camera. In order to skip the details to get the surface patches that present the building’s main structure, the algorithm applies rules and a processing sequence that aim to reasonably group extracted sparse 3D points and 3D edges. Then the surface patches are estimated from these grouped points and edges. The final step is to define the surface patches’ outline, which aim to both present the location and the actual shape of the surface patches. The results for two datasets show that the main surface patches for each dataset are successfully reconstructed.


Point Cloud Surface Patch Parallel Edge Building Facade Reliable Point 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    2d3 Homepage for boujou software, (accessed 18 August 2008)
  2. 2.
    Baltsavias, E.P.: Object extraction and revision by image analysis using existing geodata and knowledge: current status and steps towards operational systems. ISPRS Journal of Photogrammetry and Remote Sensing 58(3-4): 129-151 (2004)CrossRefGoogle Scholar
  3. 3.
    Cornelis, N., Leibe, B., Cornelis, K., Van Gool, L.: 3D Urban Scene Modeling Integrating Recognition and Reconstruction. International Journal of Computer Vision 78(2): 121-141 (2008)CrossRefGoogle Scholar
  4. 4.
    Hartley, R.I., Zisserman, A.: Multiple View Geometry in Computer Vision (second edition): Cambridge University Press, Cambridge (2000)Google Scholar
  5. 5.
    Mayer, H., Reznik, S.: Building facade interpretation from uncalibrated wide-baseline image sequences. ISPRS Journal of Photogrammetry and Remote Sensing 61(6): 371-380 (2007)CrossRefGoogle Scholar
  6. 6.
    Meer, P., Georgescu, B.: Edge detection with embedded confidence. IEEE Transactions on Pattern Analysis and Machine Intelligence 23(12): 1351-1365 (2001)CrossRefGoogle Scholar
  7. 7.
    Nistér, D.: An efficient solution to the five-point relative pose problem. IEEE Transactions on Pattern Analysis and Machine Intelligence 26(6): 756-770(2004)CrossRefGoogle Scholar
  8. 8.
    Pollefeys, M., Nistér, D., Frahm, J.M., Akbarzadeh, A., Mordohai, P., Clipp, B., Engels, C., Gallup, D., Kim, S.J., Merrell, P., Salmi, C., Sinha, S., Talton, B., Wang, L., Yang, Q., Stewénius, H., Yang, R., Welch, G., Towles, H.: Detailed Real-Time Urban 3D Reconstruction from Video. International Journal of Computer Vision 78(2): 143-167 (2008)CrossRefGoogle Scholar
  9. 9.
    Pollefeys, M., Van Gool, L., Vergauwen, M., Verbiest, F., Cornelis, K., Tops, J., Koch, R.: Visual modelling with a hand-held camera. International Journal of Computer Vision 59(3): 207-232 (2004)CrossRefGoogle Scholar
  10. 10.
    Remondino, F., EL-Hakim, S.: Image-Based 3D Modeling: A Review. The Photogrammetric Record 21(115): 269-291 (2006)Google Scholar
  11. 11.
    Tian, Y., Gerke, M., Vosselman, G., Zhu, Q.: Automatic Edge Matching Across an Image Sequence Based on Reliable Points. In: Chen, J., Jiang, J., Förstnner, W. (eds.) the International Archives of the Photogrammetry, Remote Sensing and Spatial Information Science Beijing, Vol.XXXVII, Part B3b, pp. 657-662 (2008)Google Scholar
  12. 12.
    Vosselman, G., Gorte, B., Sithole, G., Rabbani, T.: Recognising structure in laser scanning point clouds. In: Thies, M., Koch, B., Spiecker, H., Weinacher, H. (eds.) International Conference NATSCAN, Laser-Scanners for Fores and Landscpae Assessment - Instruments, Processing Methods and Applications, ISPRS working group VIII/2. Freiburg im Breisgau, Germany, pp. 33-38 (2004)Google Scholar
  13. 13.
    Werner, T., Zisserman, A.: New techniques for automated architectural reconstruction from photographs. In: Seventh European Conference on Computer Vision, Vol.II, pp. 541-555 (2002)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2009

Authors and Affiliations

  • Yixiang Tian
    • 1
  • Markus Gerke
    • 1
  • George Vosselman
    • 1
  • Qing Zhu
    • 2
  1. 1.International Institute for Geo-Information Science and Earth Observation (ITC)The Netherlands
  2. 2.State Key Lab of Information Engineering in Surveying Mapping and Remote SensingWuhan UniversityChina

Personalised recommendations