Urban modeling has attracted many attentions since Google and Microsoft have launched their 3D geo softwares. However, in order to achieve photo-realistic results at the same level as for the latest interactive video games for high-end applications, less effort has been made to automate urban objects recognition and reconstruction. This paper consists of the automation of image-based Haussmannian facade recognition and reconstruction. The input image is firstly rectified and segmented in order to obtain a rectangular and less distorted facade image extracted from urban scenes. Then based upon various visual features and architectural knowledge, different facade elements which include windows, doors and balconies are detected including positions and also measured sizes. Combined with the depth information computed from 3D range data, the facade geometries and textures can be produced. Finally, an analysis-synthesis approach is used to reconstruct the full 3D facade representation. The processing pipeline developed for this research has also been verified and tested on various Parisian facades and confirmed the desired recognition and reconstruction results.


Window Detection Terrestrial Laser Scan Lens Distortion Building Facade Building Volume 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Hoiem, D., Efros, A.A., Hebert, M.: Geometric Context from a Single Image. In: International Conference of Computer Vision, pp. 654–661 (2005)Google Scholar
  2. 2.
    Snavely, N., Seitz, S.M., Szeliski, R.: Photo tourism: exploring photo collections in 3D. ACM Trans. Graph. 25(3), 835–846 (2006)CrossRefGoogle Scholar
  3. 3.
    Szeliski, R., Zabih, R., Scharstein, D., Veksler, O., Kolmogorov, V., Agarwala, A., Tappen, M., Rother, C.: A Comparative Study of Energy Minimization Methods for Markov Random Fields with Smoothness-Based Priors. IEEE Trans. Pattern Anal. Mach. Intell. 30(6), 1068–1080 (2008)CrossRefGoogle Scholar
  4. 4.
    Müller, P., Wonka, P., et al.: Procedural Modeling of Buildings. In: ACM SIGGRAPH 2006, vol. 25, pp. 614–623 (2006)Google Scholar
  5. 5.
    Müller, P., Zeng, G., et al.: Image-based Procedural Modeling of facades. In: ACM SIGGRAPH 2007, pp. 181–184. IEEE Press, New York (2007)Google Scholar
  6. 6.
    Korah, T., Rasmussen, C.: 2D Lattice Extraction from Structured Environments. In: ICIP (2), pp. 61–64 (2007)Google Scholar
  7. 7.
    Hays, J., Leordeanu, M., Efros, A.A., Liu, Y.: Discovering Texture Regularity as a Higher-Order Correspondence Problem. In: Leonardis, A., Bischof, H., Pinz, A. (eds.) ECCV 2006. LNCS, vol. 3952, pp. 522–535. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  8. 8.
    Šochman, J.: Evaluation of the AdaBoost IPM. Technical Report TN-eTRIMS-CMP-01-2007 (2007)Google Scholar
  9. 9.
    Chun, L., Gagalowicz, A.: Image-based Modeling of Haussmannian Facades. The International Journal of Virtual Reality 9 (2009)Google Scholar
  10. 10.
    Tyleček, R., Šára, R.: A Weak Structure Model for Regular Pattern Recognition Applied to Facade Images. In: Kimmel, R., Klette, R., Sugimoto, A. (eds.) ACCV 2010, Part I. LNCS, vol. 6492, pp. 450–463. Springer, Heidelberg (2011)CrossRefGoogle Scholar
  11. 11.
    Niemann, T.: PTLens,

Copyright information

© Springer-Verlag Berlin Heidelberg 2011

Authors and Affiliations

  • Chun Liu
    • 1
  • André Gagalowicz
    • 1
  1. 1.INRIA RocquencourtFrance

Personalised recommendations