Reconstruction of structure and texture of city building facades

  • A. A. YakubenkoEmail author
  • V. A. Kononov
  • I. S. Mizin
  • V. S. Konushin
  • A. S. Konushin


An important problem in creating photorealistic 3D city maps is to interpret and clear building facades from foreground objects. Modern image recovery algorithms either yield poor quality and require much time or need substantial interaction with the user. In this paper, a new algorithm for recovering texture of building facades, which is based on information on regularity of their structures, is presented. The structure is described by a set of nonintersecting lattices of similar rectangular fragments. An algorithm for searching such structures is proposed. The algorithms are compared with the existing ones on available image databases.


facade building city 3D maps texture recovery reconstruction structure regularity 


  1. 1.
    Park, M., Collins, R.T., and Liu, Y., Deformed Lattice Discovery via Efficient Mean-Shift Belief Propagation, Proc. of the 10th European Conf. Computer Vision (ECCV), 2008, vol. 2, pp. 474–485.Google Scholar
  2. 2.
    Wenzel, S., Drauschke, M., and Forstner, W., Detection of Repeated Structures in Facade Images, Pattern Recognition Image Analysis, 2008, vol. 18, no. 3, pp. 406–411.CrossRefGoogle Scholar
  3. 3.
    Remondino, F. and El-Hakim, S., Image-based 3D Modelling: A Review, Photogrammetric Record, 2006, vol. 21, no. 115, pp. 269–291.CrossRefGoogle Scholar
  4. 4.
    Frueh, C. and Zakhor, A., An Automated Method for Large-Scale, Ground-Based City Model Acquisition, Int. J. Comput. Vision, 2004, vol. 60, no. 1, pp. 5–24.CrossRefGoogle Scholar
  5. 5.
    Cornelis, N., Leibe, B., Cornelis, K., and Van Gool, L., 3D Urban Scene Modeling Integrating Recognition and Reconstruction, Int. J. Comput. Vision, 2008, vol. 78, nos. 2–3, pp. 121–141.CrossRefGoogle Scholar
  6. 6.
    Hu, J., You, S., Neumann, U., and Park, K.K., Building Modeling from LIDAR and Aerial Imagery, ASPRS’04, Denver, Colorado, USA, 2004.Google Scholar
  7. 7.
    Moons, T., Frere, D., Vandekerckhove, J., and Van Gool, L., Automatic Modelling and 3D Reconstruction of Urban House Roofs from High Resolution Aerial Imagery, Proc. of 5th European Conf, on Computer Vision (ECCV), Freiburg, Germany, 1998, pp. 410–425.Google Scholar
  8. 8.
    Korah, T. and Rasmussen, C., Analysis of Building Textures for Reconstructing Partially Occluded Facades, Proc. of the 10th European Conf. on Computer Vision (ECCV), 2008, Part I, pp. 359–372.Google Scholar
  9. 9.
    Muller, P., Zeng, G., Wonka, P., and Van Gool, L., Image-based Procedural Modeling of Facades, ACM Trans. Graphics, 2007, vol. 26, no. 3, pp. 1–9.CrossRefGoogle Scholar
  10. 10.
    Ricard, J., Royan, J., and Aubault, O., Visualization of Real Cities Based on Procedural Modeling, IEEE Virtual Reality Workshop on Virtual Cityscapes: Key Research Issues in Modeling Large-Scale Immersive Urban Environments, 2008.Google Scholar
  11. 11.
    Wang, H., Wexler, Y., Ofek, E., and Hoppe, H., Factoring Repeated Content within and among Images, ACM Trans. Graphics, 2008, vol. 27, no. 3, pp. 1–10.Google Scholar
  12. 12.
    Schindler, G., Krishnamurthy, P., Lublinerman, R., Liu, Y., and Dellaert, F., Detecting and Matching Repeated Patterns for Automatic Geo-tagging in Urban Environments, Proc. of CVPR 2008, 2008, pp. 1–7.Google Scholar
  13. 13.
    Konushin, V. and Vezhnevets, V., Automatic Building Texture Completion, GraphiCon’2007, 2007.Google Scholar
  14. 14.
    Liebowitz, D., Criminisi, A., and Zisserman, A., Creating Architectural Models from Images, Proc. of Euro-Graphics, 1999, vol. 18, pp. 39–50.Google Scholar
  15. 15.
  16. 16.
  17. 17.
  18. 18.
  19. 19.
    Lin, H.-C., Wang, L.-L., and Yang, S.-N., Extracting Periodicity of a Regular Texture Based on Autocorrelation Functions, Pattern Recognition Letters, 1997, vol. 18, pp. 433–443.CrossRefGoogle Scholar
  20. 20.
    Hays, J., Leordeanu, M., Efros, A.A., and Liu, Y., Discovering Texture Regularity as a Higher-Order Correspondence Problem, ECCV 2006, 2006, vol. 2, pp. 522–535.CrossRefGoogle Scholar
  21. 21.
    Leung, T. and Malik, J., Detecting, Localizing and Grouping Repeated Scene Elements from an Image, Proc. of European Conf. Computer Vision (ECCV), 1996, pp. 546–555.Google Scholar
  22. 22.
    Boykov, Y. and Kolmogorov, V., An Experimental Comparison of Min-Cut/Max-Flow Algorithms for Energy Minimization in Computer Vision, Third Int. Workshop on Energy Minimization Methods in Computer Vision and Pattern Recognition, 2001.Google Scholar
  23. 23.
    Turina, A., Tuytelaars, T., Moons, T., and Van Gool, L., Grouping via the Matching of Repeated Patterns, Proc. of CAPR, 2001, pp. 250–259.Google Scholar
  24. 24.
    Perez, P., Gangnet, M., and Blake, A., Poisson Image Editing, ACM Trans. Graphics (TOG), 2003, vol. 22, no. 3.Google Scholar
  25. 25.
    Ali, H., Seifert, C., Jindal, N., Paletta, L., and Paar, G., Window Detection in Facades, Int. Conf. on Image Analysis and Processing (ICIAP), 2007, pp. 837–842.Google Scholar
  26. 26.
    Wenzel, S. and Forstner, W., Semi-Supervised Incremental Learning of Hierarchical Appearance Models, 21st Congress of the Int. Soc. for Photogrammetry and Remote Sensing (ISPRS), Beijing, China, 2008.Google Scholar
  27. 27.
    Mayer, H. and Reznik, S., Implicit Shape Models, Model Selection, and Plane Sweeping For 3D Facade Interpretation, Photogrammetric Image Analysis (PIA), 2007.Google Scholar
  28. 28.
    Criminisi, A., Perez, P., and Toyama, K., Object Removal by Exemplar-based Inpainting, Conf. Computer Vision and Pattern Recognition (CVPR), 2003, vol. 2, pp. 721–728.Google Scholar
  29. 29.
    Cech, J. and Sara, R., Windowpane Detection based on Maximum Aposteriori Probability Labeling, Int. Workshop on Combinatorial Image Analysis (IWCIA), 2008, pp. 3–11.Google Scholar
  30. 30.
    Korc, F. and Forstner, W., Finding Optimal Non-Overlapping Subset of Extracted Image Objects, 2008.Google Scholar
  31. 31.
    Grabler, F., Parsing Images of Architectural Scenes, ICCV, 2007, pp. 44–57.Google Scholar
  32. 32.
    Laycock, R.G. and Day, A. M., Towards the Automatic Integration of Ground Level Images into a Virtual Urban Environment, WSCG 2004, 2004.Google Scholar
  33. 33.
    Ripperda, N. and Brenner, C., Reconstruction of Facade Structures Using a Formal Grammar and RjM-CMC, Pattern Recognition, 2006, pp. 750–759.Google Scholar
  34. 34.
    Jung, C.R. and Schramm, R., Rectangle Detection Based on a Windowed Hough Transform, Proc. of the XVII Brazilian Symp. on Computer Graphics and Image Processing (SIBGRAPI’04), 2004, pp. 17–20.Google Scholar
  35. 35.
    Van Gool, L., Zeng, G., Van den Borre, F., and Muller, P., Towards Mass-Produced Buildings Models, Photogrammetric Image Analysis (PIA), 2007.Google Scholar
  36. 36.
    Wexler, Y., Shechtman, E., and Irani, M., Space-Time Completion of Video, IEEE Trans. on Pattern Analysis and Machine Intelligence (PAMI), 2007, vol. 2, pp. 463–476.CrossRefGoogle Scholar
  37. 37.
    Bertalmio, M., Sapiro, G., Caselles, V., and Ballester, C., Image Inpainting, Int. Conf. on Computer Graphics and Interactive Techniques, 2000, pp. 417–424.Google Scholar

Copyright information

© Pleiades Publishing, Ltd. 2011

Authors and Affiliations

  • A. A. Yakubenko
    • 1
    Email author
  • V. A. Kononov
    • 1
  • I. S. Mizin
    • 1
  • V. S. Konushin
    • 1
  • A. S. Konushin
    • 1
  1. 1.Department of Computational Mathematics and CyberneticsMoscow State UniversityMoscowRussia

Personalised recommendations