A Weak Structure Model for Regular Pattern Recognition Applied to Facade Images

  • Radim Tyleček
  • Radim Šára
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6492)


We propose a novel method for recognition of structured images and demonstrate it on detection of windows in facade images. Given an ability to obtain local low-level data evidence on primitive elements of a structure (like window in a facade image), we determine their most probable number, attribute values (location, size) and neighborhood relation. The embedded structure is weakly modeled by pair-wise attribute constraints, which allow structure and attribute constraints to mutually support each other. We use a very general framework of reversible jump MCMC, which allows simple implementation of a specific structure model and plug-in of almost arbitrary element classifiers. The MC controls the classifier by prescribing it “where to look”, without wasting too much time on unpromising locations.

We have chosen the domain of window recognition in facade images to demonstrate that the result is an efficient algorithm achieving performance of other strongly informed methods for regular structures like grids, while our general model covers loosely regular configurations as well.


Randomize Forest Image Edge Proposal Distribution Window Detection Procedural Segmentation 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Micusik, B., Kosecka, J.: Piecewise planar city 3D modeling from street view panoramic sequences. In: Proc. CVPR (2009)Google Scholar
  2. 2.
    Hohmann, B., Krispel, U., Havemann, S., Fellner, D.: CITYFIT: High-quality urban reconstructions by fitting shape grammars to images and derived textured point cloud. In: Proc. of the International Workshop 3D-ARCH (2009)Google Scholar
  3. 3.
    Pauly, M., Mitra, N., Wallner, J., Pottmann, H., Guibas, L.: Discovering structural regularity in 3D geometry. Transactions on Graphics 27, 43 (2008)CrossRefGoogle Scholar
  4. 4.
    Gips, J.: Shape grammars and their uses. Birkhäuser, Basel (1975)CrossRefGoogle Scholar
  5. 5.
    Zhu, S., Mumford, D.: A stochastic grammar of images. Foundations and Trends in Computer Graphics and Vision 2, 362 (2006)CrossRefzbMATHGoogle Scholar
  6. 6.
    Alegre, F., Dellaert, F.: A probabilistic approach to the semantic interpretation of building facades. In: International Workshop on Vision Techniques Applied to the Rehabilitation of City Centres (2004)Google Scholar
  7. 7.
    Müller, P., Zeng, G., Wonka, P., Van Gool, L.: Image-based procedural modeling of facades. Transactions on Graphics 26, 85 (2007)CrossRefGoogle Scholar
  8. 8.
    Mayer, H., Reznik, S.: Building facade interpretation from uncalibrated wide-baseline image sequences. ISPRS Journal of Photogrammetry and Remote Sensing 61, 371–380 (2007)CrossRefGoogle Scholar
  9. 9.
    Ripperda, N., Brenner, C.: Data driven rule proposal for grammar based facade reconstruction. Photogrammetric Image Analysis 36, 1–6 (2007)Google Scholar
  10. 10.
    Teboul, O., Simon, L., Koutsourakis, P., Paragios, N.: Segmentation of building facades using procedural shape prior. In: Proc. CVPR (2010)Google Scholar
  11. 11.
    Toussaint, G.T.: The relative neighbourhood graph of a finite planar set. Pattern Recognition 12, 261–268 (1980)CrossRefzbMATHGoogle Scholar
  12. 12.
    McLaughlan, G.J.: Finite Mixture Models. Wiley, Chichester (2000)CrossRefGoogle Scholar
  13. 13.
    Green, P.J.: Reversible jump Markov chain Monte Carlo computation and Bayesian model determination. Biometrika 82, 711–732 (1995)CrossRefzbMATHGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2011

Authors and Affiliations

  • Radim Tyleček
    • 1
  • Radim Šára
    • 1
  1. 1.Center for Machine Perception Faculty of Electrical EngineeringCzech Technical UniversityPragueCzech Republic

Personalised recommendations