Learning Domain Knowledge for Façade Labelling

  • Dengxin Dai
  • Mukta Prasad
  • Gerhard Schmitt
  • Luc Van Gool
Conference paper

DOI: 10.1007/978-3-642-33718-5_51

Part of the Lecture Notes in Computer Science book series (LNCS, volume 7572)
Cite this paper as:
Dai D., Prasad M., Schmitt G., Van Gool L. (2012) Learning Domain Knowledge for Façade Labelling. In: Fitzgibbon A., Lazebnik S., Perona P., Sato Y., Schmid C. (eds) Computer Vision – ECCV 2012. ECCV 2012. Lecture Notes in Computer Science, vol 7572. Springer, Berlin, Heidelberg

Abstract

This paper presents an approach to address the problem of image façade labelling. In the architectural literature, domain knowledge is usually expressed geometrically in the final design, so façade labelling should on the one hand conform to visual evidence, and on the other hand to the architectural principles – how individual assets (e.g. doors, windows) interact with each other to form a façade as a whole. To this end, we first propose a recursive splitting method to segment façades into a bunch of tiles for semantic recognition. The segmentation improves the processing speed, guides visual recognition on suitable scales and renders the extraction of architectural principles easy. Given a set of segmented training façades with their label maps, we then identify a set of meta-features to capture both the visual evidence and the architectural principles. The features are used to train our façade labelling model. In the test stage, the features are extracted from segmented façades and the inferred label maps. The following three steps are iterated until the optimal labelling is reached: 1) proposing modifications to the current labelling; 2) extracting new features for the proposed labelling; 3) feeding the new features to the labelling model to decide whether to accept the modifications. In experiments, we evaluated our method on the ECP façade dataset and achieved higher precision than the state-of-the-art at both the pixel level and the structural level.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Copyright information

© Springer-Verlag Berlin Heidelberg 2012

Authors and Affiliations

  • Dengxin Dai
    • 1
    • 2
  • Mukta Prasad
    • 1
  • Gerhard Schmitt
    • 2
  • Luc Van Gool
    • 1
  1. 1.Computer Vision LabETH ZürichSwitzerland
  2. 2.Information ArchitectureETH ZürichSwitzerland

Personalised recommendations