Extraction of Windows in Facade Using Kernel on Graph of Contours

  • Jean-Emmanuel Haugeard
  • Sylvie Philipp-Foliguet
  • Frédéric Precioso
  • Justine Lebrun
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5575)


In the past few years, street-level geoviewers has become a very popular web-application. In this paper, we focus on a first urban concept which has been identified as useful for indexing then retrieving a building or a location in a city: the windows. The work can be divided into three successive processes: first, object detection, then object characterization, finally similarity function design (kernel design). Contours seem intuitively relevant to hold architecture information from building facades. We first provide a robust window detector for our unconstrained data, present some results and compare our method with the reference one. Then, we represent objects by fragments of contours and a relational graph on these contour fragments. We design a kernel similarity function for structured sets of contours which will take into account the variations of contour orientation inside the structure set as well as spatial proximity. One difficulty to evaluate the relevance of our approach is that there is no reference database available. We made, thus, our own dataset. The results are quite encouraging regarding what was expected and what provide methods the literature.


Relational graph of segments kernel on graphs window extraction inexact graph matching 


  1. 1.
    Mikolajczyk, K., Tuytelaars, T., Schmid, C., Zisserman, A., Matas, J., Schaffalitzky, F., Kadir, T., Gool, L.V.: A comparison of affine region detectors. International Journal of Computer Vision (2005)Google Scholar
  2. 2.
    Carson, C., Belongie, S., Greenspan, H., Malik, J.: Blobworld: Image segmentation using expectation-maximization and its application to image querying. IEEE Transactions on Pattern Analysis and Machine Intelligence (2004)Google Scholar
  3. 3.
    Shawe-Taylor, J., Cristianini, N.: Kernel methods for Pattern Analysis. Cambridge University Press, Cambridge (2004)CrossRefzbMATHGoogle Scholar
  4. 4.
    Gosselin, P.-H., Cord, M., Philipp-Foliguet, S.: Kernel on Bags for multi-object database retrieval. In: ACM International Conference on Image and Video Retrieval, pp. 226–231 (2007)Google Scholar
  5. 5.
    Lebrun, J., Philipp-Foliguet, S., Gosselin, P.-H.: Image retrieval with graph kernel on regions. In: IEEE International Conference on Pattern Recognition (2008)Google Scholar
  6. 6.
    Shotton, J., Blake, A., Cipolla, R.: Contour-Based Learning for Object Detection. In: 10th IEEE International Conference on Computer Vision (2005)Google Scholar
  7. 7.
    Opelt, A., Pinz, A., Zisserman, A.: A Boundary-Fragment-Model for Object Detection. In: Leonardis, A., Bischof, H., Pinz, A. (eds.) ECCV 2006. LNCS, vol. 3952, pp. 575–588. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  8. 8.
    Suard, F., Rakotomamonjy, A., Bensrhair, A.: Détection de piétons par stéréovision et noyaux de graphes. In: 20th Groupe de Recherche et d’Etudes du Traitement du Signal et des Images (2005)Google Scholar
  9. 9.
    Kashima, H., Tsuboi, Y.: Kernel-based discriminative learning algorithms for labeling sequences, trees and graphs. In: International Conference on Machine Learning (2004)Google Scholar
  10. 10.
    Lee, S.C., Nevatia, R.: Extraction and Integration of Window in a 3D Building Model from Ground View Image. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition (2004)Google Scholar
  11. 11.
    Ferrari, V., Fevrier, L., Jurie, F., Schmid, C.: Groups of Adjacent Contour Segments for Object Detection. IEEE Transactions on Pattern Analysis and Machine Intelligence (2008)Google Scholar
  12. 12.
    Shen, J., Castan, S.: An Optimal Linear Operator for Step Edge Detection. Graphical Models and Image Processing (1992)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2009

Authors and Affiliations

  • Jean-Emmanuel Haugeard
    • 1
  • Sylvie Philipp-Foliguet
    • 1
  • Frédéric Precioso
    • 1
  • Justine Lebrun
    • 1
  1. 1.ETIS, CNRS, ENSEA, Univ Cergy-PontoiseCergy PontoiseFrance

Personalised recommendations