From Partition Trees to Semantic Trees

  • Xavier Giro
  • Ferran Marques
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4105)

Abstract

This paper proposes a solution to bridge the gap between semantic and visual information formulated as a structural pattern recognition problem. Instances of semantic classes expressed by Description Graphs are detected on a region-based representation of visual data expressed with a Binary Partition Tree. The detection process builds instances of Semantic Trees on the top of the Binary Partition Tree using an encyclopedia of models organised as a hierarchy. At the leaves of the Semantic Tree, classes are defined by perceptual models containing a list of low-level descriptors. The proposed solution is assessed in different environments to show its flexibility.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Leung, T.K., Burl, M.C., Perona, P.: Finding faces in cluttered scenes using random labeled graph matching. In: IEEE International Conference on Computer Vision, ICCV 1995, Cambridge, USA, pp. 637–644 (1995)Google Scholar
  2. 2.
    Jaimes, A., Chang, S.-F.: Learning structured visual descriptors from user input at multiple levels. International Journal of Image and Graphics 1, 415–444 (2001)CrossRefGoogle Scholar
  3. 3.
    Naphade, M., Kozintsev, I., Huang, T.: Factor graph framework for semantic video indexing. IEEE Transactions on Circuits and Systems for Video Technology 12, 40–52 (2002)CrossRefGoogle Scholar
  4. 4.
    Salembier, P., Marqués, F.: Region-based representations of image and video: segmentation tools for multimedia services. IEEE Transactions on Circuits and Systems for Video Technology 9, 1147–1169 (1999)CrossRefGoogle Scholar
  5. 5.
    Salembier, P., Garrido, L.: Binary partition tree as an efficient representation for image processing, segmentation and information retrieval. IEEE Trans. on Image Processing 9, 561–576 (2000)CrossRefGoogle Scholar
  6. 6.
    Vilaplana, V., Giró, X., Salembier, P., Marqués, F.: Region-based extraction and analysis of visual objects information. In: 4th Int. Workshop on Content-Based Multimedia Indexing, CBMI 2005, Riga, Latvia, pp. SSI.3.1–SSI.3.9 (2005)Google Scholar
  7. 7.
    Giró, X., Vilaplana, V., Marqués, F., Salembier, P.: 7. Automatic extraction and analysis of visual objects information. In: Multimedia Content and the Semantic Web, pp. 203–221. Wiley, Chichester (2005)CrossRefGoogle Scholar
  8. 8.
    Ferran Bennstrom, C., Casas, J.: Object representation using colour, shape and structure criteria in a binary partition tree. In: IEEE Intern. Conf. on Image Processing, ICIP 2005, Genova, Italy, vol. 3, pp. 1144–1147 (2005)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Xavier Giro
    • 1
  • Ferran Marques
    • 1
  1. 1.Technical University of Catalonia (UPC)Barcelona

Personalised recommendations