Analysis of Semantic Information Available in an Image Collection Augmented with Auxiliary Data

  • Mats Sjöberg
  • Ville Viitaniemi
  • Jorma Laaksonen
  • Timo Honkela
Part of the IFIP International Federation for Information Processing book series (IFIPAICT, volume 204)

Abstract

An art installation was on display in the Centre Pompidou National Museum of Modern Art in Paris, where visitors could contribute with their own personal objects, adding keyword descriptions and quantified semantic features such as age or hardness. The data was projected in real-time onto a Self-Organizing Map (SOM) which was shown in the gallery. In this paper we analyze the same data by extracting visual features from the images and organize the image collection with multiple SOMs. We show how this mapping facilitates the emergence of semantic associations between visual, textual and metadata modalities by studying the distributions of the different feature vectors on the SOMs.

References

  1. 1.
    Legrady, G., Honkela, T.: Pockets full of memories: an interactive museum installation. Visual Communication 1 (2002) 163–169CrossRefGoogle Scholar
  2. 2.
    Kohonen, T.: Self-Organizing Maps. Third edn. Volume 30 of Springer Series in Information Sciences. Springer-Verlag (2001)Google Scholar
  3. 3.
    Laaksonen, J., Koskela, M., Oja, E.: PicSOM—Self-organizing image retrieval with MPEG-7 content descriptions. IEEE Transactions on Neural Networks, Special Issue on Intelligent Multimedia Processing 13 (2002) 841–853Google Scholar
  4. 4.
    Schalkoff, R.J.: Pattern Recognition: Statistical, Structural and Neural Approaches. John Wiley & Sons, Ltd. (1992)Google Scholar
  5. 5.
    CIE: Supplement No. 2 to CIE publication No. 15 Colorimetry (E-l.3.1) 1971: Official recommendations on uniform color spaces, color-difference equations, and metric color terms (1976)Google Scholar
  6. 6.
    ISO/ IEC: Information technology — Multimedia content description interface — Part 3: Visual (2002) 15938-3:2002(E).Google Scholar
  7. 7.
    Khotanzad, A., Hong, Y.H.: Invariant image recognition by Zernike moments. IEEE Transaction on Pattern Analysis and Machine Intelligence 12 (1990) 489–497CrossRefGoogle Scholar

Copyright information

© International Federation for Information Processing 2006

Authors and Affiliations

  • Mats Sjöberg
    • 1
  • Ville Viitaniemi
    • 1
  • Jorma Laaksonen
    • 1
  • Timo Honkela
    • 1
  1. 1.Adaptive Informatics Research CentreHelsinki University of TechnologyFinland

Personalised recommendations