Analysis of Semantic Information Available in an Image Collection Augmented with Auxiliary Data
An art installation was on display in the Centre Pompidou National Museum of Modern Art in Paris, where visitors could contribute with their own personal objects, adding keyword descriptions and quantified semantic features such as age or hardness. The data was projected in real-time onto a Self-Organizing Map (SOM) which was shown in the gallery. In this paper we analyze the same data by extracting visual features from the images and organize the image collection with multiple SOMs. We show how this mapping facilitates the emergence of semantic associations between visual, textual and metadata modalities by studying the distributions of the different feature vectors on the SOMs.
- 2.Kohonen, T.: Self-Organizing Maps. Third edn. Volume 30 of Springer Series in Information Sciences. Springer-Verlag (2001)Google Scholar
- 3.Laaksonen, J., Koskela, M., Oja, E.: PicSOM—Self-organizing image retrieval with MPEG-7 content descriptions. IEEE Transactions on Neural Networks, Special Issue on Intelligent Multimedia Processing 13 (2002) 841–853Google Scholar
- 4.Schalkoff, R.J.: Pattern Recognition: Statistical, Structural and Neural Approaches. John Wiley & Sons, Ltd. (1992)Google Scholar
- 5.CIE: Supplement No. 2 to CIE publication No. 15 Colorimetry (E-l.3.1) 1971: Official recommendations on uniform color spaces, color-difference equations, and metric color terms (1976)Google Scholar
- 6.ISO/ IEC: Information technology — Multimedia content description interface — Part 3: Visual (2002) 15938-3:2002(E).Google Scholar