Advertisement

An Ontology Infrastructure for Multimedia Reasoning

  • Nikolaos Simou
  • Carsten Saathoff
  • Stamatia Dasiopoulou
  • Evangelos Spyrou
  • Nikola Voisine
  • Vassilis Tzouvaras
  • Ioannis Kompatsiaris
  • Yiannis Avrithis
  • Steffen Staab
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3893)

Abstract

In this paper, an ontology infrastucture for multimedia reasoning is presented, making it possible to combine low-level visual descriptors with domain specific knowledge and subsequently analyze multimedia content with a generic algorithm that makes use of this knowledge. More specifically, the ontology infrastructure consists of a domain-specific ontology, a visual descriptor ontology (VDO) and an upper ontology. In order to interpret a scene, a set of atom regions is generated by an initial segmentation and their descriptors are extracted. Considering all descriptors in association with the related prototype instances and relations, a genetic algorithm labels the atom regions. Finally, a constraint reasoning engine enables the final region merging and labelling into meaningful objects.

Keywords

Multimedia Content Domain Ontology Atom Region Dominant Color Visual Descriptor 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Manjunath, B., Ohm, J.R., Vasudevan, V., Yamada, A.: Color and texture descriptors. IEEE Trans. on Circuits and Systems for Video Technology, special issue on MPEG-7 11(6), 703–715 (2001)CrossRefGoogle Scholar
  2. 2.
    Brunelli, R., Mich, O., Modena, C.: A survey on video indexing. Journal of Visual Communications and Image Representation 10, 78–112 (1999)CrossRefGoogle Scholar
  3. 3.
    Staab, S., Studer, R.: Handbook on Ontologies. International Handbooks on Information Systems. Springer, Heidelberg (2004)CrossRefMATHGoogle Scholar
  4. 4.
    Schreiber, A.T., Dubbeldam, B., Wielemaker, J.: Ontology-based photo annotation. IEEE Intelligent Systems (2001)Google Scholar
  5. 5.
    Al-Khatib, W., Day, Y., Ghafoor, A., Berra, P.: Semantic modeling and knowledge representation in multimedia databases. IEEE Transactions on Knowledge and Data Engineering 11(1), 64–80 (1999)CrossRefGoogle Scholar
  6. 6.
    Yoshitaka, A., Kishida, S., Hirakawa, M., Ichikawa, T.: Knowledge-assisted contentbased retrieval for multimedia databases. IEEE Multimedia 1(4), 12–21 (1994)CrossRefGoogle Scholar
  7. 7.
    Alejandro Jaimes, B.T., Smith, J.R.: Proc. IEEE International Conference on Image and Video Retrieval, ICME 2003 (2003)Google Scholar
  8. 8.
    Jaimes, A., Smith, J.R.: Proc. IEEE International Conference on Multimedia and Expo, ICME 2003 (2003)Google Scholar
  9. 9.
    Benitez, A.B., Chang, S.F.: Proc. IEEE International Conference on Image and Video Retrieval, ICME 2002 (2002)Google Scholar
  10. 10.
    Tsechpenakis, G., Akrivas, G., Andreou, G., Stamou, G., Kollias, S.: Knowledge- Assisted Video Analysis and Object Detection. In: Proc. European Symposium on Intelligent Technologies, Hybrid Systems and their implementation on Smart Adaptive Systems (Eunite 2002), Algarve, Portugal (2002)Google Scholar
  11. 11.
    Mezaris, V., Kompatsiaris, I., Boulgouris, N., Strintzis, M.: Real-time compresseddomain spatiotemporal segmentation and ontologies for video indexing and retrieval. IEEE Trans. on Circuits and Systems for Video Technology 14(5), 606–621 (2004)CrossRefGoogle Scholar
  12. 12.
    Mezaris, V., Kompatsiaris, I., Strintzis, M.: A framework for the efficient segmentation of large-format color images. Proc. International Conference on Image Processing, vol. 1, pp. 761–764 (2002)Google Scholar
  13. 13.
    Tuan, J.C., Chang, T.S., Jen, C.W.: On the data reuse and memory bandwidth analysis for full-search block-matching VLSI architecture. IEEE Trans. on Circuits and Systems for Video Technology 12(1), 61–72 (2002)CrossRefGoogle Scholar
  14. 14.
    Yu, T., Zhang, Y.: Retrieval of video clips using global motion information. Electronics Letters 37(14), 893–895 (2001)CrossRefGoogle Scholar
  15. 15.
    Mitchell, M.: An introduction to Genetic Algorithms. MIT Press, Cambridge (1996)MATHGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Nikolaos Simou
    • 1
  • Carsten Saathoff
    • 2
  • Stamatia Dasiopoulou
    • 3
  • Evangelos Spyrou
    • 1
  • Nikola Voisine
    • 3
  • Vassilis Tzouvaras
    • 1
  • Ioannis Kompatsiaris
    • 3
  • Yiannis Avrithis
    • 1
  • Steffen Staab
    • 2
  1. 1.Image, Video and Multimedia Systems Laboratory, School of Electrical and Computer EngineeringNational Technical University of AthensZographou AthensGreece
  2. 2.Informatics and Telematics Institute Centre for Research and Technology HellasThermi-ThessalonikiGreece
  3. 3.Institute for Computer ScienceUniversity of KoblenzKoblenzGermany

Personalised recommendations