Advertisement

Semantic Annotation of Images and Videos for Multimedia Analysis

  • Stephan Bloehdorn
  • Kosmas Petridis
  • Carsten Saathoff
  • Nikos Simou
  • Vassilis Tzouvaras
  • Yannis Avrithis
  • Siegfried Handschuh
  • Yiannis Kompatsiaris
  • Steffen Staab
  • Michael G. Strintzis
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3532)

Abstract

Annotations of multimedia documents typically have been pursued in two different directions. Either previous approaches have focused on low level descriptors, such as dominant color, or they have focused on the content dimension and corresponding annotations, such as person or vehicle. In this paper, we present a software environment to bridge between the two directions. M-OntoMat-Annotizer allows for linking low level MPEG-7 visual descriptions to conventional Semantic Web ontologies and annotations. We use M-OntoMat-Annotizer in order to construct ontologies that include prototypical instances of high-level domain concepts together with a formal specification of corresponding visual descriptors. Thus, we formalize the interrelationship of high- and low-level multimedia concept descriptions allowing for new kinds of multimedia content analysis and reasoning.

Keywords

Multimedia Content Domain Ontology Domain Concept Semantic Annotation Atom Region 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

References

  1. 1.
    Chang, S.-F., Sikora, T., Puri, A.: Overview of the MPEG-7 standard. IEEE Trans. on Circuits and Systems for Video Technology 11(6), 688–695 (2001)CrossRefGoogle Scholar
  2. 2.
    Mich, O., Brunelli, R., Modena, C.M.: A survey on video indexing. Journal of Visual Communications and Image Representation 10, 78–112 (1999)CrossRefGoogle Scholar
  3. 3.
    Smeulders, A.W.M., Worring, M., Santini, S., Gupta, A., Jain, R.: Content-based image retrieval at the end of the early years. IEEE Transactions on Pattern Analysis and Machine Intelligence 22(12)Google Scholar
  4. 4.
    Handschuh, S., Staab, S.: Cream - creating metadata for the semantic web. Computer Networks 42, 579–598 (2003)zbMATHCrossRefGoogle Scholar
  5. 5.
    Wielemaker, J., Schreiber, A.T., Dubbeldam, B., Wielinga, B.J.: Ontology-based photo annotation. IEEE Intelligent Systems, May/June 2001 (2001)Google Scholar
  6. 6.
    Hollink, L., Schreiber, A.T., Wielemaker, J., Wielinga, B.: Semantic annotation of image collections. In: Proceedings of the K-CAP 2003 Workshop on Knowledge Markup and Semantic Annotation, Florida (2003)Google Scholar
  7. 7.
    Wittenburg, P., Thierry, D., Cunningham, H.: The Automatic Generation of Formal Annotations in a Multimedia Indexing and Searching Environment. In: Proc. ACL/EACL Workshop on Human Language Technology and Knowledge Management, Toulouse, France (2001)Google Scholar
  8. 8.
    Hunter, J., Drennan, J., Little, S.: Realizing the hydrogen economy through semantic web technologies. IEEE Intelligent Systems Journal - Special Issue on eScience 19, 40–47 (2004)Google Scholar
  9. 9.
    Yoshitaka, A., Kishida, S., Hirakawa, M., Ichikawa, T.: Knowledge-assisted content-based retrieval for multimedia databases. IEEE Multimedia 1(4), 12–21 (Winter 1994)CrossRefGoogle Scholar
  10. 10.
    Tansley, R., Bird, C., Hall, W., Lewis, P., Weal, M.: Automating the linking of content and concept. In: Proc. ACM Int. Multimedia Conf. and Exhibition (ACM MM 2000), October/November 2000 (2000)Google Scholar
  11. 11.
    Maillot, N., Thonnat, M., Hudelot, C.: Ontology based object learning and recognition: Application to image retrieval. In: Proceedings of the 16th IEEE International Conference on Tools with Artificial Intelligence (ICTAI 2004), Boca Raton, FL, USA, November 15-17, pp. 620–625 (2004)Google Scholar
  12. 12.
    Kompatsiaris, I., Mezaris, V., Strintzis, M.G.: Multimedia content indexing and retrieval using an object ontology. In: Stamou, G. (ed.) Multimedia Content and Semantic Web - Methods, Standards and Tools. Wiley, New York (2004)Google Scholar
  13. 13.
    Handschuh, S., Staab, S. (eds.): Annotation for the Semantic Web. IOS Press, Amsterdam (2003)zbMATHGoogle Scholar
  14. 14.
    Bloehdorn, S., Staab, S., Handschuh, S., Avrithis, Y., Tzouvaras, V., Simou, N., Strintzis, M.G., Kompatsiaris, Y., Petridis, K.: Knowledge representation for semantic multimedia content analysis and reasoning. In: Proceedings of the European Workshop on the Integration of Knowledge, Semantics and Digital Media Technology (EWIMT), Novemebr (2004)Google Scholar
  15. 15.
    Sikora, T.: The MPEG-7 Visual standard for content description - an overview. IEEE Trans. on Circuits and Systems for Video Technology, special issue on MPEG-7 11(6), 696–702 (2001)CrossRefMathSciNetGoogle Scholar
  16. 16.
    ISO/IEC 15938-5 FCD Information Technology - Multimedia Content Description Interface - Part 5: Multimedia Description Scemes, Singapore (March 2001)Google Scholar
  17. 17.
    Gangemi, A., Guarino, N., Masolo, C., Oltramari, A., Schneider, L.: Sweetening Ontologies with DOLCE. In: Gómez-Pérez, A., Benjamins, V.R. (eds.) EKAW 2002. LNCS (LNAI), vol. 2473, p. 166. Springer, Heidelberg (2002)CrossRefGoogle Scholar
  18. 18.
    ISO/IEC 15938-3 FCD Information Technology - Multimedia Content Description Interface - Part 3: Visual, Singapore (March 2001)Google Scholar
  19. 19.
    Voisine, N., Dasiopoulou, S., Mezaris, V., Spyrou, E., Athanasiadis, T., Kompatsiaris, I., Avrithis, Y., Strintzis, M.G.: Knowledge-Assisted Video Analysis Using A Genetic Algorithm. In: Proc. Workshop on Image Analysis for Multimedia Interactive Services (WIAMIS 2005) (April 2005)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2005

Authors and Affiliations

  • Stephan Bloehdorn
    • 1
  • Kosmas Petridis
    • 2
  • Carsten Saathoff
    • 3
  • Nikos Simou
    • 4
  • Vassilis Tzouvaras
    • 4
  • Yannis Avrithis
    • 4
  • Siegfried Handschuh
    • 1
  • Yiannis Kompatsiaris
    • 2
  • Steffen Staab
    • 3
  • Michael G. Strintzis
    • 2
  1. 1.Institute AIFBUniversity of KarlsruheKarlsruheGermany
  2. 2.Informatics and Telematics InstituteThermi-ThessalonikiGreece
  3. 3.Institute for Computer ScienceUniversity of Koblenz-LandauKoblenzGermany
  4. 4.School of Electrical and Computer EngineeringNational Technical University of AthensZographou, AthensGreece

Personalised recommendations