M-OntoMat-Annotizer: Image Annotation Linking Ontologies and Multimedia Low-Level Features

  • Kosmas Petridis
  • Dionysios Anastasopoulos
  • Carsten Saathoff
  • Norman Timmermann
  • Yiannis Kompatsiaris
  • Steffen Staab
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4253)

Abstract

Annotations of multimedia documents typically have been pursued in two different directions. Either previous approaches have focused on low level descriptors, such as dominant color, or they have focused on the content dimension and corresponding annotations, such as person or vehicle. In this paper, we present a software environment to bridge between the two directions. M-OntoMat-Annotizer allows for linking low level MPEG-7 visual descriptions to conventional Semantic Web ontologies and annotations. We use M-OntoMat-Annotizer in order to construct ontologies that include prototypical instances of high-level domain concepts together with a formal specification of corresponding visual descriptors. Thus, we formalize the interrelationship of high- and low-level multimedia concept descriptions allowing for new kinds of multimedia content analysis, reasoning and retrieval.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Chang, S.-F., Sikora, T., Puri, A.: Overview of the MPEG-7 standard. IEEE Trans. on Circuits and Systems for Video Technology 11(6), 688–695 (2001)CrossRefGoogle Scholar
  2. 2.
    Mich, O., Brunelli, R., Modena, C.M.: A survey on video indexing. Journal of Visual Communications and Image Representation 10, 78–112 (1999)CrossRefGoogle Scholar
  3. 3.
    Smeulders, A.W.M., Worring, M., Santini, S., Gupta, A., Jain, R.: Content-based image retrieval at the end of the early years. IEEE Transactions on Pattern Analysis and Machine Intelligence 22(12)Google Scholar
  4. 4.
    Handschuh, S., Staab, S.: Cream - creating metadata for the semantic web. Computer Networks 42, 579–598 (2003)MATHCrossRefGoogle Scholar
  5. 5.
    Wielemaker, J., Schreiber, A.T, Dubbeldam, B., Wielinga, B.J.: Ontology-based photo annotation. IEEE Intelligent Systems (May/June 2001)Google Scholar
  6. 6.
    Hollink, L., Schreiber, A.T., Wielemaker, J., Wielinga, B.: Semantic annotation of image collections. In: Proceedings of the K-CAP 2003 Workshop on Knowledge Markup and Semantic Annotation, Florida (2003)Google Scholar
  7. 7.
    Wittenburg, P., Thierry, D., Cunningham, H.: The Automatic Generation of Formal Annotations in a Multimedia Indexing and Searching Environment. In: Proc. ACL/EACL Workshop on Human Language Technology and Knowledge Management, Toulouse, France (2001)Google Scholar
  8. 8.
    Athanasiadis, T., Tzouvaras, V., Petridis, K., Precioso, F., Avrithis, Y., Kompatsiaris, I.: Using a Multimedia Ontology Infrastructure for Semantic Annotation of Multimedia Content. In: Proceedings of the 5th International Workshop on Knowledge Markup and Semantic Annotation (SemAnnot 2005) at the 4th International Semantic Web Conference, ISWC 2005, November (2005)Google Scholar
  9. 9.
    Hunter, J., Drennan, J., Little, S.: Realizing the hydrogen economy through semantic web technologies. IEEE Intelligent Systems Journal - Special Issue on eScience 19, 40–47 (2004)Google Scholar
  10. 10.
    Yoshitaka, A., Kishida, S., Hirakawa, M., Ichikawa, T.: Knowledge-assisted content-based retrieval for multimedia databases. IEEE Multimedia 1(4), 12–21 (1994)CrossRefGoogle Scholar
  11. 11.
    Tansley, R., Bird, C., Hall, W., Lewis, P., Weal, M.: Automating the linking of content and concept. In: Proc. ACM Int. Multimedia Conf. and Exhibition (ACM MM 2000) (October/November 2000)Google Scholar
  12. 12.
    Maillot, N., Thonnat, M., Hudelot, C.: Ontology based object learning and recognition: Application to image retrieval. In: Proceedings of the 16th IEEE International Conference on Tools with Artificial Intelligence (ICTAI 2004), Boca Raton, FL, USA, November 15-17, 2004, pp. 620–625 (2004)Google Scholar
  13. 13.
    Kompatsiaris, I., Mezaris, V., Strintzis, M.G.: Multimedia content indexing and retrieval using an object ontology. In: Stamou, G. (ed.) Multimedia Content and Semantic Web - Methods, Standards and Tools. Wiley, New York (2004)Google Scholar
  14. 14.
    Handschuh, S., Staab, S. (eds.): Annotation for the Semantic Web. IOS Press, Amsterdam (2003)MATHGoogle Scholar
  15. 15.
    Bloehdorn, S., Petridis, K., Saathoff, C., Simou, N., Tzouvaras, V., Avrithis, Y., Handschuh, S., Kompatsiaris, Y., Staab, S., Strintzis, M.G.: Semantic Annotation of Images and Videos for Multimedia Analysis. In: Gómez-Pérez, A., Euzenat, J. (eds.) ESWC 2005. LNCS, vol. 3532, pp. 592–607. Springer, Heidelberg (2005)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Kosmas Petridis
    • 1
  • Dionysios Anastasopoulos
    • 1
  • Carsten Saathoff
    • 2
  • Norman Timmermann
    • 2
  • Yiannis Kompatsiaris
    • 1
  • Steffen Staab
    • 2
  1. 1.Informatics and Telematics InstituteThermi-ThessalonikiGreece
  2. 2.University of KoblenzKoblenzGermany

Personalised recommendations