Abstract
Annotations of multimedia documents typically have been pursued in two different directions. Either previous approaches have focused on low level descriptors, such as dominant color, or they have focused on the content dimension and corresponding annotations, such as person or vehicle. In this paper, we present a software environment to bridge between the two directions. M-OntoMat-Annotizer allows for linking low level MPEG-7 visual descriptions to conventional Semantic Web ontologies and annotations. We use M-OntoMat-Annotizer in order to construct ontologies that include prototypical instances of high-level domain concepts together with a formal specification of corresponding visual descriptors. Thus, we formalize the interrelationship of high- and low-level multimedia concept descriptions allowing for new kinds of multimedia content analysis, reasoning and retrieval.
This research was partially supported by the European Commission under contract FP6-001765 aceMedia. The expressed content is the view of the authors but not necessarily the view of the aceMedia project as a whole.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Chang, S.-F., Sikora, T., Puri, A.: Overview of the MPEG-7 standard. IEEE Trans. on Circuits and Systems for Video Technology 11(6), 688–695 (2001)
Mich, O., Brunelli, R., Modena, C.M.: A survey on video indexing. Journal of Visual Communications and Image Representation 10, 78–112 (1999)
Smeulders, A.W.M., Worring, M., Santini, S., Gupta, A., Jain, R.: Content-based image retrieval at the end of the early years. IEEE Transactions on Pattern Analysis and Machine Intelligence 22(12)
Handschuh, S., Staab, S.: Cream - creating metadata for the semantic web. Computer Networks 42, 579–598 (2003)
Wielemaker, J., Schreiber, A.T, Dubbeldam, B., Wielinga, B.J.: Ontology-based photo annotation. IEEE Intelligent Systems (May/June 2001)
Hollink, L., Schreiber, A.T., Wielemaker, J., Wielinga, B.: Semantic annotation of image collections. In: Proceedings of the K-CAP 2003 Workshop on Knowledge Markup and Semantic Annotation, Florida (2003)
Wittenburg, P., Thierry, D., Cunningham, H.: The Automatic Generation of Formal Annotations in a Multimedia Indexing and Searching Environment. In: Proc. ACL/EACL Workshop on Human Language Technology and Knowledge Management, Toulouse, France (2001)
Athanasiadis, T., Tzouvaras, V., Petridis, K., Precioso, F., Avrithis, Y., Kompatsiaris, I.: Using a Multimedia Ontology Infrastructure for Semantic Annotation of Multimedia Content. In: Proceedings of the 5th International Workshop on Knowledge Markup and Semantic Annotation (SemAnnot 2005) at the 4th International Semantic Web Conference, ISWC 2005, November (2005)
Hunter, J., Drennan, J., Little, S.: Realizing the hydrogen economy through semantic web technologies. IEEE Intelligent Systems Journal - Special Issue on eScience 19, 40–47 (2004)
Yoshitaka, A., Kishida, S., Hirakawa, M., Ichikawa, T.: Knowledge-assisted content-based retrieval for multimedia databases. IEEE Multimedia 1(4), 12–21 (1994)
Tansley, R., Bird, C., Hall, W., Lewis, P., Weal, M.: Automating the linking of content and concept. In: Proc. ACM Int. Multimedia Conf. and Exhibition (ACM MM 2000) (October/November 2000)
Maillot, N., Thonnat, M., Hudelot, C.: Ontology based object learning and recognition: Application to image retrieval. In: Proceedings of the 16th IEEE International Conference on Tools with Artificial Intelligence (ICTAI 2004), Boca Raton, FL, USA, November 15-17, 2004, pp. 620–625 (2004)
Kompatsiaris, I., Mezaris, V., Strintzis, M.G.: Multimedia content indexing and retrieval using an object ontology. In: Stamou, G. (ed.) Multimedia Content and Semantic Web - Methods, Standards and Tools. Wiley, New York (2004)
Handschuh, S., Staab, S. (eds.): Annotation for the Semantic Web. IOS Press, Amsterdam (2003)
Bloehdorn, S., Petridis, K., Saathoff, C., Simou, N., Tzouvaras, V., Avrithis, Y., Handschuh, S., Kompatsiaris, Y., Staab, S., Strintzis, M.G.: Semantic Annotation of Images and Videos for Multimedia Analysis. In: Gómez-Pérez, A., Euzenat, J. (eds.) ESWC 2005. LNCS, vol. 3532, pp. 592–607. Springer, Heidelberg (2005)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Petridis, K., Anastasopoulos, D., Saathoff, C., Timmermann, N., Kompatsiaris, Y., Staab, S. (2006). M-OntoMat-Annotizer: Image Annotation Linking Ontologies and Multimedia Low-Level Features. In: Gabrys, B., Howlett, R.J., Jain, L.C. (eds) Knowledge-Based Intelligent Information and Engineering Systems. KES 2006. Lecture Notes in Computer Science(), vol 4253. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11893011_80
Download citation
DOI: https://doi.org/10.1007/11893011_80
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-46542-3
Online ISBN: 978-3-540-46544-7
eBook Packages: Computer ScienceComputer Science (R0)