A Novel Approach for Semantics-Enabled Search of Multimedia Documents on the Web

  • Lydia Weiland
  • Ansgar Scherp
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8325)


We present an analysis of a large corpus of multimedia documents obtained from the web. From this corpus of documents, we have extracted the media assets and the relation information between the assets. In order to conduct our analysis, the assets and relations are represented using a formal ontology. The ontology not only allows for representing the structure of multimedia documents but also to connect with arbitrary background knowledge on the web. The ontology as well as the analysis serve as basis for implementing a novel search engine for multimedia documents on the web.


Description Logic Multimedia Content Multimedia Document Link Open Data Multimedia Retrieval 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Allen, J.F.: Maintaining knowledge about temporal intervals. Commun. ACM 26(11), 832–843 (1983)CrossRefzbMATHGoogle Scholar
  2. 2.
    Baader, F., Calvanese, D., McGuinness, D.L., Nardi, D., Patel-Schneider, P.F. (eds.): The Description Logic Handbook: Theory, Implementation, and Applications. Cambridge University Press (2003)Google Scholar
  3. 3.
    Balbiani, P., Condotta, J., del Cerro, L.F.: A model for reasoning about bidimensional temporal relations. In: Principles of Knowledge Representation and Reasoning, pp. 124–130. Morgan Kaufmann (1998)Google Scholar
  4. 4.
    Boll, S., Klas, W.: ZYX - A Multimedia Document Model for Reuse and Adaptation. IEEE Trans. on Knowledge and Data Engineering 13(3), 361–382 (2001)CrossRefGoogle Scholar
  5. 5.
    Boll, S., Klas, W., Westermann, U.: Multimedia document models - sealed fate or setting out for new shores? In: Int. Conf. on Multimedia Computing and Systems, p. 9604. IEEE, Washington, DC (1999)Google Scholar
  6. 6.
    Candan, K.S., Sapino, M.L.: Data Management for Multimedia Retrieval. Cambridge University Press, New York (2010)zbMATHGoogle Scholar
  7. 7.
    Cao, Z., Wu, Z., Wang, Y.: UMQL: A unified multimedia query language. In: Signal-Image Technologies and Internet-Based System, pp. 109–115. IEEE (2007)Google Scholar
  8. 8.
    Celino, I., Valle, E.D., Cerizza, D., Turati, A.: Squiggle: a semantic search engine for indexing and retrieval of multimedia content. In: Semantic Enhanced Multimedia Presentation Systems. (2006)Google Scholar
  9. 9.
    Clementini, E., Sharma, J., Egenhofer, M.J.: Modelling topological spatial relations: Strategies for query processing. Computers & Graphics 18, 815–822 (1994)CrossRefGoogle Scholar
  10. 10.
    Diemert, B., Abel, M.-H., Moulin, C.: Semantic audiovisual asset model. Multimedia Tools and Applications 63, 663–690 (2013)CrossRefGoogle Scholar
  11. 11.
    Döller, M., Kosch, H., Wolf, I., Gruhne, M.: Towards an mpeg-7 query language. In: Damiani, E., Yetongnon, K., Chbeir, R., Dipanda, A. (eds.) SITIS 2006. LNCS, vol. 4879, pp. 10–21. Springer, Heidelberg (2009)CrossRefGoogle Scholar
  12. 12.
    Freksa, C.: Temporal reasoning based on semi-intervals. Artif. Intell. 54(1-2), 199–227 (1992)CrossRefMathSciNetGoogle Scholar
  13. 13.
    Hardman, L., Bulterman, D.C.A., van Rossum, G.: The Amsterdam hypermedia model: adding time and context to the Dexter model. Communications of the ACM 37(2) (February 1994)Google Scholar
  14. 14.
    Masolo, C., Borgo, S., Gangemi, A., Guarino, N., Oltramari, A., Schneider, L.: The wonderweb library of foundational ontologies and the dolce ontology. Technical report, ISTC-CNR (2007)Google Scholar
  15. 15.
    Merzougui, G., Djoudi, M., Behaz, A.: Conception and use of ontologies for indexing and searching by semantic contents of video courses. International Journal of Computer Science Issues 8(3) (2012)Google Scholar
  16. 16.
    Saathoff, C., Scherp, A.: M3o: The multimedia metadata ontology. In: Proceedings of the Workshop on Semantic Multimedia Database Technologies, 10th International Workshop of the Multimedia Metadata Community (SeMuDaTe 2009) (2009)Google Scholar
  17. 17.
    Scherp, A.: Authoring of Multimedia Content: A Survey of 20 Years of Research. In: Semantic Multimedia Analysis and Processing. CRC Press (2013)Google Scholar
  18. 18.
    Scherp, A., Boll, S.: MM4U - A framework for creating personalized multimedia content. In: Managing Multimedia Semantics. Idea Publishing (2005)Google Scholar
  19. 19.
    Scherp, A., Boll, S.: Paving the Last Mile for Multi-Channel Multimedia Presentation Generation. In: Chen, Y.-P.P. (ed.) Proc. of the 11th Int. Conf. on Multimedia Modeling, Melbourne, Australia, pp. 190–197. IEEE (January 2005)Google Scholar
  20. 20.
    Scherp, A., Saathoff, C., Franz, T., Staab, S.: Designing core ontologies. Applied Ontology 6, 177–221 (2011)Google Scholar
  21. 21.
    Suarez-Figueroa, M., Gomez-Perez, A., Motta, E., Gangemi, A.: Ontology Engineering in a Networked World. Springer (2012)Google Scholar
  22. 22.
    Waitelonis, J., Sack, H.: Towards exploratory video search using linked data. In: Multimedia Tools and Applications, pp. 1–28 (2011)Google Scholar
  23. 23.
    Yang, J., Li, Q., Wenyin, L., Zhuang, Y.: Searching for flash movies on the web: A content and context based framework. World Wide Web Journal (September 2005)Google Scholar
  24. 24.
    Zillner, S., Westermann, U., Winiwarter, W.: EMMA – A query algebra for enhanced multimedia meta objects. In: Meersman, R. (ed.) OTM 2004. LNCS, vol. 3291, pp. 1030–1049. Springer, Heidelberg (2004)CrossRefGoogle Scholar

Copyright information

© Springer International Publishing Switzerland 2014

Authors and Affiliations

  • Lydia Weiland
    • 1
  • Ansgar Scherp
    • 1
  1. 1.University of MannheimGermany

Personalised recommendations