Survey of Semantic Media Annotation Tools for the Web: Towards New Media Applications with Linked Media

  • Lyndon NixonEmail author
  • Raphaël Troncy
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8798)


Semantic annotation of media resources has been a focus in research since many years, the closing of the “semantic gap” being seen as key to significant improvements in media retrieval and browsing and enabling new media applications and services. However, current tools and services exhibit varied approaches which do not easily integrate and act as a barrier to wider uptake of semantic annotation of online multimedia. In this paper, we outline the Linked Media principles which can help form a consensus on media annotation approaches, survey current media annotation tools against these principles and present two emerging toolsets which can support Linked Media conformant annotation, closing with a call to future semantic media annotation tools and services to follow the same principles and ensure the growth of a Linked Media layer of semantic descriptions of online media which can be an enabler to richer future online media services.


Annotation Tool Semantic Annotation Online Medium Video Annotation Entity Extraction 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.



This work was partially supported by the European Union’s 7th Framework Programme via the projects LinkedTV (GA 287911) and MediaMixer (GA 318101) as well as the Austrian FFG COIN programme through the project ConnectME.


  1. 1.
    Dasiopoulou, S., Giannakidou, E., Litos, G., Malasioti, P., Kompatsiaris, Y.: A survey of semantic image and video annotation tools. In: Paliouras, G., Spyropoulos, C.D., Tsatsaronis, G. (eds.) Multimedia Information Extraction. LNCS (LNAI), vol. 6050, pp. 196–239. Springer, Heidelberg (2011)CrossRefGoogle Scholar
  2. 2.
    Haslhofer, B., Sanderson, R., Simon, R., Sompel, H.: Open annotations on multimedia Web resources. Multimedia Tools Appl. 1–21 (2012)Google Scholar
  3. 3.
    Hunter, J.: Adding multimedia to the semantic web - building an MPEG-7 ontology. In: 1st International Semantic Web Working Symposium (ISWC), pp. 261–281 (2001)Google Scholar
  4. 4.
    Lee, T.B.: Linked data principles. Des. Issues (2006)Google Scholar
  5. 5.
    Lee, W., Bailer, W., Bürger, T., Champin, P.-A., Evain, J.-P., Malaisé, V., Michel, T., Sasaki, F., Söderberg, J., Stegmaier, F., Strassner, J.: Ontology for Media Resources 1.0. W3C Recommendation (2012)Google Scholar
  6. 6.
    Li, Y., Rizzo, G., García, J.L.R., Troncy, R., Wald, M., Wills, G.: Enriching media fragments with named entities for video classification. In: 1st Worldwide Web Workshop on Linked Media (LiME’13), Rio de Janeiro, Brazil, pp. 469–476 (2013)Google Scholar
  7. 7.
    Li, Y., Rizzo, G., Troncy, R., Wald, M., Wills, G.: Creating enriched YouTube media fragments with NERD using timed-text. In: 11th International Semantic Web Conference (ISWC), Demo Session, Boston, USA (2012)Google Scholar
  8. 8.
    Nack, F., van Ossenbruggen, J., Hardman, L.: That obscure object of desire: multimedia metadata on the web (Part II). IEEE Multimedia 12(1), 54–63 (2005)CrossRefGoogle Scholar
  9. 9.
    Nixon, L.: The importance of linked media to the future web. In: 1st International Workshop on Linked Media (LiME), Rio de Janeiro, Brazil (2013)Google Scholar
  10. 10.
    Nixon, L., Zdolsek, T., Fabjan, A., Kese, P.: Video lectures mashup: remixing learning materials for topic-centred learning across collections. In: OCW Global Conference, Ljubljana, Slovenia (2014)Google Scholar
  11. 11.
    van Ossenbruggen, J., Nack, F., Hardman, L.: That obscure object of desire: multimedia metadata on the web (Part I). IEEE Multimedia 11(4), 38–48 (2004)CrossRefGoogle Scholar
  12. 12.
    Rizzo, G., Troncy, R.: NERD: a framework for unifying named entity recognition and disambiguation extraction tools. In: 13th Conference of the European Chapter of the Association for Computational Linguistics (EACL’12), Avignon, France (2012)Google Scholar
  13. 13.
    Sanderson, R., Ciccarese, P., Van de Sompel, H.: Open Annotation Data Model. W3C Community Draft (2013)Google Scholar
  14. 14.
    Schreiber, G., et al.: MultimediaN E-Culture demonstrator. In: Cruz, I., Decker, S., Allemang, D., Preist, C., Schwabe, D., Mika, P., Uschold, M., Aroyo, L.M. (eds.) ISWC 2006. LNCS, vol. 4273, pp. 951–958. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  15. 15.
    Troncy, R., Mannens, E., Pfeiffer, S., Van Deursen, D.: Media fragments URI 1.0 (basic). W3C Recommendation (2012)Google Scholar
  16. 16.
    Weiss, W., Bürger, T., Villa, R., Punitha, P., Halb, W.: Statement-based semantic annotation of media resources. In: Chua, T.-S., Kompatsiaris, Y., Mérialdo, B., Haas, W., Thallinger, G., Bailer, W. (eds.) SAMT 2009. LNCS, vol. 5887, pp. 52–64. Springer, Heidelberg (2009)CrossRefGoogle Scholar

Copyright information

© Springer International Publishing Switzerland 2014

Authors and Affiliations

  1. 1.MODUL UniversityViennaAustria
  2. 2.EURECOMSophia AntipolisFrance

Personalised recommendations