Multimedia Tools and Applications

, Volume 75, Issue 22, pp 14019–14038

Towards robust and reliable multimedia analysis through semantic integration of services

  • Ben De Meester
  • Ruben Verborgh
  • Pieter Pauwels
  • Wesley De Neve
  • Erik Mannens
  • Rik Van de Walle
Article

DOI: 10.1007/s11042-014-2445-9

Cite this article as:
De Meester, B., Verborgh, R., Pauwels, P. et al. Multimed Tools Appl (2016) 75: 14019. doi:10.1007/s11042-014-2445-9

Abstract

Thanks to ubiquitous Web connectivity and portable multimedia devices, it has never been so easy to produce and distribute new multimedia resources such as videos, photos, and audio. This ever-increasing production leads to an information overload for consumers, which calls for efficient multimedia retrieval techniques. Multimedia resources can be efficiently retrieved using their metadata, but the multimedia analysis methods that can automatically generate this metadata are currently not reliable enough for highly diverse multimedia content. A reliable and automatic method for analyzing general multimedia content is needed. We introduce a domain-agnostic framework that annotates multimedia resources using currently available multimedia analysis methods. By using a three-step reasoning cycle, this framework can assess and improve the quality of multimedia analysis results, by consecutively (1) combining analysis results effectively, (2) predicting which results might need improvement, and (3) invoking compatible analysis methods to retrieve new results. By using semantic descriptions for the Web services that wrap the multimedia analysis methods, compatible services can be automatically selected. By using additional semantic reasoning on these semantic descriptions, the different services can be repurposed across different use cases. We evaluated this problem-agnostic framework in the context of video face detection, and showed that it is capable of providing the best analysis results regardless of the input video. The proposed methodology can serve as a basis to build a generic multimedia annotation platform, which returns reliable results for diverse multimedia analysis problems. This allows for better metadata generation, and improves the efficient retrieval of multimedia resources.

Keywords

Multimedia analysisReasoning cycleSemantic reasoningWeb services

Copyright information

© Springer Science+Business Media New York 2015

Authors and Affiliations

  • Ben De Meester
    • 1
  • Ruben Verborgh
    • 1
  • Pieter Pauwels
    • 2
  • Wesley De Neve
    • 3
    • 4
  • Erik Mannens
    • 1
  • Rik Van de Walle
    • 1
  1. 1.Ghent University - iMinds - Multimedia LabLedeberg-GhentBelgium
  2. 2.Ghent University - Department of Architecture and Urban Planning GhentBelgium
  3. 3.Multimedia Lab, Ghent University – iMindsLedeberg-GhentBelgium
  4. 4.Image and Video Systems Lab, KAISTYuseong-guRepublic of Korea