The Video Browser Showdown: a live evaluation of interactive video search tools

  • Klaus Schoeffmann
  • David Ahlström
  • Werner Bailer
  • Claudiu Cobârzan
  • Frank Hopfgartner
  • Kevin McGuinness
  • Cathal Gurrin
  • Christian Frisson
  • Duy-Dinh Le
  • Manfred Del Fabro
  • Hongliang Bai
  • Wolfgang Weiss
Regular Paper

DOI: 10.1007/s13735-013-0050-8

Cite this article as:
Schoeffmann, K., Ahlström, D., Bailer, W. et al. Int J Multimed Info Retr (2014) 3: 113. doi:10.1007/s13735-013-0050-8

Abstract

The Video Browser Showdown evaluates the performance of exploratory video search tools on a common data set in a common environment and in presence of the audience. The main goal of this competition is to enable researchers in the field of interactive video search to directly compare their tools at work. In this paper, we present results from the second Video Browser Showdown (VBS2013) and describe and evaluate the tools of all participating teams in detail. The evaluation results give insights on how exploratory video search tools are used and how they perform in direct comparison. Moreover, we compare the achieved performance to results from another user study where 16 participants employed a standard video player to complete the same tasks as performed in VBS2013. This comparison shows that the sophisticated tools enable better performance in general, but for some tasks common video players provide similar performance and could even outperform the expert tools. Our results highlight the need for further improvement of professional tools for interactive search in videos.

Keywords

Video browsing Video search Video retrieval Exploratory search 

Copyright information

© Springer-Verlag London 2013

Authors and Affiliations

  • Klaus Schoeffmann
    • 1
  • David Ahlström
    • 1
  • Werner Bailer
    • 2
  • Claudiu Cobârzan
    • 1
  • Frank Hopfgartner
    • 3
  • Kevin McGuinness
    • 4
  • Cathal Gurrin
    • 4
  • Christian Frisson
    • 5
  • Duy-Dinh Le
    • 6
  • Manfred Del Fabro
    • 1
  • Hongliang Bai
    • 7
  • Wolfgang Weiss
    • 2
  1. 1.Alpen-Adria-Universität KlagenfurtKlagenfurtAustria
  2. 2.Joanneum ResearchGrazAustria
  3. 3.Technische Universität BerlinBerlinGermany
  4. 4.Dublin City UniversityDublinIreland
  5. 5.Université de MonsMonsBelgium
  6. 6.National Institute of InformaticsTokyoJapan
  7. 7.Orange Labs International CentersBeijingChina

Personalised recommendations