TRECVID: Benchmarking the Effectiveness of Information Retrieval Tasks on Digital Video

  • Alan F. Smeaton
  • Paul Over
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 2728)


Many research groups worldwide are now investigating techniques which can support information retrieval on archives of digital video and as groups move on to implement these techniques they inevitably try to evaluate the performance of their techniques in practical situations. The difficulty with doing this is that there is no test collection or any environment in which the effectiveness of video IR or video IR sub-tasks, can be evaluated and compared. The annual series of TREC exercises has, for over a decade, been benchmarking the effectiveness of systems in carrying out various information retrieval tasks on text and audio and has contributed to a huge improvement in many of these. Two years ago, a track was introduced which covers shot boundary detection, feature extraction and searching through archives of digital video. In this paper we present a summary of the activities in the TREC Video track in 2002 where 17 teams from across the world took part.


Search Task Test Collection Shot Boundary Shot Boundary Detection Information Retrieval Task 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. [1]
    The Internet Archive Movie Archive. Scholar
  2. [2]
    Boreczky, J.S., and Rowe, L.A. (1996) Comparison of video shot boundary detection techniques. In I.K. Sethe and R.C. Jain (Eds.) Storage and Retrieval for Still Image and Video databases IV, Proc. SPIE 2670, pp.170–179., San Jose, Calif. USA.Google Scholar
  3. [3]
    Ford, R.M. (1999). A quantitative Comparison of Shot Boundary Detection Metrics. In: M.M. Yueng, B.-L. Yeo and C.A. Bouman (Eds.).) Storage and Retrieval for Still Image and Video databases IV, Proc. SPIE 3656, pp.666–676, San Jose, Calif. USA.Google Scholar
  4. [4]
    The TREC 2002 Proceedings: Scholar
  5. [5]
    Müller, W., Marchand-Maillet, S., Müller, H. and Pun, T. Towards a fair benchmark for image browsers, In SPIE Photonics East, Voice, Video, and Data Communications, Boston, MA, USA, November 5–8 2000.Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2003

Authors and Affiliations

  • Alan F. Smeaton
    • 1
  • Paul Over
    • 2
  1. 1.Centre for Digital Video ProcessingDublin City UniversityGlasnevin, Dublin, 9Ireland
  2. 2.Retrieval Group, Information Access DivisionNational Institute of Standards and TechnologyGaithersburgUSA

Personalised recommendations