TRECVID: Benchmarking the Effectiveness of Information Retrieval Tasks on Digital Video
Many research groups worldwide are now investigating techniques which can support information retrieval on archives of digital video and as groups move on to implement these techniques they inevitably try to evaluate the performance of their techniques in practical situations. The difficulty with doing this is that there is no test collection or any environment in which the effectiveness of video IR or video IR sub-tasks, can be evaluated and compared. The annual series of TREC exercises has, for over a decade, been benchmarking the effectiveness of systems in carrying out various information retrieval tasks on text and audio and has contributed to a huge improvement in many of these. Two years ago, a track was introduced which covers shot boundary detection, feature extraction and searching through archives of digital video. In this paper we present a summary of the activities in the TREC Video track in 2002 where 17 teams from across the world took part.
KeywordsSearch Task Test Collection Shot Boundary Shot Boundary Detection Information Retrieval Task
Unable to display preview. Download preview PDF.
- The Internet Archive Movie Archive. http://www.archive.org/moviesGoogle Scholar
- Boreczky, J.S., and Rowe, L.A. (1996) Comparison of video shot boundary detection techniques. In I.K. Sethe and R.C. Jain (Eds.) Storage and Retrieval for Still Image and Video databases IV, Proc. SPIE 2670, pp.170–179., San Jose, Calif. USA.Google Scholar
- Ford, R.M. (1999). A quantitative Comparison of Shot Boundary Detection Metrics. In: M.M. Yueng, B.-L. Yeo and C.A. Bouman (Eds.).) Storage and Retrieval for Still Image and Video databases IV, Proc. SPIE 3656, pp.666–676, San Jose, Calif. USA.Google Scholar
- The TREC 2002 Proceedings: http://trec.nist.gov/pubs/trec11/t11_proceedings.html.Google Scholar
- Müller, W., Marchand-Maillet, S., Müller, H. and Pun, T. Towards a fair benchmark for image browsers, In SPIE Photonics East, Voice, Video, and Data Communications, Boston, MA, USA, November 5–8 2000.Google Scholar