Instance search retrospective with focus on TRECVID
- First Online:
- Cite this article as:
- Awad, G., Kraaij, W., Over, P. et al. Int J Multimed Info Retr (2017) 6: 1. doi:10.1007/s13735-017-0121-3
- 57 Downloads
This paper presents an overview of the Video instance search benchmark which was run over a period of 6 years (2010–2015) as part of the TREC Video Retrieval workshop series. The main contributions of the paper include (i) an examination of the evolving design of the evaluation framework and its components (system tasks, data, measures); (ii) an analysis of the influence of topic characteristics (such as rigid/non-rigid, planar/non-planar, stationary/mobile on performance; (iii) a high-level overview of results and best-performing approaches. The instance search benchmark worked with a variety of large collections of data including Sound & Vision, Flickr, BBC Rushes for the first three pilot years and with the small world of the BBC EastEnders series for the last 3 years.