Image and Video Retrieval

Volume 4071 of the series Lecture Notes in Computer Science pp 380-390

Recognizing Objects and Scenes in News Videos

  • Muhammet BaştanAffiliated withDepartment of Computer Engineering, Bilkent University
  • , Pınar DuyguluAffiliated withDepartment of Computer Engineering, Bilkent University

* Final gross prices may vary according to local VAT.

Get Access


We propose a new approach to recognize objects and scenes in news videos motivated by the availability of large video collections. This approach considers the recognition problem as the translation of visual elements to words. The correspondences between visual elements and words are learned using the methods adapted from statistical machine translation and used to predict words for particular image regions (region naming), for entire images (auto-annotation), or to associate the automatically generated speech transcript text with the correct video frames (video alignment). Experimental results are presented on TRECVID 2004 data set, which consists of about 150 hours of news videos associated with manual annotations and speech transcript text. The results show that the retrieval performance can be improved by associating visual and textual elements. Also, extensive analysis of features are provided and a method to combine features are proposed.