Show Me How to Tie a Tie: Evaluation of Cross-Lingual Video Retrieval

Conference paper

DOI: 10.1007/978-3-319-44564-9_1

Part of the Lecture Notes in Computer Science book series (LNCS, volume 9822)
Cite this paper as:
Braslavski P., Verberne S., Talipov R. (2016) Show Me How to Tie a Tie: Evaluation of Cross-Lingual Video Retrieval. In: Fuhr N. et al. (eds) Experimental IR Meets Multilinguality, Multimodality, and Interaction. CLEF 2016. Lecture Notes in Computer Science, vol 9822. Springer, Cham

Abstract

In this study we investigate the potential of cross-lingual video retrieval for how-to questions. How-to questions are the most frequent among wh-questions and constitute almost 1 % of the entire query stream. At the same time, how-to videos are popular on video sharing services. We analyzed a dataset of 500M+ Russian how-to questions. First, we carried out manual labelling of 1,000 queries that shows that about two thirds of all how-to question queries are potentially suitable for answers in the form of video in a language other than the language of the query. Then, we evaluated video retrieval quality for original and machine translated queries on a crowdsourcing platform. The evaluation reveals that machine translated questions yield video search quality comparable to the quality for original questions. Cross-lingual video search for how-to queries can improve recall and diversity of search results, as well as compensate the shortage of original content in emerging markets.

Keywords

How-to questions Video retrieval Question answering Cross-lingual information retrieval Machine translation Query translation Evaluation 

Copyright information

© Springer International Publishing Switzerland 2016

Authors and Affiliations

  • Pavel Braslavski
    • 1
  • Suzan Verberne
    • 2
  • Ruslan Talipov
    • 1
  1. 1.Ural Federal UniversityYekaterinburgRussia
  2. 2.Radboud UniversityNijmegenThe Netherlands

Personalised recommendations