Multimedia Tools and Applications

, Volume 66, Issue 3, pp 493–515

Topic modelling of clickthrough data in image search

  • Donn Morrison
  • Theodora Tsikrika
  • Vera Hollink
  • Arjen P. de Vries
  • Éric Bruno
  • Stéphane Marchand-Maillet
Article

DOI: 10.1007/s11042-012-1038-8

Cite this article as:
Morrison, D., Tsikrika, T., Hollink, V. et al. Multimed Tools Appl (2013) 66: 493. doi:10.1007/s11042-012-1038-8

Abstract

In this paper we explore the benefits of latent variable modelling of clickthrough data in the domain of image retrieval. Clicks in image search logs are regarded as implicit relevance judgements that express both user intent and important relations between selected documents. We posit that clickthrough data contains hidden topics and can be used to infer a lower dimensional latent space that can be subsequently employed to improve various aspects of the retrieval system. We use a subset of a clickthrough corpus from the image search portal of a news agency to evaluate several popular latent variable models in terms of their ability to model topics underlying queries. We demonstrate that latent variable modelling reveals underlying structure in clickthrough data and our results show that computing document similarities in the latent space improves retrieval effectiveness compared to computing similarities in the original query space. These results are compared with baselines using visual and textual features. We show performance substantially better than the visual baseline, which indicates that content-based image retrieval systems that do not exploit query logs could improve recall and precision by taking this historical data into account.

Keywords

Image retrieval Latent variable modelling User interaction Clickthrough data 

Copyright information

© Springer Science+Business Media, LLC 2012

Authors and Affiliations

  • Donn Morrison
    • 1
  • Theodora Tsikrika
    • 2
  • Vera Hollink
    • 2
  • Arjen P. de Vries
    • 2
  • Éric Bruno
    • 1
  • Stéphane Marchand-Maillet
    • 1
  1. 1.Computer Vision and Multimedia LaboratoryUniversity of GenevaGenevaSwitzerland
  2. 2.Centrum Wiskunde & InformaticaAmsterdamThe Netherlands

Personalised recommendations