Optimizing nDCG Gains by Minimizing Effect of Label Inconsistency

  • Pavel Metrikov
  • Virgil Pavlu
  • Javed A. Aslam
Conference paper

DOI: 10.1007/978-3-642-36973-5_78

Part of the Lecture Notes in Computer Science book series (LNCS, volume 7814)
Cite this paper as:
Metrikov P., Pavlu V., Aslam J.A. (2013) Optimizing nDCG Gains by Minimizing Effect of Label Inconsistency. In: Serdyukov P. et al. (eds) Advances in Information Retrieval. ECIR 2013. Lecture Notes in Computer Science, vol 7814. Springer, Berlin, Heidelberg

Abstract

We focus on nDCG choice of gains, and in particular on the fracture between large differences in exponential gains of high relevance labels and the not-so-small confusion, or inconsistency, between these labels in data. We show that better gains can be derived from data by measuring the label inconsistency, to the point that virtually indistinguishable labels correspond to equal gains. Our derived optimal gains make a better nDCG objective for training Learning to Rank algorithms.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Copyright information

© Springer-Verlag Berlin Heidelberg 2013

Authors and Affiliations

  • Pavel Metrikov
    • 1
  • Virgil Pavlu
    • 1
  • Javed A. Aslam
    • 1
  1. 1.Northeastern UniversityBostonUSA

Personalised recommendations