User Modeling and User-Adapted Interaction

, Volume 25, Issue 5, pp 427–491

What recommenders recommend: an analysis of recommendation biases and possible countermeasures

  • Dietmar Jannach
  • Lukas Lerche
  • Iman Kamehkhosh
  • Michael Jugovac
Article

DOI: 10.1007/s11257-015-9165-3

Cite this article as:
Jannach, D., Lerche, L., Kamehkhosh, I. et al. User Model User-Adap Inter (2015) 25: 427. doi:10.1007/s11257-015-9165-3

Abstract

Most real-world recommender systems are deployed in a commercial context or designed to represent a value-adding service, e.g., on shopping or Social Web platforms, and typical success indicators for such systems include conversion rates, customer loyalty or sales numbers. In academic research, in contrast, the evaluation and comparison of different recommendation algorithms is mostly based on offline experimental designs and accuracy or rank measures which are used as proxies to assess an algorithm’s recommendation quality. In this paper, we show that popular recommendation techniques—despite often being similar when compared with the help of accuracy measures—can be quite different with respect to which items they recommend. We report the results of an in-depth analysis in which we compare several recommendations strategies from different perspectives, including accuracy, catalog coverage and their bias to recommend popular items. Our analyses reveal that some recent techniques that perform well with respect to accuracy measures focus their recommendations on a tiny fraction of the item spectrum or recommend mostly top sellers. We analyze the reasons for some of these biases in terms of algorithmic design and parameterization and show how the characteristics of the recommendations can be altered by hyperparameter tuning. Finally, we propose two novel algorithmic schemes to counter these popularity biases.

Keywords

Recommender systems Bias Evaluation 

Copyright information

© Springer Science+Business Media Dordrecht 2015

Authors and Affiliations

  • Dietmar Jannach
    • 1
  • Lukas Lerche
    • 1
  • Iman Kamehkhosh
    • 1
  • Michael Jugovac
    • 1
  1. 1.Department of Computer ScienceTU DortmundDortmundGermany

Personalised recommendations