The Magic Barrier of Recommender Systems – No Magic, Just Ratings

  • Alejandro Bellogín
  • Alan Said
  • Arjen P. de Vries
Conference paper

DOI: 10.1007/978-3-319-08786-3_3

Part of the Lecture Notes in Computer Science book series (LNCS, volume 8538)
Cite this paper as:
Bellogín A., Said A., de Vries A.P. (2014) The Magic Barrier of Recommender Systems – No Magic, Just Ratings. In: Dimitrova V., Kuflik T., Chin D., Ricci F., Dolog P., Houben GJ. (eds) User Modeling, Adaptation, and Personalization. UMAP 2014. Lecture Notes in Computer Science, vol 8538. Springer, Cham


Recommender Systems need to deal with different types of users who represent their preferences in various ways. This difference in user behaviour has a deep impact on the final performance of the recommender system, where some users may receive either better or worse recommendations depending, mostly, on the quantity and the quality of the information the system knows about the user. Specifically, the inconsistencies of the user impose a lower bound on the error the system may achieve when predicting ratings for that particular user.

In this work, we analyse how the consistency of user ratings (coherence) may predict the performance of recommendation methods. More specifically, our results show that our definition of coherence is correlated with the so-called magic barrier of recommender systems, and thus, it could be used to discriminate between easy users (those with a low magic barrier) and difficult ones (those with a high magic barrier). We report experiments where the rating prediction error for the more coherent users is lower than that of the less coherent ones. We further validate these results by using a public dataset, where the magic barrier is not available, in which we obtain similar performance improvements.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Copyright information

© Springer International Publishing Switzerland 2014

Authors and Affiliations

  • Alejandro Bellogín
    • 1
  • Alan Said
    • 2
  • Arjen P. de Vries
    • 3
  1. 1.Ciudad Universitaria de CantoblancoUniversidad Autónoma de MadridMadridSpain
  2. 2.Delft University of TechnologyDelftThe Netherlands
  3. 3.Centrum Wiskunde & InformaticaAmsterdamThe Netherlands

Personalised recommendations