Collaborative Filtering: The Aim of Recommender Systems and the Significance of User Ratings

  • Jennifer Redpath
  • David H. Glass
  • Sally McClean
  • Luke Chen
Conference paper

DOI: 10.1007/978-3-642-12275-0_35

Part of the Lecture Notes in Computer Science book series (LNCS, volume 5993)
Cite this paper as:
Redpath J., Glass D.H., McClean S., Chen L. (2010) Collaborative Filtering: The Aim of Recommender Systems and the Significance of User Ratings. In: Gurrin C. et al. (eds) Advances in Information Retrieval. ECIR 2010. Lecture Notes in Computer Science, vol 5993. Springer, Berlin, Heidelberg

Abstract

This paper investigates the significance of numeric user ratings in recommender systems by considering their inclusion / exclusion in both the generation and evaluation of recommendations. When standard evaluation metrics are used, experimental results show that inclusion of numeric rating values in the recommendation process does not enhance the results. However, evaluating the accuracy of a recommender algorithm requires identifying the aim of the system. Evaluation metrics such as precision and recall evaluate how well a system performs at recommending items that have been previously rated by the user. By contrast, a new metric, known as Approval Rate, is intended to evaluate how well a system performs at recommending items that would be rated highly by the user. Experimental results demonstrate that these two aims are not synonymous and that for an algorithm to attempt both obscures the investigation. The results also show that appropriate use of numeric rating valuesin the process of calculating user similarity can enhance the performance when Approval Rate is used.

Keywords

Recommender Systems Collaborative Filtering Information Retrieval 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Copyright information

© Springer-Verlag Berlin Heidelberg 2010

Authors and Affiliations

  • Jennifer Redpath
    • 1
  • David H. Glass
    • 1
  • Sally McClean
    • 1
  • Luke Chen
    • 1
  1. 1.School of Computing and MathematicsUniversity of Ulster, Newtownabbey, Co. AntrimUK

Personalised recommendations