Language Models of Collaborative Filtering

  • Jun Wang
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5839)


Collaborative filtering is a major technique to make personalized recommendations about information items (movies, books, webpages etc) to individual users. In the literature, a common research objective is to predict unknown ratings of items for a user, on the condition that the user has explicitly rated a certain amount of items. Nevertheless, in many practical situations, we may only have implicit evidence of user preferences, such as “playback times of a music file” or “visiting frequency of a web-site”. Most importantly, a more practical view of the recommendation task is to directly generate a top-N ranked list of items that the user is most likely to like.

In this paper, we take these two concerns into account. Item ranking in recommender systems is considered as a task highly related to document ranking in text retrieval. Firstly, two practical item scoring functions are derived by adopting the generative language modelling approach of text retrieval. Secondly, to address the uncertainty associated with the score estimation, we introduce a risk-averse model that penalizes the less reliable scores. Our experiments on real data sets demonstrate that significant performance gains have been achieved.


Information Retrieval Language Model Recommender System User Preference Collaborative Filter 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Adomavicius, G., Tuzhilin, A.: Toward the next generation of recommender systems: A survey of the state-of-the-art and possible extensions. IEEE Transactions on Knowledge and Data Engineering 17(6), 734–749 (2005)CrossRefGoogle Scholar
  2. 2.
    Belkin, N.J., Croft, W.B.: Information filtering and information retrieval: two sides of the same coin? Commun. ACM 35(12), 29–38 (1992)CrossRefGoogle Scholar
  3. 3.
    Breese, J., Heckerman, D., Kadie, C.: Empirical analysis of predictive algorithms for collaborative filtering. In: Proceedings of the 14th Annual Conference on Uncertainty in Artificial Intelligence, UAI 1998 (1998)Google Scholar
  4. 4.
    Canny, J.: Collaborative filtering with privacy via factor analysis. In: SIGIR 2002 (2002)Google Scholar
  5. 5.
    Claypool, M., Le, P., Wased, M., Brown, D.: Implicit interest indicators. In: IUI 2001 (2001)Google Scholar
  6. 6.
    Croft, B.W., Lafferty, J.: Language Modeling for Information Retrieval. Springer, Heidelberg (2003)CrossRefzbMATHGoogle Scholar
  7. 7.
    Deshpande, M., Karypis, G.: Item-based top-N recommendation algorithms. ACM Trans. Inf. Syst. 22(1), 143–177 (2004)CrossRefGoogle Scholar
  8. 8.
    Goldberg, D., Nichols, D., Oki, B.M., Terry, D.: Using collaborative filtering to weave an information tapestry. Commun. ACM 35(12), 61–70 (1992)CrossRefGoogle Scholar
  9. 9.
    Herlocker, J.L., Konstan, J.A., Borchers, A., Riedl, J.: An algorithmic framework for performing collaborative filtering. In: SIGIR 1999 (1999)Google Scholar
  10. 10.
    Hofmann, T.: Latent semantic models for collaborative filtering. ACM Trans. Info. Syst. 22(1), 89–115 (2004)CrossRefGoogle Scholar
  11. 11.
    Hull, D.: Using statistical testing in the evaluation of retrieval experiments. In: SIGIR 1993 (1993)Google Scholar
  12. 12.
    Jin, R., Si, L., Zhai, C.: A study of mixture models for collaborative filtering. Inf. Retr. 9(3), 357–382 (2006)CrossRefGoogle Scholar
  13. 13.
    Manning, C.D., Raghavan, P., Schtze, H.: Introduction to Information Retrieval. Cambridge University Press, Cambridge (2008)CrossRefzbMATHGoogle Scholar
  14. 14.
    Pennock, D.M., Horvitz, E., Lawrence, S., Giles, C.L.: Collaborative filtering by personality diagnosis: A hybrid memory and model-based approach. In: UAI 2000 (2000)Google Scholar
  15. 15.
    Resnick, P., Iacovou, N., Suchak, M., Bergstrom, P., Riedl, J.: Grouplens: an open architecture for collaborative filtering of netnews. In: CSCW 1994 (1994)Google Scholar
  16. 16.
    Sarwar, B., Karypis, G., Konstan, J., Reidl, J.: Item-based collaborative filtering recommendation algorithms. In: WWW 2001 (2001)Google Scholar
  17. 17.
    Wang, J.: Relevance Models for Collaborative Filtering. Delft University of Technology (2008),, ISBN 978-90-9022932-4
  18. 18.
    Wang, J., de Vries, A.P., Reinders, M.J.: A user-item relevance model for log-based collaborative filtering. In: Lalmas, M., MacFarlane, A., Rüger, S.M., Tombros, A., Tsikrika, T., Yavlinsky, A. (eds.) ECIR 2006. LNCS, vol. 3936, pp. 37–48. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  19. 19.
    Wang, J., de Vries, A.P., Reinders, M.J.: Unified relevance models for rating prediction in collaborative filtering. ACM Trans. on Information System, TOIS (2008)Google Scholar
  20. 20.
    Wang, J., Roberston, S.E., de Vries, A.P., Reinders, M.J.T.: Probabilistic relevance models for collaborative filtering. Journal of Information Retrieval (2008)Google Scholar
  21. 21.
    Xue, G.-R., Lin, C., Yang, Q., Xi, W., Zeng, H.-J., Yu, Y., Chen, Z.: Scalable collaborative filtering using cluster-based smoothing. In: SIGIR 2005 (2005)Google Scholar
  22. 22.
    Zhai, C., Lafferty, J.: A study of smoothing methods for language models applied to ad hoc information retrieval. In: SIGIR 2001 (2001)Google Scholar
  23. 23.
    Zhu, J., Wang, J., Taylor, M., Cox, I.: Risky business: Modeling and exploiting uncertainty in information retrieval. In: SIGIR 2009 (2009)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2009

Authors and Affiliations

  • Jun Wang
    • 1
  1. 1.Department of Computer ScienceUniversity College LondonLondonUK

Personalised recommendations