A Link Prediction Approach to Recommendations in Large-Scale User-Generated Content Systems

  • Nitin Chiluka
  • Nazareno Andrade
  • Johan Pouwelse
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6611)


Recommending interesting and relevant content from the vast repositories of User-Generated Content systems (UGCs) such as YouTube, Flickr and Digg is a significant challenge. Part of this challenge stems from the fact that classical collaborative filtering techniques – such as k-Nearest Neighbor – cannot be assumed to perform as well in UGCs as in other applications. Such technique has severe limitations regarding data sparsity and scalability that are unfitting for UGCs. In this paper, we employ adaptations of popular Link Prediction algorithms that were shown to be effective in massive online social networks for recommending items in UGCs. We evaluate these algorithms on a large dataset we collect from Flickr. Our results suggest that Link Prediction algorithms are a more scalable and accurate alternative to classical collaborative filtering in the context of UGCs. Moreover, our experiments show that the algorithms considering the immediate neighborhood of users in an user-item graph to recommend items outperform the algorithms that use the entire graph structure for the same. Finally, we find that, contrary to intuition, exploiting explicit social links among users in the recommendation algorithms improves only marginally their performance.


User-Generated Content Systems Recommendation Collaborative Filtering Link Prediction Flickr 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
  2. 2.
  3. 3.
  4. 4.
  5. 5.
    Adamic, L.A., Adar, E.: E-commerce: the role of familiarity and trust. In: Social Networks, pp. 211–230 (2003)Google Scholar
  6. 6.
    Baluja, S., Seth, R., Sivakumar, D., Jing, Y., Yagnik, J., Kumar, S., Ravichandran, D., Aly, M.: Video suggestion and discovery for youtube: taking random walks through the view graph. In: WWW 2008: Proceeding of the 17th International Conference on World Wide Web (2008)Google Scholar
  7. 7.
    Benkler, Y.: The Wealth of Networks: How Social Production Transforms Markets and Freedom, ch. 5Google Scholar
  8. 8.
    Cha, M., Kwak, H., Rodriguez, P., Ahn, Y.-Y., Moon, S.: I tube, you tube, everybody tubes: analyzing the world’s largest user generated content video system. In: Proceedings of the 7th ACM SIGCOMM Conference on Internet MeasurementGoogle Scholar
  9. 9.
    Cha, M., Mislove, A., Gummadi, K.P.: A Measurement-driven Analysis of Information Propagation in the Flickr Social Network. In: WWW 2009: Proceedings of the 18th International World Wide Web Conference (2009)Google Scholar
  10. 10.
    Katz, L.: A new status index derived from sociometric analysis. Psychometrika (1953)Google Scholar
  11. 11.
    Liben-Nowell, D., Kleinberg, J.: The link prediction problem for social networks. In: CIKM 2003: Proceedings of the Twelfth International Conference on Information and Knowledge Management (2003)Google Scholar
  12. 12.
    Linden, G., Smith, B., York, J.: recommendations: Item-to-item collaborative filtering. IEEE Internet Computing (2003)Google Scholar
  13. 13.
    Oh, J., Susarla, A., Tan, Y.: Examining the diffusion of user-generated content in online social networks. SSRN eLibrary (2008)Google Scholar
  14. 14.
    Page, L., Brin, S., Motwani, R., Winograd, T.: The pagerank citation ranking: Bringing order to the web. Technical report, Stanford University (1999)Google Scholar
  15. 15.
    Sarkar, P., Chakrabarti, D., Moore, A.W.: Theoretical justification of popular link prediction heuristics. In: COLT 2010: Proceedings of the 23rd Annual Conference on Learning Theory (2010)Google Scholar
  16. 16.
    Song, H.H., Cho, T.W., Dave, V., Zhang, Y., Qiu, L.: Scalable proximity estimation and link prediction in online social networks. In: IMC 2009: Proceedings of the 9th ACM SIGCOMM Conference on Internet Measurement Conference (2009)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2011

Authors and Affiliations

  • Nitin Chiluka
    • 1
  • Nazareno Andrade
    • 1
  • Johan Pouwelse
    • 1
  1. 1.Delft University of TechnologyThe Netherlands

Personalised recommendations