Skip to main content
SpringerLink
Log in

A GPU-oriented online recommendation algorithm for efficient processing of time-varying continuous data streams

  • Regular Paper
  • Published:
Knowledge and Information Systems Aims and scope Submit manuscript

Abstract

Research on recommendation systems has gained a considerable amount of attention over the past decade as the number of online users and online contents continue to grow at an exponential rate. With the evolution of the social web, people generate and consume data in real time using online services such as Twitter, Facebook, and web news portals. With the rapidly growing online community, web-based retail systems and social media sites have to process several millions of user requests per day. Generating quality recommendations using this vast amount of data is itself a very challenging task. Nevertheless, opposed to the web-based retailers such as Amazon and Netflix, the above-mentioned social networking sites have to face an additional challenge when generating recommendations as their contents are very rapidly changing. Therefore, providing fresh information in the least amount of time is a major objective of such recommender systems. Although collaborative filtering is a widely used technique in recommendation systems, generating the recommendation model using this approach is a costly task, and often done offline. Hence, it is difficult to use collaborative filtering in the presence of dynamically changing contents, as such systems require frequent updates to the recommendation model to maintain the accuracy and the freshness of the recommendations. Parallel processing power of graphic processing units (GPUs) can be used to process large volumes of data with dynamically changing contents in real time, and accelerate the recommendation process for social media data streams. In this paper, we address the issue of rapidly changing contents, and propose a parallel on-the-fly collaborative filtering algorithm using GPUs to facilitate frequent updates to the recommendations model. We use a hybrid similarity calculation method by combining the item–item collaborative filtering with item category information and temporal information. The experimental results on real-world datasets show that the proposed algorithm outperformed several existing online CF algorithms in terms of accuracy, memory consumption, and runtime. It was also observed that the proposed algorithm scaled well with the data rate and the data volume, and generated recommendations in a timely manner.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19
Fig. 20
Fig. 21
Fig. 22
Fig. 23
Fig. 24
Fig. 25
Fig. 26
Fig. 27

Similar content being viewed by others

Notes

  1. http://tech.hulu.com/blog/2011/09/19/recommendation-system/.

  2. http://www.internetlivestats.com/twitter-statistics/.

  3. http://www.nvidia.com/object/cuda_home_new.html.

  4. http://storm.apache.org/.

  5. http://www.clef-newsreel.org/.

  6. If c is not a multiple of 32, add padding bits of zeros to the end.

  7. https://github.com/MrChrisJohnson/CollabStream.

  8. http://www.dai-labor.de/en/irml/datasets/plistanewsrecommendationdataset/.

  9. https://sites.google.com/site/newsrec2013/.

  10. http://www.ksta.de/.

  11. http://www.tagesspiegel.de/.

References

  1. Su X, Khoshgoftaar TM (2009) A survey of collaborative filtering techniques. Adv Artif Intell 2009:4

    Article  Google Scholar 

  2. Deshpande M, Karypis G (2004) Item based top-N recommendation algorithms. ACM Trans Inf Syst 22(1):143–177

    Article  Google Scholar 

  3. Bobadilla J, Fernando O, Hernando A et al (2013) Recommender systems survey. Knowl Based Syst 46:109–132

    Article  Google Scholar 

  4. Pan R, Zhou Y, Cao B et al (2008) One-class collaborative filtering. In: Proceedings of the IEEE international conference on data mining, pp 502–511

  5. Kitts B, Freed D, Vrieze M (2000) Cross-sell: a fast promotion-tunable customer-item recommendation method based on conditional independent probabilities. In: Proceedings of the ACM SIGKDD conference on knowledge discovery and data mining, pp 437–441

  6. Linden G, Smith B, York J (2003) Amazon.com recommendations: item-to-item collaborative filtering. IEEE Internet Comput 7(1):76–80

    Article  Google Scholar 

  7. Sarwar B, Karypis G, Konstan J et al (2001) Item-based collaborative filtering recommendation algorithms. In: Proceedings of the ACM international conference on world wide web, pp 285–295

  8. Das AS, Datar M, Garg A et al (2007) Google news personalization: scalable online collaborative filtering. In: Proceedings of the 16th international conference on world wide web, pp 271–280

  9. Davidson J, Liebald B, Liu J et al (2010) The YouTube video recommendation system. In: Proceedings of the ACM RecSys, pp 293–296

  10. Hofmann T (2004) Latent semantic models for collaborative filtering. ACM Trans Inf Syst 22(1):89–115

    Article  Google Scholar 

  11. Gemulla R, Nijkamp E, Haas PJ et al (2011) Large-scale matrix factorization with distributed stochastic gradient descent. In: Proceedings of the ACM SIGKDD conference on knowledge discovery and data mining, pp 69–77

  12. Han S, Yang Y, Liu W (2011) Incremental learning for dynamic collaborative filtering. J Softw 6(6):969–976

    Article  Google Scholar 

  13. Narang A, Srivastava A, Katta NPK (2011) Distributed scalable collaborative filtering algorithm. In: Proceedings of Euro-Par conference, pp 353–365

  14. Shang Y, Li Z, Qu W et al (2014) Scalable collaborative filtering recommendation algorithm with MapReduce. In: Proceedings of the IEEE international conference on dependable, autonomic and secure computing, pp 103–108

  15. Wang Y, Liao X, Wu H et al (2012) Incremental collaborative filtering considering temporal effects. arXiv:1203.5415

  16. Abernethy J, Canini K, Langford J et al (2007) Online collaborative filtering. Technical Report, University of California at Berkeley

  17. Agarwal D, Chen BC, Elango P (2010) Fast online learning through offline initialization for time-sensitive recommendation. In: Proceedings of the ACM SIGKDD conference on knowledge discovery and data mining, pp 703–712

  18. Khoshneshin M, Street WN (2010) Incremental collaborative filtering via evolutionary co-clustering. In: Proceedings of the 4th ACM RecSys, pp 325–328

  19. Li X, Barajas JM, Ding Y (2007) Collaborative filtering on streaming data with interest-drifting. Intell Data Anal 11(1):75–87

    Google Scholar 

  20. Ling G, Yang H, King I et al (2012) Online learning for collaborative filtering. In: Proceedings of the international joint conference on neural networks, pp 1–8

  21. Luo X, Xia Y, Zhu Q (2012) Incremental collaborative filtering recommender based on regularized matrix factorization. Knowl Based Syst 27:271–280

    Article  Google Scholar 

  22. Luo X, Xia Y, Zhu Q et al (2013) Boosting the k-nearest-neighborhood based incremental collaborative filtering. Knowl Based Syst 53:90–99

    Article  Google Scholar 

  23. Miranda C, Jorge AM (2008) Incremental collaborative filtering for binary ratings. In: Proceedings of the IEEE/WIC/ACM international conference on web intelligence and intelligent agent technology, pp 389–392

  24. Miranda C, Jorge AM (2009) Item-based and user-based incremental collaborative filtering for web recommendations. In: Proceedings of the portuguese conference on artificial intelligence, pp 673–684

  25. Nilashi M, Jannach D, Ibrahim O et al (2015) Clustering-and regression-based multi-criteria collaborative filtering with incremental updates. Inf Sci 293:235–250

    Article  Google Scholar 

  26. Papagelis M, Rousidis I, Plexousakis D et al (2005) Incremental collaborative filtering for highly-scalable recommendation algorithms. In: Proceedings of the international conference on foundations of intelligent systems, pp 553–561

  27. Takács G, Pilászy I, Németh B et al (2009) Scalable collaborative filtering approaches for large recommender systems. J Mach Learn Res 10:623–656

    Google Scholar 

  28. Vinagre J, Jorge AM, Gama J (2014) Fast incremental matrix factorization for recommendation with positive-only feedback. In: Proceedings of the international conference on user modeling, adaptation, and personalization, pp 459–470

  29. Wang X, Zhang J (2014) Using incremental clustering technique in collaborative filtering data update. In: Proceedings of the IEEE international conference on information reuse and integration, pp 420–427

  30. Ali M, Johnson CC, Tang AK (2011) Parallel collaborative filtering for streaming data. Technical Report, University of Texas Austin

  31. Chandramouli B, Levandoski JJ, Eldawy A et al (2011) StreamRec: a real-time recommender system. In: Proceedings of the ACM SIGMOD, pp 1243–1246

  32. Diaz-Aviles E, Drumond L, Schmidt-Thieme I et al (2012) Real-time top-N recommendation in social streams. In: Proceedings of the ACM RecSys, pp 59–66

  33. Jamali M, Ester M (2010) A matrix factorization technique with trust propagation for recommendation in social networks. In: Proceedings of the ACM RecSys, pp 135–142

  34. Matuszyk P, Spiliopoulou M (2014) Selective forgetting for incremental matrix factorization in recommender systems. In: Proceedings of the international conference on discovery science, pp 204–215

  35. Matuszyk P, Vinagre J, Spiliopoulou M et al (2015) Forgetting methods for incremental matrix factorization in recommender systems. In: Proceedings of the ACM/ SIGAPP symposium on applied computing, pp 947–953

  36. Nasraoui O, Cerwinske J, Rojas C et al (2007) Performance of recommendation systems in dynamic streaming environments. In: Proceedings of the SIAM international conference on data mining, pp 569–574

  37. Vinagre J, Jorge AM (2012) Forgetting mechanisms for scalable collaborative filtering. J Braz Comput Socy 18(4):271–282

    Article  Google Scholar 

  38. Yu K, Xu X, Tao J et al (2002) Instance selection techniques for memory-based collaborative filtering. Proc SIAM Int Conf Data Mining 2(16):59–74

    Google Scholar 

  39. Bress S, Saake G (2013) Why it is time for a HyPE: a hybrid query processing engine for efficient GPU co-processing in DBMS. Proc Int Conf Very Large Data Bases 6(12):1398–1403

    Google Scholar 

  40. Farivar R, Rebolledo D, Chan E et al (2008) A parallel implementation of k-means clustering on GPUs. In: Proceedings of the international conference on parallel and distributed processing techniques and applications, pp 340–345

  41. Garcia V, Debreuve E, Barlaud M (2008) Fast k-nearest neighbor search using GPU. In: Proceedings of the IEEE computer vision and pattern recognition workshops, pp 1–6

  42. Steinkraus D, Buck I, Simard PY (2005) Using GPUs for machine learning algorithms. In: Proceedings of the IEEE international conference on document analysis and recognition, pp 1115–1120

  43. Gao Z, Yuying L (2012) Improving the collaborative filtering recommender system by using GPU. In: Proceedings of the IEEE international conference on cyber-enabled distributed computing and knowledge discovery, pp 330–333

  44. Kato K, Hosino T (2010) Solving k-nearest neighbor problem on multiple graphics processors. In: Proceedings of the IEEE/ACM international conference on cluster, cloud and grid computing, pp 769–773

  45. Li R, Zhang Y, Yu H et al (2011) A social network-aware top-N recommender system using GPU. In: Proceedings of the ACM/IEEE joint conference on digital libraries, pp 287–296

  46. Rodrigues A, Jorge AM, Dutra I (2015) Accelerating recommender systems using GPUs. In: Proceedings of the 30th ACM/SIGAPP symposium on applied computing, pp 879–884

  47. Wang Z, Liu Y, Chiu S (2014) An efficient parallel collaborative filtering algorithm on multi-GPU platform. J Supercomput 72(6):2080–2094

    Article  Google Scholar 

  48. Ali M, Gerea C, Raman BS et al (2009) Microsoft CEP server and online behavioral targeting. Proc Int Conf Very Large Data Bases 2(2):1558–1561

    Google Scholar 

  49. HewaNadungodage C, Xia Y, Lee JJ et al (2013) GPU accelerated item-based collaborative filtering for big-data applications. In: Proceedings of the IEEE BigData conference, pp 175–180

  50. Doychev D, Lawlor A, Rafter R et al (2014) An analysis of recommender algorithms for online news. In: CLEF working notes for CLEF 2014 conference, pp 825–836

  51. Lommatzsch A, Albayrak S (2015) Real-time recommendations for user-item streams. In: Proceedings of the ACM/SIGAPP symposium on applied computing, pp 1039–1046

  52. Verbitskiy I, Probst P, Lommatzsch A (2015) Developing and evaluation of a highly scalable news recommender system. In: CLEF working notes for CLEF 2015 conference, CEUR, vol. 1391

  53. Werner S, Andreas L (2014) Optimizing and evaluating stream-based news recommendation algorithms. In: CLEF working notes for CLEF 2014 conference, pp 813–824

  54. Kille B, Hopfgartner F, Brodt T et al (2013) The plista dataset. In: Proceedings of the ACM NRS workshop, pp 2–16

  55. Cremonesi P, Koren Y, Turrin R (2010) Performance of recommender algorithms on top-N recommendation tasks. In: Proceedings of the ACM RecSys, pp 39–46

Download references

Acknowledgments

This work was supported by the IT R&D program of MKE/KEIT, Korea. [10041709, Development of Key Technologies for Big Data Analysis and Management based on Next Generation Memory].

Author information

Authors and Affiliations

  1. Department of Computer and Information Science, Purdue School of Science, IUPUI, Indianapolis, IN, USA

    Chandima HewaNadungodage & Yuni Xia

  2. Department of Electrical and Computer Engineering, Purdue School of Engineering, IUPUI, Indianapolis, IN, USA

    John Jaehwan Lee

Authors
  1. Chandima HewaNadungodage
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yuni Xia
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. John Jaehwan Lee
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Chandima HewaNadungodage.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

HewaNadungodage, C., Xia, Y. & Lee, J.J. A GPU-oriented online recommendation algorithm for efficient processing of time-varying continuous data streams. Knowl Inf Syst 53, 637–670 (2017). https://doi.org/10.1007/s10115-016-0967-3

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10115-016-0967-3

Keywords

Search

Navigation