Skip to main content
SpringerLink
Log in

A novel context-aware recommender system based on a deep sequential learning approach (CReS)

  • Original Article
  • Published:
Neural Computing and Applications Aims and scope Submit manuscript

Abstract

With an increase in online longitudinal users’ interactions, capturing users’ precise preferences and giving accurate recommendations have become an urgent need for all businesses. Existing sequence-aware methods generally exploit a static low-rank vector for acquiring the overall sequential features, and incorporate context information as auxiliary input. As a result, they have a restricted modeling ability for extracting multi-grained sequential behaviors over contextual information. In other words, they poorly capture the hierarchical relationship between context relations and item relations that currently influence users’ preferences in a unified framework. Besides, they usually utilize users’ short-term preferences with either static or irrelevant long-term representation for the prediction. To tackle the above issues, in this paper, we propose a novel Context-aware Recommender System Based on a Deep Sequential Learning Approach (CReS) to capture users’ dynamic preferences by modeling the hierarchical relationships between contexts and items in a particular session, and for combining users’ short-term sessions with the relevant long-term representations. Specifically, within a certain session, we design a hierarchical attention network between the identified context relations and items relations, namely CReSession. Therefore, with CReSession, we could provide a suitable session representation that mimics the hierarchical user interests on multiple granularities of contextual types and its corresponding items. We then introduce a neural attentive bi-directional GRU network to distill only those highly related to the recent short-term session. Finally, the relevant long-term representations and the short-term session are combined with the sequential residual connection to form the final user representation in a unified manner. With extensive experiments on two real-world datasets, CReS not only achieves significant improvement over the state-of-the-art methods in terms of pre-defined metrics, but also provides an interpretable result regarding why we recommend these items to users.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

Notes

  1. https://github.com/rn5l/session-rec.

  2. https://github.com/uctoronto/SHAN.

References

  1. He X, He Z, Song J, Liu Z, Jiang Y, Chua T (2018) NAIS: neural attentive item similarity model for recommendation. IEEE Trans Knowl Data Eng 30(12):2354–2366. https://doi.org/10.1109/tkde.2018.2831682

    Article  Google Scholar 

  2. Kabbur S, Ning X, Karypis G (2013) Fism. In: Proceedings of the 19th ACM SIGKDD international conference on knowledge discovery and data mining—KDD’13. https://www.doi.org/10.1145/2487575.2487589

  3. Sarwar B, Karypis G, Konstan J, Reidl J (2001) Item-based collaborative filtering recommendation algorithms. In: Proceedings of the tenth international conference on world wide web—WWW’01. https://www.doi.org/10.1145/371920.372071

  4. Xue F, He X, Wang X, Xu J, Liu K, Hong R (2019) Deep Item-based collaborative filtering for top-n recommendation. ACM Trans Inf Syst 37(3):1–25. https://doi.org/10.1145/3314578

    Article  Google Scholar 

  5. He R, Mcauley J (2016) Fusing similarity models with Markov Chains for sparse sequential recommendation. In: 2016 IEEE 16th international conference on data mining (ICDM). https://www.doi.org/10.1109/icdm.2016.0030

  6. Rendle S, Freudenthaler C, Schmidt-Thieme L (2010) Factorizing personalized Markov chains for next-basket recommendation. In: Proceedings of the 19th international conference on world wide web—WWW’10. https://www.doi.org/10.1145/1772690.1772773

  7. Tang J, Wang K (2018) Personalized top-N sequential recommendation via convolutional sequence embedding. In: Proceedings of the eleventh ACM international conference on web search and data mining—WSDM’18. https://www.doi.org/10.1145/3159652.3159656

  8. Chen X, Xu H, Zhang Y, Tang J, Cao Y, Qin Z, Zha H (2018) Sequential recommendation with user memory networks. In: Proceedings of the eleventh ACM international conference on web search and data mining—WSDM’18. https://www.doi.org/10.1145/3159652.3159668

  9. Balázs H, Alexandros K, Linas B, Domonkos T (2015) Session-based recommendations with recurrent neural networks. arXiv:1511.06939

  10. Li J, Ren P, Chen Z, Ren Z, Lian T, Ma J (2017) Neural attentive session-based recommendation. In: Proceedings of the 2017 ACM on conference on information and knowledge management. https://www.doi.org/10.1145/3132847.3132926

  11. Li Z, Zhao H, Liu Q, Huang Z, Mei T, Chen E (2018) Learning from history and present. In: Proceedings of the 24th ACM SIGKDD international conference on knowledge discovery and data mining. https://www.doi.org/10.1145/3219819.3220014

  12. Liu Q, Zeng Y, Mokhosi R, Zhang H (2018) Stamp. In: Proceedings of the 24th ACM SIGKDD international conference on knowledge discovery and data mining. https://www.doi.org/10.1145/3219819.3219950

  13. Xie M, Yin H, Wang H, Xu F, Chen W, Wang S (2016) Learning graph-based POI embedding for location-based recommendation. In: Proceedings of the 25th ACM international on conference on information and knowledge management. https://www.doi.org/10.1145/2983323.2983711

  14. Ying H, Zhuang F, Zhang F, Liu Y, Xu G, Xie X, Wu J (2018) Sequential recommender system based on hierarchical attention networks. In: Proceedings of the twenty-seventh international joint conference on artificial intelligence. https://www.doi.org/10.24963/ijcai.2018/546

  15. Quadrana M, Karatzoglou A, Hidasi B, Cremonesi P (2017) Personalizing session-based recommendations with hierarchical recurrent neural networks. In: Proceedings of the eleventh ACM conference on recommender systems. https://www.doi.org/10.1145/3109859.3109896

  16. Cho E, Myers SA, Leskovec J (2011) Friendship and mobility. In: Proceedings of the 17th ACM SIGKDD international conference on knowledge discovery and data mining—KDD’11. https://www.doi.org/10.1145/2020408.2020579

  17. Zhu W, Miao J, Qing L, Huang G (2015) Hierarchical extreme learning machine for unsupervised representation learning. In: 2015 international joint conference on neural networks (IJCNN). https://www.doi.org/10.1109/ijcnn.2015.7280669

  18. Hu L, Cao L, Wang S, Xu G, Cao J, Gu Z (2017) Diversifying personalized recommendation with user-session context. In: Proceedings of the twenty-sixth international joint conference on artificial intelligence. https://www.doi.org/10.24963/ijcai.2017/258

  19. Li G, Wang L, Ou W (2015) Robust personalized ranking from implicit feedback. Int J Pattern Recognit Artif Intell 30(01):1659001. https://doi.org/10.1142/s0218001416590011

    Article  Google Scholar 

  20. Mehta R, Rana K (2017) A review on matrix factorization techniques in recommender systems. In: 2017 2nd international conference on communication systems, computing and IT applications (CSCITA). https://www.doi.org/10.1109/cscita.2017.8066567

  21. Gu W, Dong S, Zeng Z (2014) Increasing recommended effectiveness with markov chains and purchase intervals. Neural Comput Appl 25(5):1153–1162. https://doi.org/10.1007/s00521-014-1599-8

    Article  Google Scholar 

  22. Kapetanakis S, Polatidis N, Alshammari G, Petridis M (2019) A novel recommendation method based on general matrix factorization and artificial neural networks. Neural Comput Appl 32(16):12327–12334. https://doi.org/10.1007/s00521-019-04534-w

    Article  Google Scholar 

  23. Zhou JP, Cheng Z, Perez F, Volkovs M (2020) TAFA: two-headed attention fused autoencoder for context-aware recommendations. In: Fourteenth ACM conference on recommender systems. https://www.doi.org/10.1145/3383313.3412268

  24. Faggioli G, Polato M, Aiolli F (2020) Recency aware collaborative filtering for next basket recommendation. In: Proceedings of the 28th ACM conference on user modeling, adaptation and personalization. https://www.doi.org/10.1145/3340631.3394850

  25. Tan YK, Xu X, Liu Y (2016) Improved recurrent neural networks for session-based recommendations. In: Proceedings of the 1st workshop on deep learning for recommender systems—DLRS 2016. https://www.doi.org/10.1145/2988450.2988452

  26. Sakar CO, Polat SO, Katircioglu M, Kastro Y (2018) Real-time prediction of online shoppers’ purchasing intention using multilayer perceptron and LSTM recurrent neural networks. Neural Comput Appl 31(10):6893–6908. https://doi.org/10.1007/s00521-018-3523-0

    Article  Google Scholar 

  27. Xu H, Jiang C (2019) Research on context-aware group recommendation based on deep learning. Neural Comput Appl 32(6):1745–1754. https://doi.org/10.1007/s00521-019-04286-7

    Article  Google Scholar 

  28. Sornalakshmi M, Balamurali S, Venkatesulu M, Krishnan MN, Ramasamy LK, Kadry S, Muthu BA (2020) Hybrid method for mining rules based on enhanced Apriori algorithm with sequential minimal optimization in healthcare industry. Neural Comput Appl. https://doi.org/10.1007/s00521-020-04862-2

    Article  Google Scholar 

  29. Hidasi B, Karatzoglou A (2018) Recurrent neural networks with top-k gains for session-based recommendations. In: Proceedings of the 27th ACM international conference on information and knowledge management. https://www.doi.org/10.1145/3269206.3271761

  30. Zhang H, Sun Y, Zhao M, Chow T, Wu Q (2020) Bridging user interest to item content for recommender systems: an optimization model. IEEE Trans Cybern 50(10):4268–4280. https://doi.org/10.1109/tcyb.2019.2900159

    Article  Google Scholar 

  31. Zhang H, Huang W, Liu L, Chow T (2020) Learning to match clothing from textual feature-based compatible relationships. IEEE Trans Ind Inform 16(11):6750–6759. https://doi.org/10.1109/tii.2019.2924725

    Article  Google Scholar 

  32. Hansen C, Hansen C, Maystre L, Mehrotra R, Brost B, Tomasi F, Lalmas M (2020) Contextual and sequential user embeddings for large-scale music recommendation. In: Fourteenth ACM conference on recommender systems. https://www.doi.org/10.1145/3383313.3412248

  33. Lin J, Pan W, Ming Z (2020) FISSA: fusing item similarity models with self-attention networks for sequential recommendation. In: Fourteenth ACM conference on recommender systems. https://www.doi.org/10.1145/3383313.3412247

  34. Kang W, Mcauley J (2018) Self-attentive sequential recommendation. In: 2018 IEEE international conference on data mining (ICDM). https://www.doi.org/10.1109/icdm.2018.00035

  35. Bahdanau D, Cho K, Bengio Y (2014) Neural machine translation by jointly learning to align and translate. arXiv:1409.0473

  36. Kang K, Park J, Kim W, Choe H, Choo J (2019) Recommender system using sequential and global preference via attention mechanism and topic modeling. In: Proceedings of the 28th ACM international conference on information and knowledge management. https://www.doi.org/10.1145/3357384.3358054

  37. Huang J, Ren Z, Zhao WX, He G, Wen J, Dong D (2019) Taxonomy-aware multi-hop reasoning networks for sequential recommendation. In: Proceedings of the twelfth ACM international conference on web search and data mining. https://www.doi.org/10.1145/3289600.3290972

  38. Afchar D, Hennequin R (2020) Making neural networks interpretable with attribution: application to implicit signals prediction. In: Fourteenth ACM conference on recommender systems. https://www.doi.org/10.1145/3383313.3412253

  39. Ludewig M, Jannach D (2018) Evaluation of session-based recommendation algorithms. User Model User Adap Interact 28(4–5):331–390. https://doi.org/10.1007/s11257-018-9209-6

    Article  Google Scholar 

  40. Järv P (2019) Predictability limits in session-based next item recommendation. In: Proceedings of the 13th ACM conference on recommender systems. https://www.doi.org/10.1145/3298689.3346990

  41. Zhang M, Wu S, Gao M, Jiang X, Xu K, Wang L (2020) Personalized graph neural networks with attention mechanism for session-aware recommendation. IEEE Trans Knowl Data Eng. https://doi.org/10.1109/tkde.2020.3031329

    Article  Google Scholar 

  42. Sun K, Qian T, Chen T, Liang Y, Nguyen Q, Yin H (2020) Where to go next: modeling long- and short-term user preferences for point-of-interest recommendation. Proc AAAI Conf Artif Intell 34(01):214–221. https://doi.org/10.1609/aaai.v34i01.5353

    Article  Google Scholar 

  43. Faruqui M, Dyer C (2014) Improving vector space word representations using multilingual correlation. In: Proceedings of the 14th conference of the European chapter of the association for computational linguistics. https://www.doi.org/10.3115/v1/e14-1049

  44. Eksombatchai C, Jindal P, Liu JZ, Liu Y, Sharma R, Sugnet C, Leskovec J (2018) Pixie. In: Proceedings of the 2018 world wide web conference on world wide web—WWW’18. https://www.doi.org/10.1145/3178876.3186183

  45. Shuai Z, Yi T, Lina Y, Aixin S (2018) Next item recommendation with self-attention. arXiv:1808.06414

  46. Zhu Y, Li H, Liao Y, Wang B, Guan Z, Liu H, Cai D (2017) What to do next: modeling user behaviors by time-LSTM. In: Proceedings of the twenty-sixth international joint conference on artificial intelligence. https://www.doi.org/10.24963/ijcai.2017/504

  47. Jannach D, Jugovac M (2019) Measuring the business value of recommender systems. ACM Trans Manag Inf Syst 10(4):1–23. https://doi.org/10.1145/3370082

    Article  Google Scholar 

  48. Silveira T, Zhang M, Lin X, Liu Y, Ma S (2017) How good your recommender system is? A survey on evaluations in recommendation. Int J Mach Learn Cybern 10(5):813–831. https://doi.org/10.1007/s13042-017-0762-9

    Article  Google Scholar 

  49. Sheu H, Li S (2020) Context-aware graph embedding for session-based news recommendation. In: Fourteenth ACM conference on recommender systems. https://www.doi.org/10.1145/3383313.3418477

  50. Qiang L, Shu W, Liang W, Tieniu T (2016) Predicting the next location: a recurrent model with spatial and temporal contexts. In: Proceedings of the thirtieth AAAI conference on artificial intelligence. https://www.doi.org/10.5555/3015812.3015841

  51. Chen Y, Thaipisutikul T, Shih TK (2020) A learning-based POI recommendation with spatiotemporal context awareness. IEEE Trans Cybern. https://doi.org/10.1109/tcyb.2020.3000733

    Article  Google Scholar 

  52. Wu Y, Li K, Zhao G, Qian X (2020) Personalized long- and short-term preference learning for next POI recommendation. IEEE Trans Knowl Data Eng. https://doi.org/10.1109/tkde.2020.3002531

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Computer Science and Information Engineering, National Central University, Taoyuan City, Taiwan

    Tipajin Thaipisutikul & Timothy K. Shih

Authors
  1. Tipajin Thaipisutikul
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Timothy K. Shih
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

TT originated the research idea, reviewed the related literature, proposed and implemented the methodology, designed and conducted the experiments, analyzed the results, and wrote the manuscript. TKS provided intellectual guidance from a domain expert’s perspective, tracked the research progress, and edited the draft. Both authors have read and approved the final manuscript.

Corresponding author

Correspondence to Tipajin Thaipisutikul.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Thaipisutikul, T., Shih, T.K. A novel context-aware recommender system based on a deep sequential learning approach (CReS). Neural Comput & Applic 33, 11067–11090 (2021). https://doi.org/10.1007/s00521-020-05640-w

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00521-020-05640-w

Keywords

Search

Navigation