Skip to main content
Log in

Disentangling interest and conformity for eliminating popularity bias in session-based recommendation

  • Regular Paper
  • Published:
Knowledge and Information Systems Aims and scope Submit manuscript

Abstract

Session-based recommendation (SBR) is to predict the next item, given an anonymous interaction sequence. Recently, many advanced SBR models have shown great recommending performance, but few studies note that they suffer from popularity bias seriously: the model tends to recommend popular items and fails to recommend long-tail items. The only few debias works relieve popularity bias indeed. However, they ignore individual’s conformity toward popular items and thus decrease recommending performance on popular items. Besides, conformity is always entangled with individual’s real interest, which hinders extracting one’s comprehensive preference. To tackle the problem, we propose an SBR framework with Disentangling InteRest and Conformity for eliminating popularity bias in SBR. In this framework, two groups of item encoders and session modeling modules are devised to extract interest and conformity, respectively, and a fusion module is designed to combine these two types of preference. Also, a discrepancy loss is utilized to disentangle the representation of interest and conformity. Besides, our devised framework can integrate with several SBR models seamlessly. We conduct extensive experiments on three real-world datasets with four advanced SBR models. The results show that our framework outperforms other state-of-the-art debias methods consistently.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

Notes

  1. https://competitions.codalab.org/competitions/11161#participate.

  2. https://www.kaggle.com/retailrocket/ecommerce-dataset.

  3. https://tianchi.aliyun.com/dataset/dataDetail?dataId=42.

References

  1. Jannach D, Ludewig M, Lerche L (2017) Session-based item recommendation in e-commerce: on short-term intents, reminders, trends and discounts. User Model User-Adap Inter 27(3):351–392. https://doi.org/10.1007/s11257-017-9194-1

    Article  Google Scholar 

  2. Ludewig M, Jannach D (2018) Evaluation of session-based recommendation algorithms. User Model User-Adap Inter 28(4):331–390. https://doi.org/10.1007/s11257-018-9209-6

    Article  Google Scholar 

  3. Bal’azs H, Alexandros K, Linas B, Domonkos T (2016) Session-based recommendations with recurrent neural networks. In: Proceedings of the 4th International Conference on Learning Representations(ICLR) arXiv:1511.06939

  4. Li J, Ren P, Chen Z, Ren Z, Lian T, Ma J (2017) Neural attentive session-based recommendation. In: Proceedings of the 2017 ACM on Conference on Information and Knowledge Management(CIKM), pp 1419–1428 https://doi.org/10.1145/3132847.3132926

  5. Wu S, Tang Y, Zhu Y, Wang L, Xie X, Tan T (2019) Session-based recommendation with graph neural networks. In: Proceedings of the AAAI conference on artificial intelligence(AAAI), vol 33, pp 346–353 https://doi.org/10.1609/aaai.v33i01.3301346

  6. Zeng J et al (2020) User sequential behavior classification for click-through rate prediction. In: Nah Y, Kim C, Kim SY, Moon YS, Whang SE (eds) Database Systems for Advanced Applications. DASFAA 2020 International Workshops. DASFAA 2020. Lecture Notes in Computer Science, vol 12115. Springer, Cham. https://doi.org/10.1007/978-3-030-59413-8_22

  7. Nguyen TT, Hui PM, Harper FM, Terveen L, Konstan JA (2014) Exploring the filter bubble: the effect of using recommender systems on content diversity. In: Proceedings of the 23rd international conference on World wide web(WWW), pp 677–686. https://doi.org/10.1145/2566486.2568012

  8. Joachims T, Swaminathan A, Schnabel T (2017) Unbiased learning-to-rank with biased feedback. In: Proceedings of the Tenth ACM International Conference on Web Search and Data Mining(WSDM), pp 781–789 https://doi.org/10.1145/3018661.3018699

  9. Zheng Y, Gao C, Li X, He X, Li Y, Jin D (2021) Disentangling user interest and conformity for recommendation with causal embedding. In: Proceedings of the 30th international conference on World wide web(WWW), pp 2980–2991 https://doi.org/10.1145/3442381.3449788

  10. Liu S, Zheng Y (2020) Long-tail session-based recommendation. In: Proceedings of the 14th ACM conference on recommender systems(RecSys), pp 509–514 https://doi.org/10.1145/3383313.3412222

  11. Gupta P, Garg D, Malhotra P, Vig L, Shroff G (2019) NISER: Normalized item and session representations to handle popularity bias. arXiv preprint arXiv:1909.04276

  12. Gupta P, Sharma A, Malhotra P, Vig L, Shroff G (2021) CauSeR: causal session-based recommendations for handling popularity bias. In: Proceedings of the 30th ACM International Conference on Information and Knowledge Management(CIKM), pp 3048–3052 https://doi.org/10.1145/3459637.3482071

  13. Wang S, Cao L, Wang Y, Sheng QZ, Orgun MA, Lian D (2021) A survey on session-based recommender systems. ACM Comput Surv CSUR 54(7):1–38. https://doi.org/10.1145/3465401

    Article  Google Scholar 

  14. Krishnan S, Patel J, Franklin MJ, Goldberg K (2014) A methodology for learning, analyzing, and mitigating social influence bias in recommender systems. In: Proceedings of the 8th ACM Conference on Recommender Systems (RecSys), pp 137–144 https://doi.org/10.1145/2645710.2645740

  15. Liu Y, Cao X, Yu Y (2016) Are you influenced by others when rating? improve rating prediction by conformity modeling. In: Proceedings of the 10th ACM conference on Recommender Systems (RecSys), pp 269–272 https://doi.org/10.1145/2959100.2959141

  16. Feng Y, Lv F, Shen W, Wang M, Sun F, Zhu Y, Yang K (2019) Deep session interest network for click-through rate prediction. arXiv preprint arXiv:1905.06482

  17. Garg D, Gupta P, Malhotra P, Vig L, Shroff G (2019) Sequence and time aware neighborhood for session-based recommendations: Stan. In: Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR), pp 1069–1072 https://doi.org/10.1145/3331184.3331322

  18. Jannach D, Ludewig, M (2017) When recurrent neural networks meet the neighborhood for session-based recommendation. In: Proceedings of the 11th ACM Conference on Recommender Systems (RecSys), pp 306–310 https://doi.org/10.1145/3109859.3109872

  19. Rendle S, Freudenthaler C, Schmidt-Thieme, L (2010) Factorizing personalized markov chains for next-basket recommendation. In: Proceedings of the 19th international conference on World wide web (WWW), pp 811–820 https://doi.org/10.1145/1772690.1772773

  20. Wu X, Liu Q, Chen E, He L, Lv J, Cao C, Hu G (2013) Personalized next-song recommendation in online karaokes. In: Proceedings of the 7th ACM Conference on Recommender Systems (RecSys), pp 137–140 https://doi.org/10.1145/2507157.2507215

  21. Chen W, Cai F, Chen H, de Rijke M (2019) A dynamic co-attention network for session-based recommendation. In: Proceedings of the 28th ACM international conference on information and knowledge management, pp 1461–1470 https://doi.org/10.1145/3357384.3357964

  22. Xia X, Yin H, Yu J, Wang Q, Cui L, Zhang X (2021) Self-supervised hypergraph convolutional networks for session-based recommendation. Proc AAAI Conf Artif Intell (AAAI) 35(5):4503–4511

    Google Scholar 

  23. Pang Y, Wu L, Shen Q, Zhang Y, Wei Z, Xu F et.al. (2022) Heterogeneous global graph neural networks for personalized session-based recommendation. In: Proceedings of the Fifteenth ACM International Conference on Web Search and Data Mining(WSDM), pp 775–783 https://doi.org/10.1145/3488560.3498505

  24. Chen J, Dong H, Wang X, Feng F, Wang M, He X (2020) Bias and debias in recommender system: A survey and future directions. arXiv preprint arXiv:2010.03240

  25. Agarwal A, Takatsu K, Zaitsev I, Joachims T (2019) A general framework for counterfactual learning-to-rank. In: Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval(SIGIR), pp 5–14 https://doi.org/10.1145/3331184.3331202

  26. Bottou L, Peters J, Quiñonero-Candela J, Charles DX, Chickering DM, Portugaly E et.al. (2013) Counterfactual reasoning and learning systems: the example of computational advertising. J Mach Learn Res, 14(11) http://jmlr.org/papers/v14/bottou13a.html

  27. Gruson A, Chandar P, Charbuillet C, McInerney J, Hansen S, Tardieu D, Carterette B (2019) Offline evaluation to make decisions about playlistrecommendation algorithms. In: Proceedings of the 12nd ACM International Conference on Web Search and Data Mining(WSDM), pp 420–428 https://doi.org/10.1145/3289600.3291027

  28. Zhang Y, Feng F, He X, Wei T, Song C, Ling G, Zhang Y (2021) Causal intervention for leveraging popularity bias in recommendation. In: Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval(SIGIR), pp 11–20 https://doi.org/10.1145/3404835.3462875

  29. Wang W, Feng F, He X, Wang X, Chua TS (2021) Deconfounded recommendation for alleviating bias amplification. In: Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery and Data Mining(KDD), pp 1717–1725 https://doi.org/10.1145/3447548.3467249

  30. Pearl J (2009) Causality. Cambridge University Press

  31. Wei T, Feng F, Chen J, Wu Z, Yi J, He X (2021) Model-agnostic counterfactual reasoning for eliminating popularity bias in recommender system. In: Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery and Data Mining(KDD), pp 1791–1800 https://doi.org/10.1145/3447548.3467289

  32. Li Y, Zemel R, Brockschmidt M, Tarlow D (2016) Gated graph sequence neural networks. In: Proceedings of the 4th International Conference on Learning Representations(ICLR) arXiv:1511.05493

  33. Qi T, Wu F, Wu C, Huang Y (2021) PP-Rec: News Recommendation with Personalized User Interest and Time-aware News Popularity. In: Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing(ACL), pp 5457–5467 https://doi.org/10.18653/v1/2021.acl-long.424

  34. Wang X, Jin H, Zhang A, He X, Xu T, Chua TS (2020) Disentangled graph collaborative filtering. In: Proceedings of the 43rd international ACM SIGIR conference on research and development in information retrieval (SIGIR), pp 1001–1010 https://doi.org/10.1145/3397271.3401137

  35. Xu C, Zhao P, Liu Y, Sheng VS, Xu J, Zhuang F et.al (2019) Graph contextualized self-attention network for session-based recommendation. In: Proceedings of the 28th International Joint Conference on Artificial Intelligence(IJCAI), pp 3940–3946 https://doi.org/10.5555/3367471.3367589

  36. Yu F, Zhu Y, Liu Q, Wu S, Wang L, Tan T (2020) TAGNN: target attentive graph neural networks for session-based recommendation. In Proceedings of the 43rd international ACM SIGIR conference on research and development in information retrieval, pp 1921–1924 https://doi.org/10.1145/3397271.3401319

  37. Armstrong R (2008) The long tail: Why the future of business is selling less of more. Can J Commun 33(1):127

    Article  Google Scholar 

  38. Liu Z, Fan Z, Wang Y, Yu PS (2021) Augmenting sequential recommendation with pseudo-prior items via reversely pre-training transformer. In Proceedings of the 44th international ACM SIGIR conference on Research and development in information retrieval, pp 1608–1612 https://doi.org/10.1145/3404835.3463036

  39. Van der Maaten L, Hinton G (2008) Visualizing data using t-SNE. J Mach Learn Res, 9(11). http://jmlr.org/papers/v9/vandermaaten08a.html

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Feng Tian.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Liu, Q., Tian, F., Zheng, Q. et al. Disentangling interest and conformity for eliminating popularity bias in session-based recommendation. Knowl Inf Syst 65, 2645–2664 (2023). https://doi.org/10.1007/s10115-023-01839-0

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10115-023-01839-0

Keywords

Navigation