Skip to main content

Exploiting Graph Structured Cross-Domain Representation for Multi-domain Recommendation

  • Conference paper
  • First Online:
Advances in Information Retrieval (ECIR 2023)

Abstract

Multi-domain recommender systems benefit from cross-domain representation learning and positive knowledge transfer. Both can be achieved by introducing a specific modeling of input data (i.e. disjoint history) or trying dedicated training regimes. At the same time, treating domains as separate input sources becomes a limitation as it does not capture the interplay that naturally exists between domains. In this work, we efficiently learn multi-domain representation of sequential users’ interactions using graph neural networks. We use temporal intra- and inter-domain interactions as contextual information for our method called MAGRec (short for Multi-dom Ain Graph-based Recommender). To better capture all relations in a multi-domain setting, we learn two graph-based sequential representations simultaneously: domain-guided for recent user interest, and general for long-term interest. This approach helps to mitigate the negative knowledge transfer problem from multiple domains and improve overall representation. We perform experiments on publicly available datasets in different scenarios where MAGRec consistently outperforms state-of-the-art methods. Furthermore, we provide an ablation study and discuss further extensions of our method.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 89.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 119.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    Code and dataset partitions are available at https://github.com/alarca94/magrec.

  2. 2.

    https://github.com/RuihongQiu/FGNN.

  3. 3.

    https://github.com/RManLuo/MAMDR.

References

  1. Abdollahpouri, H., et al.: Multistakeholder recommendation: survey and research directions. User Model. User-Adapt. Inter. 30(1), 127–158 (2020)

    Google Scholar 

  2. Ahmadi, A.H.K., Hassani, K., Moradi, P., Lee, L., Morris, Q.: Memory-based graph networks. In: 8th International Conference on Learning Representations, ICLR 2020, Addis Ababa, Ethiopia, 26–30 April 2020. OpenReview.net (2020). https://openreview.net/forum?id=r1laNeBYPB

  3. Aoki, R., Tung, F., Oliveira, G.L.: Heterogeneous multi-task learning with expert diversity. IEEE/ACM Transactions on Computational Biology and Bioinformatics, vol. PP (2022)

    Google Scholar 

  4. Caruana, R.: Multitask learning, pp. 95–133. Kluwer Academic Publishers, USA (1998)

    Google Scholar 

  5. Chang, J., et al.: Sequential recommendation with graph neural networks. In: Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 378–387. SIGIR 2021, Association for Computing Machinery, New York, NY, USA (2021). https://doi.org/10.1145/3404835.3462968

  6. Cheng, H.T., et al.: Wide & deep learning for recommender systems. In: Proceedings of the 1st Workshop on Deep Learning for Recommender Systems, pp. 7–10. DLRS 2016, Association for Computing Machinery, New York, NY, USA (2016). https://doi.org/10.1145/2988450.2988454

  7. Cui, Q., Wei, T., Zhang, Y., Zhang, Q.: HeroGRAPH: a heterogeneous graph framework for multi-target cross-domain recommendation. In: Vinagre, J., Jorge, A.M., Al-Ghossein, M., Bifet, A. (eds.) Proceedings of the 3rd Workshop on Online Recommender Systems and User Modeling co-located with the 14th ACM Conference on Recommender Systems (RecSys 2020), Virtual Event, 25 Sept 2020. CEUR Workshop Proceedings, vol. 2715. CEUR-WS.org (2020). https://ceur-ws.org/Vol-2715/paper6.pdf

  8. Fang, H., Zhang, D., Shu, Y., Guo, G.: Deep learning for sequential recommendation: Algorithms, influential factors, and evaluations. ACM Trans. Inf. Syst. 39(1), 1–42 (2020). https://doi.org/10.1145/3426723

  9. Guo, H., Chen, B., Tang, R., Zhang, W., Li, Z., He, X.: An embedding learning framework for numerical features in CTR prediction. In: Zhu, F., Ooi, B.C., Miao, C. (eds.) KDD 2021: The 27th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, Virtual Event, Singapore, 14–18 August 2021, pp. 2910–2918. ACM (2021). https://doi.org/10.1145/3447548.3467077

  10. Hidasi, B., Karatzoglou, A., Baltrunas, L., Tikk, D.: Session-based recommendations with recurrent neural networks. In: Bengio, Y., LeCun, Y. (eds.) 4th International Conference on Learning Representations, ICLR 2016, San Juan, Puerto Rico, 2-4 May 2016, Conference Track Proceedings (2016). arxiv.org/abs/1511.06939

  11. Hu, G., Zhang, Y., Yang, Q.: CoNet: collaborative cross networks for cross-domain recommendation. In: Proceedings of the 27th ACM International Conference on Information and Knowledge Management, CIKM 2018, Torino, Italy, 22–26 Oct 2018, pp. 667–676. ACM (2018). https://doi.org/10.1145/3269206.3271684

  12. Kang, W.C., McAuley, J.: Self-attentive sequential recommendation. In: 2018 IEEE International Conference on Data Mining (ICDM), pp. 197–206 (2018). https://doi.org/10.1109/ICDM.2018.00035

  13. Li, J., Ren, P., Chen, Z., Ren, Z., Lian, T., Ma, J.: Neural attentive session-based recommendation. In: Proceedings of the 2017 ACM on Conference on Information and Knowledge Management, pp. 1419–1428. CIKM 2017, Association for Computing Machinery, New York, NY, USA (2017). https://doi.org/10.1145/3132847.3132926

  14. Li, P., Jiang, Z., Que, M., Hu, Y., Tuzhilin, A.: Dual attentive sequential learning for cross-domain click-through rate prediction. In: Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining, pp. 3172–3180. KDD 2021, Association for Computing Machinery, New York, NY, USA (2021). https://doi.org/10.1145/3447548.3467140

  15. Li, Y., Tarlow, D., Brockschmidt, M., Zemel, R.S.: Gated graph sequence neural networks. In: Bengio, Y., LeCun, Y. (eds.) 4th International Conference on Learning Representations, ICLR 2016, San Juan, Puerto Rico, 2–4 May 2016, Conference Track Proceedings (2016). arxiv.org/abs/1511.05493

  16. Luo, L., et al.: MAMDR: a model agnostic learning method for multi-domain recommendation. CoRR abs/2202.12524 (2022). arxiv.org/abs/2202.12524

  17. Lv, F., et al.: SDM: sequential deep matching model for online large-scale recommender system. In: Proceedings of the 28th ACM International Conference on Information and Knowledge Management, pp. 2635–2643. CIKM 2019, Association for Computing Machinery, New York, NY, USA (2019). https://doi.org/10.1145/3357384.3357818

  18. Ma, J., Zhao, Z., Yi, X., Chen, J., Hong, L., Chi, E.H.: Modeling task relationships in multi-task learning with multi-gate mixture-of-experts. In: Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, pp. 1930–1939. KDD 2018, Association for Computing Machinery, New York, NY, USA (2018). https://doi.org/10.1145/3219819.3220007

  19. Man, T., Shen, H., Jin, X., Cheng, X.: Cross-domain recommendation: an embedding and mapping approach. In: Proceedings of the 26th International Joint Conference on Artificial Intelligence, pp. 2464–2470. IJCAI2017, AAAI Press (2017)

    Google Scholar 

  20. McMahan, H.B., et al.: Ad click prediction: a view from the trenches. In: Proceedings of the 19th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 1222–1230 (2013)

    Google Scholar 

  21. Ni, J., Li, J., McAuley, J.: Justifying recommendations using distantly-labeled reviews and fine-grained aspects. In: Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), pp. 188–197. Association for Computational Linguistics, Hong Kong, China (2019). https://doi.org/10.18653/v1/D19-1018

  22. Ouyang, W., et al.: MiNet: mixed interest network for cross-domain click-through rate prediction. In: Proceedings of the 29th ACM International Conference on Information & Knowledge Management, pp. 2669–2676. CIKM 2020, Association for Computing Machinery, New York, NY, USA (2020). https://doi.org/10.1145/3340531.3412728

  23. Pi, Q., et al.: Search-based user interest modeling with lifelong sequential behavior data for click-through rate prediction. In: Proceedings of the 29th ACM International Conference on Information & Knowledge Management, pp. 2685–2692. CIKM 2020, Association for Computing Machinery, New York, NY, USA (2020). https://doi.org/10.1145/3340531.3412744

  24. Qiu, R., Li, J., Huang, Z., YIn, H.: Rethinking the item order in session-based recommendation with graph neural networks. In: Proceedings of the 28th ACM International Conference on Information and Knowledge Management. p. 579–588. CIKM 2019, Association for Computing Machinery, New York, NY, USA (2019). https://doi.org/10.1145/3357384.3358010

  25. Schoenauer-Sebag, A., Heinrich, L., Schoenauer, M., Sebag, M., Wu, L., Altschuler, S.: Multi-domain adversarial learning. In: International Conference on Learning Representations (2019). https://openreview.net/forum?id=Sklv5iRqYX

  26. Shen, W.: Deepctr: Easy-to-use, modular and extendible package of deep-learning based CTR models. https://github.com/shenweichen/deepctr (2017)

  27. Sheng, X.R., et al.: One model to serve all: Star topology adaptive recommender for multi-domain CTR prediction. In: Proceedings of the 30th ACM International Conference on Information & Knowledge Management, pp. 4104–4113. CIKM 2021, Association for Computing Machinery, New York, NY, USA (2021). https://doi.org/10.1145/3459637.3481941

  28. Tang, H., Liu, J., Zhao, M., Gong, X.: Progressive layered extraction (PLE): a novel multi-task learning (MTL) model for personalized recommendations. In: Fourteenth ACM Conference on Recommender Systems, pp. 269–278. RecSys 2020, Association for Computing Machinery, New York, NY, USA (2020). https://doi.org/10.1145/3383313.3412236

  29. Tang, J., Wang, K.: Personalized top-n sequential recommendation via convolutional sequence embedding. In: Proceedings of the Eleventh ACM International Conference on Web Search and Data Mining, pp. 565–573. WSDM 2018, Association for Computing Machinery, New York, NY, USA (2018). https://doi.org/10.1145/3159652.3159656

  30. Wang, R., Fu, B., Fu, G., Wang, M.: Deep & cross network for ad click predictions. In: Proceedings of the ADKDD2017. ADKDD2017, Association for Computing Machinery, New York, NY, USA (2017). https://doi.org/10.1145/3124749.3124754

  31. Wu, S., Tang, Y., Zhu, Y., Wang, L., Xie, X., Tan, T.: Session-based recommendation with graph neural networks. In: Proceedings of the Thirty-Third AAAI Conference on Artificial Intelligence and Thirty-First Innovative Applications of Artificial Intelligence Conference and Ninth AAAI Symposium on Educational Advances in Artificial Intelligence. AAAI2019/IAAI2019/EAAI2019, AAAI Press (2019). https://doi.org/10.1609/aaai.v33i01.3301346

  32. Xia, X., Yin, H., Yu, J., Wang, Q., Cui, L., Zhang, X.: Self-supervised hypergraph convolutional networks for session-based recommendation. In: Thirty-Fifth AAAI Conference on Artificial Intelligence, AAAI 2021, Thirty-Third Conference on Innovative Applications of Artificial Intelligence, IAAI 2021, The Eleventh Symposium on Educational Advances in Artificial Intelligence, EAAI 2021, Virtual Event, 2–9 Feb 2021, pp. 4503–4511. AAAI Press (2021). https://ojs.aaai.org/index.php/AAAI/article/view/16578

  33. Zhao, C., Li, C., Fu, C.: Cross-domain recommendation via preference propagation graphNet. In: Proceedings of the 28th ACM International Conference on Information and Knowledge Management, pp. 2165–2168. CIKM 2019, Association for Computing Machinery, New York, NY, USA (2019). https://doi.org/10.1145/3357384.3358166

  34. Zhou, G., et al.: Deep interest evolution network for click-through rate prediction. In: The Thirty-Third AAAI Conference on Artificial Intelligence, AAAI 2019, The Thirty-First Innovative Applications of Artificial Intelligence Conference, IAAI 2019, The Ninth AAAI Symposium on Educational Advances in Artificial Intelligence, EAAI 2019, Honolulu, Hawaii, USA, 27 Jan - 1 Feb 2019, pp. 5941–5948. AAAI Press (2019). https://doi.org/10.1609/aaai.v33i01.33015941

  35. Zhou, G., et al.: Deep interest network for click-through rate prediction. In: Guo, Y., Farooq, F. (eds.) Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, KDD 2018, London, UK, 19–23 Aug 2018, pp. 1059–1068. ACM (2018). https://doi.org/10.1145/3219819.3219823

Download references

Acknowledgements

This work was partially supported by the FairTransNLP-Language Project (MCIN/AEI/10.13039/501100011033/FEDER,UE).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Alejandro Ariza-Casabona .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Ariza-Casabona, A., Twardowski, B., Wijaya, T.K. (2023). Exploiting Graph Structured Cross-Domain Representation for Multi-domain Recommendation. In: Kamps, J., et al. Advances in Information Retrieval. ECIR 2023. Lecture Notes in Computer Science, vol 13980. Springer, Cham. https://doi.org/10.1007/978-3-031-28244-7_4

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-28244-7_4

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-28243-0

  • Online ISBN: 978-3-031-28244-7

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics