Skip to main content

Knowledge-Aware Self-supervised Graph Representation Learning for Recommendation

  • Conference paper
  • First Online:
Book cover Artificial Neural Networks and Machine Learning – ICANN 2022 (ICANN 2022)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 13532))

Included in the following conference series:

Abstract

Representation learning improves the accuracy of recommendation through mining high-order neighbors information on the user-item graph, but still suffers the data sparsity and cold start problems. Although knowledge-aware representation learning can alleviate the above problems to some certain extent by using knowledge graphs to capture rich addition information of the items, this method relies heavily on a large amount of training data and annotations in a supervised learning manner. Self-supervised learning has been proved to be a good substitute because of its ability to avoid the cost of annotating large-scale datasets.

In this paper, we explore the self-supervised contrastive learning on the hybrid structure of the knowledge graph and user-item graph to solve above problems. We design a Knowledge-aware Self-supervised Graph Contrastive Learning model called KSGL. The core idea is to learn the representation of users and items effectively by pulling the augmented versions of the same users/items close to each other while pushing away different ones. Specifically, KSGL first performs data enhancement on the input hybrid graph, generates multiple views of the target node, and then refines the node embedding in each view through Graph Convolutional Networks (GCN), and finally updates the model by contrast loss. We conduct experiments on three benchmark datasets to demonstrate the effectiveness of KSGL and the results of the experiment show that our model can not only improve recommendation accuracy but also obtain robustness against interactive noise.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Bayer, I., He, X., Kanagal, B., Rendle, S.: A generic coordinate descent framework for learning from implicit feedback. In: WWW, pp. 1341–1350 (2017)

    Google Scholar 

  2. Chen, J., Dong, H., Wang, X., Feng, F., Wang, M., He, X.: Bias and debias in recommender system: a survey and future directions. arXiv preprint arXiv:2010.03240 (2020)

  3. Devlin, J., Chang, M.W., Lee, K., Toutanova, K.: Bert: pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805 (2018)

  4. Feng, Y., Hu, B., Lv, F., Liu, Q., Zhang, Z., Ou, W.: ATBRG: adaptive target-behavior relational graph network for effective recommendation. In: SIGIR, pp. 2231–2240 (2020)

    Google Scholar 

  5. Gidaris, S., Singh, P., Komodakis, N.: Unsupervised representation learning by predicting image rotations. arXiv preprint arXiv:1803.07728 (2018)

  6. Hassani, K., Khasahmadi, A.H.: Contrastive multi-view representation learning on graphs. In: ICML, pp. 4116–4126. PMLR (2020)

    Google Scholar 

  7. He, K., Fan, H., Wu, Y., Xie, S., Girshick, R.: Momentum contrast for unsupervised visual representation learning. In: CVPR, pp. 9729–9738 (2020)

    Google Scholar 

  8. Hjelm, R.D., et al.: Learning deep representations by mutual information estimation and maximization. arXiv preprint arXiv:1808.06670 (2018)

  9. Koren, Y.: Factorization meets the neighborhood: a multifaceted collaborative filtering model. In: SIGKDD, pp. 426–434 (2008)

    Google Scholar 

  10. Li, Z., Cui, Z., Wu, S., Zhang, X., Wang, L.: Fi-GNN: modeling feature interactions via graph neural networks for CTR prediction. In: CIKM, pp. 539–548 (2019)

    Google Scholar 

  11. Qiu, J., et al.: GCC: graph contrastive coding for graph neural network pre-training. In: SIGKDD, pp. 1150–1160 (2020)

    Google Scholar 

  12. Rendle, S., Gantner, Z., Freudenthaler, C., Schmidt-Thieme, L.: Fast context-aware recommendations with factorization machines. In: SIGIR, pp. 635–644 (2011)

    Google Scholar 

  13. Wang, H., Zhang, F., Xie, X., Guo, M.: DKN: deep knowledge-aware network for news recommendation. In: WWW, pp. 1835–1844 (2018)

    Google Scholar 

  14. Wang, H., Zhao, M., Xie, X., Li, W., Guo, M.: Knowledge graph convolutional networks for recommender systems. In: WWW, pp. 3307–3313 (2019)

    Google Scholar 

  15. Wang, W., Feng, F., He, X., Nie, L., Chua, T.S.: Denoising implicit feedback for recommendation. In: WSDM, pp. 373–381 (2021)

    Google Scholar 

  16. Wang, X., He, X., Cao, Y., Liu, M., Chua, T.S.: KGAT: knowledge graph attention network for recommendation. In: SIGKDD, pp. 950–958 (2019)

    Google Scholar 

  17. Wu, J., et al.: Self-supervised graph learning for recommendation. In: SIGIR, pp. 726–735 (2021)

    Google Scholar 

  18. You, Y., Chen, T., Sui, Y., Chen, T., Wang, Z., Shen, Y.: Graph contrastive learning with augmentations. Adv. Neural. Inf. Process. Syst. 33, 5812–5823 (2020)

    Google Scholar 

  19. Yuan, F., He, X., Karatzoglou, A., Zhang, L.: Parameter-efficient transfer from sequential behaviors for user modeling and recommendation. In: SIGIR, pp. 1469–1478 (2020)

    Google Scholar 

  20. Zhu, J., Guo, X.: Deep neural model for point-of-interest recommendation fused with graph embedding representation. In: Biagioni, E.S., Zheng, Y., Cheng, S. (eds.) WASA 2019. LNCS, vol. 11604, pp. 495–506. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-23597-0_40

    Chapter  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Jinghua Zhu .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Sun, Y., Zhu, J., Xi, H. (2022). Knowledge-Aware Self-supervised Graph Representation Learning for Recommendation. In: Pimenidis, E., Angelov, P., Jayne, C., Papaleonidas, A., Aydin, M. (eds) Artificial Neural Networks and Machine Learning – ICANN 2022. ICANN 2022. Lecture Notes in Computer Science, vol 13532. Springer, Cham. https://doi.org/10.1007/978-3-031-15937-4_35

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-15937-4_35

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-15936-7

  • Online ISBN: 978-3-031-15937-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics