Abstract
Representation learning improves the accuracy of recommendation through mining high-order neighbors information on the user-item graph, but still suffers the data sparsity and cold start problems. Although knowledge-aware representation learning can alleviate the above problems to some certain extent by using knowledge graphs to capture rich addition information of the items, this method relies heavily on a large amount of training data and annotations in a supervised learning manner. Self-supervised learning has been proved to be a good substitute because of its ability to avoid the cost of annotating large-scale datasets.
In this paper, we explore the self-supervised contrastive learning on the hybrid structure of the knowledge graph and user-item graph to solve above problems. We design a Knowledge-aware Self-supervised Graph Contrastive Learning model called KSGL. The core idea is to learn the representation of users and items effectively by pulling the augmented versions of the same users/items close to each other while pushing away different ones. Specifically, KSGL first performs data enhancement on the input hybrid graph, generates multiple views of the target node, and then refines the node embedding in each view through Graph Convolutional Networks (GCN), and finally updates the model by contrast loss. We conduct experiments on three benchmark datasets to demonstrate the effectiveness of KSGL and the results of the experiment show that our model can not only improve recommendation accuracy but also obtain robustness against interactive noise.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Bayer, I., He, X., Kanagal, B., Rendle, S.: A generic coordinate descent framework for learning from implicit feedback. In: WWW, pp. 1341–1350 (2017)
Chen, J., Dong, H., Wang, X., Feng, F., Wang, M., He, X.: Bias and debias in recommender system: a survey and future directions. arXiv preprint arXiv:2010.03240 (2020)
Devlin, J., Chang, M.W., Lee, K., Toutanova, K.: Bert: pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805 (2018)
Feng, Y., Hu, B., Lv, F., Liu, Q., Zhang, Z., Ou, W.: ATBRG: adaptive target-behavior relational graph network for effective recommendation. In: SIGIR, pp. 2231–2240 (2020)
Gidaris, S., Singh, P., Komodakis, N.: Unsupervised representation learning by predicting image rotations. arXiv preprint arXiv:1803.07728 (2018)
Hassani, K., Khasahmadi, A.H.: Contrastive multi-view representation learning on graphs. In: ICML, pp. 4116–4126. PMLR (2020)
He, K., Fan, H., Wu, Y., Xie, S., Girshick, R.: Momentum contrast for unsupervised visual representation learning. In: CVPR, pp. 9729–9738 (2020)
Hjelm, R.D., et al.: Learning deep representations by mutual information estimation and maximization. arXiv preprint arXiv:1808.06670 (2018)
Koren, Y.: Factorization meets the neighborhood: a multifaceted collaborative filtering model. In: SIGKDD, pp. 426–434 (2008)
Li, Z., Cui, Z., Wu, S., Zhang, X., Wang, L.: Fi-GNN: modeling feature interactions via graph neural networks for CTR prediction. In: CIKM, pp. 539–548 (2019)
Qiu, J., et al.: GCC: graph contrastive coding for graph neural network pre-training. In: SIGKDD, pp. 1150–1160 (2020)
Rendle, S., Gantner, Z., Freudenthaler, C., Schmidt-Thieme, L.: Fast context-aware recommendations with factorization machines. In: SIGIR, pp. 635–644 (2011)
Wang, H., Zhang, F., Xie, X., Guo, M.: DKN: deep knowledge-aware network for news recommendation. In: WWW, pp. 1835–1844 (2018)
Wang, H., Zhao, M., Xie, X., Li, W., Guo, M.: Knowledge graph convolutional networks for recommender systems. In: WWW, pp. 3307–3313 (2019)
Wang, W., Feng, F., He, X., Nie, L., Chua, T.S.: Denoising implicit feedback for recommendation. In: WSDM, pp. 373–381 (2021)
Wang, X., He, X., Cao, Y., Liu, M., Chua, T.S.: KGAT: knowledge graph attention network for recommendation. In: SIGKDD, pp. 950–958 (2019)
Wu, J., et al.: Self-supervised graph learning for recommendation. In: SIGIR, pp. 726–735 (2021)
You, Y., Chen, T., Sui, Y., Chen, T., Wang, Z., Shen, Y.: Graph contrastive learning with augmentations. Adv. Neural. Inf. Process. Syst. 33, 5812–5823 (2020)
Yuan, F., He, X., Karatzoglou, A., Zhang, L.: Parameter-efficient transfer from sequential behaviors for user modeling and recommendation. In: SIGIR, pp. 1469–1478 (2020)
Zhu, J., Guo, X.: Deep neural model for point-of-interest recommendation fused with graph embedding representation. In: Biagioni, E.S., Zheng, Y., Cheng, S. (eds.) WASA 2019. LNCS, vol. 11604, pp. 495–506. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-23597-0_40
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Sun, Y., Zhu, J., Xi, H. (2022). Knowledge-Aware Self-supervised Graph Representation Learning for Recommendation. In: Pimenidis, E., Angelov, P., Jayne, C., Papaleonidas, A., Aydin, M. (eds) Artificial Neural Networks and Machine Learning – ICANN 2022. ICANN 2022. Lecture Notes in Computer Science, vol 13532. Springer, Cham. https://doi.org/10.1007/978-3-031-15937-4_35
Download citation
DOI: https://doi.org/10.1007/978-3-031-15937-4_35
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-15936-7
Online ISBN: 978-3-031-15937-4
eBook Packages: Computer ScienceComputer Science (R0)