Abstract
Rating prediction is a crucial task for recommender systems, but it has the problem of difficulty in quickly capturing user preference transfer and cold-start problem. Thus, this paper proposes the meta-learning-based rating prediction model for heterogeneous information networks (HIN) called Meta-HRP (HIN-based Rating Prediction) to solve these problems. The model first constructs meta-tasks through meta-paths on HIN and then constructs an embedding representation generator based on graph convolutional network (GCN) and attention mechanism to generate embeddings for users and items. Then the proposed rating prediction meta-learner leverages historical interaction data to learn prior knowledge and rapidly adapts to new items based on a few recent user rating records to timely capture user preference transfer and alleviate the cold-start problem. We validate Meta-HRP with extensive experiments, and the proposed model reduces root mean square error by at least 8.49\(\%\) on average over the baselines on two public benchmark datasets. Furthermore, Meta-HRP outperforms the state-of-the-arts in most cold-start cases.
Similar content being viewed by others
Data Availability
The MovieLens and Douban Book datasets are available on a GitHub repository, https://github.com/librahu/HIN-Datasets-for-Recommendation-and-Network-Embedding.
References
Zhang Y, Yin C, Wu Q, He Q, Zhu H (2021) Location-aware deep collaborative filtering for service recommendation. IEEE Trans Syst Man Cybern Syst 51(6):3796–3807. https://doi.org/10.1109/TSMC.2019.2931723
Tang H, Zhao G, Bu X, Qian X (2021) Dynamic evolution of multi-graph based collaborative filtering for recommendation systems. Knowl Based Syst 228:107251. https://doi.org/10.1016/j.knosys.2021.107251
Chen W, Cai F, Chen H, Rijke MD (2019) Joint neural collaborative filtering for recommender systems. ACM Trans Inf Syst 37(4). https://doi.org/10.1145/3343117
Hung T-Y, Huang S-H (2022) Addressing the cold-start problem of recommendation systems for financial products by using few-shot deep learning. Appl Intell 52(13):15529–15546. https://doi.org/10.1007/s10489-022-03374-x
Yang T, Gao Y, Huang Z, Liu Y et al (2023) Uptdnet: A user preference transfer and drift network for cross-city next poi recommendation. Int J Intell Syst 2023. https://doi.org/10.1155/2023/9091570
Zhu Y, Lin J, He S, Wang B, Guan Z, Liu H, Cai D (2020) Addressing the item cold-start problem by attribute-driven active learning. IEEE Trans Knowl Data Eng 32(4):631–644. https://doi.org/10.1109/TKDE.2019.2891530
Qian T, Liang Y, Li Q, Xiong H (2022) Attribute graph neural networks for strict cold start recommendation. IEEE Trans Knowl Data Eng 34(8):3597–3610. https://doi.org/10.1109/TKDE.2020.3038234
Chen J, Gong Z, Li Y, Zhang H, Yu H, Zhu J, Fan G, Wu X-M, Wu K (2022) Meta-path based neighbors for behavioral target generalization in sequential recommendation. IEEE Trans Netw Sci Eng 9(3):1658–1667. https://doi.org/10.1109/TNSE.2022.3149328
Hao Q, Xu Q, Yang Z, Huang Q (2021) Learning unified embeddings for recommendation via meta-path semantics. In: Proceedings of the 29th ACM International conference on multimedia. MM’21, Association for computing machinery pp 3909–3917. https://doi.org/10.1145/3474085.3475407
Finn C, Abbeel P, Levine S (2017) Model-agnostic meta-learning for fast adaptation of deep networks. In: Proceedings of the 34th International conference on machine learning - vol 70. ICML’17, pp 1126–1135. https://dl.acm.org/doi/10.5555/3305381.3305498
Huang X, Sang J, Yu J, Xu C (2022) Learning to learn a cold-start sequential recommender. ACM Trans Inf Syst 40(2). https://doi.org/10.1145/3466753
Lee H, Im J, Jang S, Cho H, Chung S (2019) Melu: Meta-learned user preference estimator for cold-start recommendation. In: Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. KDD ’19. Association for Computing Machinery pp 1073–1082. https://doi.org/10.1145/3292500.3330859
Li Z, Amagata D, Zhang Y, Maekawa T, Hara T, Yonekawa K, Kurokawa M (2022) Hml4rec: Hierarchical meta-learning for cold-start recommendation in flash sale e-commerce. Knowledge-Based Syst 255:109674. https://doi.org/10.1016/j.knosys.2022.109674
Wang Q, Yin H, Hu Z, Lian D, Wang H, Huang Z (2018) Neural memory streaming recommender networks with adversarial training. In: Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. KDD ’18, Association for Computing Machinery pp. 2467–2475. https://doi.org/10.1145/3219819.3220004
Zhu Y, Tang Z, Liu Y, Zhuang F, Xie R, Zhang X, Lin L, He Q (2022) Personalized transfer of user preferences for cross-domain recommendation. In: Proceedings of the Fifteenth ACM International Conference on Web Search and Data Mining. WSDM ’22, Association for Computing Machinery pp 1507–1515. https://doi.org/10.1145/3488560.3498392
Jia R, Li R (2022) User preference modeling on heterogeneous implicit feedback with transfer learning. In: 2022 IEEE 25th International Conference on Computer Supported Cooperative Work in Design (CSCWD), pp 214–220 . https://doi.org/10.1109/CSCWD54268.2022.9776249
Yu R, Gong Y, He X, Zhu Y, Liu Q, Ou W, An B (2021) Personalized adaptive meta learning for cold-start user preference prediction. Proceedings of the AAAI Conference on Artificial Intelligence 35:10772–10780. https://doi.org/10.1609/aaai.v35i12.17287
Abdullah NA, Rasheed RA, Nasir MHNM, Rahman MM (2021) Eliciting auxiliary information for cold start user recommendation: A survey. Appl Sci 11(20):9608. https://doi.org/10.3390/app11209608
Shen Y, Ding N, Zheng H-T, Li Y, Yang M (2021) Modeling relation paths for knowledge graph completion. IEEE Trans Knowl Data Eng 33(11):3607–3617. https://doi.org/10.1109/TKDE.2020.2970044
Shi C, Hu B, Zhao WX, Yu PS (2019) Heterogeneous information network embedding for recommendation. IEEE Trans Knowl Data Eng 31(2):357–370. https://doi.org/10.1109/TKDE.2018.2833443
Hao J, Dun Y, Zhao G, Wu Y, Qian X (2022) Annular-graph attention model for personalized sequential recommendation. IEEE Transactions on Multimedia 24:3381–3391. https://doi.org/10.1109/TMM.2021.3097186
Liu Y, Yang S, Xu Y, Miao C, Wu M, Zhang J (2023) Contextualized graph attention network for recommendation with item knowledge graph. IEEE Trans Knowl Data Eng 35(1):181–195. https://doi.org/10.1109/TKDE.2021.3082948
Yan S, Wang H, Li Y, Zheng Y, Han L (2021) Attention-aware metapath-based network embedding for hin based recommendation. Expert Systems with Applications 174:114601. https://doi.org/10.1016/j.eswa.2021.114601
Koren Y (2008) Factorization meets the neighborhood: A multifaceted collaborative filtering model. In: Proceedings of the 14th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. KDD ’08, Association for Computing Machinery pp 426–434. https://doi.org/10.1145/1401890.1401944
Guo L, Yin H, Wang Q, Chen T, Zhou A, Quoc Viet Hung N (2019) Streaming session-based recommendation. In: Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. KDD ’19, Association for Computing Machinery pp 1569–1577. https://doi.org/10.1145/3292500.3330839
He X, Zhang H, Kan M-Y, Chua T-S (2016) Fast matrix factorization for online recommendation with implicit feedback. In: Proceedings of the 39th International ACM SIGIR Conference on Research and Development in Information Retrieval. SIGIR ’16, Association for Computing Machinery pp 549–558. https://doi.org/10.1145/2911451.2911489
Chang S, Zhang Y, Tang J, Yin D, Chang Y, Hasegawa-Johnson MA, Huang TS (2017) Streaming recommender systems. In: Proceedings of the 26th International Conference on World Wide Web. WWW ’17, International World Wide Web Conferences Steering Committee pp 381–389. https://doi.org/10.1145/3038912.3052627
Pan F, Li S, Ao X, Tang P, He Q (2019) Warm up cold-start advertisements: Improving ctr predictions via learning to learn id embeddings. In: Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval. SIGIR’19, Association for Computing Machinery pp 695–704. https://doi.org/10.1145/3331184.3331268
Du Y, Zhu X, Chen L, Fang Z, Gao Y (2022) Metakg: Meta-learning on knowledge graph for cold-start recommendation. IEEE Trans Knowl Data Eng 1–1. https://doi.org/10.1109/TKDE.2022.3168775
Wang X, Bo D, Shi C, Fan S, Ye Y, Yu PS (2022) A survey on heterogeneous graph embedding: Methods, techniques, applications and sources. IEEE Trans Big Data 1–1. https://doi.org/10.1109/TBDATA.2022.3177455
Xie Y, Yu B, Lv S, Zhang C, Wang G, Gong M (2021) A survey on heterogeneous network representation learning. Pattern Recogn 116:107936. https://doi.org/10.1016/j.patcog.2021.107936
Shi C, Li Y, Zhang J, Sun Y, Yu PS (2017) A survey of heterogeneous information network analysis. IEEE Trans Knowl Data Eng 29(1):17–37. https://doi.org/10.1109/TKDE.2016.2598561
Lu Y, Fang Y, Shi C (2020) Meta-earning on heterogeneous information networks for cold-start recommendation. In: Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. KDD ’20, Association for Computing Machinery pp 1563–1573. https://doi.org/10.1145/3394486.3403207
He X, Liao L, Zhang H, Nie L, Hu X, Chua T-S (2017) Neural collaborative filtering. In: Proceedings of the 26th International Conference on World Wide Web. WWW ’17, International World Wide Web Conferences Steering Committee pp 173–182. https://doi.org/10.1145/3038912.3052569
Dong Y, Chawla NV, Swami A (2017) Metapath2vec: Scalable representation learning for heterogeneous networks. In: Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. KDD ’17, Association for Computing Machinery pp 135–144. https://doi.org/10.1145/3097983.3098036
Acknowledgements
This work was supported in part by the National Natural Science Foundation of China under Grant 62172065 and the Natural Science Foundation of Chongqing under Grant cstc2020jcyj-msxmX0137.
Funding
This work was supported in part by the National Natural Science Foundation of China under Grant 62172065 and the Natural Science Foundation of Chongqing under Grant cstc2020jcyj-msxmX0137.
Author information
Authors and Affiliations
Contributions
Mingqiang Zhou and Kunpeng Li proposed the model in this paper and completed the experiment design and paper writing together. Kailang Dai was responsible for collecting datasets and drawing relevant charts in the paper. Quanwang Wu gave valuable suggestions and strong support for improving the method in this paper. Finally, all authors read the paper entirely.
Corresponding author
Ethics declarations
Ethics approval
This article does not contain any studies with human or animals performed by any of the authors.
Consent to participate
All authors have been personally and actively involved in substantive work leading to the manuscript, and will hold themselves jointly and individually responsible for its content.
Conflicts of Interest
All authors declare that they have no conflict of interests.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Kunpeng Li, Kailang Dai and Quanwang Wu are contributed equally to this work.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Zhou, M., Li, K., Dai, K. et al. HIN-based rating prediction in recommender systems via GCN and meta-learning. Appl Intell 53, 23271–23286 (2023). https://doi.org/10.1007/s10489-023-04769-0
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10489-023-04769-0