Skip to main content

Robust Graph Collaborative Filtering Algorithm Based on Hierarchical Attention

  • Conference paper
  • First Online:
Web Information Systems and Applications (WISA 2021)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 12999))

Included in the following conference series:

Abstract

Learning the embedding representation of users and items is the core of the collaborative filtering algorithm. In recent years, the graph neural network (GNN) has been applied to the recommendation field due to its excellent performance. However, in the process of GNN iteratively aggregating neighbor information, the occasional noise in the graph structure will transmit errors to neighbor nodes along with the aggregation process, which will worsen the embedding representation of other nodes. Noise information is ubiquitous in real life. Therefore, while mining high-order collaborative information in depth, improving the robustness of the GNN model is also an important factor that needs to be considered in the recommendation task. Based on the above problems, this paper proposes a robust graph collaborative filtering algorithm based on hierarchical attention, which includes node-level and graph-level attention. Node-level attention performs preference aggregation and occasional noise information filtering on different neighbor nodes by learning the attention coefficients of different neighbor nodes; graph-level attention performs fusion and secondary filtering of occasional noise information on different deep graph embeddings by learning the attention coefficients of different dimensional nodes. The node-level and graph-level attention can fully realize the noise reduction of the graph structure in the deep propagation process. While ensuring that the nodes encode high-order collaborative information, it minimizes the noise information carried. Extensive experimental results on three data sets show that the recommendation algorithm is better than the existing mainstream recommendation algorithm in all evaluation indicators.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 89.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 119.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Wu, Z., Pan, S., Chen, F., Long, G., Zhang, C., Philip, S.Y.: A comprehensive survey on graph neural networks. IEEE Trans. Neural Netw. Learn. Syst. 32(1), 4–24 (2020)

    Article  MathSciNet  Google Scholar 

  2. Zhu, Y., Xu, W., Zhang, J., Liu, Q., Wu, S., Wang, L.: Deep graph structure learning for robust representations: a survey. arXiv preprint arXiv:2103.03036 (2021)

  3. Chaudhari, S., Mithal, V., Polatkan, G., Ramanath, R.: An attentive survey of attention models. arXiv preprint arXiv:1904.02874 (2019)

  4. Ebesu, T., Shen, B., Fang, Y.: Collaborative memory network for recommendation systems. In: The 41st International ACM SIGIR Conference on Research & Development in Information Retrieval, pp. 515–524 (2018)

    Google Scholar 

  5. Xiao, J., Ye, H., He, X., Zhang, H., Wu, F., Chua, T.S.: Attentional factorization machines: learning the weight of feature interactions via attention networks. arXiv preprint arXiv:1708.04617 (2017)

  6. Koren, Y., Bell, R., Volinsky, C.: Matrix factorization techniques for recommender systems. Computer 42(8), 30–37 (2009)

    Article  Google Scholar 

  7. Berg, R.V.D., Kipf, T.N., Welling, M.: Graph convolutional matrix completion. arXiv preprint arXiv:1706.02263 (2017)

  8. Wang, X., He, X., Wang, M., Feng, F., Chua, T.S.: Neural graph collaborative filtering. In: Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 165–174 (2019)

    Google Scholar 

  9. He, X., Deng, K., Wang, X., Li, Y., Zhang, Y., Wang, M.: Lightgcn: simplifying and powering graph convolution network for recommendation. In: Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 639–648 (2020)

    Google Scholar 

  10. Wang, X., He, X., Cao, Y., Liu, M., Chua, T.S.: KGAT: knowledge graph attention network for recommendation. In: Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, pp. 950–958 (2019)

    Google Scholar 

  11. Li, J., Xu, Z., Tang, Y., Zhao, B., Tian, H.: Deep hybrid knowledge graph embedding for top-n recommendation. In: Wang, G., Lin, X., Hendler, J., Song, W., Xu, Z., Liu, G. (eds.) Web Information Systems and Applications, pp. 59–70. Springer International Publishing, Cham (2020)

    Chapter  Google Scholar 

  12. Rendle, S., Freudenthaler, C., Gantner, Z., Schmidt-Thieme, L.: BPR: Bayesian personalized ranking from implicit feedback. arXiv preprint arXiv:1205.2618 (2012)

Download references

Acknowledgments

This work is supported by the Scientific and technological research projects (No.2021LY505L16).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Ping Feng .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Feng, P., Qian, Y., Liu, X., Li, G., Zhao, J. (2021). Robust Graph Collaborative Filtering Algorithm Based on Hierarchical Attention. In: Xing, C., Fu, X., Zhang, Y., Zhang, G., Borjigin, C. (eds) Web Information Systems and Applications. WISA 2021. Lecture Notes in Computer Science(), vol 12999. Springer, Cham. https://doi.org/10.1007/978-3-030-87571-8_54

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-87571-8_54

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-87570-1

  • Online ISBN: 978-3-030-87571-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics