Skip to main content

NRSA: Neural Recommendation with Summary-Aware Attention

  • Conference paper
  • First Online:
Knowledge Science, Engineering and Management (KSEM 2019)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 11775))

Abstract

Reviews are widely used in recommendation systems to handle the sparsity problem of rating matrix. However, learning the representations of users and items only from reviews would be challenging since there are less meaningful words and reviews while modeling users or items. In fact, in addition to reviews there are rich off-the-shelf summaries written by users along with reviews, but existing recommendation methods ignore this useful information. The summary of a review is to describe the review with shorter sentences, and can be seen as a high-level abstraction of the review. Thus the summary can play a guidance role to indicate the important parts in a review and the informativeness of the review. Hence, we propose a neural recommendation method to learn summary-aware representations of users and items from reviews. We firstly apply a summary encoder to learn representations of text summary, which will be used as the guidance indicator. We design a summary-aware review encoder to learn representations of reviews from raw words, and another summary-aware user/item encoder to learn representations of users or items from reviews. To be specific, we propose a hierarchical attention model with summary representations as attention vectors under word- and review-level to select important words and reviews for users/items respectively. We conduct extensive experiments on real-world benchmark datasets and the results demonstrate that our approach can effectively improve the performance of neural recommendation.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    http://jmcauley.ucsd.edu/data/amazon/.

References

  1. Chen, C., Zhang, M., Liu, Y., Ma, S.: Neural attentional rating regression with review-level explanations. In: WWW, pp. 1583–1592 (2018)

    Google Scholar 

  2. Diao, Q., Qiu, M., Wu, C.Y., Smola, A.J., Jiang, J., Wang, C.: Jointly modeling aspects, ratings and sentiments for movie recommendation (JMARS). In: KDD, pp. 193–202 (2014)

    Google Scholar 

  3. Hyun, D., Park, C., Yang, M.C., Song, I., Lee, J.T., Yu, H.: Review sentiment-guided scalable deep recommender system. In: SIGIRE, pp. 965–968 (2018)

    Google Scholar 

  4. Kim, D., Park, C., Oh, J., Lee, S., Yu, H.: Convolutional matrix factorization for document context-aware recommendation. In: RecSys, pp. 233–240. ACM (2016)

    Google Scholar 

  5. Kingma, D.P., Ba, J.: Adam: a method for stochastic optimization. In: International Conference on Learning Representations (2015)

    Google Scholar 

  6. Koren, Y.: Factorization meets the neighborhood: a multifaceted collaborative filtering model. In: SIGKDD, pp. 426–434 (2008)

    Google Scholar 

  7. Koren, Y., Bell, R., Volinsky, C.: Matrix factorization techniques for recommender systems. Computer 8, 30–37 (2009)

    Article  Google Scholar 

  8. Lee, D.D., Seung, H.S.: Algorithms for non-negative matrix factorization. In: NIPS, pp. 556–562. MIT Press, Cambridge (2000)

    Google Scholar 

  9. Linden, G., Smith, B., York, J.: Amazon. com recommendations: item-to-item collaborative filtering. IEEE Internet Comput. 1, 76–80 (2003)

    Article  Google Scholar 

  10. Lu, Y., Dong, R., Smyth, B.: Coevolutionary recommendation model: Mutual learning between ratings and reviews. In: WWW, pp. 773–782 (2018)

    Google Scholar 

  11. Ma, S., Sun, X., Lin, J., Ren, X.: A hierarchical end-to-end model for jointly improving text summarization and sentiment classification. CoRR (2018)

    Google Scholar 

  12. McAuley, J., Leskovec, J.: Hidden factors and hidden topics: understanding rating dimensions with review text. In: RecSys, pp. 165–172. ACM (2013)

    Google Scholar 

  13. Mikolov, T., Sutskever, I., Chen, K., Corrado, G.S., Dean, J.: Distributed representations of words and phrases and their compositionality. In: Advances in Neural Information Processing Systems, pp. 3111–3119 (2013)

    Google Scholar 

  14. Mnih, A., Salakhutdinov, R.R.: Probabilistic matrix factorization. In: NIPS, pp. 1257–1264 (2008)

    Google Scholar 

  15. Rendle, S.: Factorization machines. In: ICDM, pp. 995–1000 (2010)

    Google Scholar 

  16. Salakhutdinov, R., Mnih, A.: Probabilistic matrix factorization. In: NIPS, pp. 1257–1264 (2008)

    Google Scholar 

  17. Schafer, J.B., Frankowski, D., Herlocker, J., Sen, S.: Collaborative filtering recommender systems. In: The adaptive web, pp. 291–324 (2007)

    Google Scholar 

  18. Seo, S., Huang, J., Yang, H., Liu, Y.: Interpretable convolutional neural networks with dual local and global attention for review rating prediction. In: Proceedings of the Eleventh ACM Conference on Recommender Systems, pp. 297–305 (2017)

    Google Scholar 

  19. Seo, S., Huang, J., Yang, H., Liu, Y.: Representation learning of users and items for review rating prediction using attention-based convolutional neural network (2017)

    Google Scholar 

  20. Wang, C., Blei, D.M.: Collaborative topic modeling for recommending scientific articles, pp. 448–456 (2011)

    Google Scholar 

  21. Zheng, L., Noroozi, V., Yu, P.S.: Joint deep modeling of users and items using reviews for recommendation. In: WSDM, pp. 425–434 (2017)

    Google Scholar 

Download references

Acknowledgments

This research was supported by grants from the National Key R&D Program of China (2018YFC0832101, 2018YFC0809800).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Pengfei Jiao .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Peng, Q., Wang, P., Wang, W., Liu, H., Sun, Y., Jiao, P. (2019). NRSA: Neural Recommendation with Summary-Aware Attention. In: Douligeris, C., Karagiannis, D., Apostolou, D. (eds) Knowledge Science, Engineering and Management. KSEM 2019. Lecture Notes in Computer Science(), vol 11775. Springer, Cham. https://doi.org/10.1007/978-3-030-29551-6_12

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-29551-6_12

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-29550-9

  • Online ISBN: 978-3-030-29551-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics