Skip to main content

Helpfulness-aware review based neural recommendation

We’re sorry, something doesn't seem to be working properly.

Please try refreshing the page. If that doesn't work, please contact support so we can address the problem.

Abstract

Reviews contain rich information of user interests and item characteristics. Incorporating reviews into recommendation has attracted increasing attention in recent years, which can help learn more accurate user and item representations for recommendation. Existing review based recommendation methods usually utilize the content of reviews while ignoring the helpfulness scores associated with them. Since different reviews have different informativeness and many reviews are noisy and even misleading, incorporating the helpfulness information of reviews can help better exploit the reviews for recommendation. In this paper, we propose a helpfulness-aware review based recommendation approach. The core of our approach is a review encoder and a user/item encoder. In the review encoder we learn representations of reviews from their content in a hierarchical way. We first learn sentence representations from words and then learn review representations from sentences, using a hierarchical attention network to select important words and sentences. In the user/item encoder, we learn representations of users/items from their reviews using an attention network. The query vector of the attention network comes from the helpfulness scores of these reviews. Since many reviews do not have helpfulness scores, we propose a neural helpfulness prediction model to predict the helpfulness scores of these reviews. The neural helpfulness prediction model is trained on the limited reviews with helpfulness scores voted by users. Extensive experiments on four benchmark datasets show that incorporating the helpfulness of reviews can effectively improve the performances of review based neural recommendation methods.

This is a preview of subscription content, access via your institution.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

Notes

  1. 1.

    http://jmcauley.ucsd.edu/data/amazon.

References

  1. Almahairi, A., Kastner, K., Cho, K., Courville, A.: Learning distributed representations from reviews for collaborative filtering. In: RecSys, pp. 147–154 (2015)

  2. Bao, Y., Fang, H., Zhang, J.: Topicmf: Simultaneously exploiting ratings and reviews for recommendation. In: AAAI (2014)

  3. Bell, R., Koren, Y., Volinsky, C.: Modeling relationships at multiple scales to improve accuracy of large recommender systems. In: KDD, pp. 95–104 (2007)

  4. Bhatt, A., Patel, A., Chheda, H., Gawande, K.: Amazon review classification and sentiment analysis. Int. J. Comput. Sci. Inf. Technol. 6(6), 5107–5110 (2015)

    Google Scholar 

  5. Catherine, R., Cohen, W.: Transnets: Learning to transform for recommendation. In: RecSys, pp. 288–296 (2017)

  6. Chen, C., Qiu, M., Yang, Y., Zhou, J., Huang, J., Li, X., Bao, F.: Review helpfulness prediction with embedding-gated cnn. arXiv preprint arXiv:1808.09896 (2018)

  7. Chen, C., Yang, Y., Zhou, J., Li, X., Bao, F.S.: Cross-domain review helpfulness prediction based on convolutional neural networks with auxiliary domain discriminators. In: NAACL, pp. 602–607 (2018)

  8. Chen, C., Zhang, M., Liu, Y., Ma, S.: Neural attentional rating regression with review-level explanations. In: WWW, pp. 1583–1592 (2018)

  9. Cheng, P., Wang, S., Ma, J., Sun, J., Xiong, H.: Learning to recommend accurate and diverse items. In: WWW, pp. 183–192 (2017)

  10. Conneau, A., Schwenk, H., Barrault, L., Lecun, Y.: Very deep convolutional networks for text classification. arXiv preprint arXiv:1606.01781 (2016)

  11. Glorot, X., Bordes, A., Bengio, Y.: Deep sparse rectifier neural networks. In: AISTATS, pp. 315–323 (2011)

  12. He, X., Chen, T., Kan, M.Y., Chen, X.: Trirank: Review-aware explainable recommendation by modeling aspects. In: CIKM, pp. 1661–1670 (2015)

  13. Kim, D., Park, C., Oh, J., Lee, S., Yu, H.: Convolutional matrix factorization for document context-aware recommendation. In: RecSys, pp. 233–240 (2016)

  14. Kim, S.M., Pantel, P., Chklovski, T., Pennacchiotti, M.: Automatically assessing review helpfulness. In: EMNLP, pp. 423–430 (2006)

  15. Kim, Y.: Convolutional neural networks for sentence classification. arXiv preprint arXiv:1408.5882 (2014)

  16. Kingma, D.P., Ba, J.: Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014)

  17. Koren, Y.: Factorization meets the neighborhood: a multifaceted collaborative filtering model. In: KDD, pp. 426–434 (2008)

  18. Koren, Y., Bell, R., Volinsky, C.: Matrix factorization techniques for recommender systems. Computer 8, 30–37 (2009)

    Article  Google Scholar 

  19. Krishnamoorthy, S.: Linguistic features for review helpfulness prediction. Expert Syst. Appl. 42(7), 3751–3759 (2015)

    Article  Google Scholar 

  20. Le, H.T., Cerisara, C., Denis, A.: Do convolutional networks need to be deep for text classification? In: AAAI (2018)

  21. Lee, D.D., Seung, H.S.: Algorithms for non-negative matrix factorization. In: NIPS, pp. 556–562 (2001)

  22. Ling, G., Lyu, M.R., King, I.: Ratings meet reviews, a combined approach to recommend. In: RecSys, pp. 105–112 (2014)

  23. Liu, P., Qiu, X., Huang, X.: Adversarial multi-task learning for text classification. arXiv preprint arXiv:1704.05742 (2017)

  24. Liu, Y., Huang, X., An, A., Yu, X.: Modeling and predicting the helpfulness of online reviews. In: ICDM, pp. 443–452 (2008)

  25. Luo, X., Zhou, M., Li, S., You, Z., Xia, Y., Zhu, Q.: A nonnegative latent factor model for large-scale sparse matrices in recommender systems via alternating direction method. TNNLS 27(3), 579–592 (2015)

    MathSciNet  Google Scholar 

  26. McAuley, J., Leskovec, J.: Hidden factors and hidden topics: understanding rating dimensions with review text. In: RecSys, pp. 165–172 (2013)

  27. Mikolov, T., Sutskever, I., Chen, K., Corrado, G.S., Dean, J.: Distributed representations of words and phrases and their compositionality. In: NIPS, pp. 3111–3119 (2013)

  28. Mnih, A., Salakhutdinov, R.R.: Probabilistic matrix factorization. In: NIPS, pp. 1257–1264 (2008)

  29. Mudambi, S.M., Schuff, D.: What makes a helpful review? A study of customer reviews on amazon. com. MIS Q. 34(1), 185–200 (2010)

    Article  Google Scholar 

  30. Ngo-Ye, T.L., Sinha, A.P.: The influence of reviewer engagement characteristics on online review helpfulness: a text regression model. Decis. Support Syst. 61, 47–58 (2014)

    Article  Google Scholar 

  31. Park, S.T., Chu, W.: Pairwise preference regression for cold-start recommendation. In: Proceedings of the third ACM conference on recommender systems, pp. 21–28. ACM (2009)

  32. Qazi, A., Syed, K.B.S., Raj, R.G., Cambria, E., Tahir, M., Alghazzawi, D.: A concept-level approach to the analysis of online review helpfulness. Comput. Hum. Behav. 58, 75–81 (2016)

    Article  Google Scholar 

  33. Seo, S., Huang, J., Yang, H., Liu, Y.: Interpretable convolutional neural networks with dual local and global attention for review rating prediction. In: RecSys, pp. 297–305 (2017)

  34. Seo, S., Huang, J., Yang, H., Liu, Y.: Representation learning of users and items for review rating prediction using attention-based convolutional neural network. In: MLRec (2017)

  35. Singh, J.P., Irani, S., Rana, N.P., Dwivedi, Y.K., Saumya, S., Roy, P.K.: Predicting the “helpfulness” of online consumer reviews. J. Bus. Res. 70, 346–355 (2017)

    Article  Google Scholar 

  36. Srivastava, N., Hinton, G., Krizhevsky, A., Sutskever, I., Salakhutdinov, R.: Dropout: a simple way to prevent neural networks from overfitting. J. Mach. Learn. Res. 15(1), 1929–1958 (2014)

    MathSciNet  MATH  Google Scholar 

  37. Tan, Y., Zhang, M., Liu, Y., Ma, S.: Rating-boosted latent topics: Understanding users and items with ratings and reviews. IJCAI 16, 2640–2646 (2016)

    Google Scholar 

  38. Tang, J., Gao, H., Hu, X., Liu, H.: Context-aware review helpfulness rating prediction. In: RecSys, pp. 1–8 (2013)

  39. Tay, Y., Luu, A.T., Hui, S.C.: Multi-pointer co-attention networks for recommendation. In: KDD, pp. 2309–2318 (2018)

  40. Yang, Z., Yang, D., Dyer, C., He, X., Smola, A., Hovy, E.: Hierarchical attention networks for document classification. In: ACL, pp. 1480–1489 (2016)

  41. Zhang, X., Zhao, J., LeCun, Y.: Character-level convolutional networks for text classification. In: Advances in neural information processing systems, pp. 649–657 (2015)

  42. Zheng, L., Noroozi, V., Yu, P.S.: Joint deep modeling of users and items using reviews for recommendation. In: WSDM, pp. 425–434 (2017)

  43. Zhou, K., Yang, S.H., Zha, H.: Functional matrix factorizations for cold-start recommendation. In: SIGIR, pp. 315–324 (2011)

Download references

Author information

Affiliations

Authors

Corresponding author

Correspondence to Suyu Ge.

Rights and permissions

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Ge, S., Qi, T., Wu, C. et al. Helpfulness-aware review based neural recommendation. CCF Trans. Pervasive Comp. Interact. 1, 285–295 (2019). https://doi.org/10.1007/s42486-019-00023-0

Download citation

Keywords

  • Recommender systems
  • Review helpfulness
  • Hierarchical attention network