Rating Supervised Latent Topic Model for Aspect Discovery and Sentiment Classification in On-Line Review Mining

Conference paper
First Online:
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9880)

Abstract

Topic models have been used for unsupervised joint aspect (or attribute) discovery and sentiment classification in on-line review mining. However in existing methods the straightforward relations between ratings, aspect importance weights and sentiments in reviews are not explicitly exploited. In this paper we propose Rating Supervised Latent Topic Model (RS-LTM) that incorporates these relations into the framework of LDA to fulfill the task. We test the proposed model on a review set crawled from Amazon.com. The preliminary experiment results show that the proposed model outperforms state-of-the-art models by a considerable margin.

Keywords

Aspect discovery Sentiment classification Topic models Review mining 
This is a preview of subscription content, log in to check access.

References

  1. 1.
    Blei, D.M., Ng, A.Y., Jordan, M.I.: Latent dirichlet allocation. J. Mach. Learn. Res. 3, 993–1022 (2003)MATHGoogle Scholar
  2. 2.
    Fahrni, A., Klenner, M.: Old wine or warm beer: target-specific sentiment analysis of adjectives. In: Proceedings of the Symposium on Affective Language in Human and Machine, AISB, pp. 60–63 (2008)Google Scholar
  3. 3.
    Fletcher, J., Patrick, J.: Evaluating the utility of appraisal hierarchies as a method for sentiment classification. In: Proceedings of the Australasian Language Technology Workshop (2005)Google Scholar
  4. 4.
    Guo, H., Zhu, H., Guo, Z., Zhang, X., Su, Z.: Product feature categorization with multilevel latent semantic association. In: Proceedings of the 18th ACM Conference on Information and Knowledge Management, CIKM 2009, pp. 1087–1096. ACM, New York (2009)Google Scholar
  5. 5.
    Heinrich, G.: Parameter estimation for text analysis. Technical report (2005)Google Scholar
  6. 6.
    Hu, M., Liu, B.: Mining and summarizing customer reviews. In: Proceedings of the Tenth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 168–177. ACM (2004)Google Scholar
  7. 7.
    Jo, Y., Oh, A.H.: Aspect and sentiment unification model for online review analysis. In: Proceedings of the Fourth ACM International Conference on Web Search and Data Mining, pp. 815–824. ACM (2011)Google Scholar
  8. 8.
    Li, F., Han, C., Huang, M., Zhu, X., Xia, Y.J., Zhang, S., Yu, H.: Structure-aware review mining and summarization. In: Proceedings of the 23rd International Conference on Computational Linguistics, pp. 653–661. Association for Computational Linguistics (2010)Google Scholar
  9. 9.
    Li, F., Huang, M., Zhu, X.: Sentiment analysis with global topics and local dependency. In: AAAI, vol. 10, pp. 1371–1376 (2010)Google Scholar
  10. 10.
    Lin, C., He, Y.: Joint sentiment/topic model for sentiment analysis. In: Proceedings of the 18th ACM Conference on Information and Knowledge Management, pp. 375–384. ACM (2009)Google Scholar
  11. 11.
    McAuley, J., Leskovec, J.: Hidden factors and hidden topics: understanding rating dimensions with review text, pp. 165–172. ACM Press (2013)Google Scholar
  12. 12.
    McAuley, J., Pandey, R., Leskovec, J.: Inferring networks of substitutable and complementary products. In: Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 785–794. ACM (2015)Google Scholar
  13. 13.
    Mei, Q., Ling, X., Wondra, M., Su, H., Zhai, C.: Topic sentiment mixture: modeling facets and opinions in weblogs. In: Proceedings of the 16th International Conference on World Wide Web, pp. 171–180. ACM (2007)Google Scholar
  14. 14.
    Moghaddam, S., Ester, M.: ILDA: interdependent LDA model for learning latent aspects and their ratings from online product reviews. In: Proceedings of the 34th International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2011, pp. 665–674. ACM, New York (2011)Google Scholar
  15. 15.
    Mukherjee, A., Liu, B.: Aspect extraction through semi-supervised modeling. In: Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics: Long Papers, vol. 1, pp. 339–348. Association for Computational Linguistics (2012)Google Scholar
  16. 16.
    Titov, I., McDonald, R.: Modeling online reviews with multi-grain topic models. In: Proceedings of the 17th International Conference on World Wide Web, pp. 111–120. ACM (2008)Google Scholar
  17. 17.
    Wang, H., Lu, Y., Zhai, C.: Latent aspect rating analysis on review text data: a rating regression approach. In: Proceedings of the 16th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 783–792. ACM (2010)Google Scholar
  18. 18.
    Yu, J., Zha, Z.J., Wang, M., Chua, T.S.: Aspect ranking: identifying important product aspects from online consumer reviews. In: Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies, vol. 1, pp. 1496–1505. Association for Computational Linguistics (2011)Google Scholar
  19. 19.
    Zhai, Z., Liu, B., Xu, H., Jia, P.: Grouping product features using semi-supervised learning with soft-constraints. In: Proceedings of the 23rd International Conference on Computational Linguistics, pp. 1272–1280. Association for Computational Linguistics (2010)Google Scholar
  20. 20.
    Zhai, Z., Liu, B., Xu, H., Jia, P.: Constrained LDA for grouping product features in opinion mining. In: Huang, J.Z., Cao, L., Srivastava, J. (eds.) PAKDD 2011, Part I. LNCS, vol. 6634, pp. 448–459. Springer, Heidelberg (2011)CrossRefGoogle Scholar
  21. 21.
    Zhao, W.X., Jiang, J., Yan, H., Li, X.: Jointly modeling aspects and opinions with a MaxEnt-LDA hybrid. In: Proceedings of the 2010 Conference on Empirical Methods in Natural Language Processing, EMNLP 2010, pp. 56–65. Association for Computational Linguistics, Stroudsburg (2010)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2016

Authors and Affiliations

  1. 1.Japan Advanced Institute of Science and TechnologyNomiJapan

Personalised recommendations