WalkToTopics: Inferring Topic Relations from a Feature Learning Perspective
The increasing number of documents is leading to more and more topics nowadays. Understanding the relations between different topics evolved in documents become more important and challenging for users. Although many topic models have been devoted to analyzing topics, the study of topics’ potential relevances is still largely limited by various difficulties. Hence, we introduce WalkToTopics, an unsupervised topic mining and analysis model, for inferring potential relevances between different topics. Relying on an advanced feature learning technique to automatically summarize topic’s neighborhood features, WalkToTopics can reveal latent relations between different topics. Compared to existing approaches, our model is able to predict the relationship between any two individual topics of documents, and it does not require any prior knowledge of the existing topics’ relations and dictionaries. Moreover, WalkToTopics is a general model that also can work on exploring topic clusters or extracting sentiments, and can be applied to potential applications, such as ideas tracking and opinion summarization. Finally, we conducted two studies for common users and experts which both quantitatively and qualitatively demonstrate the effectiveness of WalkToTopics in helping users’ understanding of hidden relevances between topics on social media.
KeywordsTopic relations Feature learning Random walk Relevance prediction
We thank all the anonymous reviewers for their insightful comments. This work is partially supported by National Natural Science Foundation of China (91546203), the Key Science Technology Project of Shandong Province (2015GGX101046), the Shandong Provincial Natural Science Foundation (ZR2014FM020), Major Scientific and Technological Innovation Projects of Shandong Province, China (No. 2017CXGC0704) and Fundamental Research Fund of Shandong Academy of Sciences (No. 2018:12-16).
- 2.Blei, D.M., Lafferty, J.D.: Dynamic topic models. In: Proceedings of the 23rd International Conference on Machine Learning, pp. 113–120. ACM (2006)Google Scholar
- 4.Cumming, G.: Understanding the New Statistics: Effect Sizes, Confidence Intervals, and Meta-Analysis. Routledge, Abingdon (2013)Google Scholar
- 7.Mcauliffe, J.D., Blei, D.M.: Supervised topic models. In: Advances in Neural Information Processing Systems, pp. 121–128 (2008)Google Scholar
- 8.Mei, Q., Ling, X., Wondra, M., Su, H., Zhai, C.: Topic sentiment mixture: modeling facets and opinions in weblogs. In: Proceedings of the 16th international conference on World Wide Web, pp. 171–180. ACM (2007)Google Scholar
- 14.Wang, X., McCallum, A.: Topics over time: a non-Markov continuous-time model of topical trends. In: Proceedings of the 12th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 424–433. ACM (2006)Google Scholar