A Temporal Topic Model for Noisy Mediums

Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10938)


Social media and online news content are increasing rapidly. The goal of this work is to identify the topics associated with this content and understand the changing dynamics of these topics over time. We propose Topic Flow Model (TFM), a graph theoretic temporal topic model that identifies topics as they emerge, and tracks them through time as they persist, diminish, and re-emerge. TFM identifies topic words by capturing the changing relationship strength of words over time, and offers solutions for dealing with flood words, i.e., domain specific words that pollute topics. An extensive empirical analysis of TFM on Twitter data, newspaper articles, and synthetic data shows that the topic accuracy and SNR of meaningful topic words are better than the existing state.


Temporal Topic Models Word Flood Domain-specific Words Ground Truth Topics Previous Time Window 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.



This work was supported by the Massive Data Institute (MDI) at Georgetown University.


  1. 1.
    de Arruda, H.F., da Fontoura Costa, L., Amancio, D.R.: Topic segmentation via community detection in complex networks. CoRR (2015).
  2. 2.
    Bhadury, A., Chen, J., Zhu, J., Liu, S.: Scaling up dynamic topic models. In: WWW. SIAM (2016)Google Scholar
  3. 3.
    Blei, D.M., Lafferty, J.D.: Dynamic topic models. In: ICML. IEEE (2006)Google Scholar
  4. 4.
    Blei, D.M., Lafferty, J.D.: Visualizing topics with multi-word expressions. arXiv e-prints (2009)Google Scholar
  5. 5.
    Blei, D.M., Ng, A.Y., Jordan, M.I.: Latent Dirichlet allocation. J. Mach. Learn. Res. 3, 993–1022 (2003)zbMATHGoogle Scholar
  6. 6.
    Blondel, V.D., Guillaume, J.-L., Lambiotte, R., Lefebvre, E.: Fast unfolding of communities in large networks. J. Stat. Mech. Theor. Exp. 2008(10), P10008 (2008)CrossRefGoogle Scholar
  7. 7.
    Cataldi, M., Di Caro, L., Schifanella, C.: Emerging topic detection on Twitter based on temporal and social terms evaluation. In: MDM-KDD. ACM (2010)Google Scholar
  8. 8.
    Chang, J., Boyd-Graber, J., Wang, C., Gerrish, S., Blei, D.M.: Reading tea leaves: how humans interpret topic models. In: NIPS. AAAI (2009)Google Scholar
  9. 9.
    InternetLiveStats: Twitter usage statistics. Accessed 05 May 2017
  10. 10.
    Kasiviswanathan, S.P., Melville, P., Banerjee, A., Sindhwani, V.: Emerging topic detection using dictionary learning. In: CIKM. ACM (2011)Google Scholar
  11. 11.
    Lafferty, J.D., Blei, D.M.: Correlated topic models. In: NIPS, pp. 147–154. AAAI (2006)Google Scholar
  12. 12.
    Noyes, D.: The top 20 valuable Facebook statistics - updated May 2017. Accessed 05 May 2017
  13. 13.
    Shahnaz, F., Berry, M.W., Pauca, V., Plemmons, R.J.: Document clustering using nonnegative matrix factorization. Inf. Process. Manage. 42, 373–386 (2006)CrossRefGoogle Scholar
  14. 14.
    Sleeman, J., Halem, M., Finin, T., Cane, M., et al.: Modeling the evolution of climate change assessment research using dynamic topic models and cross-domain divergence maps. In: Symposium on AI for Social Good. AAAI (2016)Google Scholar
  15. 15.
    Teh, Y.W., Jordan, M.I., Beal, M.J., Blei, D.M.: Hierarchical Dirichlet processes. J. Am. Stat. Assoc. 101(476), 1566–1581 (2006)MathSciNetCrossRefGoogle Scholar
  16. 16.
    Varol, O., Ferrara, E., Davis, C.A., Menczer, F., Flammini, A.: Online human-bot interactions: detection, estimation, and characterization. In: ICWSM. AAAI (2017)Google Scholar
  17. 17.
    Wang, X., McCallum, A.: Topics over time: a non-Markov continuous-time model of topical trends. In: KDD. ACM (2006)Google Scholar
  18. 18.
    Yan, X., Guo, J., Liu, S., Cheng, X., Wang, Y.: Learning topics in short texts by non-negative matrix factorization on term correlation matrix. In: SDM. SIAM (2013)CrossRefGoogle Scholar

Copyright information

© Springer International Publishing AG, part of Springer Nature 2018

Authors and Affiliations

  1. 1.Georgetown UniversityWashington, D.C.USA

Personalised recommendations