A News Analysis and Tracking System

  • Sk. Mirajul Haque
  • Lipika Dey
  • Anuj Mahajan
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5909)


Continuous monitoring of web-based news sources has emerged as a key intelligence task particularly for Homeland Security. We propose a system for web-based news tracking and alerting. Unlike subscription-based alerts, alerting is implemented as a personalized service where the system is trained to recognize potentially important news based on user preferences. Preferences are expressed as combinations of topics and can change dynamically. The system employs Latent Dirichlet Allocation (LDA) for topic discovery and Latent Semantic Indexing (LSI) for alerting.


Latent Dirichlet Allocation News Story News Item Latent Semantic Indexing Training Document 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. 1.
    Yang, Y., Liu, X.: A re-examination of text categorization methods. In: Proceedings of 22nd ACM SIGIR, California (1999)Google Scholar
  2. 2.
    Allan, J., Papka, R., Lavrenko, V.: On-line New Event Detection and Tracking. In: Proceedings of 21st ACM SIGIR, Melbourne (1998)Google Scholar
  3. 3.
    Lloyd, L., Kechagias, D., Skiena, S.: Lydia: A System for Large-Scale News Analysis. In: Consens, M.P., Navarro, G. (eds.) SPIRE 2005. LNCS, vol. 3772, pp. 161–166. Springer, Heidelberg (2005)CrossRefGoogle Scholar
  4. 4.
    Bacan, H., Pandzic, I.S., Gulija, D.: Automated News Item Categorization. In: JSAI (2005)Google Scholar
  5. 5.
    Blei, D.M., Ng, A.Y., Jordan, M.I.: Latent Dirichlet Allocation. Journal of Machine Learning Research 3, 993–1022 (2003)zbMATHCrossRefGoogle Scholar
  6. 6.
    Landauer, T.K., Foltz, P.W., Laham, D.: An Introduction to Latent Semantic Analysis. Discourse Processes 25, 259–284 (1998)CrossRefGoogle Scholar
  7. 7.
    Yamron, J.P., Carp, I., Gillick, L., Lowe, S., Van Mulbregt, P.: Topic Tracking in a News Stream. In: Proceedings of DARPA Broadcast News Workshop (1999)Google Scholar
  8. 8.
    Mori, M., Miura, T., Shioya, I.: Topic Detection and Tracking for News Web Pages. In: IEEE/WIC/ACM International Conference on Web Intelligence, pp. 338–342 (2006)Google Scholar
  9. 9.
    Fukumoto, F., Suzuki, Y.: Topic tracking based on bilingual comparable corpora and semi-supervised clustering. ACM Transactions on Asian Language Information Processing 6(3) (2007)Google Scholar
  10. 10.
    Kuhns, R.J.: A News Analysis System. In: Proc. of 12th International Conference on Computational Linguistics, COLING 1988, vol. 1, pp. 351–355 (1988)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2009

Authors and Affiliations

  • Sk. Mirajul Haque
    • 1
  • Lipika Dey
    • 1
  • Anuj Mahajan
    • 1
  1. 1.TCS Innovation LabsDelhi

Personalised recommendations