Lydia: A System for Large-Scale News Analysis

  • Levon Lloyd
  • Dimitrios Kechagias
  • Steven Skiena
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3772)


Periodical publications represent a rich and recurrent source of knowledge on both current and historical events. The Lydia project seeks to build a relational model of people, places, and things through natural language processing of news sources and the statistical analysis of entity frequencies and co-locations. Lydia is still at a relatively early stage of development, but it is already producing interesting analysis of significant volumes of text. Indeed, we encourage the reader to visit our website ( to see our analysis of recent news obtained from over 500 daily online news sources.


Natural Language Processing Entity Recognition News Source Human Language Technology Periodical Publication 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
  2. 2.
    Barzilay, R., Elhadad, N., McKeown, K.: Inferring strategies for sentence ordering in multidocument news summarization. Journal of Artifical Intelligence Research (JAIR) 17, 35–55 (2002)MATHGoogle Scholar
  3. 3.
    Frakes, W., Baeza-Yates, R.: Information Retrieval: Data Structures and Algorithms. Prentice-Hall, Englewood Cliffs (1992)Google Scholar
  4. 4.
    Hatzivassiloglou, V., Gravano, L., Maganti, A.: An investigation of linguistic features and clustering algorithms for topical document clustering. In: Proceedings of the 23rd ACM SIGIR Conference on Research and Development in Information Retrieval, Athens, Greece, pp. 224–231 (2000)Google Scholar
  5. 5.
    Hill, W., Stead, L., Rosenstein, M., Furnas, G.: Recommending and evaluating choices in a virtual community of use. In: Proceedings of ACM Conference on Human Factors in Computing Systems(CHI 1995) (1995)Google Scholar
  6. 6.
    Malone, T., Grant, K., Turbak, F., Brobst, S., Cohen, M.: Intelligent information-sharing systems. Communications of the ACM 30, 390–402 (1987)CrossRefGoogle Scholar
  7. 7.
    Manning, C.D., Schutze, H.: Foundations of Statistical Natural Language Processing. MIT Press, Cambridge (2003)Google Scholar
  8. 8.
    McKeown, K., Barzilay, R., Evans, D., Hatzivassiloglou, V., Klavans, J., Nenkova, A., Sable, C., Schiffman, B., Sigelman, S.: Tracking and summarizing news on a daily basis with columbia’s newsblaster. In: Proceedings of HLT 2002 Human Language Technology Conference, San Diego, California, USA (2002)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2005

Authors and Affiliations

  • Levon Lloyd
    • 1
  • Dimitrios Kechagias
    • 1
  • Steven Skiena
    • 1
  1. 1.Department of Computer ScienceState University of New York at Stony BrookStony Brook

Personalised recommendations