A Model for Anticipatory Event Detection

  • Qi He
  • Kuiyu Chang
  • Ee-Peng Lim
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4215)


Event detection is a very important area of research that discovers new events reported in a stream of text documents. Previous research in event detection has largely focused on finding the first story and tracking the events of a specific topic. A topic is simply a set of related events defined by user supplied keywords with no associated semantics and little domain knowledge. We therefore introduce the Anticipatory Event Detection (AED) problem: given some user preferred event transition in a topic, detect the occurence of the transition for the stream of news covering the topic. We confine the events to come from the same application domain, in particular, mergers and acquisitions. Our experiments showed that classical cosine similarity method fails for the AED task, whereas our conceptual model-based approach, through the use of domain knowledge and named entity type assignments, seems promising. We show experimentally that an AED voting classifier operating on a vector representation with name entities replaced by types performed AED successfully.


False Alarm News Article Cosine Similarity Novelty Detection Content Method 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    He, Q., Chang, K., Lim, E.P.: Anticipatory event detection via sentence classification. In: IEEE SMC Conf. (to appear, 2006)Google Scholar
  2. 2.
    Google: Google news alerts, http://www.google.com/alerts
  3. 3.
    Allan, J.: Topic Detection and Tracking. Event-based Information Organization. Kluwer Academic Publishers, Dordrecht (2002)MATHGoogle Scholar
  4. 4.
    Allan, J., Jin, H., Rajman, M., Wayne, C., Gildea, D., Lavrenko, V., Hoberman, R., Caputo, D.: Topic-based novelty detection: Final report. In: DARPA Broadcast News Transcription and Understanding Workshop (1999)Google Scholar
  5. 5.
    Jin, H., Schwartz, R., Sista, S., Walls, F.: Topic tracking for radio, tv broadcast, and newswire. In: DARPA Broadcast News Workshop, pp. 199–204 (1999)Google Scholar
  6. 6.
    Allan, J., Lavrenko, V., Jin, H.: First story detection in tdt is hard. In: 9th ACM CIKM Conf. pp. 374–381 (2000)Google Scholar
  7. 7.
    Stokes, N., Carthy, J.: Combining semantic and syntactic document classifiers to improve first story detection. In: 24th ACM SIGIR Conf. pp. 424–425 (2001)Google Scholar
  8. 8.
    Yang, Y., Zhang, J., Carbonell, J., Jin, C.: Topic-conditioned novelty detection. In: 8th ACM SIGKDD Conf. pp. 688–693 (2002)Google Scholar
  9. 9.
    Brants, T., Chen, F., Farahat, A.: A system for new event detection. In: 26th ACM SIGIR Conf. pp. 330–337 (2003)Google Scholar
  10. 10.
    Kumaran, G., Allan, J.: Text classification and named entities for new event detection. In: 27th ACM SIGIR Conf. pp. 297–304 (2004)Google Scholar
  11. 11.
    Li, Z., Wang, B., Li, M., Ma, W.Y.: A probabilistic model for retrospective news event detection. In: 28th ACM SIGIR Conf. pp. 106–113 (2005)Google Scholar
  12. 12.
    Fukumoto, F., Suzuki, Y.: Event tracking based on domain dependency. In: 23rd ACM SIGIR Conf. pp. 57–64 (2000)Google Scholar
  13. 13.
    Maguitman, A., Leake, D., Reichherzer, T., Menczer, F.: Dynamic extraction topic descriptors and discriminators: towards automatic context-based topic search. In: 13th ACM CIKM Conf. pp. 463–472 (2004)Google Scholar
  14. 14.
    Mei, Q., Zhai, C.: Discovering evolutionary theme patterns from text: an exploration of temporal text mining. In: 11th ACM SIGKDD Conf. pp. 198–207 (2005)Google Scholar
  15. 15.
    Allan, J., Wade, C., Bolivar, A.: Retrieval and novelty detection at the sentence level. In: 26th ACM SIGIR Conf. pp. 314–321 (2003)Google Scholar
  16. 16.
    Nallapati, R., Feng, A., Peng, F., Allan, J.: Event threading within news topics. In: 13th ACM CIKM Conf. pp. 446–453 (2004)Google Scholar
  17. 17.
    Kifer, D., Ben-David, S., Gehrke, J.: Detecting change in data streams. In: 30th VLDB Conf. (2004)Google Scholar
  18. 18.
    Bikel, D.M., Schwartz, R., Weischedel, R.M.: An algorithm that learns what’s in a name. Machine Learning 34(1–3), 211–231(1999)Google Scholar
  19. 19.
    Joachims, T.: Svm-light, http://svmlight.joachims.org/
  20. 20.
    Morik, K., Brockhausen, P., Joachims, T.: Combining statistical learning with a knowledge-based approach - a case study in intensive care monitoring. In: 16th ICML Conf. pp. 268–277 (1999)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Qi He
    • 1
  • Kuiyu Chang
    • 1
  • Ee-Peng Lim
    • 1
  1. 1.School of Computer EngineeringNanyang Technological UniversitySingaporeSingapore

Personalised recommendations