Combining Flat and Structured Approaches for Temporal Slot Filling or: How Much to Compress?

  • Qi Li
  • Javier Artiles
  • Taylor Cassidy
  • Heng Ji
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7182)


In this paper, we present a hybrid approach to Temporal Slot Filling (TSF) task. Our method decomposes the task into two steps: temporal classification and temporal aggregation. As in many other NLP tasks, a key challenge lies in capturing relations between text elements separated by a long context. We have observed that features derived from a structured text representation can help compressing the context and reducing ambiguity. On the other hand, surface lexical features are more robust and work better in some cases. Experiments on the KBP2011 temporal training data set show that both surface and structured approaches outperform a baseline bag-of-word based classifier and the proposed hybrid method can further improve the performance significantly. Our system achieved the top performance in KBP2011 evaluation.


Temporal Relation Structure Approach Temporal Expression Time Expression Temporal Aggregation 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Bethard, S., Martin, J.H.: Cu-tmp: Temporal relation classification using syntactic and semantic features. In: SemEval 2007: 4th International Workshop on Semantic Evaluations (2007)Google Scholar
  2. 2.
    Bunescu, R.C., Mooney, R.J.: A shortest path dependency kernel for relation extraction. In: Proc. of the HLT and EMNLP, pp. 724–731 (2005)Google Scholar
  3. 3.
    Chambers, N., Wang, S., Jurafsky, D.: Classifying temporal relations between events. In: Annual Meeting of the Association for Computational Linguistics (ACL), pp. 173–176 (2007)Google Scholar
  4. 4.
    Chang, C.C., Lin, C.J.: LIBSVM: a library for support vector machines (2001)Google Scholar
  5. 5.
    Cheng, Y., Asahara, M., Matsumoto, Y.: Naist.japan: Temporal relation identification using dependency parsed tree. In: Proceedings of the Fourth International Workshop on Semantic Evaluations (SemEval 2007), pp. 245–248 (2007)Google Scholar
  6. 6.
    Cortes, C., Vapnik, V.: Support-vector networks. Machine Learning, 273–297 (1995)Google Scholar
  7. 7.
    Finkel, J.R., Grenager, T., Manning, C.D.: Incorporating non-local information into information extraction systems by gibbs sampling. In: ACL (2005)Google Scholar
  8. 8.
    Grishman, R.: The NYU System for MUC-6 or Where’s the Syntax? In: Proceedings of the MUC-6 workshop (2010)Google Scholar
  9. 9.
    Ji, H., Grishman, R., Dang, H.T., Li, X., Griffitt, K., Ellis, J.: An Overview of the TAC2011 Knowledge Base Population Track. In: Proc. Text Analytics Conference (TAC 2011) (2010)Google Scholar
  10. 10.
    Ling, X., Weld, D.: Temporal information extraction. In: Proceedings of the Twenty Fifth National Conference on Artificial Intelligence (2010)Google Scholar
  11. 11.
    Lodhi, H., Saunders, C., Shawe-Taylor, J., Cristianini, N., Watkins, C.: Text classification using string kernels. The Journal of Machine Learning Research 2, 419–444 (2002)zbMATHGoogle Scholar
  12. 12.
    Marneffe, M.C.D., Maccartney, B., Manning, C.D.: Generating Typed Dependency Parses from Phrase Structure Parses. In: LREC 2006 (2006)Google Scholar
  13. 13.
    Mintz, M., Bills, S., Snow, R., Jurafsky, D.: Distant supervision for relation extraction without labeled data. In: ACL/AFNLP, pp. 1003–1011 (2009)Google Scholar
  14. 14.
    Puşcaşu, G.: Wvali: Temporal relation identification by syntactico-semantic analysis. In: Proceedings of the Fourth International Workshop on Semantic Evaluations (SemEval 2007), pp. 484–487 (2007)Google Scholar
  15. 15.
    Pustejovsky, J., Verhagen, M.: Semeval-2010 task 13: Evaluating events, time expressions, and temporal relations (tempeval-2) (2010)Google Scholar
  16. 16.
    Snow, R., Jurafsky, D., Ng, A.Y.: Learning syntactic patterns for automatic hypernym discovery. In: Advances in Neural Information Processing Systems, vol. 17, pp. 1297–1304 (2005)Google Scholar
  17. 17.
    Verhagen, M., Gaizauskas, R., Schilder, F., Katz, G., Pustejovsky, J.: Semeval2007 task 15: Tempeval temporal relation identification. In: SemEval 2007: 4th International Workshop on Semantic Evaluations (2007)Google Scholar
  18. 18.
    Wu, F., Weld, D.S.: Open Information Extraction using Wikipedia. In: Proc. of the 48th Annual Meeting of the Association for Computational Linguistics (2010)Google Scholar
  19. 19.
    Yoshikawa, K., Riedel, S., Asahara, M., Matsumoto, Y.: Jointly identifying temporal relations with markov logic. In: Proceedings of the Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLP, pp. 405–413 (2009)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2012

Authors and Affiliations

  • Qi Li
    • 1
  • Javier Artiles
    • 1
  • Taylor Cassidy
    • 1
  • Heng Ji
    • 1
  1. 1.Computer Science Department and Linguistics Department, Queens College and Graduate CenterCity University of New YorkNew YorkUSA

Personalised recommendations