A Syntactic Textual Entailment System Based on Dependency Parser

  • Partha Pakray
  • Alexander Gelbukh
  • Sivaji Bandyopadhyay
Conference paper

DOI: 10.1007/978-3-642-12116-6_22

Part of the Lecture Notes in Computer Science book series (LNCS, volume 6008)
Cite this paper as:
Pakray P., Gelbukh A., Bandyopadhyay S. (2010) A Syntactic Textual Entailment System Based on Dependency Parser. In: Gelbukh A. (eds) Computational Linguistics and Intelligent Text Processing. CICLing 2010. Lecture Notes in Computer Science, vol 6008. Springer, Berlin, Heidelberg

Abstract

The development of a syntactic textual entailment system that compares the dependency relations in both the text and the hypothesis has been reported. The Stanford Dependency Parser has been run on the 2-way RTE-3 development set and the dependency relations obtained for a text and hypothesis pair has been compared. Some of the important comparisons are: subject-subject comparison, subject-verb comparison, object-verb comparison and cross subject-verb comparison. Corresponding verbs are further compared using the WordNet. Each of the matches is assigned some weight learnt from the development corpus. A threshold has been set on the fraction of matching hypothesis relations based on the development set. The threshold score has been applied on the RTE-4 gold standard test set using the same methods of dependency parsing followed by comparisons. Evaluation scores obtained on the test set show 54.75% precision and 53% recall for YES decisions and 54.45% precision and 56.2% recall for NO decisions.

Keywords

Textual Entailment Dependency parsing Dependency Relations RTE-3 development set RTE-4 gold standard test set 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Copyright information

© Springer-Verlag Berlin Heidelberg 2010

Authors and Affiliations

  • Partha Pakray
    • 1
  • Alexander Gelbukh
    • 2
  • Sivaji Bandyopadhyay
    • 1
  1. 1.Computer Science and Engineering DepartmentJadavpur UniversityKolkataIndia
  2. 2.Center for Computing ResearchNational Polytechnic InstituteMexico CityMexico

Personalised recommendations