Answer Validation Using Textual Entailment

  • Partha Pakray
  • Alexander Gelbukh
  • Sivaji Bandyopadhyay
Conference paper

DOI: 10.1007/978-3-642-19437-5_29

Volume 6609 of the book series Lecture Notes in Computer Science (LNCS)
Cite this paper as:
Pakray P., Gelbukh A., Bandyopadhyay S. (2011) Answer Validation Using Textual Entailment. In: Gelbukh A. (eds) Computational Linguistics and Intelligent Text Processing. CICLing 2011. Lecture Notes in Computer Science, vol 6609. Springer, Berlin, Heidelberg

Abstract

We present an Answer Validation System (AV) based on Textual Entailment and Question Answering. The important features used to develop the AV system are Lexical Textual Entailment, Named Entity Recognition, Question-Answer type analysis, chunk boundary module and syntactic similarity module. The proposed AV system is rule based. We first combine the question and the answer into Hypothesis (H) and the Supporting Text as Text (T) to identify the entailment relation as either “VALIDATED” or “REJECTED”. The important features used for the lexical Textual Entailment module in the present system are: WordNet based unigram match, bigram match and skip-gram. In the syntactic similarity module, the important features used are: subject-subject comparison, subject-verb comparison, object-verb comparison and cross subject-verb comparison. The results obtained from the answer validation modules are integrated using a voting technique. For training purpose, we used the AVE 2008 development set. Evaluation scores obtained on the AVE 2008 test set show 66% precision and 65% F-Score for “VALIDATED” decision.

Keywords

Answer Validation Exercise (AVE) Textual Entailment (TE) Named Entity (NE) Chunk Boundary Syntactic Similarity Question Type 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Copyright information

© Springer-Verlag Berlin Heidelberg 2011

Authors and Affiliations

  • Partha Pakray
    • 1
  • Alexander Gelbukh
    • 2
  • Sivaji Bandyopadhyay
    • 1
  1. 1.Computer Science and Engineering DepartmentJadavpur UniversityKolkataIndia
  2. 2.Center for Computing ResearchNational Polytechnic InstituteMexico CityMexico