Abstract
Textual entailment recognition is one of the basic natural language understanding (NLU) tasks. Understanding the meaning of sentences is a prerequisite before applying any natural language processing (NLP) techniques to automatically recognize the textual entailment. A text entails a hypothesis if and only if the true meaning and intent of the hypothesis follows the text. Classical approaches generally utilize the feature value of each word from word embedding to represent the sentences. In this paper, we propose a new framework to identify the textual entailment relationship between text and hypothesis, thereby introducing a new semantic feature focusing on empirical threshold-based semantic text representation. We employ an element-wise Manhattan distance vector-based feature that can identify the semantic entailment relationship between the text-hypothesis pair. We carried out several experiments on a benchmark entailment classification (SICK-RTE) dataset. We train several machine learning (ML) algorithms applying both semantic and lexical features to classify the text-hypothesis pair as entailment, neutral, or contradiction. Our empirical sentence representation technique enriches the semantic information of the texts and hypotheses found to be more efficient than the classical ones. In the end, our approach significantly outperforms known methods in understanding the meaning of the sentences for the textual entailment classification task.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Dagan, I., Glickman, O., Magnini, B.: The PASCAL recognising textual entailment challenge. In: Quiñonero-Candela, J., Dagan, I., Magnini, B., d’Alché-Buc, F. (eds.) MLCW 2005. LNCS (LNAI), vol. 3944, pp. 177–190. Springer, Heidelberg (2006). https://doi.org/10.1007/11736790_9
Sharma, N., Sharma, R., Biswas, K.K.: Recognizing textual entailment using dependency analysis and machine learning. In: Proceedings of the 2015 Conference of the North American Chapter of the Association for Computational Linguistics: Student Research Workshop, pp. 147–153 (2015)
Almarwani, N., Diab, M.: Arabic textual entailment with word embeddings. In: Proceedings of the Third Arabic Natural Language Processing Workshop, pp. 185–190 (2017)
Kiros, R., et al.: Skip-thought vectors. arXiv preprint arXiv:1506.06726 (2015)
Vaswani, A. et al.: Attention is all you need. arXiv preprint arXiv:1706.03762 (2017)
Devlin, J., Chang, M.-W., Lee, K., Toutanova, K:. Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805 (2018)
Conneau, A., Kiela, D., Schwenk, H., Barrault, L., Bordes, A.: Supervised learning of universal sentence representations from natural language inference data. arXiv preprint arXiv:1705.02364 (2017)
Atabuzzaman, M., Shajalal, M., Aono, M.: Semantic representation of sentences employing an automated threshold. In: 2021 Joint 10th International Conference on Informatics, Electronics & Vision (ICIEV) and 2021 5th International Conference on Imaging, Vision and Pattern Recognition (icIVPR), pp. 1–6. IEEE (2021)
Bar Haim, R., et al.: The second pascal recognising textual entailment challenge. In: Proceedings of the Second PASCAL Challenges Workshop on Recognising Textual Entailment, vol. 7 (2006)
Giampiccolo, D., Magnini, B., Dagan, I., B Dolan, W.: The third pascal recognizing textual entailment challenge. In: Proceedings of the ACL-PASCAL workshop on textual entailment and paraphrasing, pp. 1–9 (2007)
Giampiccolo, D., Dang, H.T., Magnini, B., Dagan, I., Cabrio, E., Dolan, B.: The fourth pascal recognizing textual entailment challenge. In TAC, Citeseer (2008)
Bentivogli, L., Clark, P., Dagan, I., Giampiccolo, D.: The fifth pascal recognizing textual entailment challenge. In: TAC (2009)
Bentivogli, L., Clark, P., Dagan, I., Giampiccolo, D.: The Seventh Pascal Recognizing Textual Entailment Challenge. In TAC, Citeseer (2011)
Dzikovska, M.O., et al.: Semeval-2013 task 7: The joint student response analysis and 8th recognizing textual entailment challenge. Technical report, NORTH TEXAS STATE UNIV DENTON (2013)
Paramasivam, A., Jaya Nirmala, S.: A survey on textual entailment based question answering. J. King Saud Univ.-Comput. Inform. Sci. 34(10), 9644–9653 (2021)
Malakasiotis, P., Androutsopoulos, I.: Learning textual entailment using svms and string similarity measures. In: Proceedings of the ACL-PASCAL Workshop on Textual Entailment and Paraphrasing, pp. 42–47 (2007)
Julio Javier Castillo and Laura Alonso Alemany: An Approach Using Named Entities for Recognizing Textual Entailment. In TAC, Citeseer (2008)
Pakray, P., Bandyopadhyay, S., Gelbukh, A.F.: Lexical based two-way rte system at rte-5. In: TAC (2009)
Basak, R., Naskar, S.K., Pakray, P., Gelbukh, A.: Recognizing textual entailment by soft dependency tree matching. Computación y Sistemas, 19(4), 685–700 (2015)
Renjit, S., Sumam, M.I.: Feature based entailment recognition for malayalam language texts. Int. J. Adv. Comput. Sci. Appl. 13(2) (2022)
Liu, M., Zhang, L., Huijun, H., Nie, L., Dai, J.: A classification model for semantic entailment recognition with feature combination. Neurocomputing 208, 127–135 (2016)
Ghuge, S., Bhattacharya, A.: Survey in textual entailment. Center for Indian Language Technology, retrieved on April (2014)
Bowman, S.R., Angeli, G., Potts, C., Manning, C.D.: A large annotated corpus for learning natural language inference. arXiv preprint arXiv:1508.05326 (2015)
Shajalal, Md., Aono, M.: Semantic textual similarity between sentences using bilingual word semantics. Prog. Artif. Intell. 8(2), 263–272 (2019). https://doi.org/10.1007/s13748-019-00180-4
MMarelli, M., Menini, S., Baroni, M., Bentivogli, L., Bernardi, R., Zamparelli, R.: A sick cure for the evaluation of compositional distributional semantic models. In: Proceedings of the Ninth International Conference on Language Resources and Evaluation (LREC’14), pp. 216–223 (2014)
Bentivogli, L., Bernardi, R., Marelli, M., Menini, S., Baroni, M., Zamparelli, R.: Sick through the semeval glasses. lesson learned from the evaluation of compositional distributional semantic models on full sentences through semantic relatedness and textual entailment. Lang. Resources Eval. 50(1), 95–124, 2016
Shin, T., Razeghi, Y., Logan IV, R.L., Wallace, E., Singh, S. Autoprompt: Eliciting knowledge from language models with automatically generated prompts. arXiv preprint arXiv:2010.15980 (2020)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Shajalal, M., Atabuzzaman, M., Baby, M.B., Karim, M.R., Boden, A. (2023). Textual Entailment Recognition with Semantic Features from Empirical Text Representation. In: M, A.K., et al. Speech and Language Technologies for Low-Resource Languages . SPELLL 2022. Communications in Computer and Information Science, vol 1802. Springer, Cham. https://doi.org/10.1007/978-3-031-33231-9_12
Download citation
DOI: https://doi.org/10.1007/978-3-031-33231-9_12
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-33230-2
Online ISBN: 978-3-031-33231-9
eBook Packages: Computer ScienceComputer Science (R0)