Abstract
We describe the foundations and the systematization of natural logic-like monotonic inference using unscoped episodic logical forms (ULFs) that as reported by Kim et al. (Proceedings of the 1st and 2nd Workshops on Natural Logic Meets Machine Learning (NALOMA), Groningen, 2021a, b) introduced and first evaluated. In addition to providing a more detailed explanation of the theory and system, we present results from extending the inference manager to address a few of the limitations that as reported by Kim et al. (Proceedings of the 1st and 2nd Workshops on Natural Logic Meets Machine Learning (NALOMA), Groningen, 2021b) naive system has. Namely, we add mechanisms to incorporate lexical information from the hypothesis (or goal) sentence, enable the inference manager to consider multiple possible scopings for a single sentence, and match against the goal using English rather than the ULF.
Similar content being viewed by others
Notes
We use “goal-directed inference” here as an umbrella term for any inference method that uses knowledge of the goal in the search process.
Some other notable variations of Natural Logic are described by Lavalle-Martínez et al. (2017).
The computation of global polarity via local entailment context propagation and irrelevant polarity marking symbols are omitted for brevity and clarity.
The version 0.2.0 release and the benepar_en3 model available at https://github.com/nikitakit/self-attentive-parser/.
The transduction rules are written in a combination of the tree-to-tree transduction language (Purtee & Schubert, 2012) and a simplified variant.
This is available through the Natural Logic component of Stanford CoreNLP.
For example, in positive contexts, the may be replaced with a, as in, I saw the dog \(\Rightarrow \) I saw a dog. The imposes a flat entailment context on its restrictor whereas a imposes a positive entailment context which warrants a fresh computation of the global polarity markings.
References
Abzianidze, L. (2016). Natural solution to fracas entailment problems. In: Proceedings of the Fifth Joint Conference on Lexical and Computational Semantics, (pp. 64–74).
Angeli, G., & Manning, C.D. (2014). NaturalLI: Natural logic inference for common sense reasoning. In: Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), (pp. 534–545). Association for Computational Linguistics, Doha, Qatar. https://doi.org/10.3115/v1/D14-1059. https://aclanthology.org/D14-1059
Barker, C. (2021) . Rethinking scope islands. Linguistic Inquiry, 1–55. https://doi.org/10.1162/ling_a_00419https://direct.mit.edu/ling/article-pdf/doi/10.1162/ling_a_00419/1889100/ling_a_00419.pdf
Barker, C. (2015). Scope. In S. Lappin & C. Fox (Eds.), Handbook of Contemporary Semantics (2nd ed., pp. 40–76). Wiley Blackwell.
Burge, T. (1977). Belief de re. The Journal of Philosophy, 74(6), 338–362.
Chen, Z., Gao, Q., Moss, L.S.: NeuralLog: Natural language inference with joint neural and logical reasoning. In: Proceedings of *SEM 2021: The Tenth Joint Conference on Lexical and Computational Semantics, (pp. 78–88). Association for Computational Linguistics, Online (2021). https://doi.org/10.18653/v1/2021.starsem-1.7. https://aclanthology.org/2021.starsem-1.7
Chen, Z., & Gao, Q. (2022). Probing linguistic information for logical inference in pre-trained language models. Proceedings of the AAAI Conference on Artificial Intelligence, 36(10), 10509–10517. https://doi.org/10.1609/aaai.v36i10.21294
Cooper, R., Crouch, D., Eijck, J.V., Fox, C., Genabith, J.V., Jaspars, J., Kamp, H., Milward, D., Pinkal, M., Poesio, M., & Pulman, S. (1996). Using the framework. Technical Report LRE 62-051 D-16, The FraCaS Consortium
Donnellan, K. S. (1966). Reference and definite descriptions. The philosophical review, 75(3), 281–304.
Fodor, J., & Sag, I. (1982). Referential and quantificational indefinites. Linguistics and Philosophy, 5, 355–398.
Gordon, J., & Schubert, L. (2010). Quantificational sharpening of commonsense knowledge. In: Proceedings of the AAAI 2010 Fall Symposium on Commonsense Knowledge.
Haruta, I., Mineshima, K., & Bekki, D. (2020). Combining event semantics and degree semantics for natural language inference. In: Proceedings of the 28th International Conference on Computational Linguistics, (pp. 1758–1764). International Committee on Computational Linguistics, Barcelona, Spain (Online). https://doi.org/10.18653/v1/2020.coling-main.156. https://aclanthology.org/2020.coling-main.156
Hu, H., Chen, Q., & Moss, L. (2019). Natural language inference with monotonicity. In: Proceedings of the 13th International Conference on Computational Semantics - Short Papers, (pp. 8–15). Association for Computational Linguistics, Gothenburg, Sweden. https://doi.org/10.18653/v1/W19-0502. https://aclanthology.org/W19-0502
Kalouli, A.-L., Crouch, R., & Paiva, V. (2020). Hy-NLI: a hybrid system for natural language inference. In: Proceedings of the 28th International Conference on Computational Linguistics, (pp. 5235–5249). International Committee on Computational Linguistics, Barcelona, Spain (Online). https://doi.org/10.18653/v1/2020.coling-main.459. https://aclanthology.org/2020.coling-main.459
Kim, G.L., & Schubert, L. (2019). A type-coherent, expressive representation as an initial step to language understanding. In: Proceedings of the 13th International Conference on Computational Semantics - Long Papers, (pp. 13–30). Association for Computational Linguistics, Gothenburg, Sweden. https://doi.org/10.18653/v1/W19-0402. https://aclanthology.org/W19-0402
Kim, G., Duong, V., Lu, X., & Schubert, L. (2021). A transition-based parser for unscoped episodic logical forms. In: Proceedings of the 14th International Conference on Computational Semantics (IWCS), (pp. 184–201). Association for Computational Linguistics, Groningen, The Netherlands (online). https://aclanthology.org/2021.iwcs-1.18
Kim, G., Juvekar, M., & Schubert, L. (2021). Monotonic inference for underspecified episodic logic. In: Proceedings of the 1st and 2nd Workshops on Natural Logic Meets Machine Learning (NALOMA), (pp. 26–40). Association for Computational Linguistics, Groningen, the Netherlands (online). https://aclanthology.org/2021.naloma-1.5
Kim, G., Juvekar, M., Ekmekciu, J., Duong, V., & Schubert, L. (2021). A (mostly) symbolic system for monotonic inference with unscoped episodic logical forms. In: Proceedings of the 1st and 2nd Workshops on Natural Logic Meets Machine Learning (NALOMA), (pp. 71–80). Association for Computational Linguistics, Groningen, the Netherlands (online). https://aclanthology.org/2021.naloma-1.9
Kim, G., Kane, B., Duong, V., Mendiratta, M., McGuire, G., Sackstein, S., Platonov, G., & Schubert, L. (2019). Generating discourse inferences from unscoped episodic logical formulas. In: Proceedings of the First International Workshop on Designing Meaning Representations, (pp. 56–65). Association for Computational Linguistics, Florence, Italy. https://doi.org/10.18653/v1/W19-3306. https://aclanthology.org/W19-3306
Kitaev, N., & Klein, D. (2018). Constituency parsing with a self-attentive encoder. In: Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), (pp. 2676–2686). Association for Computational Linguistics, Melbourne, Australia. https://doi.org/10.18653/v1/P18-1249. https://aclanthology.org/P18-1249
Lambek, J. (1988). Categorial and categorical grammars. In: Categorial Grammars and Natural Language Structures, (pp. 297–317). Springer
Lavalle-Martínez, J.-d.-J., Montes-y-Gómez, M., Villaseñor-Pineda, L., Jiménez-Salazar, H., & Bárcenas-Patiño, I.-E. (2017). Equivalences among polarity algorithms. Studia Logica.
MacCartney, B., & Manning, C.D. (2008). Modeling semantic containment and exclusion in natural language inference. In: Proceedings of the 22nd International Conference on Computational Linguistics (Coling 2008), (pp. 521–528). Coling 2008 Organizing Committee, Manchester, UK. https://aclanthology.org/C08-1066
Miller, G. A. (1995). WordNet: A lexical database for english. Communications of the ACM, 38(11), 39–41. https://doi.org/10.1145/219717.219748
Mineshima, K., Martínez-Gómez, P., Miyao, Y., & Bekki, D. (2015). Higher-order logical inference with compositional semantics. In: Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing, (pp. 2055–2061).
Nayak, N., Kowarsky, M., Angeli, G., & Manning, C.D. (2014). A dictionary of nonsubsective adjectives. Technical Report CSTR 2014-04, Department of Computer Science, Stanford University. https://hci.stanford.edu/cstr/reports/2014-04.pdf
Park, J.C. (1995). Quantifier scope and constituency. In: 33rd Annual Meeting of the Association for Computational Linguistics, (pp. 205–212). Association for Computational Linguistics, Cambridge, Massachusetts, USA. https://doi.org/10.3115/981658.981686. https://aclanthology.org/P95-1028
Purtee, A., Schubert, L. (2012). TTT: A tree transduction language for syntactic and semantic processing. In: Proceedings of the Workshop on Applications of Tree Automata Techniques in Natural Language Processing. ATANLP ’12, (pp. 21–30). Association for Computational Linguistics, Stroudsburg, PA, USA.
Rozanova, J., Ferreira, D., Thayaparan, M., Valentino, M., & Freitas, A. (2022). Decomposing natural logic inferences for neural NLI. In: Proceedings of the Fifth BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP, (pp. 394–403). Association for Computational Linguistics, Abu Dhabi, United Arab Emirates (Hybrid). https://aclanthology.org/2022.blackboxnlp-1.33
Ruys, E.G., & Winter, Y. (2011). Quantifier scope in formal linguistics. In: Handbook of Philosophical Logic, (pp. 159–225). Springer. https://doi.org/10.1007/978-94-007-0479-4_3
Sánchez Valencia, V. (1991). Categorial Grammar and Natural Logic. Logic, Philosophy and Linguistics (LP) Series: ILTI Prepublication.
Sánchez-Valencia, V. (1991). Studies on natural logic and categorial grammar. University of Amsterdam.
Schubert, L. (2002). Can we derive general world knowledge from texts? In: Proceedings of the Second International Conference on Human Language Technology Research. HLT ’02, (pp. 94–97). Morgan Kaufmann Publishers Inc., San Francisco, CA, USA. http://dl.acm.org/citation.cfm?id=1289189.1289263
Schubert, L. (2014). From treebank parses to episodic logic and commonsense inference. In: Proceedings of the ACL 2014 Workshop on Semantic Parsing, (pp. 55–60). Association for Computational Linguistics, Baltimore, MD. http://www.aclweb.org/anthology/W14-2411
Schubert, L., & Tong, M. (2003). Extracting and evaluating general world knowledge from the brown corpus. In: Proceedings of the HLT-NAACL 2003 Workshop on Text Meaning, (pp. 7–13). https://aclanthology.org/W03-0902
Schubert, L. K. (2000). The situations we talk about. In J. Minker (Ed.), Logic-based Artificial Intelligence (pp. 407–439). Kluwer Academic Publishers.
Tian, R., Miyao, Y., & Matsuzaki, T. (2014). Logical inference on dependency-based compositional semantics. In: Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), (pp. 79–89). Association for Computational Linguistics, Baltimore, Maryland. https://doi.org/10.3115/v1/P14-1008. https://aclanthology.org/P14-1008
Van Benthem, J. (1986). Essays in logical semantics. Studies in Linguistics and Philosophy, vol. 29. Springer.
Acknowledgements
This work was supported by NSF EAGER grant NSF IIS-1908595, DARPA CwC subcontract W911NF-15-1-0542, and a Sproull Graduate Fellowship from the University of Rochester.
Funding
The authors have not disclosed any funding.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflicts of interest
The authors have not disclosed any conflict of interests.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
The code is available at https://github.com/genelkim/ulf-jolli-si-2023.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Kim, G.L., Juvekar, M., Ekmekciu, J. et al. Monotonic Inference with Unscoped Episodic Logical Forms: From Principles to System. J of Log Lang and Inf 33, 69–88 (2024). https://doi.org/10.1007/s10849-023-09412-2
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10849-023-09412-2