Skip to main content

Towards a Wide-Coverage Tableau Method for Natural Logic

Part of the Lecture Notes in Computer Science book series (LNAI,volume 9067)

Abstract

The first step towards a wide-coverage tableau prover for natural logic is presented. We describe an automatized method for obtaining Lambda Logical Forms from surface forms and use this method with an implemented prover to hunt for new tableau rules in textual entailment data sets. The collected tableau rules are presented and their usage is also exemplified in several tableau proofs. The performance of the prover is evaluated against the development data sets. The evaluation results show an extremely high precision above 97 % of the prover along with a decent recall around 40 %.

Keywords

  • Combinatory Categorial Grammar
  • Lambda Logical Form
  • Natural logic
  • Theorem prover
  • Tableau method
  • Textual entailment

This is a preview of subscription content, access via your institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • DOI: 10.1007/978-3-662-48119-6_6
  • Chapter length: 17 pages
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
eBook
USD   54.99
Price excludes VAT (USA)
  • ISBN: 978-3-662-48119-6
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
Softcover Book
USD   69.99
Price excludes VAT (USA)
Fig. 1.
Fig. 2.
Fig. 3.
Fig. 4.
Fig. 5.
Fig. 6.

Notes

  1. 1.

    Hereafter we assume the following standard conventions while writing typed \(\lambda \)-terms: a type of a term is written in a subscript unless it is omitted, a term application is left-associative, and a type constructor comma is right-associative and is ignored if atomic types are single lettered.

  2. 2.

    The latter two constructions have the same semantic types in the approach of [2], who also uses the C&C parser, like us, for obtaining logical forms but of first-order logic. The reason is that both PP and N categories for prepositional phrases and nouns, respectively, are mapped to et type.

  3. 3.

    An importance of the explanations is also shown by the fact that recently SemEval-2015 introduced a pilot task interpretable STS that requires systems to explain their decisions for semantic textual similarity.

  4. 4.

    The connection between LLFs of [12] and the terms of an abstract level was already pointed out by Muskens in the project’s description “Towards logics that model natural reasoning”.

  5. 5.

    Actually the obtained CCG term is not completely a \(\lambda \)-term since it may contain type changes from lexical rules. For instance, in \((\mathbf{several}_{\mathtt{n},\mathtt{n}} \mathbf{delegate}_{\mathtt{n}})_{\mathtt{np}}\) subterm, \((.)_{\mathtt{np}}\) operator changes a type of its argument into \(\mathtt{np}\). Nevertheless, this kind of type changes are accommodated in the \(\lambda \)-term normalization calculus.

  6. 6.

    Implementation of the prover, its computational model and functionality is a separate and extensive work, and it is out of scope of the current paper.

  7. 7.

    The Fracas test suite can be found at http://www-nlp.stanford.edu/~wcmac/downloads, and the SICK trial data at http://alt.qcri.org/semeval2014/task1/index.php?id=data-and-tools.

  8. 8.

    It is not true that mod_n_tr \(_1\) always gives correct conclusions for the constructions similar to (10). In case of small beer glass the rule entails small glass that is not always the case, but this can be avoided in the future by having more fine-grained analysis of phrases (that beer glass is a compound noun), richer semantic knowledge about concepts and more restricted version of the rule; currently rule mod_n_tr \(_1\) can be considered as a default rule for analyzing this kind of constructions.

  9. 9.

    Note that the phrase in (16) is wrongly analyzed by the CCG parser; the correct analysis is \(\mathbf{for}_{\mathtt{np},\mathtt{n},\mathtt{n}} C_\mathtt{np}(\mathbf{nobel}_{\mathtt{n},\mathtt{n}} \mathbf{prize}_{\mathtt{n}})\). Moreover, entailments similar to (16) are not always valid (e.g. \(\mathbf{short}_{\mathtt{n},\mathtt{n}} \big ( \mathbf{man}_{\mathtt{pp},\mathtt{n}} (\mathbf{in}_{\mathtt{np},\mathtt{pp}} \mathbf{netherlands}_\mathtt{np}) \big ) \not \Rightarrow \mathbf{short}_{\mathtt{n},\mathtt{n}} \mathbf{man}_{\mathtt{n}}\)). Since the parser and our implemented filters, at this stage, are not able to give correct analysis of noun complementation and post-nominal modification, we adopt n_pp_mod as a default rule for these constructions.

  10. 10.

    The FraCaS data contains entailment problems requiring deep semantic analysis and it is rarely used for system evaluation. We are aware of a single case of evaluating the system against this data; namely, the NatLog system [9] achieves quite high accuracy on the data but only on problems with a single premise. The comparison of our prover to it must await future research.

References

  1. Bos, J., Clark, S., Steedman, M., Curran, J.R., Hockenmaier, J.: Wide-coverage semantic representations from a CCG parser. In: Proceedings of the 20th International Conference on Computational Linguistics (COLING 2004), pp. 1240–1246 (2004)

    Google Scholar 

  2. Bos, J.: Towards a large-scale formal semantic lexicon for text processing. from form to meaning: processing texts automatically. In: Proceedings of the Biennal GSCL Conference, pp. 3–14 (2009)

    Google Scholar 

  3. Champollioni, L.: Quantification and negation in event semantics. In: Baltic International Yearbook of Cognition, Logic and Communication, vol. 6 (2010)

    Google Scholar 

  4. Clark, S., Curran, J.R.: Wide-coverage efficient statistical parsing with CCG and log-linear models. Comput. Linguist. 33(4), 493–552 (2007)

    CrossRef  Google Scholar 

  5. Cooper, R., Crouch, D., van Eijck, J., Fox, C., van Genabith, J., Jaspars, J., Kamp, H., Milward, D., Pinkal, M., Poesio, M., Pulman, S.: Using the framework. Technical Report LRE 62–051 D-16. The FraCaS Consortium (1996)

    Google Scholar 

  6. Fellbaum, C. (ed.): WordNet: An Electronic Lexical Database. MIT press, Cambridge (1998)

    MATH  Google Scholar 

  7. de Groote, Ph.: Towards abstract categorial grammars. In: Proceedings of the Conference on ACL 39th Annual Meeting and 10th Conference of the European Chapter, pp. 148–155 (2001)

    Google Scholar 

  8. Honnibal, M., Curran, J.R., Bos, J.: Rebanking CCGbank for improved NP interpretation. In: Proceedings of the 48th Meeting of the Association for Computational Linguistics (ACL), pp. 207–215 (2010)

    Google Scholar 

  9. MacCartney, B., Manning, C.D.: Modeling semantic containment and exclusion in natural language inference. In: Proceedings of Coling-2008, Manchester, UK (2008)

    Google Scholar 

  10. Marelli, M., et al.: A sick cure for the evaluation of compositional distributional semantic models. In Proceedings of LREC, Reykjavik (2014)

    Google Scholar 

  11. Muskens, R.: Language, lambdas, and logic. In: Kruijff, G., Oehrle, R. (eds.) Resource-Sensitivity, Binding and Anaphora. Studies in Linguistics and Philosophy, vol. 80, pp. 23–54. Springer, Heidelberg (2003)

    CrossRef  Google Scholar 

  12. Muskens, R.: An analytic tableau system for natural logic. In: Aloni, M., Bastiaanse, H., de Jager, T., Schulz, K. (eds.) Logic, Language and Meaning. LNCS, vol. 6042, pp. 104–113. Springer, Heidelberg (2010)

    CrossRef  Google Scholar 

  13. Steedman, M., Baldridge, J.: Combinatory Categorial Grammar. In: Borsley, R.D., Borjars, K. (eds.) pp. 181–224. Blackwell Publishing (2011)

    Google Scholar 

  14. Winter, Y., Zwarts, J.: Event semantics and abstract categorial grammar. In: Kanazawa, M., Kornai, A., Kracht, M., Seki, H. (eds.) MOL 12. LNCS, vol. 6878, pp. 174–191. Springer, Heidelberg (2011)

    CrossRef  Google Scholar 

Download references

Acknowledgements

I would like to thank Reinhard Muskens for his discussions and continuous feedback on this work. I also thank Matthew Honnibal, James R. Curran and Johan Bos for sharing the retrained CCG parser and anonymous reviewers of LENLS11 for their valuable comments. The research is part of the project “Towards Logics that Model Natural Reasoning” and supported by the NWO grant (project number 360-80-050).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Lasha Abzianidze .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and Permissions

Copyright information

© 2015 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Abzianidze, L. (2015). Towards a Wide-Coverage Tableau Method for Natural Logic. In: Murata, T., Mineshima, K., Bekki, D. (eds) New Frontiers in Artificial Intelligence. JSAI-isAI 2014. Lecture Notes in Computer Science(), vol 9067. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-662-48119-6_6

Download citation

  • DOI: https://doi.org/10.1007/978-3-662-48119-6_6

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-662-48118-9

  • Online ISBN: 978-3-662-48119-6

  • eBook Packages: Computer ScienceComputer Science (R0)