Abstract
Coecke et al. (2010) developed a compositional model of meaning for distributional semantics, in which each word in a sentence has a meaning vector and the distributional meaning of the sentence is a function of the tensor products of the word vectors. Abstractly speaking, this function is the morphism corresponding to the grammatical structure of the sentence in the category of finite dimensional vector spaces. In this chapter, we provide a concrete method for implementing this linear meaning map by presenting an algorithm for computing representations for various syntactic classes which have functional types; this algorithm results in assigning concrete corpus-based vector spaces to the abstract type of ‘sentence’. Our construction method is based on structured vector spaces whose basis vectors are pairs of words and grammatical roles. The concrete sentence spaces only depend on the types of the verbs of sentences; we use an embedding of these spaces and compare meanings of sentences with different grammatical structures by simply taking the inner product of their vectors in the bigger space. Our constructions are exemplified on a toy corpus.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsNotes
- 1.
Intransitive and ditransitive verbs are interpreted in an analogous fashion; see Sect. 5.
References
Baroni, M., & Zamparelli, R. (2010). Nouns are vectors, adjectives are matrices: Representing adjective-noun constructions in semantic space. In Conference on empirical methods in natural language processing (EMNLP-10), Cambridge.
Clark, S., & Pulman, S. (2007). Combining symbolic and distributional models of meaning. In Proceedings of AAAI spring symposium on quantum interaction. Menlo Park: AAAI Press.
Coecke, B., Sadrzadeh, M., & Clark, S. (2010). Mathematical foundations for a compositional distributional model of meaning. Linguistic Analysis, 36, 345–384 (Lambek Festschrift). arXiv:1003.4394v1 [cs.CL].
Erk, K., & Padó, S. (2008). A structured vector space model for word meaning in context. In Conference on empirical methods in natural language processing (EMNLP-08), Honolulu, Hawaii (pp. 897–906).
Firth, J. (1957). Papers in linguistics, 1934–1951. London: Oxford University Press.
Frege, G. (1892). Über Sinn und Bedeutung. Zeitschrift fuer Philosophie un philosophische Kritik, 100, 25–50.
Grefenstette, G. (1992). Use of syntactic context to produce term association lists for text retrieval. In N. J. Belkin, P. Ingwersen, & A. M. Pejtersen (Eds.), SIGIR (pp. 89–97). New York: ACM.
Grefenstette, G. (1994). Explorations in automatic thesaurus discovery. Boston: Kluwer Academic.
Harris, Z. (1968). Mathematical structures of language. New York: Wiley-Interscience.
Jurafsky, D., & Martin, J. H. (2000). Speech and language processing: An introduction to natural language processing, computational linguistics, and speech recognition. New York: Prentice Hall.
Lambek, J. (2008). From word to sentence. Monza: Polimetrica.
Landauer, T., & Dumais, S. (1997). A solution to Plato’s problem: The latent semantic analysis theory of acquisition, induction, and representation of knowledge. Psychological Review, 104(2), 211–240.
Manning, C., Raghavan, P., & Schutze, H. (2008). Introduction to information retrieval (Vol. 1). Cambridge: Cambridge University Press.
Mitchell, J., & Lapata, M. (2008). Vector-based models of semantic composition. In Proceedings of the 46th annual meeting of the association for computational linguistics, Columbus (pp. 236–244).
Montague, R. (1970). English as a formal language. In Linguaggi nella societae nella tecnica (pp. 189–224).
Schuetze, H. (1998). Automatic word sense discrimination. Computational Linguistics, 24(1), 97–123.
Smolensky, P., & Legendre, G. (2005). The harmonic mind: From neural computation to optimality-theoretic grammar. Vol. I: Cognitive architecture. Vol. II: Linguistic and philosophical implications. Cambridge: MIT Press.
Widdows, D. (2004). Geometry and meaning. Stanford: CSLI.
Wittgenstein, L. (1953). Philosophical investigations (trans: Anscombe, G. E. M.). Oxford: Blackwell Sci.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer Science+Business Media Dordrecht
About this chapter
Cite this chapter
Grefenstette, E., Sadrzadeh, M., Clark, S., Coecke, B., Pulman, S. (2014). Concrete Sentence Spaces for Compositional Distributional Models of Meaning. In: Bunt, H., Bos, J., Pulman, S. (eds) Computing Meaning. Text, Speech and Language Technology, vol 47. Springer, Dordrecht. https://doi.org/10.1007/978-94-007-7284-7_5
Download citation
DOI: https://doi.org/10.1007/978-94-007-7284-7_5
Publisher Name: Springer, Dordrecht
Print ISBN: 978-94-007-7283-0
Online ISBN: 978-94-007-7284-7
eBook Packages: Computer ScienceComputer Science (R0)