Language Modelling with Dynamic Syntax

  • David Tugwell
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4188)


In this paper we introduce a system for the robust analysis of English using the apporach of Dynamic Syntax, in which the syntactic process is modelled as the word-by-word construction of a semantic representation. We argue that the inherent incrementality of the approach, in contrast with the essentially static assumptions of standard generative grammar, has clear advantages for the task of language modelling. To demonstrate its potential we show that this syntactic approach consistently outperforms a standard trigram model in word recovery tasks on parsable sentences. Furthermore, these results are achieved without recourse to hand-prepared training data.


Mutual Information Syntactic Structure Transition Rule British National Corpus Lexical Rule 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Milward, D.: Dynamic Dependency Grammar. Linguistics and Philosophy 17, 561–605 (1994)CrossRefGoogle Scholar
  2. 2.
    Kempson, R., Meyer-Viol, W., Gabbay, D.: Dynamic Syntax: the flow of language understanding. Blackwell, Oxford (2001)Google Scholar
  3. 3.
    Hausser, R.: Complexity in Left-Associative Grammar. Theoretical Computer Science 106, 283–308 (1992)MATHMathSciNetCrossRefGoogle Scholar
  4. 4.
    Chomsky, N.: Syntactic structures. Mouton, The Hague (1957)Google Scholar
  5. 5.
    Schank, R.C.: Conceptual information processing. Elsevier, Amsterdam (1975)MATHGoogle Scholar
  6. 6.
    Jackendoff, R.: Semantic structures. MIT Press, Cambridge (1990)Google Scholar
  7. 7.
    Goldberg, A.E.: Constructions: a construction grammar approach to argument structure. University of Chicago Press, Chicago (1995)Google Scholar
  8. 8.
    Kilgarriff, A., Tugwell, D.: Sketching words. In: Corréard, M.-H. (ed.) Lexicography and Natural Language Processing: A Festschrift in Honour of B.T.S. Atkins, EURALEX, pp. 125–137Google Scholar
  9. 9.
    Chelba, C., Jelinek, F.: Exploiting syntactic structure for language modeling. In: Proceedings of 36th ACL and 17th COLING, pp. 225–231 (1998)Google Scholar
  10. 10.
    Roark, B.: Probabilistic top-down parsing and language modeling. Computational Linguistics 27(2), 249–276 (2001)MathSciNetCrossRefGoogle Scholar
  11. 11.
    Chen, S.F., Goodman, J.: An empirical study of smoothing techniques for language modeling. In: Proceedings of 34th ACL, pp. 310–318 (1996)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • David Tugwell
    • 1
  1. 1.School of Computer ScienceUniversity of St AndrewsUK

Personalised recommendations