Skip to main content
Log in

The relationship between the frequency and the processing complexity of linguistic structure

  • Published:
Journal of Psycholinguistic Research Aims and scope Submit manuscript

Abstract

In this paper the relative frequencies of the possible resolutions of ambiguities involving noun phrase attachment sites are compared to the results of off-line psycholinguistic measurements of syntactic complexity. A lack of correlation between the two is observed. It is therefore argued that the comprehension system is distinct from what is driving the frequencies in the corpora. A production heuristic separate from the comprehension system is proposed to account for the observed frequencies.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  • Altmann, G., & Steedman, M. (1988). Interaction with context during human sentence Processing.Cognition, 30, 191–238.

    Google Scholar 

  • Anderson, J. R. (1980).Cognitive psychology and its implications. New York: W. H. Freeman.

    Google Scholar 

  • Anderson, J. R. (1983).The architecture of cognition. Cambridge, MA: Harvard University Press.

    Google Scholar 

  • Bever, Thomas G. (1970). The cognitive basis for linguistic structures. In J. R. Hayes (Ed.),Cognition and the development of language (pp. 279–362). New York: Wiley.

    Google Scholar 

  • Carreiras, M., & Clifton, C., Jr. (1993). Relative clause interpretation preferences in Spanish and English.Language and Speech, 36, 353–372.

    Google Scholar 

  • Clifton, C., Jr. (1988, August).Restrictions on late closure: Appearance and reality. Paper presented at the 6th Australian Language and Speech Conference, University of New South Wales, Sydney, Australia.

    Google Scholar 

  • Clifton, C. Jr., Speer, S., & Abney, S. P. (1991). Parsing arguments: Phrase structure and argument structure as determinants of initial parsing decisions.Journal of Memory and Language, 30, 251–271.

    Google Scholar 

  • Corley, M., & Corley, S. (1995).Cross-linguistic and inter-linguistic evidence for the use of statistics in human sentence processing. Unpublished manuscript, University of Exeter, Exeter, England, and University of Edinburgh, Edinburgh, Scotland.

    Google Scholar 

  • Crain, S., & Steedman, M. (1985). On not being led up the garden path: The use of context by the psychological parser. In D. Dowty, L. Karttunen, & A. Zwicky (Eds.),Natural language processing: Psychological, computational and theoretical perspectives (pp. 320–358). Cambridge, UK: Cambridge University Press.

    Google Scholar 

  • Cuetos, F., & Mitchell, D. C. (1988). Cross-linguistic differences in parsing: Restrictions on the use of the late closure strategy in Spanish.Cognition, 30, 73–105.

    Google Scholar 

  • Cuetos, F., Mitchell, D. C., & Corley, M. M. B. (in press). Parsing in different languages. In M. Carreiras, J. Garcia-Albea, & N. Sabastian-Galles (Eds.),Language processing in Spanish. Hillsdale, NJ: Erlbaum.

  • De Vincenzi, M., & Job, R. (1993). Some observations on the universality of the late closure strategy.Journal of Psycholinguistic Research, 22, 189–206.

    Google Scholar 

  • Frazier, L. (1978).On comprehending sentences: Syntactic parsing strategies. Unpublished doctoral dissertation, University of Connecticut, Storrs.

  • Frazier, L. (1987). Sentence processing: A tutorial review. In M. Coltheart (Ed.),Attention and performance XII. Hillsdale, NJ: Erlbaum.

    Google Scholar 

  • Frazier, L., & Rayner, K. (1982). Making and correcting errors during sentence comprehension: Eye movements in the analysis of structurally ambiguous sentences.Cognitive Psychology 14, 178–210.

    Google Scholar 

  • Gibson, E. (1991).A computational theory of human linguistic processing: Memory limitations and processing breakdown, Unpublished doctoral dissertation, Carnegie Mellon University, Pittsburgh.

    Google Scholar 

  • Gibson, E., & Loomis, J. (1994). A corpus analysis of recency preference and predicate proximity. InProceedings of the Sixteenth Annual Conference of the Cognitive Science Society, (pp. 357–362) Atlanta, GA. Hillsdale, NJ: Erlbaum.

    Google Scholar 

  • Gibson, E., & Pearlmutter, N. (1994) A corpus-based analysis of psycholinguistic constraints on prepositional phrase attachment. In C. Clifton, Jr., L. Frazier, & K. Rayner (Eds.),Perspectives in sentence processing (pp. 181–198). Hillsdale, NJ: Erlbaum.

    Google Scholar 

  • Gibson, E., Pearlmutter, N., Canseco-Gonzalez, E., & Hickok, G. (in press). Recency preference in the human sentence processing mechanism.Cognition.

  • Gilboy, E., Sopena, J. M., Clifton, C., Jr., & Frazier, L. (1995). Argument structure and association preferences in Spanish and English complex NPs.Cognition, 54, 131–167.

    Google Scholar 

  • Hawkins, J. A. (1994).A performance theory of order and constituency. Cambridge, UK: Cambridge University Press.

    Google Scholar 

  • Hays, W. (1988).Statistics (4th ed.). Orlando, FL: Holt, Rinehart and Winston.

    Google Scholar 

  • Hindle, D., & Rooth, M. (1993). Structural ambiguity and lexical relations.Computational Linguistics, 9, 103–120.

    Google Scholar 

  • Hobbs, J. R., & Bear, J. (1990). Two principles of parse preference. InProceedings of the Thirteenth International Conference on Computational Linguistics (vol. 3, pp. 162–167). University of Helsinki.

  • Juliano, C., & Tanenhaus, M. K. (1994). A constraint-based lexical account of the subject/object attachment preference.Journal of Psycholinguistic Research, 23, 459–472.

    Google Scholar 

  • Kimball, J. (1973). Seven principles of surface structure parsing in natural language.Cognition 2, 15–47.

    Google Scholar 

  • Kučera, H., & Francis, W. N. (1967).Computational analysis of present day American English. Providence, RI: Brown University Press.

    Google Scholar 

  • MacDonald, M. C. (1993). The interaction of lexical and syntactic ambiguity.Journal of Memory and Language, 32, 692–715.

    Google Scholar 

  • MacDonald, M. C., Pearlmutter, N., & Seidenberg, M. (1994). The lexical nature of syntactic ambiguity resolution.Psychological Review, 101, 676–703.

    Google Scholar 

  • Marcus, M. P., Santorini, B., & Marcinkiewicz, M. A. (1993). Building a large annotated corpus of English: The Penn Treebank.Computational Linguistics, 19, 313–330.

    Google Scholar 

  • Merlo, P. (1994). A corpus-based analysis of verb-continuation frequencies for syntactic processing.Journal of Psycholinguistic Research, 23, 435–458.

    Google Scholar 

  • McClelland, J. L., & Rumelhart, D. E. (1981). An interactive model of context effects in letter perception: I. An account of basic findings.Psychological Review, 88, 375–407.

    Google Scholar 

  • Mitchell, D. C. (1994). Sentence parsing. In M. A. Gernsbacher (Ed.),Handbook of psycholinguistics (pp. 375–409). New York: Academic Press.

    Google Scholar 

  • Mitchell, D. C., & Cuetos, F. (1991). The origins of parsing strategies.Conference proceedings: Current issues in natural language processing, (pp. 1–12). Austin: University of Texas at Austin, CT.

    Google Scholar 

  • Mitchell, D. C., Cuetos, F., & Corley, M. M. B. (1992, March).Statistical versus linguistic determinants of parsing bias: Cross-linguistic evidence. Paper presented at the 5th annual CUNY Conference on Sentence Processing, New York.

  • Mitchell, D. C., Cuetos, F., Corley, M. M. B., & Brysbaert, M. (1995).Exposure-based models of human parsing: Evidence for the use of coarse-grained (non-lexical) statistical records. Unpublished manuscript, University of Exeter, Exeter, England.

    Google Scholar 

  • Rayner, K., Carlson, M., & Frazier, L. (1983)The interaction of syntax and semantics during sentence processing: Eye movements in the analysis of semantically biased sentences.Journal of Verbal Learning and Verbal Behavior, 22, 358–374.

    Google Scholar 

  • Ross, J. R. (1968).Universal constraints on variables. Unpublished doctoral dissertation, MIT.

  • Spivey-Knowlton, M., & Sedivy, J. (1995). Resolving attachment ambiguities with multiple constraints.Cognition, 55, 227–267.

    Google Scholar 

  • Taraban, R., & McClelland, J. R. (1988). Constituent attachment and thematic role assignment in sentence processing: Influences of content-based expectations.Journal of Memory and Language, 27, 597–632.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Edward Gibson.

Additional information

We would like to thank Susanne Tunstall for providing linguistic judgments in the corpus analyses reported in Sec. 3.3. We also wish to thank the following people for helpful, comments and discussions on earlier presentations of this paper: the audience at the Eighth Human Sentence Processing Conference, in Tucson Arizona, Maria Babyonyshev, Tom Bever, Martin Corley, Danny Fox, Don Mitchell, Edson Miyamoto, Janet Nicol, Colin Phillips, Gregg Solomon, Michael Spivey-Knowlton, James Thomas, and Tom Wasow. All remaining errors are our own. The second author was supported by the Research Training Grant “Language: Acquisition and Computation” awarded by the National Science Foundation (U.S.) to the Massachusetts Institute of Technology (DIR 9113607), and by a fellowship from the Social Sciences and Humanities Research Council of Canada.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Gibson, E., Schütze, C.T. & Salomon, A. The relationship between the frequency and the processing complexity of linguistic structure. J Psycholinguist Res 25, 59–92 (1996). https://doi.org/10.1007/BF01708420

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1007/BF01708420

Keywords

Navigation