Skip to main content
Log in

Integration of Syntactic and Semantic Information in Predictive Processing: Cross-Linguistic Evidence from German and English

  • Published:
Journal of Psycholinguistic Research Aims and scope Submit manuscript

Abstract

Two visual-world eyetracking experiments were conducted to investigate whether, how, and when syntactic and semantic constraints are integrated and used to predict properties of subsequent input. Experiment 1 contrasted auditory German constructions such as, “The hare-nominative eats ... (the cabbage-acc)” versus “The hare-accusative eats ... (the fox-nom),” presented with a picture containing a hare, fox, cabbage, and distractor. We found that the probabilities of the eye movements to the cabbage and fox before the onset of NP2 were modulated by the case-marking of NP1, indicating that the case-marking (syntactic) information and verbs' semantic constraints are integrated rapidly enough to predict the most plausible NP2 in the scene. Using English versions of the same stimuli in active/passive voice (Experiment 2), we replicated the same effect, but at a slightly earlier position in the sentence. We discuss the discrepancies in the two Germanic languages in terms of the ease of integrating information across, or within, constituents.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

REFERENCES

  • Altmann, G. T. M., & Kamide, Y. (1999). Incremental interpretation at verbs: Restricting the domain of subsequent reference. Cognition, 73, 247-264.

    Google Scholar 

  • Altmann, G. T. M., & Steedman, M. J. (1988). Interaction with context during human sentence processing. Cognition, 30(3), 191-238.

    Google Scholar 

  • Altmann, G. T. M., van Nice, K., Garnham, A., & Henstra, J. A. (1998).Late closure in context. Journal of Memory and Language, 38, 459-484.

    Google Scholar 

  • Allopenna, P. D., Magnuson, J. S., & Tanenhaus, M. K. (1998). Tracking the time course of spoken word recognition using eye movements: Evidence for continuous mapping models. Journal of Memory and Language, 38, 419-439.

    Google Scholar 

  • Bader, M., & Lasser, I. (1994). German verb-final clauses and sentence processing: Evidence for immediate attachment. In C., Clifton, Jr., L. Frazier, & K. Rayner (Eds.), Perspectives on Sentence Processing (pp. 225-242). Hillsdale, NJ: Lawrence Erlbaum Associates.

    Google Scholar 

  • Bever, T. G. (1970). The cognitive basis for linguistic structures. In J. R. Hayes (Ed.), Cognition and the Development of Language, (pp. 273-312). New York, NY: Wiley.

    Google Scholar 

  • Chambers, C. G., Eberhard, K. M., Filip, H., & Carlson, G. N. (2002). Circumscribing referential domains during real time language comprehension. Journal of Memory and Language, 47, 30-49.

    Google Scholar 

  • Cooper, R. M. (1974). The control of eye fixation by the meaning of spoken language: A new methodology for the real-time investigation of speech perception, memory, and language processing. Cognitive Psychology, 6, 84-107.

    Google Scholar 

  • Duebel, H., & Schneider, W. X. (1996). Saccade target selection and object recognition: Evidence for a common attentional mechanism. Vision Research, 36, 1827-1837.

    Google Scholar 

  • Eberhard, K., Spivey-Knowlton, S., Sedivy, J., & Tanenhaus, M. (1995). Eye movements as a window into real-time spoken language processing in natural contexts. Journal of Psycholinguistic Research, 24, 409-436.

    Google Scholar 

  • Frazier, L. (1979). On Comprehending Sentences: Syntactic Parsing Strategies. Bloomington, IN: IULC.

    Google Scholar 

  • Hemforth, B., & Konieczny, L. (Eds.) (2000). German Sentence Processing (Studies in Theoretical Psycholinguistics, Vol. 24). Dodrecht: Kluwer Academic Publishers.

    Google Scholar 

  • Hoffman, J. E., & Surbramaniam, B. (1995). The role of visual attention in saccadic eye movements. Perception & Psychophysics, 57, 787-795.

    Google Scholar 

  • Kako, E., & Trueswell, J. C. (2000). Verb meanings, object affordances, and the incremental restriction of reference. Proceedings of the 22nd Annual Conference of the Cognitive Science Society (pp. 256-261). Hillsdale, NJ: Lawrence Erlbaum Associates.

    Google Scholar 

  • Kamide, Y., Altmann, G. T. M., & Haywood, S. (in press) Prediction and thematic information in incremental sentence processing: Evidence from anticipatory eye movements. Journal of Memory and Language.

  • Kamide, Y., & Mitchell, D. C. (1999). Incremental pre-head attachment in Japanese parsing. Language and Cognitive Processes, 14, 631-662.

    Google Scholar 

  • Koh, S. (1997). The resolution of the dative NP ambiguity in Korean. Journal of Psycholinguistic Research, 26, 265-273.

    Google Scholar 

  • Kowler, E., Anderson, E., Dosher, B., & Blaser, E. (1995). The role of attention in the programming of saccades. Vision Research, 35, 1897-1916.

    Google Scholar 

  • MacDonald, M. C., Pearlmutter, N. J., & Seidenberg, M. S. (1994). The lexical nature of syntactic ambiguity resolution. Psychological Review, 101, 676-703.

    Google Scholar 

  • Marlsen-Wilson, W. D. (1975). Speech perception as an interactive parallel process. Science, 189, 226-228.

    Google Scholar 

  • Mitchell, D. C. (1987). Lexical guidance in human parsing: Locus and processing characteristics. In M. Coltheart (Ed.), Attention and Performance, XII (pp. 601-618). Hillsdale, NJ: Lawrence Erlbaum Associates.

    Google Scholar 

  • Pollard, C., & Sag, I. A. (1987). Information-Based Syntax and Semantics. CSLS lecture notes (No. 13). Stanford: Centre for the Study of Language and Information, 1.

    Google Scholar 

  • Pollard, C., & Sag, I. A. (1994). Head-Driven Phrase Structure Grammar. Chicago, London: University of Chicago Press and CSLI Publications.

    Google Scholar 

  • Pritchett, B. L. (1991). Head position and parsing ambiguity. Journal of Psycholinguistic Research, 20, 251-270.

    Google Scholar 

  • Pritchett, B. L. (1992). Grammatical Competence and Parsing Performance. Chicago: University of Chicago Press.

    Google Scholar 

  • Rayner, K., Monkie, G. W., & Ehrlich, S. F. (1978). Eye movements and integrating information across fixations. Journal of Experimental Psychology: Human Perception and Performance, 4, 529-544.

    Google Scholar 

  • Remington, R. W. (1980). Attention and saccadic eye movements. Journal of Experimental Psychology: Human Perception and Performance, 6, 726-744.

    Google Scholar 

  • Scheepers, C., Kamide, Y., & Altmann, G. T. M.(in prep.) The integration of verb restrictions and case information in projecting upcoming arguments in German: Evidence from anticipatory eye movements.

  • Sedivy, J. C., Tanenhaus, M. K., Chambers, C. G., & Carlson, G. N. (1999). Achieving incremental semantic interpretation through contextual representation. Cognition, 71, 109-148.

    Google Scholar 

  • Stevenson, S. (1994). Competition and recency in a hybrid network model of syntactic disambiguation. Journal of Psycholinguistic Research, 23, 295-322.

    Google Scholar 

  • Sussman, R. S., & Sevidy, J. C. (2001, September). Argument structure and the time course of gap-filling processes. Paper presented at the AMLaP-2000 conference, Leiden, Netherlands.

  • Tanenhaus, M. K., Garnsey, S., & Boland, J. (1990). Combinatory lexical information and language comprehension. In Altmann, G. T. M. (Ed.) Cognitive Models of Speech Processing: Psycholinguistic and Computational Perspectives (pp. 271-408). Cambridge, MA: MIT Press.

    Google Scholar 

  • Tanenhaus, M. K., Magnuson, J. S., Dahan, D., & Chambers, C. G. (2001). Eye movements and lexical access in spoken-language comprehension: Evaluating a linking hypothesis between fixations and linguistic processing. Journal of Psycholinguistic Research, 29, 557-580.

    Google Scholar 

  • Tanenhaus, M. K., Spivey-Knowlton, M. J., Eberhard, K. M., & Sedivy, J. C. (1995). Integration of visual and linguistic information in spoken language comprehension. Science, 268(5217),1632-1634.

    Google Scholar 

  • Townsend, D. J., & Bever, T. G. (2001). Sentence Comprehension: The Integration of Habits and Rules. Cambridge, MA: MIT Press.

    Google Scholar 

  • Trueswell, J. C., Sekerina, I., Hill, N. M., & Logrip, M. L. (1999). The kindergarten-path effect: Studying on-line sentence processing in young children. Cognition, 73, 89-134.

    Google Scholar 

  • Trueswell, J. C., Tanenhaus, M. K., & Kello, C. (1993). Verb-specific constraints in sentence processing: Separating effects of lexical preferences from garden-paths. Journal of Experimental Psychology: Learning, Memory & Cognition, 19, 528-553.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Rights and permissions

Reprints and permissions

About this article

Cite this article

Kamide, Y., Scheepers, C. & Altmann, G.T.M. Integration of Syntactic and Semantic Information in Predictive Processing: Cross-Linguistic Evidence from German and English. J Psycholinguist Res 32, 37–55 (2003). https://doi.org/10.1023/A:1021933015362

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1023/A:1021933015362

Navigation