Abstract
Two visual-world eyetracking experiments were conducted to investigate whether, how, and when syntactic and semantic constraints are integrated and used to predict properties of subsequent input. Experiment 1 contrasted auditory German constructions such as, “The hare-nominative eats ... (the cabbage-acc)” versus “The hare-accusative eats ... (the fox-nom),” presented with a picture containing a hare, fox, cabbage, and distractor. We found that the probabilities of the eye movements to the cabbage and fox before the onset of NP2 were modulated by the case-marking of NP1, indicating that the case-marking (syntactic) information and verbs' semantic constraints are integrated rapidly enough to predict the most plausible NP2 in the scene. Using English versions of the same stimuli in active/passive voice (Experiment 2), we replicated the same effect, but at a slightly earlier position in the sentence. We discuss the discrepancies in the two Germanic languages in terms of the ease of integrating information across, or within, constituents.
Similar content being viewed by others
REFERENCES
Altmann, G. T. M., & Kamide, Y. (1999). Incremental interpretation at verbs: Restricting the domain of subsequent reference. Cognition, 73, 247-264.
Altmann, G. T. M., & Steedman, M. J. (1988). Interaction with context during human sentence processing. Cognition, 30(3), 191-238.
Altmann, G. T. M., van Nice, K., Garnham, A., & Henstra, J. A. (1998).Late closure in context. Journal of Memory and Language, 38, 459-484.
Allopenna, P. D., Magnuson, J. S., & Tanenhaus, M. K. (1998). Tracking the time course of spoken word recognition using eye movements: Evidence for continuous mapping models. Journal of Memory and Language, 38, 419-439.
Bader, M., & Lasser, I. (1994). German verb-final clauses and sentence processing: Evidence for immediate attachment. In C., Clifton, Jr., L. Frazier, & K. Rayner (Eds.), Perspectives on Sentence Processing (pp. 225-242). Hillsdale, NJ: Lawrence Erlbaum Associates.
Bever, T. G. (1970). The cognitive basis for linguistic structures. In J. R. Hayes (Ed.), Cognition and the Development of Language, (pp. 273-312). New York, NY: Wiley.
Chambers, C. G., Eberhard, K. M., Filip, H., & Carlson, G. N. (2002). Circumscribing referential domains during real time language comprehension. Journal of Memory and Language, 47, 30-49.
Cooper, R. M. (1974). The control of eye fixation by the meaning of spoken language: A new methodology for the real-time investigation of speech perception, memory, and language processing. Cognitive Psychology, 6, 84-107.
Duebel, H., & Schneider, W. X. (1996). Saccade target selection and object recognition: Evidence for a common attentional mechanism. Vision Research, 36, 1827-1837.
Eberhard, K., Spivey-Knowlton, S., Sedivy, J., & Tanenhaus, M. (1995). Eye movements as a window into real-time spoken language processing in natural contexts. Journal of Psycholinguistic Research, 24, 409-436.
Frazier, L. (1979). On Comprehending Sentences: Syntactic Parsing Strategies. Bloomington, IN: IULC.
Hemforth, B., & Konieczny, L. (Eds.) (2000). German Sentence Processing (Studies in Theoretical Psycholinguistics, Vol. 24). Dodrecht: Kluwer Academic Publishers.
Hoffman, J. E., & Surbramaniam, B. (1995). The role of visual attention in saccadic eye movements. Perception & Psychophysics, 57, 787-795.
Kako, E., & Trueswell, J. C. (2000). Verb meanings, object affordances, and the incremental restriction of reference. Proceedings of the 22nd Annual Conference of the Cognitive Science Society (pp. 256-261). Hillsdale, NJ: Lawrence Erlbaum Associates.
Kamide, Y., Altmann, G. T. M., & Haywood, S. (in press) Prediction and thematic information in incremental sentence processing: Evidence from anticipatory eye movements. Journal of Memory and Language.
Kamide, Y., & Mitchell, D. C. (1999). Incremental pre-head attachment in Japanese parsing. Language and Cognitive Processes, 14, 631-662.
Koh, S. (1997). The resolution of the dative NP ambiguity in Korean. Journal of Psycholinguistic Research, 26, 265-273.
Kowler, E., Anderson, E., Dosher, B., & Blaser, E. (1995). The role of attention in the programming of saccades. Vision Research, 35, 1897-1916.
MacDonald, M. C., Pearlmutter, N. J., & Seidenberg, M. S. (1994). The lexical nature of syntactic ambiguity resolution. Psychological Review, 101, 676-703.
Marlsen-Wilson, W. D. (1975). Speech perception as an interactive parallel process. Science, 189, 226-228.
Mitchell, D. C. (1987). Lexical guidance in human parsing: Locus and processing characteristics. In M. Coltheart (Ed.), Attention and Performance, XII (pp. 601-618). Hillsdale, NJ: Lawrence Erlbaum Associates.
Pollard, C., & Sag, I. A. (1987). Information-Based Syntax and Semantics. CSLS lecture notes (No. 13). Stanford: Centre for the Study of Language and Information, 1.
Pollard, C., & Sag, I. A. (1994). Head-Driven Phrase Structure Grammar. Chicago, London: University of Chicago Press and CSLI Publications.
Pritchett, B. L. (1991). Head position and parsing ambiguity. Journal of Psycholinguistic Research, 20, 251-270.
Pritchett, B. L. (1992). Grammatical Competence and Parsing Performance. Chicago: University of Chicago Press.
Rayner, K., Monkie, G. W., & Ehrlich, S. F. (1978). Eye movements and integrating information across fixations. Journal of Experimental Psychology: Human Perception and Performance, 4, 529-544.
Remington, R. W. (1980). Attention and saccadic eye movements. Journal of Experimental Psychology: Human Perception and Performance, 6, 726-744.
Scheepers, C., Kamide, Y., & Altmann, G. T. M.(in prep.) The integration of verb restrictions and case information in projecting upcoming arguments in German: Evidence from anticipatory eye movements.
Sedivy, J. C., Tanenhaus, M. K., Chambers, C. G., & Carlson, G. N. (1999). Achieving incremental semantic interpretation through contextual representation. Cognition, 71, 109-148.
Stevenson, S. (1994). Competition and recency in a hybrid network model of syntactic disambiguation. Journal of Psycholinguistic Research, 23, 295-322.
Sussman, R. S., & Sevidy, J. C. (2001, September). Argument structure and the time course of gap-filling processes. Paper presented at the AMLaP-2000 conference, Leiden, Netherlands.
Tanenhaus, M. K., Garnsey, S., & Boland, J. (1990). Combinatory lexical information and language comprehension. In Altmann, G. T. M. (Ed.) Cognitive Models of Speech Processing: Psycholinguistic and Computational Perspectives (pp. 271-408). Cambridge, MA: MIT Press.
Tanenhaus, M. K., Magnuson, J. S., Dahan, D., & Chambers, C. G. (2001). Eye movements and lexical access in spoken-language comprehension: Evaluating a linking hypothesis between fixations and linguistic processing. Journal of Psycholinguistic Research, 29, 557-580.
Tanenhaus, M. K., Spivey-Knowlton, M. J., Eberhard, K. M., & Sedivy, J. C. (1995). Integration of visual and linguistic information in spoken language comprehension. Science, 268(5217),1632-1634.
Townsend, D. J., & Bever, T. G. (2001). Sentence Comprehension: The Integration of Habits and Rules. Cambridge, MA: MIT Press.
Trueswell, J. C., Sekerina, I., Hill, N. M., & Logrip, M. L. (1999). The kindergarten-path effect: Studying on-line sentence processing in young children. Cognition, 73, 89-134.
Trueswell, J. C., Tanenhaus, M. K., & Kello, C. (1993). Verb-specific constraints in sentence processing: Separating effects of lexical preferences from garden-paths. Journal of Experimental Psychology: Learning, Memory & Cognition, 19, 528-553.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Kamide, Y., Scheepers, C. & Altmann, G.T.M. Integration of Syntactic and Semantic Information in Predictive Processing: Cross-Linguistic Evidence from German and English. J Psycholinguist Res 32, 37–55 (2003). https://doi.org/10.1023/A:1021933015362
Issue Date:
DOI: https://doi.org/10.1023/A:1021933015362