Abstract
Distributional properties of language and the implicit acquisition of knowledge about these properties influences human language processing. Connectionist approaches of sentence processing provide a paradigm that places the role of frequency at the core of psycholinguistic reasoning. We introduce this paradigm and some of its consequences by focusing on simple recurrent networks (Elman 1990) and the processing differences of relative clauses (MacDonald/Christiansen 2002). An effect of frequency that is predicted by connectionist models–but not by classical, computational symbol processing models–is the interference of so-called ›local syntactic coherences‹: embedded sequences that have–if they occur in isolation–a particular interpretation. However, embedded in a complex sentence, this interpretation is incorrect because the preceding context of the global sentence renders it ungrammatical. It has been shown in both reading- and visual world studies that the local, syntactically invalid analysis of such sequences is in fact processed, interferes with the globally correct analysis, and can even influence interpretational processes. This is remarkable since such effects seem to be in conflict with fundamental assumptions about economical language processing. In addition, we show that the amount of ›distraction‹ that the local sequence causes depends on the tendency of the local sequence towards the local analysis, where this tendency was measured by examining corpus data. We take these effects as strong evidence in favour of processing accounts that do not take effects of distributional properties in processing as mere phenomena of ›performance‹ but rather as results of the fundamental mechanisms and processes language acquisition and processing are built on.
Similar content being viewed by others
Literatur
Anderson, John R.: Rules of the mind. Hillsdale, NJ 1993.
Anderson, John R./ Lebiere, Christian: The atomic components of thought. Mahwah. NJ 1998.
Anderson, John R./ Bothell, Daniel/ Byrne, Michael D./ Douglass, Scott/ Lebiere, Christian/ Qin, Yulin: »An Integrated Theory of the Mind«. In: Psychological Review 111/4 (2004), S. 1036–1060.
Auer, Peter: »On-line syntax: Thoughts on the temporality of spoken language«. In: Language Sciences 31 (2009), S. 1–13.
Bever, Thomas G.: »The cognitive basis for linguistic structures«. In: John R. Hayes (Hg.): Cognition and the development of language, Bd. 279. New York, NY 1970, S. 279–362.
Bicknell, Klinton/ Levy, Roger: »A model of local coherence effects in human sentence processing as consequences of updates from bottom-up prior to posterior beliefs«. In: Proceedings of North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL HLT) 2009 conference. Boulder, CO 2009, S. 665–673.
Bicknell, Klinton/ Levy, Roger/ Demberg, Vera: »Correcting the incorrect: Local coherence effects modeled with prior belief update«. In: Proceedings of the 35th Annual Meeting of the Berkeley Linguistics Society (BLS). Berkeley, CA 2010.
Christiansen, Morten H./ Chater, Nick: »Toward a connectionist model of recursion in human linguistic performance«. In: Cognitive Science 23/2 (1999), S. 157–205.
Cooper, Roger M.: »The control of eye fixation by the meaning of spoken language: A new methodology for the real-time investigation of speech perception, memory, and language processing«. In: Cognitive Psychology 6 (1974), S. 84–107.
Corley, Steffan/ Crocker, Matthew W.: »The modular statistical hypothesis: Exploring lexikal category ambiguity«. In: Matthew W. Crocker/ Martin Pickering/ Charles Clifton (Hg.): Architectures and Mechanisms for Language Processing. Cambridge UK 2000, S. 135–16.
Daneman, Meredith/ Carpenter, Patricia A.: »Individual Differences in Working Memory and Reading«. In: Journal of Verbal Learning and Verbal Behaviour 19/4 (1980), S. 450–466.
Elman, Jeffrey L.: »Finding structure in time«. In: Cognitive Science 14 (1990), S. 179–211.
Elman, Jeffrey L.: »Learning and development in neural networks: The importance of starting small«. In: Cognition 48 (1993), S. 71–99.
Elman, Jeffrey L.: »An alternative view of the mental lexicon«. In: Trends in Cognitive Science 8/7 (2004), S. 301–306.
Elman, Jeffrey L.: »On the meaning of words and dinosaur bones: Lexical knowledge without a lexicon«. In: Cognitive Science 33/4 (2009), S. 547–582.
Elman, Jeffrey L./ Bates, Elizabeth A./ Johnson, Mark H./ Karmiloff-Smith, Annette: Rethinking innateness: A connectionist perspective on development. Cambridge MA 1996.
Frazier, Lyn: »Sentence processing: A tutorial review«. In: M. Coltheart (Hg.): Attention and Performance XI. Hillsdale, NJ 1987, S. 559–586.
Frazier, Lyn/ Fodor, Janet D.: »The sausage machine: A new two-stage parsing model«. In: Cognition 6/4 (1978), S. 291–325.
Gibson, Edward: »Linguistic complexity: Locality of syntactic dependencies«. In: Cognition 68 (1998), S. 1–76.
Gibson, Edward: »The Dependency Locality Theory: A Distance-based Theory of Linguistic Complexity«. In: Alec Marantz/ Yasushi Miyashita/ Wayne O’Neil (Hg.): Image, Language, Brain: Papers from the First Mind Articulation Project Symposium. Cambridge, MA 2000.
Gibson, Edward: »The interaction of top-down and bottom-up statistics in the resolution of syntactic category ambiguity«. In: Journal of Memory and Language 54 (2006), S. 363–388.
Gordon, Peter C./ Hendrick, Randall/ Johnson, Marcus: »Memory interference during language processing«. In: Journal of Experimental Psychology: Learning, Memory, and Cognition 27 (2001), S. 1411–1423.
Hale, John T.: »A probabilistic earley parser as a psycholinguistic model«. In: Proceedings of the Second Meeting of the North American Chapter of the Association for Computational Linguistics. Stroudsburg, PA 2001, S. 159–166.
Hale, John T.: »What a rational parser would do«. In: Cognitive Science 35/3 (2011), S. 399–443.
Hawkins, John A.: Efficiency and complexity in grammars. Oxford 2004.
Jurafsky, Dan: »A probabilistic model of lexical and syntactic access and disambiguation«. In: Cognitive Science 20/2 (1996), S. 137–194.
Just, Marcel A./ Carpenter, Patricia A.: »A capacity theory of comprehension: individual differences in working memory«. In: Psycholocigal Review 99/1 (1992), S. 122–149.
King, Jonathan/ Just, Marcel A.: »Individual differences in syntactic processing: the role of working memory«. In: Journal of Memory and Language 30/5 (1991), S. 580–602.
Konieczny, Lars: »The psychological reality of local coherences in sentence processing«. In: Bruno Bara/ Larry Barsalou/ Monica Bucciarelli (Hg.): Proceedings of the 27th Annual Conference of the Cognitive Science Society. Mahwah, NJ 2005, S. 1178–1183.
Konieczny, Lars/ Müller, Daniel/ Baumann, Peter/ Hachmann, Wibke/ Wolfer, Sascha: »Local syntactic coherence interpretation, and how prosody modulates it.« Posterpräsentation auf der 22nd Annual CUNY Conference on Human Sentence Processing. 26.–28. März 2009. Davis, CA 2009b.
Konieczny, Lars/ Müller, Daniel/ Hachmann, Wibke/ Schwarzkopf, Sarah/ Wolfer, Sascha: »Local syntactic coherence interpretation. Evidence from a visual world study«. In: N. A. Taatgen/ H. van Rijn (Hg.): Proceedings of the 31st Annual Conference of the Cognitive Science Society. Austin, TX 2009, S. 1133–1138.
Konieczny, Lars/ Ruh, Nicolas/ Müller, Daniel: »What’s in an error? A closer look at SRNs processing relative clauses«. In: Andrew Howes/ David Peebles/ Richard P. Cooper (Hg.): Proceedings of the 9th International Conference on Cognitive Modeling. Manchester, UK 2009, S. 300–305.
Konieczny, Lars/ Weldle, Helmut/ Wolfer, Sascha/ Müller, Daniel/ Baumann, Peter/ Feldmeth, Anne Karina/ Kühner, David/ Teske, Minkus: »Local coherences interfere with online anaphora resolution. « Posterpräsentation auf der 15th Annual Conference on Architectures and Mechanisms for Language Processing (AMLaP 09). 7.–9. September 2009. Barcelona 2009c.
Kukona, Anuenue/ Tabor, Whitney: »Impulse processing: A dynamical systems model of incremental eye movements in the visual world paradigm«. In: Cognitive Science 35 (2011), S. 1009–1051.
Levy, Roger: »Expectation-based syntactic comprehension«. In: Cognition 106/3 (2008a), S. 1126–1177.
Levy, Roger: »A noisy-channel model of rational human sentence comprehension under uncertain input«. In: Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP). Waikiki/Honululu, Hawai 2008b.
Lewis, Richard L./ Vasishth, Shravan: »An activation-based model of sentence processing as skilled memory retrieval«. In: Cognitive Science 29/3 (2005), S. 375–419.
MacDonald, Maryellen C./ Pearlmutter, Neil J./ Seidenberg, Mark S.: »The lexical nature of syntactic ambiguity resolution«. In: Psychological Review 101 (1994), S. 676–703.
MacDonald, Maryellen C./ Christiansen, Morten H.: »Reassessing Working Memory: Comment on Just and Carpenter (1992) and Waters and Caplan (1996)«. In: Psychological Review 109/1 (2002), S. 35–54.
Müller, Daniel/ Hachmann, Wibke/ Konieczny, Lars: »Local syntactic and semantic coherence in reading«. Posterpräsentation auf der 15th Annual Conference on Architectures and Mechanisms for Language Processing (AMLaP 09), 7.–9. September 2009. Barcelona 2009.
Müller-Feldmeth, Daniel/ Baumann, Peter/ Wolfer, Sascha/ Konieczny, Lars: »A connectionist model of graded effects in local syntactic coherence interpretation«. Posterpräsentation auf der 25th Annual CUNY Conference on Human Sentence Processing. 14.–16. März 2012. New York, NY 2012.
Seidenberg, Mark S./ McClelland, James L.: »A distributed, developmental model of word recognition and naming«. In: Psychological Review 96/4 (1989), S. 523–568.
Spivey, Michael J.: The Continuity of Mind. New York, NY 2007.
Tabor, Whitney: »Lexical Change as Nonlinear Interpolation«. In: J. D. Moore/ J. F. Lehman (Hg.): Proceedings of the 17th Annual Cognitive Science Conference. Hillsdale, NJ 1995.
Tabor, Whitney/ Bruno Galantucci/ Daniel Richardson: »Effects of merely local syntactic coherence on sentence processing«, in: Journal of Memory and Language, 50/4 (2004), S. 355–370.
Trueswell, John C./ Tanenhaus, Michael C.: »Toward a lexicalist framework for constraint-based syntactic ambiguity resolution.«. In: Charles Clifton/ Lyn Frazier/ Keith Rayner (Hg.): Perspectives in Sentence Processing. Hillsdale, NJ 1994, S. 155–179.
Van Dyke, Julie A.: »Interference effects from grammatically unavailable constituents during sentence processing«. In: Journal of Experimental Psychology: Learning, Memory, and Cognition 33/2 (2007), S. 407–430.
van Gelder, Tim: »The dynamical hypothesis in cognitive science«. In: Behavioral and Brain Sciences 21/5 (1998), S. 615–665.
Weldle, Helmut/ Konieczny, Lars/ Müller, Daniel/ Wolfer, Sascha, Baumann, Peter: »Connectionist modeling of situated language processing: Language and meaning acquisition from an embodiment perspective«. In: N. A. Taatgen/ H. van Rijn (Hg.): Proceedings of the 31st Annual Conference of the Cognitive Science Society. Austin, TX 2009, S. 827–832.
Wells, Justine B./ Christiansen, Morten H./ Race, David S./ Acheson, Daniel J./ MacDonald, Maryellen C.: »Experience and sentence processing: Statistical learning and relative clause comprehension«. In: Cognitive Psychology 58 (2009), S. 250–271.
Zwaan, Rolf A./ Madden, Carol J.: »Embodied sentence comprehension«. In: Diane Pecher/ Rolf D. Zwaan (Hg.): Grounding cognition: The role of perception and action in memory, language, and thinking. Cambridge, UK 2005, S. 224–245.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Müller-Feldmeth, D., Konieczny, L. Frequenzeffekte in der Satzverarbeitung. Wie Erfahrung den Erwerb und die Verarbeitung von Sprache beeinflusst. Z Literaturwiss Linguistik 43, 96–121 (2013). https://doi.org/10.1007/BF03379875
Published:
Issue Date:
DOI: https://doi.org/10.1007/BF03379875