Memory & Cognition

, Volume 46, Issue 6, pp 864–877 | Cite as

A failure to replicate rapid syntactic adaptation in comprehension

  • Caoimhe M. Harrington Stack
  • Ariel N. James
  • Duane G. Watson


Language comprehension requires successfully navigating linguistic variability. One hypothesis for how listeners manage variability is that they rapidly update their expectations of likely linguistic events in new contexts. This process, called adaptation, allows listeners to better predict the upcoming linguistic input. In previous work, Fine, Jaeger, Farmer, and Qian (PLoS ONE, 8, e77661, 2013) found evidence for syntactic adaptation. Subjects repeatedly encountered sentences in which a verb was temporarily ambiguous between main verb (MV) and reduced relative clause (RC) interpretations. They found that subjects who had higher levels of exposure to the unexpected RC interpretation of the sentences had an easier time reading the RC sentences but a more difficult time reading the MV sentences. They concluded that syntactic adaptation occurs rapidly in unexpected structures and also results in difficulty with processing the previously expected alternative structures. This article presents two experiments. Experiment 1 was designed as a follow-up to Fine et al.’s study and failed to find evidence of adaptation. A power analysis of Fine et al.’s raw data revealed that a similar study would need double the items and four times the subjects to reach 95% power. In Experiment 2 we designed a close replication of Fine et al.’s experiment using these sample size guidelines. No evidence of rapid syntactic adaptation was found in this experiment. The failure to find evidence of adaptation in both experiments calls into question the robustness of the effect.


Sentence processing Syntax Adaptation Replication 


  1. Baayen, R. H. (2008). Analyzing linguistic data: A practical introduction to statistics using R. Cambridge, UK: Cambridge University Press.CrossRefGoogle Scholar
  2. Browne, W. J., Lahi, M. G., & Parker, R. M. (2009). A guide to sample size calculations for random effect models via simulation and the MLPowSim software package. Bristol, UK: University of Bristol.Google Scholar
  3. Buhrmester, M., Kwang, T., & Gosling, S. D. (2011). Amazon’s Mechanical Turk: A new source of inexpensive, yet high-quality, data? Perspectives on Psychological Science, 6, 3–5. CrossRefPubMedGoogle Scholar
  4. Buz, E., Tanenhaus, M. K., & Jaeger, T. F. (2016). Dynamically adapted context-specific hyper-articulation: Feedback from interlocutors affects speakers’ subsequent pronunciations. Journal of Memory and Language, 89, 68–86.CrossRefPubMedPubMedCentralGoogle Scholar
  5. Chang, F. (2002). Symbolically speaking: A connectionist model of sentence production. Cognitive Science, 26, 609–651. CrossRefGoogle Scholar
  6. Chang, F., Dell, G. S., & Bock, K. (2006). Becoming syntactic. Psychological Review, 113, 234–272. CrossRefPubMedGoogle Scholar
  7. Elman, J. L. (1990). Finding structure in time. Cognitive Science, 14, 179–211.CrossRefGoogle Scholar
  8. Farmer, T. A., Fine, A. B., Yan, S., Cheimariou, S., & Jaeger, F. (2014). Error-driven adaptation of higher-level expectations during reading. In P. Bello, M. Guarini, M. McShane, & B. Scassellati (Eds.), Proceedings of the 36h Annual Meeting of the Cognitive Science Society (pp. 2181–2186). Austin, TX: Cognitive Science SocietyGoogle Scholar
  9. Ferreira, F., & Clifton, C., Jr. (1986). The independence of syntactic processing. Journal of Memory and Language, 25, 348–368. CrossRefGoogle Scholar
  10. Fine, A. B., & Jaeger, T. F. (2011). Language comprehension is sensitive to changes in the reliability of lexical cues. In Proceedings of the 33rd Annual Meeting of the Cognitive Science Society, 33, 925–930.Google Scholar
  11. Fine, A. B., & Jaeger, T. F. (2013). Evidence for implicit learning in syntactic comprehension. Cognitive Science, 37, 578–591. CrossRefPubMedGoogle Scholar
  12. Fine, A. B., & Jaeger, T. F. (2016). The role of verb repetition in cumulative structural priming in comprehension. Journal of Experimental Psychology: Learning, Memory, and Cognition, 42, 1362–1376.PubMedGoogle Scholar
  13. Fine, A. B., Jaeger, T. F., Farmer, T. A., & Qian, T. (2013). Rapid expectation adaptation during syntactic comprehension. PLoS ONE, 8, e77661. CrossRefPubMedPubMedCentralGoogle Scholar
  14. Fraundorf, S. H., & Jaeger, T. F. (2016). Readers generalize adaptation to newly-encountered dialectal structures to other unfamiliar structures. Journal of Memory and Language, 91, 28–58.CrossRefPubMedPubMedCentralGoogle Scholar
  15. Garnsey, S. M., Pearlmutter, N. J., Myers, E., & Lotocky, M. A. (1997). The contributions of verb bias and plausibility to the comprehension of temporarily ambiguous sentences. Journal of Memory and Language, 37, 58–93. CrossRefGoogle Scholar
  16. Gibson, E., Tan, C., Futrell, R., Mahowald, K., Konieczny, L., Hemforth, B., & Fedorenko, E. (2017). Don’t Underestimate the Benefits of Being Misunderstood. Psychological Science, 28, 703–712.CrossRefPubMedGoogle Scholar
  17. Jaeger, T. F., & Snider, N. E. (2008). Implicit learning and syntactic persistence: Surprisal and cumulativity. In B. C. Love, K. McRae, & V.M. Sloutsky (Eds.), Proceedings of the 30th Annual Cognitive Science Society (pp. 1061–1066). Austin, TX: Cognitive Science Society.Google Scholar
  18. Jaeger, T. F., & Snider, N. E. (2013). Alignment as a consequence of expectation adaptation: Syntactic priming is affected by the prime’s prediction error given both prior and recent experience. Cognition, 127, 57–83. CrossRefPubMedGoogle Scholar
  19. Kleinschmidt, D. F., Fine, A. B., & Jaeger, T. F. (2012). A belief-updating model of adaptation and cue combination in syntactic comprehension. In N. Miyake, D. Peebles, & R.P. Cooper (Eds.), Proceedings of the 34th Annual Meeting of the Cognitive Science Society (pp. 599–604). Austin, TX: Cognitive Science Society.Google Scholar
  20. Kleinschmidt, D. F., & Jaeger, T. F. (2015). Robust speech perception: Recognize the familiar, generalize to the similar, and adapt to the novel. Psychological Review, 122, 148–203. CrossRefPubMedPubMedCentralGoogle Scholar
  21. Kurumada, C., Brown, M., Bibyk, S., Pontillo, D., & Tanenhaus, M. (2014). Rapid adaptation in online pragmatic interpretation of contrastive prosody. In P. Bello, M. Guarini, M. McShane, & B. Scassellati (Eds.), Proceedings of the 36th Annual Meeting of the Cognitive Science Society (pp. 791–796). Austin, TX: Cognitive Science SocietyGoogle Scholar
  22. Liu, L., & Jaeger, T. F. (2018). Inferring causes during speech perception. Cognition, 174, 55–70. CrossRefPubMedGoogle Scholar
  23. Loftus, G. R. (1978). On interpretation of interactions. Memory & Cognition, 6, 312–319. CrossRefGoogle Scholar
  24. MacDonald, M. C., Just, M. A., & Carpenter, P. A. (1992). Working memory constraints on the processing of syntactic ambiguity. Cognitive Psychology, 24, 56–98.CrossRefPubMedGoogle Scholar
  25. MacDonald, M. C., Pearlmutter, N. J., & Seidenberg, M. S. (1994). The lexical nature of syntactic ambiguity resolution. Psychological Review, 101, 676–703. CrossRefPubMedGoogle Scholar
  26. Miikkulainen, R., & Dyer, M. G. (1991). Natural language processing with modular PDP networks and distributed lexicon. Cognitive Science, 15, 343–399.CrossRefGoogle Scholar
  27. Myslin, M., & Levy, R. (2016). Comprehension priming as rational expectation for repetition: Evidence from syntactic processing. Cognition, 147, 29–56.CrossRefPubMedGoogle Scholar
  28. Norris, D., McQueen, J. M., & Cutler, A. (2016). Prediction, Bayesian inference and feedback in speech recognition. Language, Cognition and Neuroscience, 31, 4–18. CrossRefPubMedGoogle Scholar
  29. Rayner, K., Carlson, M., & Frazier, L. (1983). The interaction of syntax and semantics during sentence processing: Eye movements in the analysis of semantically biased sentences. Journal of Verbal Learning and Verbal Behavior, 22, 358–374.CrossRefGoogle Scholar
  30. Rohde, D. L. T., & Plaut, D. C. (1999). Language acquisition in the absence of explicit negative evidence: How important is starting small? Cognition, 72, 67–109. CrossRefPubMedGoogle Scholar
  31. Schnoebelen, T., & Kuperman, V. (2010). Using Amazon Mechanical Turk for linguistic research. Psihologija, 43, 441–464.CrossRefGoogle Scholar
  32. Snedeker, J., & Trueswell, J. C. (2004). The developing constraints on parsing decisions: The role of lexical-biases and referential scenes in child and adult sentence processing. Cognitive Psychology, 49, 238–299.CrossRefPubMedGoogle Scholar
  33. Trueswell, J. C., & Tanenhaus, M. K. (1994). Toward a lexicalist framework of constraint-based syntactic ambiguity resolution. In C. Clifton, L. Frazier, & K. Rayner (Eds.), Perspectives on sentence processing (pp. 155–179). Hillsdale, NJ: Erlbaum.Google Scholar
  34. Trueswell, J. C., Tanenhaus, M. K., & Garnsey, S. M. (1994). Semantic influences on parsing: Use of thematic role information in syntactic ambiguity resolution. Journal of Memory and Language, 33, 285–318. CrossRefGoogle Scholar
  35. Wells, J. B., Christiansen, M. H., Race, D. S., Acheson, D. J., & MacDonald, M. C. (2009). Experience and sentence processing: Statistical learning and relative clause comprehension. Cognitive Psychology, 58, 250–271.CrossRefPubMedGoogle Scholar
  36. Wittenberg, E., & Levy, R. (2017). If you want a quick kiss, make it count: How choice of syntactic construction affects event construal. Journal of Memory and Language, 94, 254–271. CrossRefGoogle Scholar
  37. Xiang, M., & Kuperberg, G. (2015). Reversing expectations during discourse comprehension. Language, Cognition and Neuroscience, 30, 648–672. CrossRefPubMedGoogle Scholar
  38. Yildirim, I., Degen, J., Tanenhaus, M. K., & Jaeger, T. F. (2013). Linguistic Variability and Adaptation in Quantifier Meanings. In M. Knauff, M. Pauen, N. Sebanz, & I. Wachsmuth (Eds.), Proceedings of the 35th Annual Conference of the Cognitive Science Society (pp. 3835–3840). Austin, TX: Cognitive Science Society.Google Scholar

Copyright information

© Psychonomic Society, Inc. 2018

Authors and Affiliations

  • Caoimhe M. Harrington Stack
    • 1
  • Ariel N. James
    • 2
  • Duane G. Watson
    • 1
  1. 1.Vanderbilt UniversityNashvilleUSA
  2. 2.Macalester CollegeSt. PaulUSA

Personalised recommendations