Abstract
In this chapter, we review recent research concerned with “inner voice” experiences during silent reading of direct speech (e.g., Mary said, “This dress is beautiful!”) and indirect speech (e.g., Mary said that the dress was beautiful). Converging findings from speech analysis, brain imaging, and eye tracking indicate that readers spontaneously engage in mental simulations of audible-speech like representations during silent reading of direct speech, and to a much lesser extent during silent reading of indirect speech. This “simulated” implicit prosody is highly correlated with the overt prosody generated during actual speaking. We then compare this “simulated” implicit prosody with the sort of “default” implicit prosody that is commonly discussed in relation to syntactic ambiguity resolution. We hope our discussion will motivate new interdisciplinary research into prosodic processing during reading which could potentially unify the two phenomena within a single theoretical framework.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
The capitalization and repetition of letters represent emphases in intensity and length.
References
Alexander, J. D., & Nygaard, L. C. (2008). Reading voices and hearing text: Talker-specific auditory imagery in reading. Journal of Experimental Psychology-Human Perception and Performance, 34(2), 446–459. doi:10.1037/0096-1523.34.2.446.
Ashby, J., & Clifton, C. (2005). The prosodic property of lexical stress affects eye movements during silent reading. Cognition, 96(3), B89–B100. doi:10.1016/j.cognition.2004.12.006.
Banfield, A. (1973). Narrative style and grammar of direct and indirect speech. Foundations of Language, 81(4), 1–39.
Banfield, A. (1982). Unspeakable sentences: Narration and representation in the language of fiction. Boston: Routledge.
Banse, R., & Scherer, K. R. (1996). Acoustic profiles in vocal emotion expression. Journal of Personality and Social Psychology, 70(3), 614–636. doi:10.1037/0022-3514.70.3.614.
Barsalou, L. W. (1999). Perceptual symbol systems. Behavioral and Brain Sciences, 22(4), 577–660.
Barsalou, L. W. (2008). Grounded cognition. Annual Review of Psychology, 59, 617–645. doi:10.1146/annurev.psych.59.103006.093639.
Barsalou, L. W. (2009). Simulation, situated conceptualization, and prediction. Philosophical Transactions of the Royal Society B-Biological Sciences, 364(1521), 1281–1289. doi:10.1098/rstb.2008.0319.
Belin, P., Zatorre, R. J., Lafaille, P., Ahad, P., & Pike, B. (2000). Voice-selective areas in human auditory cortex. Nature, 403(6767), 309–312. doi:10.1038/35002078.
Bohan, J., Sanford, A. J., Cochrane, S., & Sanford, A. J. S. (2008). Direct and indirect speech modulates depth of processing. Poster presented at the 14th Annual conference on architectures and mechanisms for language processing (AMLaP), Cambridge, UK.
Brück, C., Kreifelts, B., Gößling-Arnold, C., Wertheimer, J., & Wildgruber, D. (2014). Inner voices: The cerebral representation of emotional voice cues described in literary texts. Social Cognitive and Affective Neuroscience. doi:10.1093/scan/nst180.
Carreiras, M., & Clifton, C. (1993). Relative clause interpretation preferences in Spanish and English. Language and Speech, 36(4), 353–372. doi:10.1177/002383099303600401.
Carreiras, M., & Clifton, C. (1999). Another word on parsing relative clauses: Eyetracking evidence from Spanish and English. Memory & Cognition, 27(5), 826–833. doi:10.3758/BF03198535.
Clark, H. H., & Gerrig, R. J. (1990). Quotations as demonstrations. Language, 66(4), 764–805.
Clifton, C., Carlson, K., & Frazier, L. (2002). Informative prosodic boundaries. Language and Speech, 45(2), 87–114. doi:10.1177/00238309020450020101.
D’Argembeau, A., Feyers, D., Majerus, S., Collette, F., Van der Linden, M., Maquet, P., & Salmon, E. (2008). Self-reflection across time: Cortical midline structures differentiate between present and past selves. Social Cognitive and Affective Neuroscience, 3(3), 244–252. doi:10.1093/scan/nsn020.
Eerland, A., Engelen, J. A. A., & Zwaan, R. A. (2013). The influence of direct and indirect speech on mental representations. PLoS ONE, 8(6), e65480. doi:10.1371/journal.pone.0065480.
Fodor, J. D. (1998). Learning to parse? Journal of Psycholinguistic Research, 27(2), 285–319. doi:10.1023/A:1023258301588.
Fodor, J. D. (2002). Prosodic disambiguation in silent reading. In PROCEEDINGS-NELS (Vol. 1, pp. 113–132).
Friederici, A. D., Meyer, M., & von Cramon, D. Y. (2000a). Auditory language comprehension: An event-related fMRI study on the processing of syntactic and lexical information. Brain and Language, 74(2), 289–300. doi:10.1006/brln.2000.2313.
Friederici, A. D., Wang, Y. H., Herrmann, C. S., Maess, B., & Oertel, U. (2000b). Localization of early syntactic processes in frontal and temporal cortical areas: A magnetoencephalographic study. Human Brain Mapping, 11(1), 1–11.
Hemforth, B., Konieczny, L., Scheepers, C., & Strube, G. (1998). Syntactic ambiguity resolution in German. In D. Hillert (Ed.), Sentence processing: A crosslinguistic perspective—syntax and semantics (Vol. 31, pp. 293–312). San Diego: Academic.
Kiefer, M., Sim, E. J., Herrnberger, B., Grothe, J., & Hoenig, K. (2008). The sound of concepts: Four markers for a link between auditory and conceptual brain systems. Journal of Neuroscience, 28(47), 12224–12230. doi:10.1523/jneurosci.3579-08.2008.
Koizumi, Y. (2009). Processing the not-because ambiguity in English: The role of pragmatics and prosody. Dissertation, City University of New York.
Li, C. N. (1986). Direct speech and indirect speech: A functional study. In F. Coulmas (Ed.), Direct and indirect speech (pp. 29–45). Berlin: Mouton de Gruyter.
Lovrić, N., Bradley, D., & Fodor, J. D. (2000). RC attachment in Croatian with and without preposition. Poster presented at the 6th Annual Conference on architectures and mechanisms for language processing (AMLaP), Leiden.
Lovrić, N., Bradley, D., & Fodor, J. D. (2001). Silent prosody resolves syntactic ambiguities: Evidence from Croatian. Paper presented at the 2nd SUNY/CUNY/NYU Conference, Stonybrook, NY.
Maynell, L. A. (1999). Effect of pitch accent placement on resolving relative clause ambiguity in English. Poster presented at the 12th Annual CUNY Conference on human sentence processing, New York.
Mitchell, R. L. C., Elliott, R., Barry, M., Cruttenden, A., & Woodruff, P. W. R. (2003). The neural response to emotional prosody, as revealed by functional magnetic resonance imaging. Neuropsychologia, 41(10), 1410–1421. doi:10.1016/s0028-3932(03)00017-4.
Ogawa, S., & Lee, T. M. (1990). Magnetic-resonance-imaging of blood-vessels at high fields: In vivo and in vitro measurements and image stimulation. Magnetic Resonance in Medicine, 16(1), 9–18. doi:10.1002/mrm.1910160103.
Ogawa, S., Lee, T. M., Kay, A. R., & Tank, D. W. (1990a). Brain magnetic-resonance-imaging with contrast dependent on blood oxygenation. Proceedings of the National Academy of Sciences of the United States of America, 87(24), 9868–9872. doi:10.1073/pnas.87.24.9868.
Ogawa, S., Lee, T. M., Nayak, A. S., & Glynn, P. (1990b). Oxygenation-sensitive contrast in magnetic-resonance image of rodent brain at high magnetic-fields. Magnetic Resonance in Medicine, 14(1), 68–78. doi:10.1002/mrm.1910140108.
Partee, B. (1973). The syntax and semantics of quotation. In S. R. Anderson & P. Kiparsky (Eds.), A festschrift for Morris Halle (pp. 410–418). New York: Holt, Reinhart and Winston.
Patterson, R. D., Uppenkamp, S., Johnsrude, I. S., & Griffiths, T. D. (2002). The processing of temporal pitch and melody information in auditory cortex. Neuron, 36(4), 767–776. doi:10.1016/s0896-6273(02)01060-7.
Peelen, M. V., Atkinson, A. P., & Vuilleumier, P. (2010). Supramodal representations of perceived emotions in the human brain. Journal of Neuroscience, 30(30), 10127–10134. doi:10.1523/jneurosci.2161-10.2010.
Quinn, D., Abdelghany, H., & Fodor, J. D. (2000). More evidence of implicit prosody in reading: French and Arabic relative clauses. Poster presented at the 13th Annual CUNY Conference on human sentence processing, La Jolla, CA.
Scott, S. K., Blank, C. C., Rosen, S., & Wise, R. J. S. (2000). Identification of a pathway for intelligible speech in the left temporal lobe. Brain, 123(12), 2400–2406. doi:10.1093/brain/123.12.2400.
Shafran, R. W. (2011). Prosody and parsing in a double PP construction in Hebrew. Dissertation, City University of New York.
Shaked, A. (2009). Attachment ambiguities in Hebrew complex nominals: Prosody and parsing. Dissertation, City University of New York.
Steinhauer, K. (2003). Electrophysiological correlates of prosody and punctuation. Brain and Language, 86(1), 142–164. doi:10.1016/S0093-934x(02)00542-4
Steinhauer, K., & Friederici, A. D. (2001). Prosodic boundaries, comma rules, and brain responses: the closure positive shift in ERPs as a universal marker for prosodic phrasing in listeners and readers. Journal of Psycholinguistic Research, 30(3), 267–295.
Stites, M. C., Luke, S. G., & Christianson, K. (2013). The psychologist said quickly, “Dialogue descriptions modulate reading speed!” Memory & Cognition, 41(1), 137–151. doi:10.3758/s13421-012-0248-7.
Tannen, D. (1986). Introducing constructed dialogue in Greek and American conversational and literary narrative. In F. Coulmas (Ed.), Direct and indirect speech (pp. 311–332). Berlin: Mouton de Gruyter.
Tannen, D. (1989). “Oh talking voice that is so sweet”: Constructing dialogue in conversation. In D. Tannen (Ed.), Talking voices: Repetition, dialogue, and imagery in conversational discourse. Cambridge: Cambridge University Press.
Vogeley, K., & Fink, G. R. (2003). Neural correlates of the first-person-perspective. Trends in Cognitive Sciences, 7(1), 38–42. doi:10.1016/S1364-6613(02)00003-7.
Wierzbicka, A. (1974). The semantics of direct and indirect discourse. Research on Language & Social Interaction, 7(3–4), 267–307.
Wildgruber, D., Riecker, A., Hertrich, I., Erb, M., Grodd, W., Ethofer, T., & Ackermann, H. (2005). Identification of emotional intonation evaluated by fMRI. Neuroimage, 24(4), 1233–1241. doi:10.1016/j.neuroimage.2004.10.034.
Yao, B. (2011). Mental simulations in comprehension of direct versus indirect quotations. PhD thesis, University of Glasgow.
Yao, B., & Scheepers, C. (2011). Contextual modulation of reading rate for direct versus indirect speech quotations. Cognition, 121(3), 447–453. doi:10.1016/j.cognition.2011.08.007.
Yao, B., Belin, P., & Scheepers, C. (2011). Silent reading of direct versus indirect speech activates voice-selective areas in the auditory cortex. Journal of Cognitive Neuroscience, 23(10), 3146–3152. doi:10.1162/jocn_a_00022.
Yao, B., Belin, P., & Scheepers, C. (2012). Brain “talks over” boring quotes: Top-down activation of voice-selective areas while listening to monotonous direct speech quotations. NeuroImage, 60(3), 1832–1842. doi:10.1016/j.neuroimage.2012.01.111.
Zagar, D., Pynte, J., & Rativeau IV, S. (1997). Evidence for early closure attachment on first pass reading times in French. The Quarterly Journal of Experimental Psychology, 50(2), 421–438. doi:10.1080/713755715.
Zatorre, R. J., Evans, A. C., & Meyer, E. (1994). Neural mechanisms underlying melodic perception and memory for pitch. Journal of Neuroscience, 14(4), 1908–1919.
Zatorre, R. J., Belin, P., & Penhune, V. B. (2002). Structure and function of auditory cortex: music and speech. Trends in Cognitive Sciences, 6(1), 37–46. doi:10.1016/s1364-6613(00)01816-7.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this chapter
Cite this chapter
Yao, B., Scheepers, C. (2015). Inner Voice Experiences During Processing of Direct and Indirect Speech. In: Frazier, L., Gibson, E. (eds) Explicit and Implicit Prosody in Sentence Processing. Studies in Theoretical Psycholinguistics, vol 46. Springer, Cham. https://doi.org/10.1007/978-3-319-12961-7_15
Download citation
DOI: https://doi.org/10.1007/978-3-319-12961-7_15
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-12960-0
Online ISBN: 978-3-319-12961-7
eBook Packages: Humanities, Social Sciences and LawSocial Sciences (R0)