Skip to main content
SpringerLink
Log in

Inner Voice Experiences During Processing of Direct and Indirect Speech

  • Chapter
  • First Online:
Book cover Explicit and Implicit Prosody in Sentence Processing

Part of the book series: Studies in Theoretical Psycholinguistics ((SITP,volume 46))

Abstract

In this chapter, we review recent research concerned with “inner voice” experiences during silent reading of direct speech (e.g., Mary said, “This dress is beautiful!”) and indirect speech (e.g., Mary said that the dress was beautiful). Converging findings from speech analysis, brain imaging, and eye tracking indicate that readers spontaneously engage in mental simulations of audible-speech like representations during silent reading of direct speech, and to a much lesser extent during silent reading of indirect speech. This “simulated” implicit prosody is highly correlated with the overt prosody generated during actual speaking. We then compare this “simulated” implicit prosody with the sort of “default” implicit prosody that is commonly discussed in relation to syntactic ambiguity resolution. We hope our discussion will motivate new interdisciplinary research into prosodic processing during reading which could potentially unify the two phenomena within a single theoretical framework.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD 109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    The capitalization and repetition of letters represent emphases in intensity and length.

References

  • Alexander, J. D., & Nygaard, L. C. (2008). Reading voices and hearing text: Talker-specific auditory imagery in reading. Journal of Experimental Psychology-Human Perception and Performance, 34(2), 446–459. doi:10.1037/0096-1523.34.2.446.

    Article  Google Scholar 

  • Ashby, J., & Clifton, C. (2005). The prosodic property of lexical stress affects eye movements during silent reading. Cognition, 96(3), B89–B100. doi:10.1016/j.cognition.2004.12.006.

    Article  Google Scholar 

  • Banfield, A. (1973). Narrative style and grammar of direct and indirect speech. Foundations of Language, 81(4), 1–39.

    Google Scholar 

  • Banfield, A. (1982). Unspeakable sentences: Narration and representation in the language of fiction. Boston: Routledge.

    Google Scholar 

  • Banse, R., & Scherer, K. R. (1996). Acoustic profiles in vocal emotion expression. Journal of Personality and Social Psychology, 70(3), 614–636. doi:10.1037/0022-3514.70.3.614.

    Article  Google Scholar 

  • Barsalou, L. W. (1999). Perceptual symbol systems. Behavioral and Brain Sciences, 22(4), 577–660.

    Google Scholar 

  • Barsalou, L. W. (2008). Grounded cognition. Annual Review of Psychology, 59, 617–645. doi:10.1146/annurev.psych.59.103006.093639.

    Article  Google Scholar 

  • Barsalou, L. W. (2009). Simulation, situated conceptualization, and prediction. Philosophical Transactions of the Royal Society B-Biological Sciences, 364(1521), 1281–1289. doi:10.1098/rstb.2008.0319.

    Article  Google Scholar 

  • Belin, P., Zatorre, R. J., Lafaille, P., Ahad, P., & Pike, B. (2000). Voice-selective areas in human auditory cortex. Nature, 403(6767), 309–312. doi:10.1038/35002078.

    Article  Google Scholar 

  • Bohan, J., Sanford, A. J., Cochrane, S., & Sanford, A. J. S. (2008). Direct and indirect speech modulates depth of processing. Poster presented at the 14th Annual conference on architectures and mechanisms for language processing (AMLaP), Cambridge, UK.

    Google Scholar 

  • Brück, C., Kreifelts, B., Gößling-Arnold, C., Wertheimer, J., & Wildgruber, D. (2014). Inner voices: The cerebral representation of emotional voice cues described in literary texts. Social Cognitive and Affective Neuroscience. doi:10.1093/scan/nst180.

    Google Scholar 

  • Carreiras, M., & Clifton, C. (1993). Relative clause interpretation preferences in Spanish and English. Language and Speech, 36(4), 353–372. doi:10.1177/002383099303600401.

    Google Scholar 

  • Carreiras, M., & Clifton, C. (1999). Another word on parsing relative clauses: Eyetracking evidence from Spanish and English. Memory & Cognition, 27(5), 826–833. doi:10.3758/BF03198535.

    Article  Google Scholar 

  • Clark, H. H., & Gerrig, R. J. (1990). Quotations as demonstrations. Language, 66(4), 764–805.

    Article  Google Scholar 

  • Clifton, C., Carlson, K., & Frazier, L. (2002). Informative prosodic boundaries. Language and Speech, 45(2), 87–114. doi:10.1177/00238309020450020101.

    Article  Google Scholar 

  • D’Argembeau, A., Feyers, D., Majerus, S., Collette, F., Van der Linden, M., Maquet, P., & Salmon, E. (2008). Self-reflection across time: Cortical midline structures differentiate between present and past selves. Social Cognitive and Affective Neuroscience, 3(3), 244–252. doi:10.1093/scan/nsn020.

    Article  Google Scholar 

  • Eerland, A., Engelen, J. A. A., & Zwaan, R. A. (2013). The influence of direct and indirect speech on mental representations. PLoS ONE, 8(6), e65480. doi:10.1371/journal.pone.0065480.

    Article  Google Scholar 

  • Fodor, J. D. (1998). Learning to parse? Journal of Psycholinguistic Research, 27(2), 285–319. doi:10.1023/A:1023258301588.

    Article  Google Scholar 

  • Fodor, J. D. (2002). Prosodic disambiguation in silent reading. In PROCEEDINGS-NELS (Vol. 1, pp. 113–132).

    Google Scholar 

  • Friederici, A. D., Meyer, M., & von Cramon, D. Y. (2000a). Auditory language comprehension: An event-related fMRI study on the processing of syntactic and lexical information. Brain and Language, 74(2), 289–300. doi:10.1006/brln.2000.2313.

    Article  Google Scholar 

  • Friederici, A. D., Wang, Y. H., Herrmann, C. S., Maess, B., & Oertel, U. (2000b). Localization of early syntactic processes in frontal and temporal cortical areas: A magnetoencephalographic study. Human Brain Mapping, 11(1), 1–11.

    Article  Google Scholar 

  • Hemforth, B., Konieczny, L., Scheepers, C., & Strube, G. (1998). Syntactic ambiguity resolution in German. In D. Hillert (Ed.), Sentence processing: A crosslinguistic perspective—syntax and semantics (Vol. 31, pp. 293–312). San Diego: Academic.

    Google Scholar 

  • Kiefer, M., Sim, E. J., Herrnberger, B., Grothe, J., & Hoenig, K. (2008). The sound of concepts: Four markers for a link between auditory and conceptual brain systems. Journal of Neuroscience, 28(47), 12224–12230. doi:10.1523/jneurosci.3579-08.2008.

    Article  Google Scholar 

  • Koizumi, Y. (2009). Processing the not-because ambiguity in English: The role of pragmatics and prosody. Dissertation, City University of New York.

    Google Scholar 

  • Li, C. N. (1986). Direct speech and indirect speech: A functional study. In F. Coulmas (Ed.), Direct and indirect speech (pp. 29–45). Berlin: Mouton de Gruyter.

    Google Scholar 

  • Lovrić, N., Bradley, D., & Fodor, J. D. (2000). RC attachment in Croatian with and without preposition. Poster presented at the 6th Annual Conference on architectures and mechanisms for language processing (AMLaP), Leiden.

    Google Scholar 

  • Lovrić, N., Bradley, D., & Fodor, J. D. (2001). Silent prosody resolves syntactic ambiguities: Evidence from Croatian. Paper presented at the 2nd SUNY/CUNY/NYU Conference, Stonybrook, NY.

    Google Scholar 

  • Maynell, L. A. (1999). Effect of pitch accent placement on resolving relative clause ambiguity in English. Poster presented at the 12th Annual CUNY Conference on human sentence processing, New York.

    Google Scholar 

  • Mitchell, R. L. C., Elliott, R., Barry, M., Cruttenden, A., & Woodruff, P. W. R. (2003). The neural response to emotional prosody, as revealed by functional magnetic resonance imaging. Neuropsychologia, 41(10), 1410–1421. doi:10.1016/s0028-3932(03)00017-4.

    Article  Google Scholar 

  • Ogawa, S., & Lee, T. M. (1990). Magnetic-resonance-imaging of blood-vessels at high fields: In vivo and in vitro measurements and image stimulation. Magnetic Resonance in Medicine, 16(1), 9–18. doi:10.1002/mrm.1910160103.

    Article  Google Scholar 

  • Ogawa, S., Lee, T. M., Kay, A. R., & Tank, D. W. (1990a). Brain magnetic-resonance-imaging with contrast dependent on blood oxygenation. Proceedings of the National Academy of Sciences of the United States of America, 87(24), 9868–9872. doi:10.1073/pnas.87.24.9868.

    Article  Google Scholar 

  • Ogawa, S., Lee, T. M., Nayak, A. S., & Glynn, P. (1990b). Oxygenation-sensitive contrast in magnetic-resonance image of rodent brain at high magnetic-fields. Magnetic Resonance in Medicine, 14(1), 68–78. doi:10.1002/mrm.1910140108.

    Article  Google Scholar 

  • Partee, B. (1973). The syntax and semantics of quotation. In S. R. Anderson & P. Kiparsky (Eds.), A festschrift for Morris Halle (pp. 410–418). New York: Holt, Reinhart and Winston.

    Google Scholar 

  • Patterson, R. D., Uppenkamp, S., Johnsrude, I. S., & Griffiths, T. D. (2002). The processing of temporal pitch and melody information in auditory cortex. Neuron, 36(4), 767–776. doi:10.1016/s0896-6273(02)01060-7.

    Article  Google Scholar 

  • Peelen, M. V., Atkinson, A. P., & Vuilleumier, P. (2010). Supramodal representations of perceived emotions in the human brain. Journal of Neuroscience, 30(30), 10127–10134. doi:10.1523/jneurosci.2161-10.2010.

    Article  Google Scholar 

  • Quinn, D., Abdelghany, H., & Fodor, J. D. (2000). More evidence of implicit prosody in reading: French and Arabic relative clauses. Poster presented at the 13th Annual CUNY Conference on human sentence processing, La Jolla, CA.

    Google Scholar 

  • Scott, S. K., Blank, C. C., Rosen, S., & Wise, R. J. S. (2000). Identification of a pathway for intelligible speech in the left temporal lobe. Brain, 123(12), 2400–2406. doi:10.1093/brain/123.12.2400.

    Article  Google Scholar 

  • Shafran, R. W. (2011). Prosody and parsing in a double PP construction in Hebrew. Dissertation, City University of New York.

    Google Scholar 

  • Shaked, A. (2009). Attachment ambiguities in Hebrew complex nominals: Prosody and parsing. Dissertation, City University of New York.

    Google Scholar 

  • Steinhauer, K. (2003). Electrophysiological correlates of prosody and punctuation. Brain and Language, 86(1), 142–164. doi:10.1016/S0093-934x(02)00542-4

    Article  Google Scholar 

  • Steinhauer, K., & Friederici, A. D. (2001). Prosodic boundaries, comma rules, and brain responses: the closure positive shift in ERPs as a universal marker for prosodic phrasing in listeners and readers. Journal of Psycholinguistic Research, 30(3), 267–295.

    Article  Google Scholar 

  • Stites, M. C., Luke, S. G., & Christianson, K. (2013). The psychologist said quickly, “Dialogue descriptions modulate reading speed!” Memory & Cognition, 41(1), 137–151. doi:10.3758/s13421-012-0248-7.

    Article  Google Scholar 

  • Tannen, D. (1986). Introducing constructed dialogue in Greek and American conversational and literary narrative. In F. Coulmas (Ed.), Direct and indirect speech (pp. 311–332). Berlin: Mouton de Gruyter.

    Google Scholar 

  • Tannen, D. (1989). “Oh talking voice that is so sweet”: Constructing dialogue in conversation. In D. Tannen (Ed.), Talking voices: Repetition, dialogue, and imagery in conversational discourse. Cambridge: Cambridge University Press.

    Google Scholar 

  • Vogeley, K., & Fink, G. R. (2003). Neural correlates of the first-person-perspective. Trends in Cognitive Sciences, 7(1), 38–42. doi:10.1016/S1364-6613(02)00003-7.

    Article  Google Scholar 

  • Wierzbicka, A. (1974). The semantics of direct and indirect discourse. Research on Language & Social Interaction, 7(3–4), 267–307.

    Google Scholar 

  • Wildgruber, D., Riecker, A., Hertrich, I., Erb, M., Grodd, W., Ethofer, T., & Ackermann, H. (2005). Identification of emotional intonation evaluated by fMRI. Neuroimage, 24(4), 1233–1241. doi:10.1016/j.neuroimage.2004.10.034.

    Article  Google Scholar 

  • Yao, B. (2011). Mental simulations in comprehension of direct versus indirect quotations. PhD thesis, University of Glasgow.

    Google Scholar 

  • Yao, B., & Scheepers, C. (2011). Contextual modulation of reading rate for direct versus indirect speech quotations. Cognition, 121(3), 447–453. doi:10.1016/j.cognition.2011.08.007.

    Article  Google Scholar 

  • Yao, B., Belin, P., & Scheepers, C. (2011). Silent reading of direct versus indirect speech activates voice-selective areas in the auditory cortex. Journal of Cognitive Neuroscience, 23(10), 3146–3152. doi:10.1162/jocn_a_00022.

    Article  Google Scholar 

  • Yao, B., Belin, P., & Scheepers, C. (2012). Brain “talks over” boring quotes: Top-down activation of voice-selective areas while listening to monotonous direct speech quotations. NeuroImage, 60(3), 1832–1842. doi:10.1016/j.neuroimage.2012.01.111.

    Article  Google Scholar 

  • Zagar, D., Pynte, J., & Rativeau IV, S. (1997). Evidence for early closure attachment on first pass reading times in French. The Quarterly Journal of Experimental Psychology, 50(2), 421–438. doi:10.1080/713755715.

    Article  Google Scholar 

  • Zatorre, R. J., Evans, A. C., & Meyer, E. (1994). Neural mechanisms underlying melodic perception and memory for pitch. Journal of Neuroscience, 14(4), 1908–1919.

    Google Scholar 

  • Zatorre, R. J., Belin, P., & Penhune, V. B. (2002). Structure and function of auditory cortex: music and speech. Trends in Cognitive Sciences, 6(1), 37–46. doi:10.1016/s1364-6613(00)01816-7.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. School of Psychological Sciences, University of Manchester, Manchester, UK

    Bo Yao

  2. Institute of Neuroscience and Psychology, University of Glasgow, Glasgow, UK

    Christoph Scheepers

Authors
  1. Bo Yao
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Christoph Scheepers
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Bo Yao .

Editor information

Editors and Affiliations

  1. Department of Linguistics, University of Massachusetts, Amherst, Amherst, Massachusetts, USA

    Lyn Frazier

  2. Department of Psychology, Massachusetts Institute of Technology, Cambridge, Massachusetts, USA

    Edward Gibson

Rights and permissions

Reprints and permissions

Copyright information

© 2015 Springer International Publishing Switzerland

About this chapter

Cite this chapter

Yao, B., Scheepers, C. (2015). Inner Voice Experiences During Processing of Direct and Indirect Speech. In: Frazier, L., Gibson, E. (eds) Explicit and Implicit Prosody in Sentence Processing. Studies in Theoretical Psycholinguistics, vol 46. Springer, Cham. https://doi.org/10.1007/978-3-319-12961-7_15

Download citation

Publish with us

Policies and ethics

Search

Navigation