Abstract
The influence of emotional prosody on the evaluation of emotional facial expressions was investigated in an event-related brain potential (ERP) study using a priming paradigm, the facial affective decision task. Emotional prosodic fragments of short (200-msec) and medium (400-msec) duration were presented as primes, followed by an emotionally related or unrelated facial expression (or facial grimace, which does not resemble an emotion). Participants judged whether or not the facial expression represented an emotion. ERP results revealed an N400-like differentiation for emotionally related prime-target pairs when compared with unrelated prime-target pairs. Faces preceded by prosodic primes of medium length led to a normal priming effect (larger negativity for unrelated than for related prime-target pairs), but the reverse ERP pattern (larger negativity for related than for unrelated prime-target pairs) was observed for faces preceded by short prosodic primes. These results demonstrate that brief exposure to prosodic cues can establish a meaningful emotional context that influences related facial processing; however, this context does not always lead to a processing advantage when prosodic information is very short in duration.
Article PDF
Similar content being viewed by others
References
Ashley, V., Vuilleumier, P., & Swick, D. (2004). Time course and specificity of event-related potentials to emotional expressions. Neuro-Report, 15, 211–216.
Balconi, M., & Pozzoli, U. (2003). Face-selective processing and the effect of pleasant and unpleasant emotional expressions on ERP correlates. International Journal of Psychophysiology, 49, 67–74.
Banse, R., & Scherer, K. R. (1996). Acoustic profiles in vocal emotion expression. Journal of Personality & Social Psychology, 70, 614–636.
Bargh, J. A., Chaiken, S., Govender, R., & Pratto, F. (1992). The generality of the automatic attitude activation effect. Journal of Personality & Social Psychology, 62, 893–912.
Bentin, S., & McCarthy, G. (1994). The effects of immediate stimulus repetition on reaction time and event-related potentials in tasks of different complexity. Journal of Experimental Psychology: Learning, Memory, & Cognition, 20, 130–149.
Bermeitinger, C., Frings, C., & Wentura, D. (2008). Reversing the N400: Event-related potentials of a negative semantic priming effect. NeuroReport, 19, 1479–1482.
Besson, M., Kutas, M., & Van Petten, C. (1992). An event-related potential (ERP) analysis of semantic congruity and repetition effects in sentences. Journal of Cognitive Neuroscience, 4, 132–149.
Bobes, M. A., Valdés-Sosa, M., & Olivares, E. (1994). An ERP study of expectancy violation in face perception. Brain & Cognition, 26, 1–22.
Boersma, P., & Weenink, D. (2009). Praat: Doing phonetics by computer (Version 4.1.13) [Computer program]. Available from www .praat.org.
Borod, J. C., Pick, L. H., Hall, S., Sliwinski, M., Madigan, N., Obler, L. K., et al. (2000). Relationships among facial, prosodic, and lexical channels of emotional perceptual processing. Cognition & Emotion, 14, 193–211.
Bostanov, V., & Kotchoubey, B. (2004). Recognition of affective prosody: Continuous wavelet measures of event-related brain potentials to emotional exclamations. Psychophysiology, 41, 259–268.
Bower, G. H. (1981). Mood and memory. American Psychologist, 36, 129–148.
Bower, G. H. (1991). Mood congruity of social judgments. In J. P. Forgas (Ed.), Emotion and social judgments (International Series in Experimental Social Psychology) (pp. 31–53). Oxford: Pergamon.
Bowers, D., Bauer, R. M., & Heilman, K. M. (1993). The nonverbal affect lexicon: Theoretical perspectives from neuropsychological studies of affect perception. Neuropsychology, 7, 433–444.
Brown, C., & Hagoort, P. (1993). The processing nature of the N400: Evidence from masked priming. Journal of Cognitive Neuroscience, 5, 34–44.
Caldara, R., Jermann, F., López Arango, G., & Van der Linden, M. (2004). Is the N400 category-specific? A face and language processing study. NeuroReport, 15, 2589–2593.
Carr, T. H., & Dagenbach, D. (1990). Semantic priming and repetition priming from masked words: Evidence for a center-surround attentional mechanism in perceptual recognition. Journal of Experimental Psychology: Learning, Memory, & Cognition, 16, 341–350.
Carroll, N. C., & Young, A. W. (2005). Priming of emotion recognition. Quarterly Journal of Experimental Psychology, 58A, 1173–1197.
Deacon, D., Hewitt, S., Yang, C.-M., & Nagata, M. (2000). Eventrelated potential indices of semantic priming using masked and unmasked words: Evidence that the N400 does not reflect a post-lexical process. Cognitive Brain Research, 9, 137–146.
Deacon, D., Uhm, T.-J., Ritter, W., Hewitt, S., & Dynowska, A. (1999). The lifetime of automatic semantic priming effects may exceed two seconds. Cognitive Brain Research, 7, 465–472.
De Gelder, B., Meeren, H. K. M., Righart, R., van den Stock, J., van de Riet, W. A. C., & Tamietto, M. (2006). Beyond the face: Exploring rapid influences of context on face processing. Progress in Brain Research, 155, 37–48.
De Gelder, B., & Vroomen, J. (2000). The perception of emotions by ear and by eye. Cognition & Emotion, 14, 289–311.
Eimer, M., & Holmes, A. (2002). An ERP study on the time course of emotional face processing. NeuroReport, 13, 427–431.
Fazio, R. H., Sanbonmatsu, D. M., Powell, M. C., & Kardes, F. R. (1986). On the automatic activation of attitudes. Journal of Personality & Social Psychology, 50, 229–238.
Feldmann Barett, L., Lindquist, K. A., & Gendron, M. (2007). Language as context for the perception of emotion. Trends in Cognitive Sciences, 11, 327–332.
Frings, C., Bermeitinger, C., & Wentura, D. (2008). Center-surround or spreading inhibition: Which mechanism caused the negative effect from repeated masked semantic primes? Experimental Psychology, 55, 234–242.
Grandjean, D., Sander, D., Pourtois, G., Schwartz, S., Seghier, M. L., Scherer, K. R., & Vuilleumier, P. (2005). The voices of wrath: Brain responses to angry prosody in meaningless speech. Nature Neuroscience, 8, 145–146.
Green, M. J., Williams, L. M., & Davidson, D. (2003). In the face of danger: Specific viewing strategies for facial expressions of threat? Cognition & Emotion, 17, 779–786.
Greenhouse, S. W., & Geisser, S. (1959). On methods in the analysis of profile data. Psychometrika, 24, 95–112.
Handy, T. C. (2004). Event-related potentials: A methods handbook. Cambridge, MA: MIT Press.
Hansen, C. H., & Shantz, C. A. (1995). Emotion-specific priming: Congruence effects on affect and recognition across negative emotions. Personality & Social Psychology Bulletin, 21, 548–557.
Hermans, D., De Houwer, J., & Eelen, P. (1994). The affective priming effect: Automatic activation of evaluative information in memory. Cognition & Emotion, 8, 515–533.
Hermans, D., De Houwer, J., & Eelen, P. (2001). A time course analysis of the affective priming effect. Cognition & Emotion, 15, 143–165.
Hermans, D., De Houwer, J., Smeesteres, D., & Van den Broeck, A. (1997). Affective priming with associatively unrelated primes and targets. Paper presented at the Sixth Tagung der Fachgruppe Sozialpsychologie, Konstanz, Germany.
Holcomb, P. J. (1988). Automatic and attentional processing: An eventrelated brain potential analysis of semantic priming. Brain & Language, 35, 66–85.
Kanske, P., & Kotz, S. A. (2007). Concreteness in emotional words: ERP evidence from a hemifield study. Brain Research, 1148, 138–148.
Klauer, K. C., & Musch, J. (2003). Affective priming: Findings and theories. In J. Musch & K. C. Klauer (Eds.), The psychology of evaluation: Affective processes in cognition and emotion (pp. 7–49). Mahwah, NJ: Erlbaum.
Klauer, K. C., Roßnagel, C., & Musch, J. (1997). List-context effects in evaluative priming. Journal of Experimental Psychology: Learning, Memory, & Cognition, 23, 246–255.
Kotz, S. A. (2001). Neurolinguistic evidence for bilingual language representation: A comparison of reaction times and event-related brain potentials. Bilingualism: Language & Cognition, 4, 143–154.
Kotz, S. A., & Paulmann, S. (2007). When emotional prosody and semantics dance cheek to cheek: ERP evidence. Brain Research, 1151, 107–118.
Kutas, M., & Federmeier, K. D. (2000). Electrophysiology reveals semantic memory use in language comprehension. Trends in Cognitive Sciences, 4, 463–470.
Kutas, M., & Van Petten, C. K. (1994). Psycholinguistics electrified: Event-related brain potential investigations. In M. A. Gernsbacher (Ed.), Handbook of psycholinguistics (pp. 83–143). San Diego: Academic Press.
Massaro, D. W., & Egan, P. B. (1996). Perceiving affect from the voice and the face. Psychonomic Bulletin & Review, 3, 215–221.
Niedenthal, P. M., & Halberstadt, J. B. (1995). The acquisition and structure of emotional response categories. In D. L. Medin (Vol. Ed.), Psychology of learning and motivation (Vol. 33, pp. 23–63). San Diego: Academic Press.
Niedenthal, P. M., Halberstadt, J. B., & Setterlund, M. B. (1997). Being happy and seeing (“happy”): Emotional state mediates visual word recognition. Cognition & Emotion, 11, 403–432.
Paulmann, S., & Kotz, S. A. (2006, August). Valence, arousal, and task effects on the P200 in emotional prosody processing. Poster presented at the 12th Annual Conference on Architectures and Mechanisms for Language Processing, Nijmegen, The Netherlands.
Paulmann, S., & Kotz, S. A. (2008a). Early emotional prosody perception based on different speaker voices. NeuroReport, 19, 209–213.
Paulmann, S., & Kotz, S. A. (2008b). An ERP investigation on the temporal dynamics of emotional prosody and emotional semantics in pseudo- and lexical-sentence context. Brain & Language, 105, 59–69.
Paulmann, S., & Pell, M. D. (2009). Facial expression decoding as a function of emotional meaning status: ERP evidence. NeuroReport, 20, 1603–1608.
Paulmann, S., Pell, M. D., & Kotz, S. A. (2008). Functional contributions of the basal ganglia to emotional prosody: Evidence from ERPs. Brain Research, 1217, 171–178.
Pegna, A. J., Landis, T., & Khateb, A. (2008). Electrophysiological evidence for early non-conscious processing of fearful facial expressions. International Journal of Psychophysiology, 70, 127–136.
Pell, M. D. (2001). Influence of emotion and focus location on prosody in matched statements and questions. Journal of the Acoustical Society of America, 109, 1668–1680.
Pell, M. D. (2002). Evaluation of nonverbal emotion in face and voice: Some preliminary findings on a new battery of tests. Brain & Cognition, 48, 499–504.
Pell, M. D. (2005a). Nonverbal emotion priming: Evidence from the (“facial affect decision task.”) Journal of Nonverbal Behavior, 29, 45–73.
Pell, M. D. (2005b). Prosody-face interactions in emotional processing as revealed by the facial affect decision task. Journal of Nonverbal Behavior, 29, 193–215.
Pell, M. D., Paulmann, S., Dara, C., Alasseri, A., & Kotz, S. A. (2009). Factors in the recognition of vocally expressed emotions: A comparison of four languages. Journal of Phonetics, 37, 417–435.
Pell, M. D., & Skorup, V. (2008). Implicit processing of emotional prosody in a foreign versus native language. Speech Communication, 50, 519–530.
Phillips, M. L., Drevets, W. C., Rauch, S. L., & Lane, R. (2003). Neurobiology of emotion perception I: The neural basis of normal emotion perception. Biological Psychiatry, 54, 504–514.
Pourtois, G., de Gelder, B., Vroomen, J., Rossion, B., & Crommelinck, M. (2000). The time-course of intermodal binding between seeing and hearing affective information. NeuroReport, 11, 1329–1333.
Power, M. J., Brewin, C. R., Stuessy, A., & Mahony, T. (1991). The emotional priming task: Results from a student population. Cognitive Therapy & Research, 15, 21–31.
Russell, J. A., & Fehr, B. (1987). Relativity in the perception of emotion in facial expressions. Journal of Experimental Psychology: General, 116, 223–237.
Russell, J. [A.], & Lemay, G. (2000). Emotion concepts. In M. Lewis & J. M. Haviland-Jones (Eds.), Handbook of emotions (pp. 491–503). New York: Guilford.
Ruys, K. I., & Stapel, D. A. (2008). Emotion elicitor or emotion messenger? Subliminal priming reveals two faces of facial expressions. Psychological Science, 19, 593–600.
Scherer, K. R. (1986). Vocal affect expression: A review and a model for future research. Psychological Bulletin, 99, 143–165.
Schirmer, A., & Kotz, S. A. (2006). Beyond the right hemisphere: Brain mechanisms mediating vocal emotional processing. Trends in Cognitive Sciences, 10, 24–30.
Schirmer, A., Kotz, S. A., & Friederici, A. D. (2002). Sex differentiates the role of emotional prosody during word processing. Cognitive Brain Research, 14, 228–233.
Schirmer, A., Kotz, S. A., & Friederici, A. D. (2005). On the role of attention for the processing of emotions in speech: Sex differences revisited. Cognitive Brain Research, 24, 442–452.
Schupp, H. T., Junghöfer, M., Weike, A. I., & Hamm, A. O. (2004). The selective processing of briefly presented affective pictures: An ERP analysis. Psychophysiology, 41, 441–449.
Spruyt, A., Hermans, D., De Houwer, J., Vandromme, H., & Eelen, P. (2007). On the nature of the affective priming effect: Effects of stimulus onset asynchrony and congruency proportion in naming and evaluative categorization. Memory & Cognition, 35, 95–106.
Vroomen, J., Driver, J., & de Gelder, B. (2001). Is cross-modal integration of emotional expressions independent of attentional resources? Cognitive, Affective, & Behavioral Neuroscience, 1, 382–387.
Vuilleumier, P., & Pourtois, G. (2007). Distributed and interactive brain mechanisms during emotion face perception: Evidence from functional neuroimaging. Neuropsychologia, 45, 174–194.
Wentura, D. (1998). Affektives Priming in der Wortentscheidungsaufgabe: Evidenz für post-lexikalische Urteilstendenzen [Affective priming in the lexical decision task: Evidence for post-lexical judgmental tendencies]. Sprache & Kognition, 17, 125–137.
Werheid, K., Alpay, G., Jentzsch, I., & Sommer, W. (2005). Priming emotional facial expressions as evidenced by event-related brain potentials. International Journal of Psychophysiology, 55, 209–219.
Zhang, Q., Lawson, A., Guo, C., & Jiang, Y. (2006). Electrophysiological correlates of visual affective priming. Brain Research Bulletin, 71, 316–323.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Paulmann, S., Pell, M.D. Contextual influences of emotional speech prosody on face processing: How much is enough?. Cognitive, Affective, & Behavioral Neuroscience 10, 230–242 (2010). https://doi.org/10.3758/CABN.10.2.230
Received:
Accepted:
Issue Date:
DOI: https://doi.org/10.3758/CABN.10.2.230