Skip to main content
SpringerLink
Log in

Rating of Intensity of Emotions Across Auditory, Visual, and Auditory-Visual Sensory Domains

  • Published:
Current Psychology Aims and scope Submit manuscript

Abstract

The perceived intensity for happy and sad emotions in three sensory domains-AV (auditory-visual), VO (visual-only) and AO (auditory-only)-was compared with 58 undergraduate college students using a within-subject design. Both happy and sad emotions were rated higher in intensity in the AV (auditory-visual) condition compared to the VO (visual-only) and AO (auditory-only) conditions separately. There was no significant difference observed between VO (visual-only) and AO (auditory-only) conditions for either happy or sad emotional stimuli. The implications for these findings are discussed especially with respect to the possibly decreased impact of intensity of emotions in different modes of communication like phone or email.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Auberge, V., & Cathiard, M. (2003). Can we hear the prosody of a smile? Speech Communication, 40(1), 87–97.

    Article  Google Scholar 

  • Banse, R., & Scherer, K. R. (1996). Acoustic profiles in vocal emotion expression. Journal of Personality and Social Psychology, 70(3), 614–636.

    Article  PubMed  Google Scholar 

  • Barkhuysen, P., Krahmer, E., & Swerts, M. (2010). Crossmodal and incremental perception of audiovisual cues to emotional speech. Language and Speech, 53, 3–30.

    Article  PubMed  Google Scholar 

  • Biehl, M., Matsumoto, D., Ekman, P., Hearn, V., Heider, K., Kudoh, T., & Ton, V. (1997). Matsumoto and Ekman’s Japanese and Caucasian facial expressions of emotion (JACFEE): reliability data and cross-national differences. Journal of Nonverbal Behavior, 21(1), 3–21.

    Article  Google Scholar 

  • Collignon, O., Girard, S., Gosselin, F., Roy, S., Saint-Amour, D., Lassonde, M., & Lepore, F. (2008). Audio-visual integration of emotion expression. Brain Research, 1242, 126–135.

    Article  PubMed  Google Scholar 

  • Darwin, C. (1872). The expressions of emotions in man and animals. London: John Murray.

    Book  Google Scholar 

  • de Gelder, B., & Vroomen, J. (2000). The perception by ear and eye. Cognition and Emotion, 14(3), 289–311.

    Article  Google Scholar 

  • de Gelder, B., Vroomen, J., & Bertelson, P. (1998). Upright but not inverted faces modify the perception of emotion in the voice. Cahiers de Psychologie Cognitive, 17, 1021–1032.

    Google Scholar 

  • Derks, D., Bos, A. E. R., & von Grumbkow, J. (2008). Emoticons and online message interpretation. Social Science Computer Review, 26(3), 379–388.

    Article  Google Scholar 

  • Ekman, P. (1993). Facial expression and emotion. American Psychologist, 48, 384–392.

    Article  PubMed  Google Scholar 

  • Ekman, P. (1994). Strong evidence for universals in facial expressions: a reply to Russell’s mistaken critique. Psychological Bulletin, 115, 268–287.

    Article  PubMed  Google Scholar 

  • Ekman, P., Friesen, W. V., O’Sullivan, M., Chan, A., Diacoyanni-Tarlatzis, I., Heider, K., Krause, R., LeCompte, W. A., Pitcairn, T., Ricci-Bitti, P. E., Scherer, K., Tomita, M., & Tzavaras, A. (1987). Universals and cultural differences in the judgments of facial expressions of emotion. Journal of Personality and Social Psychology, 53, 712–717.

    Article  PubMed  Google Scholar 

  • Etcoff, N., Freeman, R., & Cave, K. R. (1991). Can we lose memories of faces? Content specificity and awareness in prosopagnosia. Journal of Cognitive Neuroscience, 3, 25–41.

    Article  Google Scholar 

  • Frijda, N. H., Ortony, A., Sonnemans, J., & Clore, G. L. (1992). The complexity of intensity: issues concerning the structure of emotion intensity. Review of Personality and Social Psychology, 13, 60–89.

    Google Scholar 

  • Hess, U., Kappas, A., & Scherer, K. (1988). Multichannel communication of emotion: Synthetic signal production. In K. Scherer (Ed.), Facets of emotion: Recent research (pp. 161–182). Hillsdale, NJ: Erlbaum.

    Google Scholar 

  • Hess, U., Blairy, S., & Kleck, R. E. (1997). The intensity of emotional facial expressions and decoding accuracy. Journal of Nonverbal Behavior, 21(4), 241–257.

    Article  Google Scholar 

  • Johnston, T., & Scherer, K. R. (2000). Vocal communication of emotion. In M. Lewis & J. Haviland (Eds.), Handbook of emotion (2nd ed., pp. 220–235). New York, NY: Guilford Press.

    Google Scholar 

  • Juslin, P. N., & Laukka, P. (2001). Impact of intended emotion intensity on cue utilization and decoding accuracy in vocal expression of emotion. Emotion, 1(4), 381–412.

    Article  PubMed  Google Scholar 

  • Kim, J., & Davis, C. (2012). Perceiving emotion from a talker: how face and voice work together. Visual Cognition, 20(8), 902–921.

    Article  Google Scholar 

  • Laukka, P., Juslin, P. N., & Bresin, R. (2005). A dimensional approach to vocal expression of emotion. Cognition and Emotion, 19(5), 633–653.

    Article  Google Scholar 

  • MacDonald, J., & McGurk, H. (1978). Visual influences on speech perception processes. Perception & Psychophysics, 24, 253–257.

    Article  Google Scholar 

  • Massaro, D. W., & Egan, P. B. (1996). Perceiving affect from the face and voice. Psychonomic Bulletin and Review, 3, 215–221.

    Article  Google Scholar 

  • Matsumoto, D. (1990). Cultural similarities and differences in display rules. Motivation and Emotion, 14, 195–214.

    Article  Google Scholar 

  • Matsumoto, D., & Ekman, P. (1989). American-Japanese cultural differences in intensity ratings of facial expressions of emotion. Motivation and Emotion, 13, 143–157.

    Article  Google Scholar 

  • McGurk, H., & MacDonald, J. (1976). Hearing lips and seeing voices. Nature, 264, 746–748.

    Article  PubMed  Google Scholar 

  • Meltzoff, A. N., & Moore, M. K. (1977). Imitation of facial and manual gestures in human neonates. Science, 198, 75–78.

    Article  PubMed  Google Scholar 

  • Most, T., & Michaelis, H. (2012). Auditory, visual and auditory-visual perceptions of emotions by young children with hearing loss versus children with normal hearing. Journal of Speech, Language, and Hearing Research, 55, 1148–1162.

    Article  PubMed  Google Scholar 

  • Munhall, K. G., Jones, J. A., Callan, D. E., Kuratate, T., & Vatikiotis-Bateson, E. (2004). Visual prosody and speech intelligibility. Psychological Science, 15(2), 133–137.

    Article  PubMed  Google Scholar 

  • Murray, I. R., & Arnott, J. L. (1993). Toward the simulation of emotion in synthetic speech: a review of the literature on human vocal emotion. Journal of the Acoustical Society of America, 93, 1097–1108.

    Article  PubMed  Google Scholar 

  • Russell, J. A. (1994). Is there universal recognition of emotion from facial expression? A review of cross-cultural studies. Psychological Bulletin, 115, 102–141.

    Article  PubMed  Google Scholar 

  • Scherer, K. R., Banse, R., Wallbott, H. G., & Goldbeck, T. (1991). Vocal cues in emotion encoding and decoding. Motivation and Emotion, 15, 123–148.

    Article  Google Scholar 

  • Scherer, K. R., Banse, R., & Wallbott, H. G. (2001). Emotion inferences from vocal expression correlate across languages and cultures. Journal of Cross-Cultural Psychology, 32(1), 76–92.

    Article  Google Scholar 

  • Schimmack, U. (2003). Affect measurement in experience sampling approach. Journal of Happiness Studies, 4, 79–106.

    Article  Google Scholar 

  • Schwartz, J.-L., Berthommier, F., & Savariaux, C. (2004). Seeing to hear better: evidence for early audio-visual interactions in speech identification. Cognition, 93, B69–B78.

    Article  PubMed  Google Scholar 

  • Sweeney, T. D., Suzuki, S., Grabowecky, M., & Paller, K. A. (2009). Long-lasting effects of subliminal affective priming from facial expressions. Consciousness and Cognition, 18, 929–938.

    Article  Google Scholar 

  • Sweeney, T. D., Suzuki, S., Grabowecky, M., & Paller, K. A. (2013). Detecting and categorizing fleeting emotions in faces. Emotion, 13(1), 76–91.

    Article  Google Scholar 

  • Tartter, V. C. (1980). Happy talk: perceptual and acoustic effects of smiling on speech. Perception & Psychophysics, 27, 24–27.

    Article  Google Scholar 

  • Tartter, V. C., & Braun, D. (1994). Hearing smiles and frowns in normal and whisper speech registers. Journal of the Acoustical Society of America, 96(4), 2101–2107.

    Article  PubMed  Google Scholar 

  • Todd, R. M., Cunningham, W. A., Anderson, A. K., & Thompson, E. (2012). Affect-biased attention as emotion regulation. Trends in Cognitive Sciences, 16(7), 365–372.

    Article  PubMed  Google Scholar 

  • Wallbott, H. G., & Scherer, K. R. (1986). Cues and channels in emotion recognition. Journal of Personality and Social Psychology, 51, 690–699.

    Article  Google Scholar 

  • Wolf, A. (2000). Emotional expressions online: gender differences in emoticon use. Cyberpsychology & Behavior, 3(5), 827–833.

    Article  Google Scholar 

  • Yehia, H. C., Rubin, P. E., & Vatikiotis-Bateson, E. (1998). Quantitative association of vocal tract and facial behavior. Speech Communication, 26, 23–44.

    Article  Google Scholar 

Download references

Acknowledgments

This research was partially funded by Faculty Development Grant at Widener University. I would like to thank Kevin Barnes for his help in editing the stimuli used in this study.

Author information

Authors and Affiliations

  1. 342 Kapelski, Widener University, Chester, PA, 19013, USA

    Naureen Bhullar

Authors
  1. Naureen Bhullar
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Naureen Bhullar.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Bhullar, N. Rating of Intensity of Emotions Across Auditory, Visual, and Auditory-Visual Sensory Domains. Curr Psychol 32, 186–196 (2013). https://doi.org/10.1007/s12144-013-9173-6

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12144-013-9173-6

Keywords

Search

Navigation