Abstract
The present work explores how language specificity and gender affect the emotional decoding process. It investigates the ability of Lithuanian male and female subjects to decode emotional information through male and female vocal and visual emotional expressions. The exploited emotional stimuli are based on extracts of American English (a globally spread language), and Italian (a country specific language) movies. The assumption is that the recognition of the emotional states expressed by the actors/actresses will change according to the familiarity of the languages and the subjects’ gender. Results show that Lithuanian subjects recognition accuracy is affected by the language specificity of the stimuli. Moreover, a gender effect occurs in decoding Italian vocal stimuli.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Zeng, Z., Pantic, M., Rosiman, G.I., Huang, T.S.: A Survey of Affect Recognition Methods: Audio, visual, and spontaneous expressions. Trans. on Pattern Analysis and Machine Intelligence 31(1), 39–58 (2009)
Ververidis, D., Kotropoulos, C.: Emotional Speech Recognition: Resources, Features and Methods. Elsevier Speech Communication 48(9), 1162–1181 (2006)
Aubergé, V., Cathiard, M.: Can we hear the prosody of smile? Speech Communication 40, 87–97 (2003)
Attardo, S., Eisterhold, J., Hay, J., Poggi, I.: Multimodal Markers of Irony and Sarcasm, Humor. International Journal of Humor Research 16(2), 243–260 (2003)
Chollet, G., Esposito, A., Gentes, A., Horain, P., Karam, W., Li, Z., Pelachaud, C., Perrot, P., Petrovska-Delacrétaz, D., Zhou, D., Zouari, L.: Multimodal Human Machine Interactions in Virtual and Augmented Reality. In: Esposito, A., Hussain, A., Marinaro, M., Martone, R. (eds.) COST Action 2102. LNCS, vol. 5398, pp. 1–23. Springer, Heidelberg (2009)
Esposito, A.: The Amount of Information on Emotional States Conveyed by the Verbal and Nonverbal Channels: Some Perceptual Data. In: Stylianou, Y., Faundez-Zanuy, M., Esposito, A. (eds.) COST 277. LNCS, vol. 4391, pp. 249–268. Springer, Heidelberg (2007)
Wang, Y., Guan, L., Venetsanopoulos, A.N.: Kernel Cross-Modal Factor Analysis for Information Fusion with Application to Bimodal Emotion Recognition. IEEE Transactions on Multimedia 14(3), 1520–9210, 597 – 607 (2012)
Ekman, P.: Strong Evidence for Universals in Facial Expressions: A Reply to Russell’s Mistaken Critique. Psychological Bulletin 115, 268–287 (1994)
Mesquita, B., Frijda, N.H., Scherer, K.R.: Culture and Emotion. In: Berry, J.W., Dasen, P.R., Saraswathi, T.S. (eds.) Handbook of Cross-cultural Psychology. Basic processes and human development, pp. 255–297. Allyn & Bacon, Boston (1997)
Russell, J.A.: Is There Universal Recognition of Emotion from Facial Expression? A Review of the Cross-cultural Studies. Psychological Bulletin 115, 102–141 (1994)
Scherer, K.R., Wallbott, H.G.: Evidence for Universality and Cultural Variation of Differential Emotion Response Patterning. Journal of Personality and Social Psychology 66, 310–328 (1994)
Fridlund, A.J.: The new ethology of human facial expressions. In: Russell, J.A., Fernandez Dols, J. (eds.) The Psychology of Facial Expression, pp. 103–129. Cambridge University Press (1997)
Scherer, K.R., Banse, R., Wallbott, H.G.: Emotion Inferences from Vocal Expression Correlate across Languages and Cultures. Journal of Cross-Cultural Psychology 32, 76–92 (2001)
Esposito, A., Riviello, M.T., Bourbakis, N.: Cultural Specific Effects on the Recognition of Basic Emotions: A Study on Italian Subjects. In: Holzinger, A., Miesenberger, K. (eds.) USAB 2009. LNCS, vol. 5889, pp. 135–148. Springer, Heidelberg (2009)
Elfenbein, H.A., Ambady, N.: On the universality and cultural specificity of emotion recognition: A meta-analysis. Psychological Bulletin 128, 203–235 (2002), doi:10.1037/0033-2909.128.2.203
Scherer, K.R., Banse, R., Wallbott, H.G.: Emotion inferences from vocal expression correlate across languages and cultures. Journal of Cross-Cultural Psychology 32, 76–92 (2001)
Riviello, M.T., Esposito, A.: A Cross-Cultural Study on the Effectiveness of Visual and Vocal Channels in Transmitting Dynamic Emotional Information. Acta Polytechnica Hungarica, Journal of Applied Sciences 9(1), 157–170 (2012)
Plant, E.A., Hyde, J.S., Keltner, D., Devine, P.G.: The gender stereotyping of emotions. Psychology of Women Quarterly 24, 81–92 (2000), doi:10.1111/j.1471-6402.2000.tb01024
Brody, L.R., Hall, J.A.: Gender and emotion in context. In: Lewis, M., Haviland-Jones, J. (eds.) Handbook of Emotions, vol. 3, pp. 395–408. Guilford, New York (2008)
Schmid, P.C., Schmid Mast, M., Bombari, D., Mast, F.D.: Gender Effects in Information Processing on a Nonverbal Decoding Task. Springer Science Business Media, LLC (2011)
Crystal, D.: English as a Global Language, 2nd edn. Cambridge University Press, Cambridge (2003)
Riviello, M.T., Chetouani, M., Cohen, D., Esposito, A.: On the perception of emotional “voices”: A cross-cultural comparison among American, French and Italian subjects. In: Esposito, A. (ed.) Communication and Enactment 2010. LNCS, vol. 6800, pp. 368–377. Springer, Heidelberg (2011)
Esposito, A., Riviello, M.T., Bourbakis, N.: Cultural Specific Effects on the Recognition of Basic Emotions: A Study on Italian Subjects. In: Holzinger, A., Miesenberger, K. (eds.) USAB 2009. LNCS, vol. 5889, pp. 135–148. Springer, Heidelberg (2009)
Esposito, A.: The Perceptual and Cognitive Role of Visual and Auditory Channels in Conveying Emotional Information. Cognitive Computation Journal 1, 268–278 (2009)
Esposito, A.: The Amount of Information on Emotional States Conveyed by the Verbal and Nonverbal Channels: Some Perceptual Data. In: Stylianou, Y., Faundez-Zanuy, M., Esposito, A. (eds.) COST 277. LNCS, vol. 4391, pp. 249–268. Springer, Heidelberg (2007)
Ekman, P.: An argument for basic emotions. Cognition and Emotion 6, 169–200 (1992)
Izard, C.E.: Innate and universal facial expressions: Evidence from developmental and cross-cultural research. Psychological Bulletin 115, 288–299 (1994)
Scherer, K.R.: Vocal communication of emotion: A review of research paradigms. Speech Communication 40, 227–256 (2003)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
Riviello, M.T., Maskeliunas, R., Kruminiene, J., Esposito, A. (2014). Language and Gender Effect in Decoding Emotional Information: A Study on Lithuanian Subjects. In: Bassis, S., Esposito, A., Morabito, F. (eds) Recent Advances of Neural Network Models and Applications. Smart Innovation, Systems and Technologies, vol 26. Springer, Cham. https://doi.org/10.1007/978-3-319-04129-2_35
Download citation
DOI: https://doi.org/10.1007/978-3-319-04129-2_35
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-04128-5
Online ISBN: 978-3-319-04129-2
eBook Packages: EngineeringEngineering (R0)