Skip to main content

The Emotion Code in Sensory Modalities

An Investigation of the Relationship Between Sensorimotor Dimensions and Emotional Valence-Arousal

  • Conference paper
  • First Online:
Chinese Lexical Semantics (CLSW 2022)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 13496))

Included in the following conference series:

Abstract

Human sensations and emotions are our primary embodied feelings in experiencing the outside world. The two systems are closely intertwined and jointly contribute to cognitive processes such as language use. However, how the two systems interact as manifested in our languages is still not well understood. This paper utilizes perceptual strengths and affective ratings to delve into the interaction between specific sensory modalities and emotional valence-arousal in Chinese. We found that smell and interoception, considered the two sensations directly linked to emotional processing, are more emotional and can elicit higher arousal levels than words associated with other senses. This study demonstrates the relevance and significance of the relationship between sensorimotor and affective information. It further sheds light on the embodied effect and associated emotional implications in the Chinese language.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 64.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 84.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    Note that the five traditional sensory modalities, i.e., visual, auditory, gustatory, olfactory, and tactile senses, mainly detect signals from the external stimuli rather than from the inner body.

  2. 2.

    Another reason for omitting dominant action effectors is because almost all the action effectors jointly shared a dominant place with other effectors in [9] since action strength is relatively low for noun concepts. Therefore, considering the statistical power, we will mainly focus on sensory modalities in this paper.

  3. 3.

    Note the words in the two datasets were both from a Mega study of Lexical Decision in Simplified Chinese (MELD-SCH, Tsang et al. [22]).

  4. 4.

    Absolute valence is achieved by subtracting the mean of all valence ratings from each rating and then taking the absolute value.

  5. 5.

    JASP is a free and open-source program for statistical analysis.

References

  1. Barsalou, L.W.: Situated simulation in the human conceptual system. Lang. Cogn. Process. 18(5–6), 513–562 (2003)

    Article  Google Scholar 

  2. Barsalou, L.W.: Grounded cognition: past, present, and future. Topics Cogn. Sci. 2(4), 716–724 (2010)

    Article  Google Scholar 

  3. Gallese, V., Lakoff, G.: The brain’s concepts: the role of the sensory-motor system in conceptual knowledge. Cogn. Neuropsychol. 22(3–4), 455–479 (2005)

    Article  Google Scholar 

  4. Glenberg, A.M., Kaschak, M.P.: Grounding language in action. Psychon. Bull. Rev. 9(3), 558–565 (2002)

    Article  Google Scholar 

  5. Buccino, G., Riggio, L., Melli, G., Binkofski, F., Gallese, V., Rizzolatti, G.: Listening to action-related sentences modulates the activity of the motor system: a combined TMS and behavioral study. Cogn. Brain Res. 24(3), 355–363 (2005)

    Article  Google Scholar 

  6. Pulvermüller, F.: Brain mechanisms linking language and action. Nat. Rev. Neurosci. 6(7), 576–582 (2005)

    Article  Google Scholar 

  7. Chen, I.-H., Zhao, Q.Q., Long, Y.F., Lu, Q., Huang, C.-R.: Mandarin Chinese modality exclusivity norms. PLoS ONE 14(2), e0211336 (2019)

    Article  Google Scholar 

  8. Lynott, D., Connell, L., Brysbaert, M., Brand, J., Carney, J.: The Lancaster sensorimotor Norms: multidimensional measures of perceptual and action strength for 40,000 English words. Behav. Res. Methods 52(3), 1271–1291 (2020)

    Article  Google Scholar 

  9. Zhong, Y., Wan, M.Y., Ahrens, K., Huang, C.-R.: Sensorimotor norms for Chinese nouns and their relationship with orthographic and semantic variables. Lang. Cogn. Neurosci. 37(8), 1000–1022 (2022)

    Article  Google Scholar 

  10. Craig, A.D.: Emotional moments across time: a possible neural basis for time perception in the anterior insula. Philos. Trans. R. Soc. B: Biol. Sci. 364(1525), 1933–1942 (2009)

    Article  Google Scholar 

  11. Dunn, B.D., et al.: Listening to your heart: how interoception shapes emotion experience and intuitive decision making. Psychol. Sci. 21(12), 1835–1844 (2010)

    Article  Google Scholar 

  12. Connell, L., Lynott, D., Banks, B.: Interoception: the forgotten modality in perceptual grounding of abstract and concrete concepts. Philos. Trans. R. Soc. B: Biol. Sci. 373(1752), 20170143 (2018)

    Article  Google Scholar 

  13. Zhong, Y., Huang, C.-R., Ahrens, K.: Embodied grounding of concreteness/abstractness: a sensory-perceptual account of concrete and abstract concepts in Mandarin Chinese. Presented at the 22th Chinese Lexical Semantic Workshop (CLSW 2021), Nanjing Normal University, China, 15–16 May 2021

    Google Scholar 

  14. Russell, J.A.: A circumplex model of affect. J. Pers. Soc. Psychol. 39(6), 1161–1178 (1980)

    Article  Google Scholar 

  15. Bradley, M.M., Lang, P.J.: Affective norms for English words (ANEW): Instruction manual and affective ratings. Technical Report C-1, the Center for Research in Psychophysiology, University of Florida, vol. 30, no. 1, pp. 25–36 (1999)

    Google Scholar 

  16. Warriner, A.B., Kuperman, V., Brysbaert, M.: Norms of valence, arousal, and dominance for 13,915 English lemmas. Behav. Res. Methods 45(4), 1191–1207 (2013). https://doi.org/10.3758/s13428-012-0314-x

    Article  Google Scholar 

  17. Xu, X., Li, J.Y., Chen, H.L.: Valence and arousal ratings for 11,310 simplified Chinese words. Behav. Res. Methods 54(1), 1–16 (2021)

    MathSciNet  Google Scholar 

  18. Yu, L.C., et al.: Building Chinese affective resources in valence-arousal dimensions. In: Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pp. 540–545 (2016)

    Google Scholar 

  19. Winter, B.: Taste and smell words form an affectively loaded and emotionally flexible part of the English lexicon. Lang. Cogn. Neurosci. 31(8), 975–988 (2016)

    Article  Google Scholar 

  20. Phillips, M.L., Heining, M.: Neural correlates of emotion perception: from faces to taste. In: Rouby, C., Schaal, B., Dubois, D., Gervais, R., Holley, A. (eds.) Olfaction, taste, and cogntion, pp. 196–208. Cambridge University Press, Cambridge (2002)

    Chapter  Google Scholar 

  21. Krifka, M.: A note on an asymmetry in the hedonic implicatures of olfactory and gustatory terms. In: Fuchs, S., Hoole, P., Mooshammer, C., Zygis, M. (eds.) Between the regular and the particular in speech and language, pp. 235–245. Peter Lang, Frankfurt (2010)

    Google Scholar 

  22. Tsang, Y.-K., et al.: MELD-SCH: a megastudy of lexical decision in simplified Chinese. Behav. Res. Methods 50(5), 1763–1777 (2018)

    Article  Google Scholar 

  23. JASP Team: JASP (Version 0.16) [Computer software] (2021). https://jasp-stats.org/

  24. Kadohisa, M.: Effects of odor on emotion, with implications. Front. Syst. Neuroscience 7(66) (2013)

    Google Scholar 

  25. Critchley, H.D., Garfinkel, S.N.: Interoception and emotion. Curr. Opin. Psychol. 17, 7–14 (2017)

    Article  Google Scholar 

  26. Quadt, L., Critchley, H.D., Garfinkel, S.N.: Interoception and emotion: shared mechanisms and clinical implications. In: Tsakiris, M., De Preester, H. (eds.) The interoceptive mind: From Homeostasis to Awareness, pp. 123–143. Oxford University Press, Oxford, UK (2018)

    Google Scholar 

Download references

Acknowledgement

This work is supported by the dean’s reserve grant (1-ZVTL) from the Faculty of Humanities at The Hong Kong Polytechnic University.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Yin Zhong .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Zhong, Y., Ahrens, K. (2023). The Emotion Code in Sensory Modalities. In: Su, Q., Xu, G., Yang, X. (eds) Chinese Lexical Semantics. CLSW 2022. Lecture Notes in Computer Science(), vol 13496. Springer, Cham. https://doi.org/10.1007/978-3-031-28956-9_15

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-28956-9_15

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-28955-2

  • Online ISBN: 978-3-031-28956-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics