Affective Taste Evaluation System Using Sound Symbolic Words

  • Tomohiko Inazumi
  • Jinhwan KwonEmail author
  • Kohei Suzuki
  • Maki Sakamoto
Conference paper
Part of the Advances in Intelligent Systems and Computing book series (AISC, volume 774)


Language and emotions play an important role in affective computing and advancement of artificial intelligence. Sound-symbolic words (SSWs) have become increasingly important for meaningful descriptions of perceptual experiences as a detailed and reliable vocabulary. In this research, we constructed a system for quantifying texture/taste impressions expressed by SSWs. This system decomposes input SSW into phoneme elements and refers to the category quantity of each phoneme element for each adjective scale referring to a quantitative rating database. Then, the system displays the evaluation values calculated by impression-rating predictive model. We anticipate that this system will be able to support food development and recommendation of food name which expresses the impression of goods.


Affective system Human-systems integration Taste Sound-symbolic words 



This work was supported by Grant-in-Aid for Scientific Research (A) Grant Number 15H01720), a Grant-in-Aid for Scientific Research on Innovative Areas “Shitsukan” (Grant Number 23135510 and 25135713), and JSPS KAKENHI Grant Number 15H05922 (Grant-in-Aid for Scientific Research on Innovative Areas “Innovative SHITSUKSAN Science and Technology”) from MEXT, Japan.


  1. 1.
    Cambria, E.: Affective computing and sentiment analysis. IEEE Intel. Syst. 31(2), 102–107 (2016)CrossRefGoogle Scholar
  2. 2.
    Ren, F.: From cloud computing to language engineering affective computing and advanced intelligence. Int. J. Adv. Intel. 2(1), 1–14 (2010)Google Scholar
  3. 3.
    Calvo, R.A., D’Mello, S., Gratch, J., Kappas, A. (eds.): The Oxford Handbook of Affective Computing. Oxford Library of Psychology, New York (2015)Google Scholar
  4. 4.
    Köhler, W.: Gestalt Psychology. Liveright Publishing Corporation, NewYork (1929)Google Scholar
  5. 5.
    Sapir, E.: A study of phonetic symbolism. J. Exp. Psychol. 12, 225–239 (1929). Scholar
  6. 6.
    Newman, S.S.: Further experiments in phonetic symbolism. Am. J. Psychol. 45, 53–75 (1933)CrossRefGoogle Scholar
  7. 7.
    Werner, H., Wapner, S.: Toward a general theory of perception. Psychol. Rev. 59, 324–338 (1952)CrossRefGoogle Scholar
  8. 8.
    Wertheimer, M.: The relation between the sound of a word and its meaning. Am. J. Psychol. 71, 412–415 (1958)CrossRefGoogle Scholar
  9. 9.
    Taylor, I.K.: Phonetic symbolism re-examined. Psychol. Bull. 60, 200–209 (1963)CrossRefGoogle Scholar
  10. 10.
    Spence, C.: Crossmodal correspondences: a tutorial review. Atten. Percept. Psychophys. 73(4), 1–25 (2011)CrossRefGoogle Scholar
  11. 11.
    Schmidtke, D.S., Conrad, M., Jacobs, A.M.: Phonological iconicity. Front. Psychol. 5, 80 (2014). Scholar
  12. 12.
    Bloomfield, L.: Language. Henry Holt, New York (1933)Google Scholar
  13. 13.
    Osgood, C.E.: The nature and measurement of meaning. Psychol. Bull. 49, 197–237 (1952). Scholar
  14. 14.
    Bhushan, N., Rao, A.R., Lohse, G.L.: The texture lexicon: understanding the categorization of visual texture terms and their relationship to texture images. Cogn. Sci. 21, 219–246 (1997). Scholar
  15. 15.
    Guest, S., Dessirier, J.M., Mehrabyan, A., McGlone, F., Essick, G., Gescheider, G., et al.: The development and validation of sensory and emotional scales of touch perception. Atten. Percept. Psychophys. 73, 531–550 (2011). Scholar
  16. 16.
    Ramachandran, V.S., Hubbard, E.M.: Synaesthesia—a window into perception, thought and language. J. Conscious. Stud. 8, 3–34 (2001)Google Scholar
  17. 17.
    Ramachandran, V.S., Hubbard, E.M.: Hearing colors, tasting shapes. Sci. Am. 288, 43–49 (2003)CrossRefGoogle Scholar
  18. 18.
    Gallace, A., Boschin, E., Spence, C.: On the taste of “Bouba” and “Kiki”: an exploration of word-food associations in neurologically normal participants. Cogn. Neurosci. 2, 34–46 (2011)CrossRefGoogle Scholar
  19. 19.
    Ngo, M.K., Misra, R., Spence, C.: Assessing the shapes and speech sounds that people associate with chocolate samples varying in cocoa content. Food Qual. Pref. 22, 567–572 (2011)CrossRefGoogle Scholar
  20. 20.
    Sakamoto, M., Watanabe, J.: Cross-modal associations between sounds and drink tastes/textures: a study with spontaneous production of sound-symbolic words. Chem. Sens. 41(3), 197–203 (2015)CrossRefGoogle Scholar
  21. 21.
    Doizaki, R., Watanabe, J., Sakamoto, M.: Automatic estimation of multidimensional ratings from a single sound-symbolic word and word-based visualization of tactile perceptual space. IEEE Trans. Haptics 10(2), 173–182 (2017)CrossRefGoogle Scholar

Copyright information

© Springer International Publishing AG, part of Springer Nature 2019

Authors and Affiliations

  • Tomohiko Inazumi
    • 1
  • Jinhwan Kwon
    • 1
    Email author
  • Kohei Suzuki
    • 1
  • Maki Sakamoto
    • 1
  1. 1.Graduate School of Informatics and EngineeringThe University of Electro-CommunicationsChofuJapan

Personalised recommendations