Abstract
In this paper we present our study on expressive gibberish speech synthesis as a means for affective communication between computing devices, such as a robot or an avatar, and their users. Gibberish speech consists of vocalizations of meaningless strings of speech sounds and is sometimes used by performing artists to express intended (and often exaggerated) emotions and affect, such as anger and surprise, without actually pronouncing any understandable word. The advantage of gibberish in affective computing lies with the fact that no understandable text has to be pronounced and that only affect is conveyed. This can be used to test the effectiveness of affective prosodic strategies, for example, but it can also be applied in actual systems.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Heimlich, K.: Animal-Assisted Therapy and the Severely Disabled Child: A Quantitative Study. Journal of Rehabilitation 67(4), 48–54 (2001)
Shibata, T., Mitsui, T., Wada, K., Touda, A., Kumasaka, T., Tagami, K., Tanie, K.: Mental Commit Robot and Its Application to Therapy of Children. In: Proc. of the IEEE/ASME International Conference on AIM 2001, p. 182 (July 2001)
Mehrabian, A.: Communication Without Words. Psychology Today 2(4), 53–56 (1968)
Carlson, R., Granström, B., Nord, I.: Segmental Evaluation Using the Esprit/SAM Test Procedures and Mono-syllabic Words. In: Bailly, G., Benont, C. (eds.) Talking Machines, pp. 443–453. Elsevier, North Holland (1990)
Yilmazyildiz, S., Mattheyses, W., Patsis, G., Verhelst, W.: Expressive Speech Recognition and Synthesis as Enabling Technologies for Affective Robot-Child Communication. In: Zhuang, Y., Yang, S., Rui, Y., He, Q. (eds.) PCM 2006. LNCS, vol. 4261, pp. 1–8. Springer, Heidelberg (2006)
Oudeyer, P.Y.: The Synthesis of Cartoon Emotional Speech. In: Proc. of the 1st International Conference on Prosody, Aix-en-Provence, France, pp. 551–554 (2002)
Breazal, C.: Sociable Machines: Expressive Social Exchanges Between Humans and Robots. Ph.D. thesis, MIT AI Lab (2000)
Hart, M.: Project Gutenberg (2003), http://www.gutenberg.org
Latacz, L., Kong, Y., Mattheyses, W., Verhelst, W.: An Overview of the VUB Entry for the 2008 Blizzard Challenge. Blizzard Challenge 2008, In: Brisbane, Australia (2008)
Schröder, M.: Speech and Emotion Research: An Overview of Research Frameworks and Dimensional Approach to Emotional Speech Synthesis. Ph.D. thesis, PHONUS 7, Research Report of the Institute of Phonetics, Saarland University (2004)
OpenMary: Open Source Emotional Text-to-Speech Synthesis System, http://mary.dfki.de/
Schröder, M., Cowie, R., Douglas-Cowie, E., Westerdijk, M., Gielen, S.: Acoustic Correlates of Emotion Dimensions in View of Speech Synthesis. In: Proc. of the Eurospeech 2001, Aalborg vol. 1, pp. 87–90 (2001)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Yilmazyildiz, S., Latacz, L., Mattheyses, W., Verhelst, W. (2010). Expressive Gibberish Speech Synthesis for Affective Human-Computer Interaction. In: Sojka, P., Horák, A., Kopeček, I., Pala, K. (eds) Text, Speech and Dialogue. TSD 2010. Lecture Notes in Computer Science(), vol 6231. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-15760-8_74
Download citation
DOI: https://doi.org/10.1007/978-3-642-15760-8_74
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-15759-2
Online ISBN: 978-3-642-15760-8
eBook Packages: Computer ScienceComputer Science (R0)