Cognition and Physio-acoustic Correlates — Audio and Audio-visual Effects of a Short English Emotional Statement: On JL2, FL2 and EL1
This paper concerns the correlation between cognition test results from audio and audio-visual effects on nine English emotional words and the physio-acoustic distances. Two parameters were selected; F0 and intensity. The two types of distance were calculated: the average and pattern-distance for each emotion. 2 Japanese, 2 Finnish, and 1 English group participated in the cognition tests. Regarding cognition, the correct answer ratios were higher in audio-visual than audio for all three languages. The difference between audio and audio-visual was much smaller in Japanese than in the other languages. Finnish showed different correct answer patterns than the others. The correlation between cognition and distances confirmed that the pattern distance was more correlated with cognition than with average distance in both audio and audio-visual. Also, it seems that intensity was more correlated with cognition than F0.
KeywordsCorrect Answer Standard Score Emotion Word Acoustic Parameter Cognition Test
Unable to display preview. Download preview PDF.
- 1.Isei-Jaakkola, T., Neff, P.: Japanese L2 Learner’s Emotional Cognition of English Intonation. In: Proceedings of 7th Annual Congress of EPSJ (2002)Google Scholar
- 2.Isei-Jaakkola, T., Soga, S., Barat, R.: Audio and Audio-visual Effects on English Emotions by Japanese L2. In: A Handbook for the EPSJ Kanto Branch 6th Meeting, pp. 63–68 (2004)Google Scholar
- 3.Isei-Jaakkola, T., Sun, Q., Hirose, K.: Audio and Audio-visual Effects of English Emotional Word on Japanese L2’s Cognition and the Acoustic Correlate. In: Proceedings of SPECOM 2005, pp. 455–458 (2005)Google Scholar
- 4.Isei-Jaakkola, T., Sun, Q., Hirose, K.: Audio and Audio-visual Effects of a Short English Emotional Sentence on Japanese L2’s and English L1’s Cognition, and Physio-acoustic Correlate. In: Proceedings of Int. Conf. of Speech Prosody Dresden (2006)Google Scholar
- 5.Scherer, K.R.: Cross-cultural Investigation of Emotion Inferences from Voice and Speech: Implications of Speech and Technology. In: Proceedings of ICSLP Beijing, vol. 2, pp. 379–382 (2000)Google Scholar