Advertisement

Cognition and Physio-acoustic Correlates — Audio and Audio-visual Effects of a Short English Emotional Statement: On JL2, FL2 and EL1

  • Toshiko Isei-Jaakkola
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4139)

Abstract

This paper concerns the correlation between cognition test results from audio and audio-visual effects on nine English emotional words and the physio-acoustic distances. Two parameters were selected; F0 and intensity. The two types of distance were calculated: the average and pattern-distance for each emotion. 2 Japanese, 2 Finnish, and 1 English group participated in the cognition tests. Regarding cognition, the correct answer ratios were higher in audio-visual than audio for all three languages. The difference between audio and audio-visual was much smaller in Japanese than in the other languages. Finnish showed different correct answer patterns than the others. The correlation between cognition and distances confirmed that the pattern distance was more correlated with cognition than with average distance in both audio and audio-visual. Also, it seems that intensity was more correlated with cognition than F0.

Keywords

Correct Answer Standard Score Emotion Word Acoustic Parameter Cognition Test 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Isei-Jaakkola, T., Neff, P.: Japanese L2 Learner’s Emotional Cognition of English Intonation. In: Proceedings of 7th Annual Congress of EPSJ (2002)Google Scholar
  2. 2.
    Isei-Jaakkola, T., Soga, S., Barat, R.: Audio and Audio-visual Effects on English Emotions by Japanese L2. In: A Handbook for the EPSJ Kanto Branch 6th Meeting, pp. 63–68 (2004)Google Scholar
  3. 3.
    Isei-Jaakkola, T., Sun, Q., Hirose, K.: Audio and Audio-visual Effects of English Emotional Word on Japanese L2’s Cognition and the Acoustic Correlate. In: Proceedings of SPECOM 2005, pp. 455–458 (2005)Google Scholar
  4. 4.
    Isei-Jaakkola, T., Sun, Q., Hirose, K.: Audio and Audio-visual Effects of a Short English Emotional Sentence on Japanese L2’s and English L1’s Cognition, and Physio-acoustic Correlate. In: Proceedings of Int. Conf. of Speech Prosody Dresden (2006)Google Scholar
  5. 5.
    Scherer, K.R.: Cross-cultural Investigation of Emotion Inferences from Voice and Speech: Implications of Speech and Technology. In: Proceedings of ICSLP Beijing, vol. 2, pp. 379–382 (2000)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Toshiko Isei-Jaakkola
    • 1
    • 2
  1. 1.Graduate School of Information Science and TechnologyUniversity of TokyoTokyoJapan
  2. 2.PL9, Department of Speech SciencesUniversity of HelsinkiHelsinkiFinland

Personalised recommendations