IEMOCAP: interactive emotional dyadic motion capture database

  • Carlos Busso
  • Murtaza Bulut
  • Chi-Chun Lee
  • Abe Kazemzadeh
  • Emily Mower
  • Samuel Kim
  • Jeannette N. Chang
  • Sungbok Lee
  • Shrikanth S. Narayanan
Article

Abstract

Since emotions are expressed through a combination of verbal and non-verbal channels, a joint analysis of speech and gestures is required to understand expressive human communication. To facilitate such investigations, this paper describes a new corpus named the “interactive emotional dyadic motion capture database” (IEMOCAP), collected by the Speech Analysis and Interpretation Laboratory (SAIL) at the University of Southern California (USC). This database was recorded from ten actors in dyadic sessions with markers on the face, head, and hands, which provide detailed information about their facial expressions and hand movements during scripted and spontaneous spoken communication scenarios. The actors performed selected emotional scripts and also improvised hypothetical scenarios designed to elicit specific types of emotions (happiness, anger, sadness, frustration and neutral state). The corpus contains approximately 12 h of data. The detailed motion capture information, the interactive setting to elicit authentic emotions, and the size of the database make this corpus a valuable addition to the existing databases in the community for the study and modeling of multimodal and expressive human communication.

Keywords

Audio-visual database Dyadic interaction Emotion Emotional assessment Motion capture system 

Copyright information

© Springer Science+Business Media B.V. 2008

Authors and Affiliations

  • Carlos Busso
    • 1
  • Murtaza Bulut
    • 1
  • Chi-Chun Lee
    • 1
  • Abe Kazemzadeh
    • 1
  • Emily Mower
    • 1
  • Samuel Kim
    • 1
  • Jeannette N. Chang
    • 1
  • Sungbok Lee
    • 1
  • Shrikanth S. Narayanan
    • 1
  1. 1.Speech Analysis and Interpretation Laboratory (SAIL)University of Southern CaliforniaLos AngelesUSA

Personalised recommendations