Performance Analysis of Acoustic Emotion Recognition for In-Car Conversational Interfaces

  • Christian Martyn Jones
  • Ing-Marie Jonsson
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4555)


The automotive industry are integrating more technologies into the standard new car kit. New cars often provide speech enabled communications such as voice-dial, as well as control over the car cockpit including entertainment systems, climate and satellite navigation. In addition there is the potential for a richer interaction between driver and car by automatically recognising the emotional state of the driver and responding intelligently and appropriately. Driver emotion and driving performance are often intrinsically linked and knowledge of the driver emotion can enable to the car to support the driving experience and encourage better driving. Automatically recognising driver emotion is a challenge and this paper presents a performance analysis of our in-car acoustic emotion recognition system.


In-car systems emotion recognition emotional responses driving simulator affective computing speech recognition 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Lunenfeld, H.: Human factor considerations of motorist navigation and information systems. In: Vehicle Navigation and Information Systems Conference Proceedings, pp. 35–42 (1989)Google Scholar
  2. 2.
    Galovski, T., Blanchard, E.: Road rage: a domain for psychological intervention? Aggressive Violent Behavior 9(2), 105–127 (2004)CrossRefGoogle Scholar
  3. 3.
    Groeger, J.A.: Understanding driving: Applying cognitive psychology to a complex everyday task. U.K. Psychology Press, Hove (2000)Google Scholar
  4. 4.
    Nass, C., Jonsson, I.-M., Harris, H., Reaves, B., Endo, J., Brave, S., Takayama, L.: Increasing safety in cars by matching driver emotion and car voice emotion. In: Proceedings of CHI 2005, Portland, Oregon, USA (2005)Google Scholar
  5. 5.
    Cowie, R., Douglas-Cowie, E., Tsapatsoulis, N., Votsis, G., Kollias, S., Fellenz, W., Taylor, J.G.: Emotion recognition in human-computer interaction. IEEE Signal Proc, pp. 32–80 (2001)Google Scholar
  6. 6.
    Humaine Portal.: Research on affective computing,
  7. 7.
    Jones, C.: Project to develop voice-driven emotive technologies, Scottish Executive, Enterprise transport and lifelong learning department, UK (2004)Google Scholar
  8. 8.
    Kapoor, A., Qi, Y., Picard, R.: Fully automatic upper facial action recognition, IEEE International Workshop on Analysis and Modeling of Faces and Gestures (AMFG 2003) held in conjunction with ICCV 2003. Nice, France (2003)Google Scholar
  9. 9.
    Khan, M., Ward, R., Ingleby, M.: Distinguishing facial expressions by thermal imaging using facial thermal feature points. In: Proceedings of HCI 2005, pp. 5–9. Edinburgh, UK (2005)Google Scholar
  10. 10.
    Healey, J., Picard, R.: SmartCar: Detecting driver stress. In: Proceedings of ICPR 2000, Barcelona, Spain (2000)Google Scholar
  11. 11.
    Nass, C., Brave, S.: Wired for speech: How voice activates and advances the human-computer relationship. MIT Press, Cambridge, MA (2005)Google Scholar
  12. 12.
    Jones, C., Jonsson, I.-M.: Speech patterns for older adults while driving. In: Proceedings of HCI International 2005, Las Vegas, Nevada, USA (2005)Google Scholar
  13. 13.
    Jones, C., Jonsson, I.-M.: Automatic recognition of affective cues in the speech of car drivers to allow appropriate responses. In: Proceedings of OZCHI, Canberra, Australia (2005)Google Scholar
  14. 14.
    STISIM drive system: Systems technology, Inc. California,
  15. 15.
    Izard, C.: Human Emotions. Plenum Press, New York (1977)Google Scholar
  16. 16.
    Isen, A.M.: Positive affect and decision making. In: Lewis, M., Haviland-Jones, J.M. (eds.) Handbook of emotions, pp. 417–435. The Guilford Press, New York (2000)Google Scholar
  17. 17.
    Brave, S.: Agents that care: Investigating the effects of orientation of emotion exhibited by an embodied computer agent, Doctoral dissertation. Stanford University, CA (2003)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2007

Authors and Affiliations

  • Christian Martyn Jones
    • 1
  • Ing-Marie Jonsson
    • 2
  1. 1.University of the Sunshine Coast, Queensland, 4558Australia
  2. 2.Department of Communication, Stanford University, California 94305USA

Personalised recommendations