Emotion Recognition Using Bio-sensors: First Steps towards an Automatic System

Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3068)


The detection of emotion is becoming an increasingly important field for human-computer interaction as the advantages emotion recognition offer become more apparent and realisable. Emotion recognition can be achieved by a number of methods, one of which is through the use of bio-sensors. Bio-sensors possess a number of advantages against other emotion recognition methods as they can be made both inobtrusive and robust against a number of environmental conditions which other forms of emotion recognition have difficulty to overcome. In this paper, we describe a procedure to train computers to recognise emotions using multiple signals from many different bio-sensors. In particular, we describe the procedure we adopted to elicit emotions and to train our system to recognise them. We also present a set of preliminary results which indicate that our neural net classifier is able to obtain accuracy rates of 96.6% and 89.9% for recognition of emotion arousal and valence respectively.


Heart Rate Variability Emotion Recognition Skin Conductivity Facial Expression Recognition International Affective Picture System 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Rangayyan, R.M.: Biomedical Signal Analysis – A Case-Study Approach. IEEE Press, Los Alamitos (2002)Google Scholar
  2. 2.
    Lang, P.J., Bradley, M.M., Cuthbert, B.N.: International affective picture system (IAPS): Instruction Manual and Affective Ratings. Technical Report A-5. Gainesville, FL. The Center for Research in Psychophysiology, University of Florida (2001)Google Scholar
  3. 3.
    Center for the Study of Emotion and Attention [CSEA-NIMH], The international affective picture system: Digitized photographs. Gainesville, FL: The Center for Research in Psychphysiology, Univerity of Florida (2001)Google Scholar
  4. 4.
    Barreto, A., Heimer, M., Garcia, M.: Characterization of Photoplehtysmographic Blood Volume Pulse Waveforms for Exercise Evalution. In: Proceedings 14th Southern Biomedical Engineering Conference, Shreveport, Louisiana, April 1995, pp. 220–223 (1995)Google Scholar
  5. 5.
    Chrisite, Multivariate Discrimination of Emotion-specific Autonomic Nervous System Activity, Master Thesis in Science of Psychology, VirginiaGoogle Scholar
  6. 6.
    Picard, R.W.: Affective Computing. MIT Press, Cambridge (2000)Google Scholar
  7. 7.
    Reeves, B., Nass, C.: The Media Equation, Center for the Study of Language and Information. Stanford University, Stanford (1996)Google Scholar
  8. 8.
    Picard, R.W.: Toward computers that recognize and respond to user emotion. IBM Systems Journal 39(3&4) (2000)Google Scholar
  9. 9.
    Healy, J., Picard, R.: Digital processing of Affective Signals. In: ICASSP 1998 (1998)Google Scholar
  10. 10.
    Kandel, E.R., Schwartz, J.H., Jessell, T.J.: Principles of neural science, 4th edn. McGraw-Hill, New York (2000)Google Scholar
  11. 11.
    Vyzas, E., Picard, R.: Offline and Online Emotion Recognition from physiological data. In: EBA 1999 (1999)Google Scholar
  12. 12.
    Tato, R., Santos, R., Kompe, R., Pardo, J.M.: Emotional Space Improves Emotion Recognition. In: ICSLP 2002, Denver, pp. 2029–2032 (2002)Google Scholar
  13. 13.
    Ekman, P., Friesen, W.E.: Facial Action Coding system. Consulting Pychologist Press, Palo Alto (1977)Google Scholar
  14. 14.
    Cowie, R.: Describing the emotional states expressed in speech. In: ISCA workshop on speech and emotion, Belfast (2000)Google Scholar
  15. 15.
    Turk, M., Pentland, A.: Eigen Faces for Recognition. Journal of Cognitive Neuroscience 3(1) (1991)Google Scholar
  16. 16.
    Fernandez, R., Picard, R.: Signal Processing for Recognition of Human Frustration; Media Laboratory, Perceptual Computing TR 447, MIT, Cambridge, MA (1997)Google Scholar
  17. 17.
    Juang, B.H., Soong, F.K.: Hands-free Telecommunications. In: HSC 2001, Kyoto, Japan, pp. 5–10 (2001)Google Scholar
  18. 18.
    SNNS; Stuttgart Neural Network Simulator,
  19. 19.
    Pentland, A.: Perceptual Intelligence. Communications of the ACM 43(3), 35–44 (2000)CrossRefGoogle Scholar
  20. 20.
    Richins, M.L.: Measuring Emotions in the Consumption Experience. Journal of Consumer Research 24, 127–146 (1997)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2004

Authors and Affiliations

  1. 1.Sony Corporate Laboratories EuropeStuttgartGermany

Personalised recommendations