Skip to main content

Emotion Recognition Using Bio-sensors: First Steps towards an Automatic System

  • Conference paper
Affective Dialogue Systems (ADS 2004)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 3068))

Included in the following conference series:

Abstract

The detection of emotion is becoming an increasingly important field for human-computer interaction as the advantages emotion recognition offer become more apparent and realisable. Emotion recognition can be achieved by a number of methods, one of which is through the use of bio-sensors. Bio-sensors possess a number of advantages against other emotion recognition methods as they can be made both inobtrusive and robust against a number of environmental conditions which other forms of emotion recognition have difficulty to overcome. In this paper, we describe a procedure to train computers to recognise emotions using multiple signals from many different bio-sensors. In particular, we describe the procedure we adopted to elicit emotions and to train our system to recognise them. We also present a set of preliminary results which indicate that our neural net classifier is able to obtain accuracy rates of 96.6% and 89.9% for recognition of emotion arousal and valence respectively.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Rangayyan, R.M.: Biomedical Signal Analysis – A Case-Study Approach. IEEE Press, Los Alamitos (2002)

    Google Scholar 

  2. Lang, P.J., Bradley, M.M., Cuthbert, B.N.: International affective picture system (IAPS): Instruction Manual and Affective Ratings. Technical Report A-5. Gainesville, FL. The Center for Research in Psychophysiology, University of Florida (2001)

    Google Scholar 

  3. Center for the Study of Emotion and Attention [CSEA-NIMH], The international affective picture system: Digitized photographs. Gainesville, FL: The Center for Research in Psychphysiology, Univerity of Florida (2001)

    Google Scholar 

  4. Barreto, A., Heimer, M., Garcia, M.: Characterization of Photoplehtysmographic Blood Volume Pulse Waveforms for Exercise Evalution. In: Proceedings 14th Southern Biomedical Engineering Conference, Shreveport, Louisiana, April 1995, pp. 220–223 (1995)

    Google Scholar 

  5. Chrisite, Multivariate Discrimination of Emotion-specific Autonomic Nervous System Activity, Master Thesis in Science of Psychology, Virginia

    Google Scholar 

  6. Picard, R.W.: Affective Computing. MIT Press, Cambridge (2000)

    Google Scholar 

  7. Reeves, B., Nass, C.: The Media Equation, Center for the Study of Language and Information. Stanford University, Stanford (1996)

    Google Scholar 

  8. Picard, R.W.: Toward computers that recognize and respond to user emotion. IBM Systems Journal 39(3&4) (2000)

    Google Scholar 

  9. Healy, J., Picard, R.: Digital processing of Affective Signals. In: ICASSP 1998 (1998)

    Google Scholar 

  10. Kandel, E.R., Schwartz, J.H., Jessell, T.J.: Principles of neural science, 4th edn. McGraw-Hill, New York (2000)

    Google Scholar 

  11. Vyzas, E., Picard, R.: Offline and Online Emotion Recognition from physiological data. In: EBA 1999 (1999)

    Google Scholar 

  12. Tato, R., Santos, R., Kompe, R., Pardo, J.M.: Emotional Space Improves Emotion Recognition. In: ICSLP 2002, Denver, pp. 2029–2032 (2002)

    Google Scholar 

  13. Ekman, P., Friesen, W.E.: Facial Action Coding system. Consulting Pychologist Press, Palo Alto (1977)

    Google Scholar 

  14. Cowie, R.: Describing the emotional states expressed in speech. In: ISCA workshop on speech and emotion, Belfast (2000)

    Google Scholar 

  15. Turk, M., Pentland, A.: Eigen Faces for Recognition. Journal of Cognitive Neuroscience 3(1) (1991)

    Google Scholar 

  16. Fernandez, R., Picard, R.: Signal Processing for Recognition of Human Frustration; Media Laboratory, Perceptual Computing TR 447, MIT, Cambridge, MA (1997)

    Google Scholar 

  17. Juang, B.H., Soong, F.K.: Hands-free Telecommunications. In: HSC 2001, Kyoto, Japan, pp. 5–10 (2001)

    Google Scholar 

  18. SNNS; Stuttgart Neural Network Simulator, http://www-ra.informatik.uni-tuebingen.de/SNNS

  19. Pentland, A.: Perceptual Intelligence. Communications of the ACM 43(3), 35–44 (2000)

    Article  Google Scholar 

  20. Richins, M.L.: Measuring Emotions in the Consumption Experience. Journal of Consumer Research 24, 127–146 (1997)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2004 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Haag, A., Goronzy, S., Schaich, P., Williams, J. (2004). Emotion Recognition Using Bio-sensors: First Steps towards an Automatic System. In: André, E., Dybkjær, L., Minker, W., Heisterkamp, P. (eds) Affective Dialogue Systems. ADS 2004. Lecture Notes in Computer Science(), vol 3068. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-24842-2_4

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-24842-2_4

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-22143-2

  • Online ISBN: 978-3-540-24842-2

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics