Biometric Emotion Assessment and Feedback in an Immersive Digital Environment

  • Daniel Castro SilvaEmail author
  • Vasco Vinhas
  • Luís Paulo Reis
  • Eugénio Oliveira


Affective computing has increased its significance both in terms of academic and industry attention and investment. Alongside, immersive digital environments have settled as a reliable domain, with progressively inexpensive hardware solutions. Having this in mind, the authors envisioned the automatic real-time user emotion extraction through biometric readings in an immersive digital environment. In the running example, the environment consisted in an aeronautical simulation, and biometric readings were based mainly on galvanic skin response, respiration rate and amplitude, and phalanx temperature. The assessed emotional states were also used to modify some simulation context variables, such as flight path, weather conditions and maneuver smoothness level. The results were consistent with the emotional states as stated by the users, achieving a success rate of 77%, considering single emotions and 86% considering a quadrant-based analysis.


Emotion assessment Biometric readings Immersive digital environments Aeronautical simulation 


  1. 1.
    Kozima H, Michalowski MP, Nakagawa C (2009) A playful robot for research, therapy, and entertainment. Int J Soc Rob 1(1):3–18 CrossRefGoogle Scholar
  2. 2.
    Kim J-H, Jeong I-B, Park I-W, Lee K-H (2009) Multi-layer architecture of ubiquitous robot system for integrated services. Int J Soc Rob 1(1):19–28 CrossRefGoogle Scholar
  3. 3.
    Mayo Clinic (2008) Phobias. Available online at Accessed December 2008
  4. 4.
    Stoller G (2006) Fear of flying can cripple workers. USA Today, March 2006. Available online at Accessed December 2008
  5. 5.
    Russell JA (1980) A circumplex model of affect. J Personal Soc Psychol 39:1161–1178 CrossRefGoogle Scholar
  6. 6.
    Damásio AR (1998) Emotions and the human brain. Department of Neurology, Iowa, USA Google Scholar
  7. 7.
    Damásio AR (1994) Descartes error: emotion, reason and human brain. Europa-América Google Scholar
  8. 8.
    Altarriba J, Basnight DM, Canary TM (2003) Emotion representation and perception across cultures. In: Lonner WJ, Dinnel DL, Hayes SA, Sattler DN (eds) Read in psychol and cult. Center for Cross-Cultural Research, Western Washington University, Bellingham (Unit 4, Chap 5) Google Scholar
  9. 9.
    Benovoy M, Cooperstock J, Deitcher J (2008) Biosignals analysis and its application in a performance setting—towards the development of an emotional-imaging generator. In: Proc of the first int conf on biomedic electron and devices (Biosignals 2008), pp 253–258 Google Scholar
  10. 10.
    Teixeira J, Vinhas V, Oliveira E, Reis LP (2008) Emotion assessment tool for human-machine interfaces—using EEG data and multimedia stimuli towards emotion classification. In: Int conf on signal process and multimed appl (SIGMAP 2008), pp 185–188 Google Scholar
  11. 11.
    Vinhas V, Oliveira E, Reis LP (2008) Realtime dynamic multimedia storyline based on online audience biometric information. In: KES intell interact multimed syst and serv (KES IIMSS), pp 545–554 Google Scholar
  12. 12.
    Kim J, André E (2008) Multi-channel biosignal analysis for automatic emotion recognition. In: Int conf on bio-inspired syst and signal process (Biosignals 2008) Google Scholar
  13. 13.
    Katsis C, Katertsidis N, Ganiatsas G, Fotiadis D (2008) Towards emotion recognition in car-racing drivers: a biosignal processing approach. IEEE Trans Syst Man Cybern, Part A, Syst Hum 38(3):502–512 CrossRefGoogle Scholar
  14. 14.
    Simtrain LLC (2008) Available online at Accessed December 2008
  15. 15.
    Gimenes R, Silva DC, Reis, LP, Oliveira E (2008) Flight simulation environments applied to agent-based autonomous UAVs. In: Int conf on enterp inf syst (ICEIS 2008), pp 243–246 Google Scholar
  16. 16.
    Lewis M, Jacobson J (2002) Game engines in scientific research. Commun ACM 45(1):27–31 Google Scholar
  17. 17.
    Kahan M, Tanzer J, Darvin D, Borer F (2000) Virtual reality-assisted cognitive-behavioral treatment for fear of flying: acute treatment and follow-up. Cyberpsychol Behav 3(3):387–392 CrossRefGoogle Scholar
  18. 18.
    da Costa R, Sardinha A, Nardi A (2008) Virtual reality exposure in the treatment of fear of flying. Aviat Space Environ Med 79(9):899–903 CrossRefGoogle Scholar
  19. 19.
    Anderson P, Jacobs CH, Lindner GK, Edwards S, Zimand E, Hodges L, Rothbaum BO (2006) Cognitive behavior therapy for fear of flying: sustainability of treatment gains after September 11. Behav Ther 37(1):91–97 CrossRefGoogle Scholar
  20. 20.
    Rothbaum BO, Anderson P, Zimand E, Hodges L, Lang D, Wilson J (2006) Virtual reality exposure therapy and standard (in vivo) exposure therapy in the treatment for the fear of flying. Behav Ther 37(1):80–90 CrossRefGoogle Scholar
  21. 21.
    Virtual Aviation (2008) Available online at Accessed December 2008
  22. 22.
    Bird S (2005) You’re cleared for take-off—how to tackle a fear of flying on a virtual plane. The Times. Available online at Accessed December 2008

Copyright information

© Springer Science & Business Media BV 2009

Authors and Affiliations

  • Daniel Castro Silva
    • 1
    Email author
  • Vasco Vinhas
    • 1
  • Luís Paulo Reis
    • 1
  • Eugénio Oliveira
    • 1
  1. 1.Department of Informatics Engineering, Faculty of EngineeringUniversity of Porto/Artificial Intelligence and Computer Science LaboratoryPortoPortugal

Personalised recommendations