Advertisement

BioStories: Dynamic Multimedia Environments Based on Real-Time Audience Emotion Assessment

  • Vasco Vinhas
  • Eugénio Oliveira
  • Luís Paulo Reis
Part of the Lecture Notes in Business Information Processing book series (LNBIP, volume 73)

Abstract

BioStories is the outcome of a four-year research project focused in uniting affective and ubiquitous computing with context aware multimedia environments real-time generation. Its initial premise was based in the possibility of performing real-time automatic emotion assessment trough online biometric channels monitoring and use this information to design on-the-fly dynamic multimedia storylines emotionally adapted, so that end users would unconsciously be determining the story graph. The emotion assessment process was based on biometric channels dynamic fusion such as EEG, GSR, respiration rate and volume, skin temperature and heart rate on top of Russell’s circumplex model of affect. BioStories’ broad scope also allowed for some spin-off projects namely mouse control through EMG that resulted in a tested technology for alternative/ inclusive interfaces. Exhaustive experiments showed 86% of success rate for emotion assessment, IC95%(p)≈(0.81, 0.90), in a dynamic tridimensional virtual environment with an immersiveness user score of 4.3 out of 5. The success of the proposed approach allows the vision of its appliance in several domains such as virtual entertainment, videogames and cinema as well as direct marketing, digital TV and domotic appliances.

Keywords

Emotion assessment Biometric channels Dynamic interfaces Multimedia content 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Gomes, A., Vinhas, V.: Mouse Control Through Electromyography. In: BIOSIGNALS 2008 – International Conference on Bio-inspired Systems and Signal Processing, pp. 371–376 (2008)Google Scholar
  2. 2.
    Benovoy, M., Cooperstock, J., Deitcher, J.: Biosignals Analysis and its Alication in a Performance Setting - Towards the Development of an Emotional-Imaging Generator. In: Proceedings of the First Inte Conference on Biomedical Electronics and Devices, pp. 253–258 (2008)Google Scholar
  3. 3.
    van den Broek, E.L., et al.: Biosignals as an Advanced Man-Machine Interface. In: BIOSTEC International Joint Conference on Biomedical Engineering Systems and Technologies, pp. 15–24 (2009)Google Scholar
  4. 4.
    Ekman, P.: Emotion in the Human Face, pp. 39–55. Cambridge University Press, Cambridge (2005)Google Scholar
  5. 5.
    Wang, H., Prendinger, H., Igarashi, T.: Communicating emotions in online chat using physiological sensors and animated text. In: Conference on Human Factors in Computing System, pp. 1171–1174 (2004)Google Scholar
  6. 6.
    Chung, J.-w., Scott Vercoe, G.: The affective remixer: personalized music arranging. In: Conference on Human Factors in Computing Systems, pp. 393–398 (2006)Google Scholar
  7. 7.
    Teixeira, J., Vinhas, V., Oliveira, E., Reis, L.P.: General-Purpose Emotion Assessment Testbed Based on Biometric Information. In: KES IIMSS - Intelligent Interactive Multimedia Systems and Services, pp. 533–543. University of Piraeus, Greece (2008)Google Scholar
  8. 8.
    Teixeira, J., Vinhas, V., Oliveira, E., Reis, L.P.: MultiChannel Emotion Assessment Framework - Gender and High-Frequency Electroencephalography as Key-Factors. In: Proceedings of ICEIS 2008 - 10th International Conference on Enterprise Information Systems, pp. 331–334 (2008)Google Scholar
  9. 9.
    Teixeira, J., Vinhas, V., Oliveira, E., Reis, L.P.: A New Aroach to Emotion Assessment Based on Biometric Data. In: WI-IAT 2008 - IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology, Sydney, Australia, December 9-12, pp. 505–511 (2008)Google Scholar
  10. 10.
    Katsis, C., Katertsidis, N., Ganiatsas, G., Fotiadis, D.: Towards Emotion Recognition in Car-Racing Drivers: A Biosignal Processing Aroach, in IEEE Tran. IEEE Tran. on Systems, Man, and Cybernetics – Part A: Systems and Humans 38(3), 502–512 (2008)CrossRefGoogle Scholar
  11. 11.
    Kim, J., André, E.: Multi-Channel BioSignal Analysis for Automatic Emotion Recognition. In: Proceedings of the First International Conference on Biomedical Electronics and Devices (2008)Google Scholar
  12. 12.
    Picard, R.W., Vyzas, E., Healey, J.: Toward Machine Emotional Intelligence: Analysis of Affective physiological state. IEEE Transactions on Pattern Analysis and Machine Intelligence 23(10), 1175–1191 (2001)CrossRefGoogle Scholar
  13. 13.
    Russell, J.A.: A Circumplex Model of Affect. Journal of Personality and Social Psychology (39), 1161–1178 (1980)Google Scholar
  14. 14.
    Russell, J.A.: Evidence for a Three-Factor Theory of Emotions. Journal of Research in Personality 11, 273–294 (1977)CrossRefGoogle Scholar
  15. 15.
    Fairclough, S.H.: Fundamentals of Physiological Computing. Interaction with Computers 21(1-2), 133–145 (2009)CrossRefGoogle Scholar
  16. 16.
    Vinhas, V., Oliveira, E., Reis, L.P.: Realtime Dynamic Multimedia Storyline Based on Online Audience Biometric Information. In: KES IIMSS - Intelligent Interactive Multimedia Systems and Services, pp. 545–554. University of Piraeus, Greece (2008)Google Scholar
  17. 17.
    Vinhas, V., Oliveira, E., Reis, L.P.: Dynamic Multimedia Content Delivery Based on Real-Time User Emotions – Multichannel Online Biosignals Towards Adaptative GUI and Content Delivery. In: International Conference on Bio-inspired Systems and Signal Processing, pp. 299–304 (2009)Google Scholar
  18. 18.
    Vinhas, V., Silva, D.C., Oliveira, E., Reis, L.P.: Dynamic Multimedia Environment Based On Real-Time User Emotion Assessment – Biometric User Data Towards Affective Immersive Environments. In: ICEIS 2009 – International Conference on Enterprise Information Systems (2009)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2011

Authors and Affiliations

  • Vasco Vinhas
    • 1
    • 2
  • Eugénio Oliveira
    • 1
    • 2
  • Luís Paulo Reis
    • 1
    • 2
  1. 1.FEUP – Faculdade de Engenharia da Universidade do PortoPortoPortugal
  2. 2.LIACC – Laboratório de Inteligência Artificial e Ciência de ComputadoresPortoPortugal

Personalised recommendations