Abstract
BioStories is the outcome of a four-year research project focused in uniting affective and ubiquitous computing with context aware multimedia environments real-time generation. Its initial premise was based in the possibility of performing real-time automatic emotion assessment trough online biometric channels monitoring and use this information to design on-the-fly dynamic multimedia storylines emotionally adapted, so that end users would unconsciously be determining the story graph. The emotion assessment process was based on biometric channels dynamic fusion such as EEG, GSR, respiration rate and volume, skin temperature and heart rate on top of Russell’s circumplex model of affect. BioStories’ broad scope also allowed for some spin-off projects namely mouse control through EMG that resulted in a tested technology for alternative/ inclusive interfaces. Exhaustive experiments showed 86% of success rate for emotion assessment, IC95%(p)≈(0.81, 0.90), in a dynamic tridimensional virtual environment with an immersiveness user score of 4.3 out of 5. The success of the proposed approach allows the vision of its appliance in several domains such as virtual entertainment, videogames and cinema as well as direct marketing, digital TV and domotic appliances.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Gomes, A., Vinhas, V.: Mouse Control Through Electromyography. In: BIOSIGNALS 2008 – International Conference on Bio-inspired Systems and Signal Processing, pp. 371–376 (2008)
Benovoy, M., Cooperstock, J., Deitcher, J.: Biosignals Analysis and its Alication in a Performance Setting - Towards the Development of an Emotional-Imaging Generator. In: Proceedings of the First Inte Conference on Biomedical Electronics and Devices, pp. 253–258 (2008)
van den Broek, E.L., et al.: Biosignals as an Advanced Man-Machine Interface. In: BIOSTEC International Joint Conference on Biomedical Engineering Systems and Technologies, pp. 15–24 (2009)
Ekman, P.: Emotion in the Human Face, pp. 39–55. Cambridge University Press, Cambridge (2005)
Wang, H., Prendinger, H., Igarashi, T.: Communicating emotions in online chat using physiological sensors and animated text. In: Conference on Human Factors in Computing System, pp. 1171–1174 (2004)
Chung, J.-w., Scott Vercoe, G.: The affective remixer: personalized music arranging. In: Conference on Human Factors in Computing Systems, pp. 393–398 (2006)
Teixeira, J., Vinhas, V., Oliveira, E., Reis, L.P.: General-Purpose Emotion Assessment Testbed Based on Biometric Information. In: KES IIMSS - Intelligent Interactive Multimedia Systems and Services, pp. 533–543. University of Piraeus, Greece (2008)
Teixeira, J., Vinhas, V., Oliveira, E., Reis, L.P.: MultiChannel Emotion Assessment Framework - Gender and High-Frequency Electroencephalography as Key-Factors. In: Proceedings of ICEIS 2008 - 10th International Conference on Enterprise Information Systems, pp. 331–334 (2008)
Teixeira, J., Vinhas, V., Oliveira, E., Reis, L.P.: A New Aroach to Emotion Assessment Based on Biometric Data. In: WI-IAT 2008 - IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology, Sydney, Australia, December 9-12, pp. 505–511 (2008)
Katsis, C., Katertsidis, N., Ganiatsas, G., Fotiadis, D.: Towards Emotion Recognition in Car-Racing Drivers: A Biosignal Processing Aroach, in IEEE Tran. IEEE Tran. on Systems, Man, and Cybernetics – Part A: Systems and Humans 38(3), 502–512 (2008)
Kim, J., André, E.: Multi-Channel BioSignal Analysis for Automatic Emotion Recognition. In: Proceedings of the First International Conference on Biomedical Electronics and Devices (2008)
Picard, R.W., Vyzas, E., Healey, J.: Toward Machine Emotional Intelligence: Analysis of Affective physiological state. IEEE Transactions on Pattern Analysis and Machine Intelligence 23(10), 1175–1191 (2001)
Russell, J.A.: A Circumplex Model of Affect. Journal of Personality and Social Psychology (39), 1161–1178 (1980)
Russell, J.A.: Evidence for a Three-Factor Theory of Emotions. Journal of Research in Personality 11, 273–294 (1977)
Fairclough, S.H.: Fundamentals of Physiological Computing. Interaction with Computers 21(1-2), 133–145 (2009)
Vinhas, V., Oliveira, E., Reis, L.P.: Realtime Dynamic Multimedia Storyline Based on Online Audience Biometric Information. In: KES IIMSS - Intelligent Interactive Multimedia Systems and Services, pp. 545–554. University of Piraeus, Greece (2008)
Vinhas, V., Oliveira, E., Reis, L.P.: Dynamic Multimedia Content Delivery Based on Real-Time User Emotions – Multichannel Online Biosignals Towards Adaptative GUI and Content Delivery. In: International Conference on Bio-inspired Systems and Signal Processing, pp. 299–304 (2009)
Vinhas, V., Silva, D.C., Oliveira, E., Reis, L.P.: Dynamic Multimedia Environment Based On Real-Time User Emotion Assessment – Biometric User Data Towards Affective Immersive Environments. In: ICEIS 2009 – International Conference on Enterprise Information Systems (2009)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Vinhas, V., Oliveira, E., Reis, L.P. (2011). BioStories: Dynamic Multimedia Environments Based on Real-Time Audience Emotion Assessment. In: Filipe, J., Cordeiro, J. (eds) Enterprise Information Systems. ICEIS 2010. Lecture Notes in Business Information Processing, vol 73. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-19802-1_35
Download citation
DOI: https://doi.org/10.1007/978-3-642-19802-1_35
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-19801-4
Online ISBN: 978-3-642-19802-1
eBook Packages: Computer ScienceComputer Science (R0)