EmoActivity - An EEG-Based Gamified Emotion HCI for Augmented Artistic Expression: The i-Treasures Paradigm

  • Vasileios Charisis
  • Stelios Hadjidimitriou
  • Leontios Hadjileontiadis
  • Deniz Uğurca
  • Erdal Yilmaz
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9178)


There are important cultural differences in emotions that can be predicted and connected to each other in the light of cultural and artistic expressions. The main differences reflected at the affective space are expressed through initial response tendencies of appraisal and action readiness. Capturing and handling the emotions during artistic activities could be used as a dominant source of information to acquire and augment the cultural expression and maximize the emotional impact to the audience. This paper presents a novel EEG-based game-like application, to learn and handle affective states and transitions towards augmented artistic expression. According to the game scenario, the user has to reach and sustain one or more target affective states based on the level of the game, the difficulty setting and his/her current affective state. The game, although at its first version, has been demonstrated to a small group of potential users and has received positive feedback. Its use by a wider audience is anticipated within the realization of the i-Treasure FP7 EU Programme (2013-2017).


Human-computer interaction Emotion game Affective state detection Game-based learning Contemporary music composition Valence-arousal space EEG Emotiv Emoactivity i-Treasures 


  1. 1.
    Juslin, P.N., Sloboda, J.A.: Handbook of Music and Emotions Theory, Research, Applications. Oxford University Press, New York (2000)Google Scholar
  2. 2.
    Koelsch, S., Siebel, W.A.: Towards a neural basis of music perception. Trends Cogn. Sci. 9, 578–584 (2005)CrossRefzbMATHGoogle Scholar
  3. 3.
    Juslin, P.N.: Five facets of musical expression: a psychologist’s perspective on music performance. Psychol. Music 31, 273–302 (2003)CrossRefGoogle Scholar
  4. 4.
    The i-Treasures project.
  5. 5.
    Kirriemuir, J., McFarlane, A.: Literature Review in Games and Learning. A NESTA Futurelab Research Report – Report 8. NESTA Futurelab Series, Bristol (2004)Google Scholar
  6. 6.
    Michael, D., Chen, S.: Serious Games: Games That Educate, Train, and Inform. Thomson Course Technology, Boston (2006)Google Scholar
  7. 7.
    Charlier, N., Ott, M., Remmele, B., Whitton, N.: Not Just for Children: Game-Based Learning for Older Adults. In: 6th European Conference on Games Based Learning, pp. 102–108 (2012)Google Scholar
  8. 8.
    Van Eck, R.: Digital game-based learning: it’s not just the digital natives who are restless. EDUCAUSE Rev. 41, 17–30 (2006)zbMATHGoogle Scholar
  9. 9.
    Russell, J.A.: A circumflex model of affect. J. Pers. Soc. Psychol. 39, 1161–1178 (1980)CrossRefGoogle Scholar
  10. 10.
    Higuchi, T.: Approach to an irregular time series on the basis of the fractal theory. Physica D 31, 277–283 (1988)MathSciNetCrossRefzbMATHGoogle Scholar
  11. 11.
    Liu, Y., Sourina, O., Nguyen, M.K.: Real-time EEG-based emotion recognition and its applications. In: Gavrilova, M.L., Tan, C.J.K., Sourin, A., Sourina, O. (eds.) Transactions on Computational Science XII. LNCS, vol. 6670, pp. 256–277. Springer, Heidelberg (2011)CrossRefGoogle Scholar
  12. 12.
    Accardo, A., Affinito, M., Carrozzi, M., Bouquet, F.: Use of the fractal dimension for the analysis of electroencephalographic time series. Biol. Cybern. 77, 339–350 (1997)CrossRefzbMATHGoogle Scholar
  13. 13.
    Davidson, R.J.: What does the prefrontal cortex “do” in affect: perspectives on frontal EEG asymmetry research. Biol. Psychol. 67, 219–233 (2004)CrossRefGoogle Scholar
  14. 14.
    Lang, P.J., Bradley, M.M., Cuthbert, B.N.: International affective picture system (IAPS): Affective ratings of pictures and instruction manual. Technical report A-8, University of Florida (2008)Google Scholar
  15. 15.
    Sudhof, M., Emilsson, A.G., Maas, A.L., Potts, C.: Sentiment expression conditioned by affective transitions and social forces. In: 20th ACM SIGKDD International Conference of Knowledge Discovery and Data Mining, pp. 1136–1145 (2014)Google Scholar
  16. 16.
    Baker, D.R.S.J., Mercedes, M., Rodrigo, T., Xolocotzin, U.E.: The dynamics of affective transitions in simulation problem-solving environments. In: 2nd International Conference on Affective Computing and Intelligence Interactions, pp. 666–677 (2007)Google Scholar
  17. 17.
    Cherry, K.: Color psychology: how colors impact moods, feelings, and behaviors.

Copyright information

© Springer International Publishing Switzerland 2015

Authors and Affiliations

  • Vasileios Charisis
    • 1
  • Stelios Hadjidimitriou
    • 1
  • Leontios Hadjileontiadis
    • 1
  • Deniz Uğurca
    • 2
  • Erdal Yilmaz
    • 2
  1. 1.Department of Electrical and Computer EngineeringAristotle University of ThessalonikiThessalonikiGreece
  2. 2.Argedor Information TechnologiesAnkaraTurkey

Personalised recommendations