A Scenario-Centred Approach to Emotion Profiling Based on EEG Signal Processing

  • Angelica Reyes-MunozEmail author
  • Genaro Rebolledo
  • Victor Callaghan
Conference paper
Part of the Lecture Notes in Electrical Engineering book series (LNEE, volume 532)


This paper considers how the use of physiological sensing to measure human emotions will change the world in areas such as education, human–robot interfaces, job applications, interaction with friends, finding love and ultimately, how to live. For example, a particularly interesting question relates to people’s emotions in relation to delivering a “good” job performance, through introducing automated systems which seek to balance the tasks to be undertaken by machines versus those managed by people, thereby improving overall performance. In such cases, we would need to consider if the emotional behaviour that people display have important keys to building more successful and productive systems and whether removing emotions be counterproductive. Also, we consider whether grounding human–computer interfaces in the rich and complex emotional lives of people can lead to more effective and productive systems? This paper will examine such issues through the use of a scenario-centred design approach called science fiction prototyping, aiming to cast a little more light on the design of such emotion-based systems.


Emotions EEG Signal processing Science fiction Creative writing Prototyping Scenario-based design 



This work was partially supported by the project “Flight operations of multiple RPAS” TRA2016-77012-R and the grant for international mobility of the Obra Social La Caixa 2016.


  1. 1.
    R.W. Picard, Affective Computing (MIT Press, Cambridge, 1997)Google Scholar
  2. 2.
    P. Ekman, An argument for basic emotions. Cognit. Emot. 6(3–4), 169–200 (1992)CrossRefGoogle Scholar
  3. 3.
    R. Baker, S. D’Mello, M. Rodrigo, A. Raesser, Better to be frustrated than bored: The incidence, persistence, and impact of learners’ cognitive–affective states during interactions with three different computer-based learning environments. Int. J. Human Comput. Stud. 68(4), 223–241 (2010)CrossRefGoogle Scholar
  4. 4.
    R.A. Calvo, S.K. D’Mello, Affect detection: An interdisciplinary review of models, methods, and their applications. IEEE Trans. Affect. Comput. 1(1), 18–37 (2010)CrossRefGoogle Scholar
  5. 5.
    B. Jordan, Instantaneous self-assessment (ISA). (1992),
  6. 6.
    G. Sandra, Hart: NASA-task load index (NASA-TLX); 20 years later (2006),
  7. 7.
    K.T. Durkee, S.M. Pappada, A.E. Ortiz, J.J. Feeney, S.M. Galster, System decision framework for augmenting human performance using real-time workload classifiers, in Cognitive Methods in Situation Awareness and Decision Support (CogSIMA), 2015 IEEE International Inter-Disciplinary Conference on, (IEEE, New York, 2015), pp. 8–13Google Scholar
  8. 8.
    G. Padrón-Rivera, G. Rebolledo-Mendez, P. Pozos-Parra, N.S. Huerta-Pacheco, Identification of action units related to affective states in a tutoring system for mathematics. Special issue on intelligent and affective learning environments: New trends and challenges. Educ. Technol. Soc. 19(2), 77–86 (2016)Google Scholar
  9. 9.
    I. Arroyo, D.G. Cooper, W. Burleson, B.P. Woolf, K. Muldner, R. Christopherson, Emotion sensors go to school, in Proceedings of the 2009 Conference on Artificial Intelligence in Education: Building Learning Systems that Care: From Knowledge Representation to Affective Modelling, (IOS Press, Amsterdam, 2009), pp. 17–24Google Scholar
  10. 10.
    M.-L. Lai, M.-J. Tsai, F.-Y. Yang, C.-Y. Hsu, T.-C. Liu, S.W.-Y. Lee, M.-H. Lee, G.-L. Chiou, J.-C. Liang, C.-C. Tsai, A review of using eye-tracking technology in exploring learning from 2000 to 2012. Educ. Res. Rev. 10, 90–115 (2013)CrossRefGoogle Scholar
  11. 11.
    R.W. Picard, Automating the recognition of stress and emotion: From lab to real-world impact. IEEE MultiMed. 23(3), 3–7 (2016)CrossRefGoogle Scholar
  12. 12.
    J. Pan, Y. Li, J. Wang, An EEG-based brain-computer interface for emotion recognition, in International Joint Conference on Neural Networks, (IEEE, New York, 2016), pp. 2063–2067Google Scholar
  13. 13.
    W.-L. Zheng, B.-L. Lu, Investigating critical frequency bands and channels for EEG-based emotion recognition with deep neural networks. IEEE Trans. Auton. Ment. Dev. 7(3), 162–175 (2015)CrossRefGoogle Scholar
  14. 14.
    R. Kottaimalai, M.P. Rajasekaran, V. Selvam, B. Kannapiran, Brain waves for automatic biometric-based user recognition. IEEE Trans. Inf. Forensics Security 9(5), 782–800 (2014)CrossRefGoogle Scholar
  15. 15.
    N.N.Y. Chu, Brain-computer Interface technology and development: The emergence of imprecise brainwave headsets in the commercial world. IEEE Consum. Electron. Mag. 4(3), 34–41 (2015). CrossRefGoogle Scholar
  16. 16.
    M. Shen, L. Lin, J. Chen, C. Chang, A prediction approach for multichannel EEG signals modeling using local wavelet SVM. IEEE Trans. Instrum. Meas. 59(5), 1485–1492 (2010). CrossRefGoogle Scholar
  17. 17.
    L. Grace, O. Alejandro, M. Scott, Measuring musical engagement using expressive movement and EEG brain dynamics. PsychoMcol 24(1), 75–91 (2014)Google Scholar
  18. 18.
    B. Kaelin, Creating 3D objects with your brain (2013),
  19. 19.
    B.D. Johnson, Science Fiction Prototyping: Designing the Future with Science Fiction (Morgan & Claypool, San Rafael, 2011)Google Scholar
  20. 20.
    V. Callaghan, Creative science: Injecting innovation into the IT industry. iTNOW 57(2), 52–55 (2015)CrossRefGoogle Scholar
  21. 21.
    V. Callaghan, Micro-Futures, in Creative-Science 2014, (Shanghai Jiaotong University, China, 2014)Google Scholar
  22. 22.
    Genetic Information Discrimination:
  23. 23.
    R. Talwar, T. Hancock, Possible new careers emerging from advances in science and technology (2010–2030) (2010),
  24. 24.
    H. Fisher, Why We Love–the Nature and Chemistry of Romantic Love (Henry Holt and Company, New York, 2004)Google Scholar
  25. 25.
    K. Cheng, Master Thesis: Download your Emotions. Mixed Media Installation (The New School Parsons School of Design, New York, 2016)Google Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  • Angelica Reyes-Munoz
    • 1
    Email author
  • Genaro Rebolledo
    • 2
  • Victor Callaghan
    • 3
  1. 1.Polytechnic University of CataloniaBarcelonaSpain
  2. 2.University of VeracruzXalapaMexico
  3. 3.University of EssexColchesterUK

Personalised recommendations