An Environment for Studying Visual Emotion Perception

  • Davide CarneiroEmail author
  • Hélder Rocha
  • Paulo Novais
Conference paper
Part of the Advances in Intelligent Systems and Computing book series (AISC, volume 615)


Visual emotion perception is the ability of recognizing and identifying emotions through the visual interpretation of a situation or environment. In this paper we propose an innovative environment for supporting this type of studies, aimed at replacing current pencil-and-paper approaches. Besides automatizing the whole process, this environment provides new features that can enrich the study of emotion perception. These new features are especially interesting for the field of Human-Compute Interaction and Affective computing as they quantify the effects of experiencing different emotional dimensions on the individual’s interaction with the computer.


Visual emotion perception Behavioural biometrics Keyboard dynamics 



This work has been supported by COMPETE: POCI-01-0145-FEDER-007043 and FCT—Fundação para a Ciência e Tecnologia within the Project Scope: UID/CEC/00319/2013.


  1. 1.
    Bradley, M.M., Lang, P.J.: Measuring emotion: the self-assessment manikin and the semantic differential. J. Behav. Ther. Exp. Psychiatry 25(1), 49–59 (1994)CrossRefGoogle Scholar
  2. 2.
    Cambria, E.: Affective computing and sentiment analysis. IEEE Intell. Syst. 31(2), 102–107 (2016)CrossRefGoogle Scholar
  3. 3.
    Carneiro, D., Novais, P.: Quantifying the effects of external factors on individual performance. Future Gener. Comput. Syst. 66, 171–186 (2017)CrossRefGoogle Scholar
  4. 4.
    Lang, P.J., Bradley, M.M., Cuthbert, B.N.: International affective picture system (IAPS): affective ratings of pictures and instruction manual. Technical report A-8 (2008)Google Scholar
  5. 5.
    Lewis, M.B.: Exploring the positive and negative implications of facial feedback. Emotion 12(4), 852 (2012)CrossRefGoogle Scholar
  6. 6.
    Pimenta, A., Carneiro, D., Novais, P., Neves, J.: Monitoring mental fatigue through the analysis of keyboard and mouse interaction patterns. In: International Conference on Hybrid Artificial Intelligence Systems, pp. 222–231. Springer (2013)Google Scholar
  7. 7.
    Pinheiro, A., Liu, T., Zhao, Z., Nestor, P.G., McCarley, R.W., Niznikiewicz, M.A.: Emotional cues during simultaneous face and voice processing: electrophysiological insights (2012)Google Scholar
  8. 8.
    Rodrigues, M., Gonçalves, S., Carneiro, D., Novais, P., Fdez-Riverola, F.: Keystrokes and clicks: measuring stress on e-learning students. In: Management Intelligent Systems, pp. 119–126. Springer (2013)Google Scholar
  9. 9.
    Shukla, P., Solanki, R.: Web based keystroke dynamics application for identifying emotional state 2, 4489–4493 (2011)Google Scholar
  10. 10.
    Tsui, W.H., Lee, P., Hsiao, T.C.: The effect of emotion on keystroke: an experimental study using facial feedback hypothesis. In: Engineering in Medicine and Biology Society (EMBC), 2013 35th Annual International Conference of the IEEE, pp. 2870–2873. IEEE (2013)Google Scholar

Copyright information

© Springer International Publishing AG 2017

Authors and Affiliations

  1. 1.CIICESI, ESTG, Polytechnic Institute of PortoFelgueirasPortugal
  2. 2.Algoritmi Center/Department of InformaticsUniversity of MinhoBragaPortugal

Personalised recommendations