Recognizing Emotions in Human Computer Interaction: Studying Stress Using Skin Conductance
This paper reports an experiment for stress recognition in human-computer interaction. Thirty-one healthy participants performed five stressful HCI tasks and their skin conductance signals were monitored. The selected tasks were most frequently listed as stressful by 15 typical computer users who were involved in pre-experiment interviews asking them to identify stressful cases of computer interaction. The collected skin conductance signals were analyzed using seven popular machine learning classifiers. The best stress recognition accuracy was achieved by the cubic support vector machine classifier both per task (on average 90.8 %) and for all tasks (Mean = 98.8 %, SD = 0.6 %). This very high accuracy demonstrates the potentials of using physiological signals for stress recognition in the context of typical HCI tasks. In addition, the results allow us to move on a first integration of the specific stress recognition mechanism in PhysiOBS, a previously-proposed software tool that supports researchers and practitioners in user emotional experience evaluation.
KeywordsUsers emotional experience evaluation Physiological data Skin response conductance Physiological signal analysis
This paper has been co-financed by the European Union (European Social Fund – ESF) and Greek National funds through the Operational Program “Education and Lifelong Learning” of the National Strategic Reference Framework (NSRF) (Funding Program: “Hellenic Open University”).
- 2.Vermeeren, A.P.O.S., Law, E.L.-C., Roto, V., Obrist, M., Hoonhout, J., Väänänen-Vainio-Mattila, K.: User experience evaluation methods: current state and development needs. In: Proceedings of the 6th Nordic Conference on Human-Computer Interaction: Extending Boundaries. pp. 521–530. ACM, New York (2010)Google Scholar
- 3.Ganglbauer, E., Schrammel, J., Tscheligi, M.: Possibilities of psychophysiological methods for measuring emotional aspects in mobile contexts. In: Proceedings of Mobile HCI (2009)Google Scholar
- 4.Mandryk, R.L., Atkins, M.S., Inkpen, K.M.: A continuous and objective evaluation of emotional experience with interactive play environments. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. pp. 1027–1036. ACM, New York (2006)Google Scholar
- 7.Lin, T., Omata, M., Hu, W., Imamiya, A.: Do physiological data relate to traditional usability indexes? In: Proceedings of the 17th Australia Conference on Computer-Human Interaction: Citizens Online: Considerations for Today and the Future. pp. 1–10. Computer-Human Interaction Special Interest Group (CHISIG) of Australia, Narrabundah, Australia (2005)Google Scholar
- 10.Hernandez, J., Paredes, P., Roseway, A., Czerwinski, M.: Under pressure: sensing stress of computer users. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 51–60. ACM, New York (2014)Google Scholar
- 12.Lunn, D., Harper, S.: Using Galvanic skin response measures to identify areas of frustration for older web 2.0 users. In: Proceedings of the 2010 International Cross Disciplinary Conference on Web Accessibility (W4A), pp. 34:1–34:10. ACM, New York (2010)Google Scholar
- 13.Liapis, A., Karousos, N., Katsanos, C., Xenos, M.: Evaluating user’s emotional experience in HCI: the physiOBS approach. In: Kurosu, M. (ed.) HCI 2014, Part II. LNCS, vol. 8511, pp. 758–767. Springer, Heidelberg (2014)Google Scholar
- 14.Drachen, A., Nacke, L.E., Yannakakis, G., Pedersen, A.L.: Correlation between heart rate, electrodermal activity and player experience in first-person shooter games. In: Proceedings of the 5th ACM SIGGRAPH Symposium on Video Games, pp. 49–54. ACM, New York (2010)Google Scholar