Stress Measurement in Multi-tasking Decision Processes Using Executive Functions Analysis

  • Lucas PalettaEmail author
  • Martin Pszeida
  • Bernhard Nauschnegg
  • Thomas Haspl
  • Raphael Marton
Conference paper
Part of the Advances in Intelligent Systems and Computing book series (AISC, volume 953)


The presented work aimed to investigate how the impact of cognitive stress would affect the attentional processes, in particular, the performance of the executive functions that are involved in the coordination of multi-tasking processes. The study setup for the proof-of-concept involved a cognitive task as well as a visuomotor task, concretely, an eye-hand coordination task, in combination with an obstacle avoidance task that is characteristic in human-robot collaboration. The results provide the proof that increased stress conditions can actually be measured in a significantly correlated increase of an error distribution as consequence of the precision of the eye-hand coordination. The decrease of performance is a proof that the attentional processes are a product of executive function processes. The results confirm the dependency of executive functions and decision processes on stress conditions and will enable quantitative measurements of attention effects in multi-tasking configurations.


Stress measurement Gaze analysis Multi-tasking Executive functions Human-robot collaboration Spatial fixation distribution 



This work has been supported by the Austrian Ministry for Transport, Innovation and Technology (BMVIT) within the project framework CollRob (Collaborative Robotics), as well as by the Austrian BMVIT/FFG by projects MMASSIST II (No. 858623) and FLEXIFF (No. 861264). We would like to thank in particular Norah Neuhuber for her support in the interpretation of the bio-sensor data.


  1. 1.
    Baddeley, A.D., Hitch, G.: Working memory. In: Bower, G.A. (ed.) The Psychology of Learning and Motivation: Advances in Research and Theory, vol. 8, pp. 47–89 (1974)Google Scholar
  2. 2.
    Lezak, M.D.: Neuropsychological Assessment. Oxford University Press, New York (1995)Google Scholar
  3. 3.
    Bütepage, J., Kragic, D.: Human-robot collaboration: from psychology to social robotics arXiv:1705.10146 (2017)
  4. 4.
    Koolhaas, J.M., Bartolomucci, A., Buwalda, B., De Boer, S.F., Flügge, G., Korte, S.M., Meerlo, P., Murison, R., Olivier, B., Palanza, P., Richter-Levin, G.: Stress revisited: a critical evaluation of the stress concept. Neurosci. Biobehav. Rev. 35, 1291–1301 (2011)CrossRefGoogle Scholar
  5. 5.
    Hermans, E.J., Henckens, M.J.A.G., Joels, M., Fernandez, G.: Dynamic adaptation of large-scale brain networks in response to acute stressors. Trends Neurosci. 37, 304–314 (2014)CrossRefGoogle Scholar
  6. 6.
    Chajut, E., Algom, D.: Selective attention improves under stress: implications for theories of social cognition. J. Pers. Soc. Psychol. 85, 231 (2003)CrossRefGoogle Scholar
  7. 7.
    Jaeggi, S.M., Buschkuehl, M., Perrig, W.J., Meier, B.: The concurrent validity of the N-back task as a working memory measure. Memory 18(4), 394–412 (2010)CrossRefGoogle Scholar
  8. 8.
    Flanagan, J.R., Johansson, R.S.: Action plans used in action observation. Nature 424, 769 (2003)CrossRefGoogle Scholar
  9. 9.
    Selye, H.: A syndrome produced by diverse nocuous agents. Nature 138(July 4), 32 (1936)CrossRefGoogle Scholar
  10. 10.
    Lazarus, R.S., Folkman, S.: Stress, Appraisal, and Coping. Springer, New York (1984)Google Scholar
  11. 11.
    Smith, E., Jonides, J.: Storage and executive processes in the frontal lobes. Science 283, 1657–1661 (1999)CrossRefGoogle Scholar
  12. 12.
    Dickerson, S.S., Kemeny, M.E.: Acute stressors and cortisol responses: a theoretical integration and synthesis of laboratory research. Psychol. Bull. 130, 355–391 (2004). Scholar
  13. 13.
    Diamond, A.: Executive functions. Annu. Rev. Psychol. 64, 135–168 (2013). Scholar
  14. 14.
    Meyer, D.E., Evans, J.E., Lauber, E.J., Gmeindl, L., Rubinstein, J., Junck, L., Koeppe, R.A.: The role of dorsolateral prefrontal cortex for executive cognitive processes in task switching. J. Cogn. Neurosci. 10 (1998)Google Scholar
  15. 15.
    Del Missier, F., Mäntyla, T., Bruine de Bruin, W.: Executive functions in decision making: an individual differences approach. Think. Reasoning 16(2), 69–97 (2010)CrossRefGoogle Scholar
  16. 16.
    Cannon, W.B.: The Wisdom of the Body. Norton, New York (1932)CrossRefGoogle Scholar
  17. 17.
    Boucsein, W.: Electrodermal Activity. Plenum, New York (1992)CrossRefGoogle Scholar
  18. 18.
    Setz, C., Arnrich, B., Schumm, J., La Marca, R., Tröster, G., Ehlert, U.: Discriminating stress from cognitive load using a wearable EDA device. IEEE Trans. Inf. Technol. Biomed. 14(2), 410–417 (2010)CrossRefGoogle Scholar
  19. 19.
    Taelman, J., Vandeput, S., Spaepen, A., Van Huffel, S.: Influence of mental stress on heart rate and heart rate variability. In: Proceedings Conferences for International Federation for Medical and Biological Engineering, pp. 1366–1369 (2008)Google Scholar
  20. 20.
    Sharma, N., Gedeon, T.: Objective measures, sensors and computational techniques for stress recognition and classification: a survey. Comput. Methods Programs Biomed. 108, 1287–1301 (2012)CrossRefGoogle Scholar
  21. 21.
    Sun, F., Kuo, C., Cheng, H.-T., Buthpitiya, S., Collins, P., Griss, M.: Activity-aware mental stress detection using physiological sensors. In: Mobile Computing, Applications, and Services, pp. 211–230. Springer, Heidelberg (2011)Google Scholar
  22. 22.
    Van Orden, K.F., Limbert, W., Makeig, S.: Eye activity correlates of workload during a visuospatial memory task. Hum. Factors: J. Hum. Factors Ergon. Soc. 43, 111–121 (2001)CrossRefGoogle Scholar
  23. 23.
    NaturalPoint, Inc.: DBA OptiTrack (2016).

Copyright information

© Springer Nature Switzerland AG 2020

Authors and Affiliations

  • Lucas Paletta
    • 1
    Email author
  • Martin Pszeida
    • 1
  • Bernhard Nauschnegg
    • 1
  • Thomas Haspl
    • 2
  • Raphael Marton
    • 1
  1. 1.Digital - Institute for Information and Communication TechnologiesJoanneum Research Forschungsgesellschaft mbHGrazAustria
  2. 2.Robotics - Institute for Robotics and MechatronicsJoanneum Research Forschungsgesellschaft mbHKlagenfurt am WörtherseeAustria

Personalised recommendations