Abstract
Subjects’ eye movement behavior related to cognitive effort during gait was measured as subjects walked to perform low and high cognitive load tasks. We found that all pupil diameter measures, fixation durations, and the proportion of blink duration changed significantly during gait as a function of task load. In contrast, the number of fixations, saccade durations and travel time did not change significantly as a function of task load. Findings showed that pupil diameter was the best predictor of task load during one’s gait preceding the performance of the task. While other studies have demonstrated the importance of eye fixation characteristics during gait, our findings showed that eye measures related to pupil diameter were better at detecting cognitive load while walking to perform a task compared to eye fixation data. We also found that cognitive effort was not limited to just the performance of the task, but that it was also exerted during one’s gait preceding the performance of the task. Therefore, the additional attention demand caused by an increase in task complexity may result in less attentional resources being available to adequately handle distractions (such as obstacle avoidance) while walking to perform the task. Consequently, this may increase the likelihood of falls in those individuals with lower attentional capacity.
Similar content being viewed by others
References
Ahlstrom U, Friedman-Berg FJ (2006) Using eye movement activity as a correlate of cognitive workload. Int J Ind Ergonom 36:623–636. https://doi.org/10.1016/j.ergon.2006.04.002
Archer KJ, Kimes RV (2008) Empirical characterization of random forest variable importance measures. Comput Stat Data An 52:2249–2260. https://doi.org/10.1016/j.csda.2007.08.015
Bailey BP, Iqbal ST (2008) Understanding changes in mental workload during execution of goal-directed tasks and its application for interruption management. Acm T Comput-Hum Int 14:1–28. https://doi.org/10.1145/1314683.1314689
Beatty J (1982) Task-evoked pupillary responses, processing load, and the structure of processing resources. Psychol Bull 91:276. https://doi.org/10.1037/0033-2909.91.2.276
Beatty J, Kahneman D (1966) Pupillary changes in two memory tasks. Psychon Sci 5:371–372. https://doi.org/10.3758/BF03328444
Bent B, Wang K, Grzesiak E, Jiang C, Qi Y, Jiang Y, Cho P, Zingler K, Ogbeide FI, Zhao A, Runge R (2020) The Digital Biomarker Discovery Pipeline: an open source software platform for the development of digital biomarkers using mHealth and wearables data. Cts-Clin Transl Sci 1:28. https://doi.org/10.1017/cts.2020.511
Breiman L (2001) Random forests. Mach Learn 45:5–32
Buettner R, Sauer S, Maier C, Eckhardt A (2015) Towards ex ante prediction of user performance: a novel NeuroIS methodology based on real-time measurement of mental effort. Internat Conf Syst Sci 5:533–542. https://doi.org/10.1109/HICSS.2015.70
Cinelli ME, Patla AE, Allard F (2009) Behaviour and gaze analyses during a goal-directed locomotor task. Q J Exp Psychol 62:483–499. https://doi.org/10.1080/17470210802168583
Clark RA, Pua YH, Fortin K, Ritchie C, Webster KE, Denehy L, Bryant AL (2012) Validity of the Microsoft Kinect for assessment of postural control. Gait Posture 36:372–377. https://doi.org/10.1016/j.gaitpost.2012.03.033
Clark RA, Bower KJ, Mentiplay BF, Paterson K, Pua YH (2013) Concurrent validity of the Microsoft Kinect for assessment of spatiotemporal gait variables. J Biomech 46:2722–2725. https://doi.org/10.1016/j.jbiomech.2013.08.011
Dierkes K, Kassner M, Bulling A (2018) A novel approach to single camera, glint-free 3D eye model fitting including corneal refraction. ACM Sympo Eye Track Res Appl 3:1–9. https://doi.org/10.1145/3204493.3204525
Dolatabadi E, Taati B, Mihailidis A (2016) Concurrent validity of the Microsoft Kinect for Windows v2 for measuring spatiotemporal gait parameters. Med Eng Phys 38:952–958. https://doi.org/10.1016/j.medengphy.2016.06.015
Dutta T (2012) Evaluation of the Kinect sensor for 3-D kinematic measurement in the workplace. Appl Ergon 43:645–649. https://doi.org/10.1016/j.apergo.2011.09.011
Fehrenbacher DD, Djamasbi S (2017) Information systems and task demand: An exploratory pupillometry study of computerized decision making. Decis Support Syst 97:1–11. https://doi.org/10.1016/j.dss.2017.02.007
Fitousi D, Wenger MJ (2011) Processing capacity under perceptual and cognitive load: a closer look at load theory. J Exp Psychol Human 37:781. https://doi.org/10.1037/a0020675
Goldberg JH, Kotval XP (1999) Computer interface evaluation using eye movements: methods and constructs. Int J Ind Ergonom 24:631–645. https://doi.org/10.1016/S0169-8141(98)00068-7
Heitz RP, Schrock JC, Payne TW, Engle RW (2008) Effects of incentive on working memory capacity: behavioral and pupillometric data. Psychophysiology 45:119–129. https://doi.org/10.1111/j.1469-8986.2007.00605.x
Hess RF, Howell ER (1988) Detection of low spatial frequencies: a single filter or multiple filters? Ophthal Physl Opt 8:378–385. https://doi.org/10.1111/j.1475-1313.1988.tb01172.x
Holmqvist K, Nyström M, Andersson R, Dewhurst R, Jarodzka H, Van de Weijer J (2011) Eye tracking: a comprehensive guide to methods and measures. OUP, Oxford
Horn BK (1987) Closed-form solution of absolute orientation using unit quaternions. J Opt Soc Am 4:629–642. https://doi.org/10.1364/JOSAA.4.000629
Hupe JM, Lamirel C, Lorenceau J (2009) Pupil dynamics during bistable motion perception. J Vision 9:10. https://doi.org/10.1167/9.7.10
Kahneman D, Tursky B, Shapiro D, Crider A (1969) Pupillary, heart rate, and skin resistance changes during a mental task. J Exp Psychol 79:164. https://doi.org/10.1037/h0026952
Kahya M, Wood TA, Sosnoff JJ, Devos H (2018) Increased postural demand is associated with greater cognitive workload in healthy young adults: a pupillometry study. Front Hum Neurosci 12:288. https://doi.org/10.3389/fnhum.2018.00288
Kassner M, Patera W, Bulling A (2014) Pupil: an open source platform for pervasive eye tracking and mobile gaze-based interaction. Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct Publication 1151–1160. https://doi.org/10.1145/2638728.2641695
Laeng B, Sirois S, Gredebäck G (2012) Pupillometry: A window to the preconscious? Perspect Psychol Sci 7:18–27. https://doi.org/10.1177/1745691611427305
Ledger H (2013) The effect cognitive load has on eye blinking. Plymouth Student Sci 6:206–223
Mathur A, Gehrmann J, Atchison DA (2013) Pupil shape as viewed along the horizontal visual field. J Vision 13:3. https://doi.org/10.1167/13.6.3
Matthis JS, Yates JL, Hayhoe MM (2018) Gaze and the control of foot placement when walking in natural terrain. Curr Biol 28:1224–1233.e5. https://doi.org/10.1016/j.cub.2018.03.008
Oldfield RC (1971) The assessment and analysis of handedness: the Edinburgh inventory. Neuropsychologia 9:97–113. https://doi.org/10.1016/0028-3932(71)90067-4
Panchuk D, Vickers JN (2011) Effect of narrowing the base of support on the gait, gaze and quiet eye of elite ballet dancers and controls. Cogn Process 12:267–276. https://doi.org/10.1007/s10339-011-0395-y
Pedregosa F, Varoquaux G, Gramfort A, Michel V, Thirion B, Grisel O, Dubourg V (2011) Scikit-learn: machine learning in Python. J Mach Learn Res 12:2825–2830
Pfleging B, Fekety DK, Schmidt A, Kun AL (2016) A model relating pupil diameter to mental workload and lighting conditions. Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems 5776–5788. https://doi.org/10.1145/2858036.2858117
Piquado T, Isaacowitz D, Wingfield A (2010) Pupillometry as a measure of cognitive effort in younger and older adults. Psychophysiology 47:560–569. https://doi.org/10.1111/j.1469-8986.2009.00947.x
Porter G, Troscianko T, Gilchrist ID (2007) Effort during visual search and counting: insights from pupillometry. Q J Exp Psychol 60:211–229. https://doi.org/10.1080/17470210600673818
Rosenbaum DA, Brach M, Semenov A (2011) Behavioral ecology meets motor behavior: choosing between walking and reaching paths. J Motor Behav 43:131–136. https://doi.org/10.1080/00222895.2010.548423
Rozado D, Lochner M, Engelke U, Dünser A (2019) Detecting intention through motor-imagery-triggered pupil dilations. Hum-Comput Interact 34:83–113. https://doi.org/10.1080/07370024.2017.1293540
Saeedpour-Parizi MR, Hassan SE, Baniasadi T, Baute KJ, Shea JB (2020) Hierarchical goal effects on center of mass velocity and eye fixations during gait. Exp Brain Res. https://doi.org/10.1007/s00221-020-05900-0
Salthouse TA, Ellis CL (1980) Determinants of eye-fixation duration. Am J Psychol 93:207–234. https://doi.org/10.2307/1422228
Şendurur E, Doğusoy B, Yondemir Çalişkan N (2020) Investigation of non-native learners’ informal learning processes from cognitive-load theory perspective. Interact Learn Envir 28:95–106. https://doi.org/10.1080/10494820.2018.1517096
Shojaeizadeh M, Djamasbi S, Paffenroth RC, Trapp AC (2019) Detecting task demand via an eye tracking machine learning system. Decis Support Syst 116:91–101. https://doi.org/10.1016/j.dss.2018.10.012
Simpson HM, Paivio A (1968) Effects on pupil size of manual and verbal indicators of cognitive task fulfillment. Percept Psychophys 3:185–190. https://doi.org/10.3758/BF03212726
Smallwood J, Brown KS, Tipper C, Giesbrecht B, Franklin MS, Mrazek MD, Carlson JM, Schooler JW (2011) Pupillometric evidence for the decoupling of attention from perceptual input during offline thought. PLoS ONE. https://doi.org/10.1371/journal.pone.0018298
Steinhauer SR, Condray R, Kasparek A (2000) Cognitive modulation of midbrain function: task-induced reduction of the pupillary light reflex. Int J Psychophysiol 39:21–30. https://doi.org/10.1016/S0167-8760(00)00119-7
Stuyven E, Van der Goten K, Vandierendonck A, Claeys K, Crevits L (2000) The effect of cognitive load on saccadic eye movements. Acta Psychol 104:69–85. https://doi.org/10.1016/S0001-6918(99)00054-2
Van Orden KF, Limbert W, Makeig S, Jung TP (2001) Eye activity correlates of workload during a visuospatial memory task. Hum Factors 43:111–121. https://doi.org/10.1518/001872001775992570
Wang Q, Yang S, Liu M, Cao Z, Ma Q (2014) An eye-tracking study of website complexity from cognitive load perspective. Decis Support Syst 62:1–10. https://doi.org/10.1016/j.dss.2014.02.007
White O, French RM (2017) Pupil diameter may reflect motor control and learning. J Motor Behav 49:141–149. https://doi.org/10.1080/00222895.2016.1161593
Wright RA (1996) Brehm’s theory of motivation as a model of effort and cardiovascular response. Guilford Press, Newyork
Zénon A, Sidibé M, Olivier E (2014) Pupil size variations correlate with physical effort perception. Front Behav Neurosci 8:286. https://doi.org/10.3389/fnbeh.2014.00286
Acknowledgements
This project was partially funded by the Indiana University Vice Provost for Research through the Research Equipment Fund.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no conflict of interest.
Informed consent
Informed consent was obtained from all individual subjects included in the study.
Additional information
Communicated by Francesco Lacquaniti.
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Saeedpour-Parizi, M.R., Hassan, S.E. & Shea, J.B. Pupil diameter as a biomarker of effort in goal-directed gait. Exp Brain Res 238, 2615–2623 (2020). https://doi.org/10.1007/s00221-020-05915-7
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00221-020-05915-7