Skip to main content
SpringerLink
Log in
Book cover

International Conference on Applied Human Factors and Ergonomics

AHFE 2019: Advances in Neuroergonomics and Cognitive Engineering pp 129–141Cite as

Eye Tracking-Based Workload and Performance Assessment for Skill Acquisition

  • Conference paper
  • First Online:

Part of the book series: Advances in Intelligent Systems and Computing ((AISC,volume 953))

Abstract

The result of training to improve in a given skill is most often demonstrated by an increase in the relevant performance measures. However, a complementary and at times more informative measure is the mental workload imposed on the performer when doing the task. While a number of varied methods exist for measuring workload, we have chosen to explore physiological and neurological correlates for their low amount of impact and interference on subjects during an experiment. In this study, participants trained on a six-task cognitive battery over four weeks while being simultaneously recorded with remote eye tracking and a host of other neurophysiological instruments. In this preliminary analysis, we found that measures of saccades, fixations, and pupil diameters significantly correlated with task performance over time and at different difficulties, indicating the validity of our task battery as well as the specificity of workload-related eye tracking measures.

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Parasuraman, R.: Neuroergonomics: research and practice. Theor. Issues Ergon. Sci. 4(1–2), 5–20 (2003)

    Article  Google Scholar 

  2. Parasuraman, R., Wilson, G.F.: Putting the brain to work: neuroergonomics past, present, and future. Hum. Factors 50(3), 468–474 (2008)

    Article  Google Scholar 

  3. Fedota, J., Parasuraman, R.: Neuroergonomics and human error. AU Theor. Issues Ergon. Sci. 11(5), 402–421 (2010)

    Article  Google Scholar 

  4. Ayaz, H., Pakir, M., Izzetoglu, K., Curtin, A., Shewokis, P.A., Bunce, S.C., Onaral, B.: Monitoring expertise development during simulated UAV piloting tasks using optical brain imaging. In: 2012 IEEE Aerospace Conference (2012)

    Google Scholar 

  5. Ayaz, H., Onaral, B., Izzetoglu, K., Shewokis, P.A., McKendrick, R., Parasuraman, R.: Continuous monitoring of brain dynamics with functional near infrared spectroscopy as a tool for neuroergonomic research: empirical examples and a technological development. Front. Hum. Neurosci. 7, 871 (2013)

    Article  Google Scholar 

  6. Afergan, D., Peck, E.M., Solovey, E.T., Jenkins, A., Hincks, S.W., Brown, E.T., Chang, R., Jacob, R.J.K.: Dynamic difficulty using brain metrics of workload. ACM, Toronto, Ontario, Canada (2014). https://doi.org/10.1145/2556288.2557230

  7. Hancock, P., Chignell, M.H.: Toward a theory of mental work load: stress and adaptability in human-machine systems. In: Proceedings of the International IEEE Conference on Systems, Man and Cybernetics, 378–383 (1986)

    Google Scholar 

  8. Hart, S.G.: NASA-task load index (NASA-TLX); 20 years later. In: Proceedings of the Human Factors and Ergonomics Society Annual Meeting. Sage (2006)

    Google Scholar 

  9. Debue, N., van de Leemput, C.: What does germane load mean? An empirical contribution to the cognitive load theory. Front. Psychol. 5, 1099 (2014)

    Article  Google Scholar 

  10. John, M.S., Kobus, D.A., Morrison, J.G.: A multi-tasking environment for manipulating and measuring neural correlates of cognitive workload. In: Proceedings of the IEEE 7th Conference on Human Factors and Power Plants (2002)

    Google Scholar 

  11. Miller, G.A.: The magical number seven, plus or minus two: some limits on our capacity for processing information. Psychol. Rev. 63(2), 81 (1956)

    Article  Google Scholar 

  12. Solovey, E.T., Zec, M., Garcia Perez, E.A., Reimer, B., Mehler, B.: Classifying driver workload using physiological and driving performance data: two field studies. In: Proceedings of the 32nd Annual ACM Conference on Human Factors in Computing Systems. ACM (2014)

    Google Scholar 

  13. Mehler, B., Reimer, B., Coughlin, J.F.: Sensitivity of physiological measures for detecting systematic variations in cognitive demand from a working memory task: an on-road study across three age groups. Hum. Factors 54(3), 396–412 (2012)

    Article  Google Scholar 

  14. Ahlstrom, U., Friedman-Berg, F.J.: Using eye movement activity as a correlate of cognitive workload. Int. J. Ind. Ergon. 36(7), 623–636 (2006)

    Article  Google Scholar 

  15. Jacob, R.J.K., Karn, K.S.: Eye tracking in human-computer interaction and usability research: ready to deliver the promises. In: Hyönä, J., Radach, R., Deubel, H. (eds.) The Mind’s Eye, pp. 573–605. North-Holland, Amsterdam (2003)

    Chapter  Google Scholar 

  16. Goldberg, J.H., Kotval, X.P.: Computer interface evaluation using eye movements: methods and constructs. Int. J. Ind. Ergon. 24(6), 631–645 (1999)

    Article  Google Scholar 

  17. Parasuraman, R., Christensen, J., Grafton, S.: Neuroergonomics: the brain in action and at work. Neuroimage 59(1), 1–3 (2012)

    Article  Google Scholar 

  18. Ayaz, H., Willems, B., Bunce, S., Shewokis, P.A., Izzetoglu, K., Hah, S., Deshmukh, A., Onaral, B.: Estimation of cognitive workload during simulated air traffic control using optical brain imaging sensors. In: Schmorrow, D.D., Fidopiastis, C.M. (eds.) Foundations of Augmented Cognition. Directing the Future of Adaptive Systems: 6th International Conference, FAC 2011, Held as Part of HCI International 2011, Proceedings, pp. 549–558, Springer, Berlin, Heidelberg, Orlando, FL, USA, 9–14 July 2011

    Chapter  Google Scholar 

  19. Liu, Y., Ayaz, H., Shewokis, P.A.: Multisubject “learning” for mental workload classification using concurrent EEG, fNIRS, and physiological measures. Front. Hum. Neurosci. 11, 389 (2017)

    Article  Google Scholar 

  20. Di Domenico, S.I., Rodrigo, A.H., Ayaz, H., Fournier, M.A., Ruocco, A.C.: Decision-making conflict and the neural efficiency hypothesis of intelligence: a functional near-infrared spectroscopy investigation. Neuroimage 109, 307–317 (2015)

    Article  Google Scholar 

  21. Durantin, G., Gagnon, J.F., Tremblay, S., Dehais, F.: Using near infrared spectroscopy and heart rate variability to detect mental overload. Behav. Brain Res. 259, 16–23 (2014)

    Article  Google Scholar 

  22. Rodrigo, A.H., Domenico, S.I.D., Ayaz, H., Gulrajani, S., Lam, J., Ruocco, A.C.: Differentiating functions of the lateral and medial prefrontal cortex in motor response inhibition. NeuroImage 85, Part 1(0), 423–431 (2014)

    Article  Google Scholar 

  23. Logan, G.D., Van Zandt, T., Verbruggen, F., Wagenmakers, E.J.: On the ability to inhibit thought and action: general and special theories of an act of control. Psychol. Rev. 121(1), 66–95 (2014)

    Article  Google Scholar 

  24. Shalev, L., Ben-Simon, A., Mevorach, C., Cohen, Y., Tsal, Y.: Conjunctive continuous performance task (CCPT)–a pure measure of sustained attention. Neuropsychologia 49(9), 2584–2591 (2011)

    Article  Google Scholar 

  25. McKendrick, R., Ayaz, H., Olmstead, R., Parasuraman, R.: Enhancing dual-task performance with verbal and spatial working memory training: continuous monitoring of cerebral hemodynamics with NIRS. NeuroImage 85, Part 3(0), 1014–1026 (2014)

    Article  Google Scholar 

  26. Owen, A.M., McMillan, K.M., Laird, A.R., Bullmore, E.: N-back working memory paradigm: a meta-analysis of normative functional neuroimaging studies. Hum. Brain Mapp. 25(1), 46–59 (2005)

    Article  Google Scholar 

  27. Wickens, C.D.: Situation awareness and workload in aviation. Curr. Dir. Psychol. Sci. 11(4), 128–133 (2002)

    Article  Google Scholar 

  28. Endsley, M.R.: Design and evaluation for situation awareness enhancement. Proc. Hum. Factors Soc. Annu. Meet. 32(2), 97–101 (1988)

    Article  Google Scholar 

  29. Hagen, K., Ehlis, A.-C., Haeussinger, F.B., Heinzel, S., Dresler, T., Mueller, L.D., Herrmann, M.J., Fallgatter, A.J., Metzger, F.G.: Activation during the trail making test measured with functional near-infrared spectroscopy in healthy elderly subjects. NeuroImage 85, Part 1, 583–591 (2014)

    Article  Google Scholar 

  30. Müller, L.D., Guhn, A., Zeller, J.B.M., Biehl, S.C., Dresler, T., Hahn, T., Fallgatter, A.J., Polak, T., Deckert, J., Herrmann, M.J.: Neural correlates of a standardized version of the trail making test in young and elderly adults: a functional near-infrared spectroscopy study. Neuropsychologia 56, 271–279 (2014)

    Article  Google Scholar 

  31. Aklin, W.M., Lejuez, C.W., Zvolensky, M.J., Kahler, C.W., Gwadz, M.: Evaluation of behavioral measures of risk taking propensity with inner city adolescents. Behav. Res. Ther. 43(2), 215–228 (2005)

    Article  Google Scholar 

  32. Crowley, T.J., Raymond, K.M., Mikulich-Gilbertson, S.K., Thompson, L.L., Lejuez, C.W.: A risk-taking “set” in a novel task among adolescents with serious conduct and substance problems. J. Am. Acad. Child Adolesc. Psychiatry 45(2), 175–183 (2006)

    Article  Google Scholar 

  33. Ebbinghaus, H.: Memory: a contribution to experimental psychology. Ann. Neurosci. 20(4), 155–156 (2013)

    Article  Google Scholar 

  34. Ayaz, H., Dehais, F.: Neuroergonomics: The Brain at Work and Everyday Life, 1st edn. Elsevier, Academic Press, London (2019)

    Google Scholar 

  35. Gramann, K., Ferris, D.P., Gwin, J., Makeig, S.: Imaging natural cognition in action. Int. J. Psychophys. 91(1), 22–29 (2014)

    Article  Google Scholar 

  36. Gramann, K., Fairclough, S.H., Zander, T.O., Ayaz, H.: Editorial: trends in neuroergo-nomics. Front. Hum. Neurosci. 11(165) (2017). https://doi.org/10.3389/fnhum.2017.00165

Download references

Acknowledgments

This research was supported by the Air Force Research Laboratory’s Human Performance Sensing BAA call 002 under contract number FA8650-16-c-6764. The content of the information herein does not necessarily reflect the position or the policy of the sponsor and no official endorsement should be inferred.

Author information

Authors and Affiliations

  1. School of Biomedical Engineering, Science, and Health Systems, Drexel University, Philadelphia, PA, USA

    Jesse Mark, Adrian Curtin & Hasan Ayaz

  2. Advanced Technology Laboratories, Lockheed Martin, Cherry Hill, NJ, USA

    Amanda Kraft, Trevor Sands, William D. Casebeer & Matthias Ziegler

  3. Department of Family and Community Health, University of Pennsylvania, Philadelphia, PA, USA

    Hasan Ayaz

  4. Center for Injury Research and Prevention, Children’s Hospital of Philadelphia, Philadelphia, PA, USA

    Hasan Ayaz

  5. Drexel Business Solutions Institute, Drexel University, Philadelphia, PA, USA

    Hasan Ayaz

Authors
  1. Jesse Mark
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Adrian Curtin
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Amanda Kraft
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Trevor Sands
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. William D. Casebeer
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Matthias Ziegler
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Hasan Ayaz
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jesse Mark .

Editor information

Editors and Affiliations

  1. Drexel University, Philadelphia, PA, USA

    Hasan Ayaz

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Mark, J. et al. (2020). Eye Tracking-Based Workload and Performance Assessment for Skill Acquisition. In: Ayaz, H. (eds) Advances in Neuroergonomics and Cognitive Engineering. AHFE 2019. Advances in Intelligent Systems and Computing, vol 953. Springer, Cham. https://doi.org/10.1007/978-3-030-20473-0_14

Download citation

Publish with us

Policies and ethics

Search

Navigation