Performance-Based Eye-Tracking Analysis in a Dynamic Monitoring Task

  • Wei Du
  • Jung Hyup KimEmail author
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9744)


The goal of this study is to explore how ocular behavior is different in groups that possessed varying levels of performance in dynamic control tasks with complex visual components. Twenty two university students participated in this study by operating a human-in-the-loop (HITL) simulator. The participants were asked to identify unknown air track(s) and take proper actions to defend a battleship. During the experiment, a head-mounted eye-tracking device was used continuously to record participants’ visual attention span regarding the normalized coordinates of their gaze points. In the current study, fixation duration was the main eye-tracking metrics. Air track identification accuracy and the NASA Task Load Index (NASA-TLX) were also used to measure participants’ task performance and overall subjective mental workload.


Mental workload Cognitive modeling Eye tracking analysis Task performance Human-in-the-loop simulation 


  1. Andrá, C., Lindström, P., Arzarello, F., Holmqvist, K., Robutti, O., Sabena, C.: Reading mathematics representations: an eye-tracking study. Int. J. Sci. Math. Educ. 13(2), 237–259 (2013)Google Scholar
  2. Bednarik, R., Tukiainen, M.: An eye-tracking methodology for characterizing program comprehension processes. Paper Presented at the Proceedings of the 2006 Symposium on Eye Tracking Research and Applications (2006)Google Scholar
  3. Crosby, M.E., Stelovsky, J.: How do we read algorithms? A case study. Computer 23(1), 25–35 (1990)CrossRefGoogle Scholar
  4. De Waard, D., Studiecentrum, V.: The measurement of drivers’ mental workload. Groningen University, Traffic Research Center Netherlands (1996)Google Scholar
  5. Eggemeier, F.T.: Properties of workload assessment techniques. Adv. Psychol. 52, 41–62 (1988)CrossRefGoogle Scholar
  6. Granka, L.A., Joachims, T., Gay, G.: Eye-tracking analysis of user behavior in WWW search. Paper Presented at the Proceedings of the 27th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (2004)Google Scholar
  7. Goldberg, J.H., Kotval, X.P.: Computer interface evaluation using eye movements: methods and constructs. Int. J. Ind. Ergonomics, 24(6), 631–645 (1999)Google Scholar
  8. Guo, K., Mahmoodi, S., Robertson, R.G., Young, M.P.: Longer fixation duration while viewing face images. Exp. Brain Res. 171(1), 91–98 (2006)CrossRefGoogle Scholar
  9. Hart, S.G., Staveland, L.E.: Development of NASA-TLX (task load index): results of empirical and theoretical research. Adv. Psychol. 52, 139–183 (1988)CrossRefGoogle Scholar
  10. Hegarty, M., Mayer, R.E., Green, C.E.: Comprehension of arithmetic word problems: Evidence from students’ eye fixations. J. Educ. Psychol. 84(1), 76 (1992)CrossRefGoogle Scholar
  11. Hyönä, J., Niemi, P.: Eye movements during repeated reading of a text. Acta Psychol. 73(3), 259–280 (1990)CrossRefGoogle Scholar
  12. Jacob, R., Karn, K.S.: Eye tracking in human-computer interaction and usability research: Ready to deliver the promises. Mind 2(3), 4 (2003)Google Scholar
  13. Just, M.A., Carpenter, P.A.: Eye fixations and cognitive processes. Cogn. Psychol. 8(4), 441–480 (1976)CrossRefGoogle Scholar
  14. Kim, J.H.: Simulation training in self-regulated learning: investigating the effects of dual feedback on dynamic decision-making tasks. In: Zaphiris, P., Ioannou, A. (eds.) LCT 2014, Part I. LNCS, vol. 8523, pp. 419–428. Springer, Heidelberg (2014)Google Scholar
  15. Kim, J.H., Chan, T., Du, W.: The learning effect of augmented reality training in a computer-based simulation environment. In: Zaphiris, P., Ioannou, A. (eds.) LCT 2015. LNCS, vol. 9192, pp. 406–414. Springer, Heidelberg (2015)CrossRefGoogle Scholar
  16. Kim, J.H., Rothrock, L., Tharanathan, A., Thiruvengada, H.: Investigating the effects of metacognition in dynamic control tasks. In: Jacko, J.A. (ed.) Human-Computer Interaction, Part I, HCII 2011. LNCS, vol. 6761, pp. 378–387. Springer, Heidelberg (2011)Google Scholar
  17. Liversedge, S.P., Findlay, J.M.: Saccadic eye movements and cognition. Trends Cogn. Sci. 4(1), 6–14 (2000)CrossRefGoogle Scholar
  18. Macht, G.A., Nembhard, D.A., Kim, J.H., Rothrock, L.: Structural models of extraversion, communication, and team performance. Int. J. Ind. Ergon. 44(1), 82–91 (2014)CrossRefGoogle Scholar
  19. Palinko, O., Kun, A.L., Shyrokov, A., Heeman, P.: Estimating cognitive load using remote eye tracking in a driving simulator. Paper Presented at the Proceedings of the 2010 Symposium on Eye-Tracking Research and Applications (2010)Google Scholar
  20. Poole, A., Ball, L.J.: Eye tracking in human-computer interaction and usability research: current status and future. Prospects. In: Ghaoui, C. (ed.) Encyclopedia of Human-Computer Interaction. Idea Group. Inc, Citeseer, Pennsylvania (2005)Google Scholar
  21. Rayner, K.: Eye movements in reading and information processing: 20 years of research. Psychol. Bull. 124(3), 372 (1998)CrossRefGoogle Scholar
  22. Rayner, K., Chace, K.H., Slattery, T.J., Ashby, J.: Eye movements as reflections of comprehension processes in reading. Sci. Stud. Read. 10(3), 241–255 (2006)CrossRefGoogle Scholar
  23. Reid, G.B., Nygren, T.E.: The subjective workload assessment technique: a scaling procedure for measuring mental workload. Adv. Psychol. 52, 185–218 (1988)CrossRefGoogle Scholar
  24. Tsai, M.-J., Hou, H.-T., Lai, M.-L., Liu, W.-Y., Yang, F.-Y.: Visual attention for solving multiple-choice science problem: an eye-tracking analysis. Comput. Educ. 58(1), 375–385 (2012)CrossRefGoogle Scholar
  25. Tsang, P.S., Velazquez, V.L.: Diagnosticity and multidimensional subjective workload ratings. Ergonomics 39(3), 358–381 (1996)CrossRefGoogle Scholar
  26. van Gog, T., Scheiter, K.: Eye tracking as a tool to study and enhance multimedia learning. Learn. Instr. 20(2), 95–99 (2010)CrossRefGoogle Scholar
  27. Yarbus, A.: Eye Movements and Vision. Plenum Press, New York (1967)CrossRefGoogle Scholar

Copyright information

© Springer International Publishing Switzerland 2016

Authors and Affiliations

  1. 1.Service Standards and Development DepartmentAir China Cargo Co. Ltd.BeijingChina
  2. 2.Department of Industrial and Manufacturing Systems EngineeringUniversity of MissouriColumbiaUSA

Personalised recommendations