Skip to main content
SpringerLink
Log in

Using Eye Tracking for Research on Learning and Computational Thinking

  • Conference paper
  • First Online:
HCI in Games: Serious and Immersive Games (HCII 2021)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 12790))

Included in the following conference series:

Abstract

This paper presents a conceptual discussion of the theoretical constructs and perspectives in relation to using eye tracking as an assessment and research tool of computational thinking. It also provides a historical review of major mechanisms underlying the current eye-tracking technologies, and a technical evaluation of the set-up, the data capture and visualization interface, the data mining mechanisms, and the functionality of freeware eye trackers of different genres. During the technical evaluation of current eye trackers, we focus on gauging the versatility and accuracy of each tool in capturing the targeted cognitive measures in diverse task and environmental settings—static versus dynamic stimuli, in-person or remote data collection, and individualistic or collaborative learning space. Both theoretical frameworks and empirical review studies on the implementation of eye-tracking suggests that eye-tracking is a solid tool or approach for studying computational thinking. However, due to the current constraints of eye-tracking technologies, eye-tracking is limited in acting as an accessible and versatile tool for tracking diverse learners’ naturalistic interactions with dynamic stimuli in an open-ended, complex learning environment.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Alemdag, E., Cagiltay, K.: A systematic review of eye tracking research on multi- media learning. Comput. Educ. 125, 413–428 (2018)

    Article  Google Scholar 

  2. Anderson, N.D.: A call for computational thinking in undergraduate psychology. Psychol. Learn. Teach. 15(3), 226–234 (2016)

    Article  Google Scholar 

  3. Angeli, C., Giannakos, M.: Computational thinking education: issues and challenges (2020)

    Google Scholar 

  4. Arslanyilmaz, A., Corpier, K.: Eye tracking to evaluate comprehension of computational thinking. In: Proceedings of the 2019 ACM Conference on Innovation and Technology in Computer Science Education, p. 296 (2019)

    Google Scholar 

  5. Baltrusaitis, T., Zadeh, A., Lim, Y.C., Morency, L.P.: Openface 2.0: facial behavior analysis toolkit. In: 2018 13th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2018). pp. 59–66. IEEE (2018)

    Google Scholar 

  6. Barr, D., Harrison, J., Conery, L.: Computational thinking: a digital age skill for everyone. Learn. Lead. Technol. 38(6), 20–23 (2011)

    Google Scholar 

  7. Bassett, D., Green, A.: Engagement as visual attention: a new story for publishers. In: Publishing and Data Research Forum, London, pp. 17–20 (2015)

    Google Scholar 

  8. Blascheck, T., Kurzhals, K., Raschke, M., Burch, M., Weiskopf, D., Ertl, T.: State- of-the-art of visualization for eye tracking data. In: EuroVis (STARs) (2014)

    Google Scholar 

  9. Borys, M., Plechawska-Wójcik, M.: Eye-tracking metrics in perception and visual attention research. EJMT 3, 11–23 (2017)

    Google Scholar 

  10. Caruana, N., et al.: Joint attention difficulties in autistic adults: an interactive eye- tracking study. Autism 22(4), 502–512 (2018)

    Article  Google Scholar 

  11. Cowen, L., Ball, L.J., Delin, J.: An eye movement analysis of web page usability. In: People and Computers XVI-Memorable Yet Invisible, pp. 317–335. Springer (2002). https://doi.org/10.1007/978-1-4471-0105-5_19

  12. Dahlstrom-Hakki, I., Asbell-Clarke, J., Rowe, E.: Showing is knowing: the potential and challenges of using neurocognitive measures of implicit learning in the classroom. Mind Brain Educ. 13(1), 30–40 (2019)

    Article  Google Scholar 

  13. Ekman, R.: What the Face Reveals: Basic and Applied Studies of Spontaneous Expression using the Facial Action Coding System (FACS). Oxford University Press, Oxford (1997)

    Google Scholar 

  14. Ellis, N.C., Hafeez, K., Martin, K.I., Chen, L., Boland, J., Sagarra, N.: An eye- tracking study of learned attention in second language acquisition. Appl. Psycholinguist. 35(3), 547–579 (2014)

    Article  Google Scholar 

  15. Findlay, J.M., Findlay, J.M., Gilchrist, I.D., et al.: Active Vision: The Psychology of Looking and Seeing, vol. 37, Oxford University Press, Oxford (2003)

    Google Scholar 

  16. Fredricks, J.A., McColskey, W.: The measurement of student engagement: a compartive analysis of various methods and student self-report instruments. In: Handbook of Research on Student Engagement, pp. 763–782. Springer (2012). https://doi.org/10.1007/978-1-4614-2018-7_37

  17. Godfroid, A.: Eye tracking. Routledge encyclopedia of second language acquisition, pp. 234–236 (2012)

    Google Scholar 

  18. van Gog, T., Jarodzka, H.: Eye tracking as a tool to study and enhance cognitive and metacognitive processes in computer-based learning environments. In: Azevedo, R., Aleven, V. (eds.) International Handbook of Metacognition and Learning Technologies. SIHE, vol. 28, pp. 143–156. Springer, New York (2013). https://doi.org/10.1007/978-1-4419-5546-3_10

    Chapter  Google Scholar 

  19. Goldberg, J.H., Kotval, X.P.: Computer interface evaluation using eye movements: methods and constructs. Int. J. Ind. Ergon. 24(6), 631–645 (1999)

    Article  Google Scholar 

  20. Huang, M.X., Kwok, T.C., Ngai, G., Chan, S.C., Leong, H.V.: Building a personalized, auto-calibrating eye tracker from user interactions. In: Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, pp. 5169–5179 (2016)

    Google Scholar 

  21. Hyönä, J., Tommola, J., Alaja, A.M.: Pupil dilation as a measure of processing load in simultaneous interpretation and other language tasks. Q. J. Exp. Psychol. 48(3), 598–612 (1995)

    Google Scholar 

  22. Jacob, R.J., Karn, K.S.: Eye tracking in human-computer interaction and usability research: ready to deliver the promises. In: The Mind’s Eye, pp. 573–605. Elsevier (2003)

    Google Scholar 

  23. Just, M.A., Carpenter, P.A.: A theory of reading: from eye fixations to comprehension. Psychol. Rev. 87(4), 329 (1980)

    Article  Google Scholar 

  24. Kaakinen, J.K., Ballenghein, U., Tissier, G., Baccino, T.: Fluctuation in cognitive engagement during reading: evidence from concurrent recordings of postural and eye movements. J. Exp. Psychol. Learn. Mem. Cogn. 44(10), 1671 (2018)

    Article  Google Scholar 

  25. Kiefer, P., Giannopoulos, I., Raubal, M., Duchowski, A.: Eye tracking for spatial research: Cognition, computation, challenges. Spat. Cogn. Comput. 17(1–2), 1–19 (2017)

    Article  Google Scholar 

  26. Krafka, K., et al.: Eye tracking for everyone. In: 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 2016

    Google Scholar 

  27. Krejtz, K., Duchowski, A., Krejtz, I., Szarkowska, A., Kopacz, A.: Discerning ambient/focal attention with coefficient k. ACM Trans. Appl. Perception (TAP) 13(3), 1–20 (2016)

    Article  Google Scholar 

  28. Krejtz, K., et al.: Gaze transition entropy. ACM Trans. Appl. Perception (TAP) 13(1), 1–20 (2015)

    Google Scholar 

  29. Kruger, J.L., Doherty, S.: Measuring cognitive load in the presence of educational video: towards a multimodal methodology. Australas. J. Educ. Technol. 32(6) (2016)

    Google Scholar 

  30. Kulke, L.V., Atkinson, J., Braddick, O.: Neural differences between covert and overt attention studied using EEG with simultaneous remote eye tracking. Front. Hum. Neurosci. 10, 592 (2016)

    Article  Google Scholar 

  31. Lai, M.L., et al.: A review of using eye-tracking technology in exploring learning from 2000 to 2012. Educ. Res. Rev. 10, 90–115 (2013)

    Article  Google Scholar 

  32. Liu, H.C., Lai, M.L., Chuang, H.H.: Using eye-tracking technology to investigate the redundant effect of multimedia web pages on viewers’ cognitive processes. Comput. Hum. Behav. 27(6), 2410–2417 (2011)

    Article  Google Scholar 

  33. Miller, B.W.: Using reading times and eye-movements to measure cognitive engagement. Educ. Psychol. 50(1), 31–42 (2015)

    Article  Google Scholar 

  34. Navab, A., Gillespie-Lynch, K., Johnson, S.P., Sigman, M., Hutman, T.: Eye- tracking as a measure of responsiveness to joint attention in infants at risk for autism. Infancy 17(4), 416–431 (2012)

    Article  Google Scholar 

  35. Obaidellah, U., Al Haek, M., Cheng, P.C.H.: A survey on the usage of eye-tracking in computer programming. ACM Comput. Surv. (CSUR) 51(1), 1–58 (2018)

    Google Scholar 

  36. O’Brien, H.L., Toms, E.G.: What is user engagement? A conceptual framework for defining user engagement with technology. J. Am. Soc. Inform. Sci. Technol. 59(6), 938–955 (2008)

    Article  Google Scholar 

  37. O’Brien, H.L., Cairns, P., Hall, M.: A practical approach to measuring user engagement with the refined user engagement scale (UES) and new UES short form. Int. J. Hum Comput Stud. 112, 28–39 (2018)

    Article  Google Scholar 

  38. Papavlasopoulou, S., Sharma, K., Giannakos, M., Jaccheri, L.: Using eye-tracking to unveil differences between kids and teens in coding activities. In: Proceedings of the 2017 Conference on Interaction Design and Children, pp. 171–181 (2017)

    Google Scholar 

  39. Papavlasopoulou, S., Sharma, K., Giannakos, M.N.: How do you feel about learning to code? Investigating the effect of children’s attitudes towards coding using eye- tracking. Int. J. Child-Comput. Interact. 17, 50–60 (2018)

    Article  Google Scholar 

  40. Papoutsaki, A., Sangkloy, P., Laskey, J., Daskalova, N., Huang, J., Hays, J.: Webgazer: scalable webcam eye tracking using user interactions. In: Proceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence, pp. 3839–3845 (2016)

    Google Scholar 

  41. Park, S., Aksan, E., Zhang, X., Hilliges, O.: Towards end-to-end video-based eye-tracking. In: Vedaldi, A., Bischof, Horst, Brox, T., Frahm, J.-M. (eds.) ECCV 2020. LNCS, vol. 12357, pp. 747–763. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-58610-2_44

    Chapter  Google Scholar 

  42. Peterson, M.S., Kramer, A.F., Irwin, D.E.: Covert shifts of attention precede involuntary eye movements. Percept. Psychophys. 66(3), 398–405 (2004)

    Article  Google Scholar 

  43. Pfeiffer, U.J., Vogeley, K., Schilbach, L.: From gaze cueing to dual eye-tracking: novel approaches to investigate the neural correlates of gaze in social interaction. Neurosci. Biobehav. Rev. 37(10), 2516–2528 (2013)

    Article  Google Scholar 

  44. Pietinen, S., Bednarik, R., Tukiainen, M.: Shared visual attention in collaborative programming: a descriptive analysis. In: Proceedings of the 2010 ICSE Workshop on Cooperative and Human Aspects of Software Engineering, pp. 21–24 (2010)

    Google Scholar 

  45. Rayner, K.: Eye movements in reading and information processing: 20 years of research. Psychol. Bull. 124(3), 372 (1998)

    Article  Google Scholar 

  46. Rayner, K.: The 35th sir frederick bartlett lecture: eye movements and attention in reading, scene perception, and visual search. Q. J. Exp. Psychol. 62(8), 1457–1506 (2009)

    Article  Google Scholar 

  47. Schneider, B., Pea, R.: Real-time mutual gaze perception enhances collaborative learning and collaboration quality. Int. J. Comput.-Support. Collab. Learn. 8(4), 375–397 (2013). https://doi.org/10.1007/s11412-013-9181-4

    Article  Google Scholar 

  48. Schneider, B., Sharma, K., Cuendet, S., Zufferey, G., Dillenbourg, P., Pea, R.: Leveraging mobile eye-trackers to capture joint visual attention in co-located collaborative learning groups. Int. J. Comput.-Supported Collab. Learn. 13(3), 241–261 (2018)

    Article  Google Scholar 

  49. Sharafi, Z., Soh, Z., Guéhéneuc, Y.G.: A systematic literature review on the usage of eye-tracking in software engineering. Inf. Softw. Technol. 67, 79–107 (2015)

    Google Scholar 

  50. Sharma, K., Papavlasopoulou, S., Giannakos, M.: Coding games and robots to en- hance computational thinking: How collaboration and engagement moderate children’s attitudes? Int. J. Child-Comput. Interact. 21, 65–76 (2019)

    Article  Google Scholar 

  51. Shojaeizadeh, M., Djamasbi, S., Trapp, A.C.: Density of gaze points within a fixation and information processing behavior. In: Antona, M., Stephanidis, C. (eds.) UAHCI 2016. LNCS, vol. 9737, pp. 465–471. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-40250-5_44

    Chapter  Google Scholar 

  52. Shute, V.J., Sun, C., Asbell-Clarke, J.: Demystifying computational thinking. Educ. Res. Rev. 22, 142–158 (2017)

    Article  Google Scholar 

  53. Sweller, J.: Cognitive load during problem solving: effects on learning. Cogn. Sci. 12(2), 257–285 (1988)

    Article  Google Scholar 

  54. Underwood, G., Radach, R.: Eye guidance and visual information processing: reading, visual search, picture perception and driving. In: Eye Guidance in Reading and Scene Perception, pp. 1–27. Elsevier (1998)

    Google Scholar 

  55. Valliappan, N., et al.: Accelerating eye movement research via accurate and affordable smartphone eye tracking. Nat. Commun. 11(1), 1–12 (2020)

    Article  Google Scholar 

  56. Wing, J.M.: Computational thinking. Commun. ACM 49(3), 33–35 (2006)

    Article  Google Scholar 

  57. Xu, P., Ehinger, K.A., Zhang, Y., Finkelstein, A., Kulkarni, S.R., Xiao, J.: Turkergaze: crowdsourcing saliency with webcam based eye tracking. arXiv preprint arXiv:1504.06755 (2015)

  58. Zagermann, J., Pfeil, U., Reiterer, H.: Measuring cognitive load using eye tracking technology in visual computing. In: Proceedings of the Sixth Workshop on Beyond Time and Errors on Novel Evaluation Methods for Visualization, pp. 78–85 (2016)

    Google Scholar 

  59. Judd ,C.H.: Psychol. Rev. Monoh. Suppl. VII(35) (1907)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Florida State University, Tallahassee, FL, 32306-4453, USA

    Fengfeng Ke & Zlatko Sokolikj

  2. University of Florida, Gainesville, FL, 32611, USA

    Ruohan Liu & Maya Israel

  3. TERC, Cambridge, MA, 02140, USA

    Ibrahim Dahlstrom-Hakki

Authors
  1. Fengfeng Ke
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ruohan Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Zlatko Sokolikj
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Ibrahim Dahlstrom-Hakki
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Maya Israel
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Fengfeng Ke .

Editor information

Editors and Affiliations

  1. DePaul University, Chicago, IL, USA

    Xiaowen Fang

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Ke, F., Liu, R., Sokolikj, Z., Dahlstrom-Hakki, I., Israel, M. (2021). Using Eye Tracking for Research on Learning and Computational Thinking. In: Fang, X. (eds) HCI in Games: Serious and Immersive Games. HCII 2021. Lecture Notes in Computer Science(), vol 12790. Springer, Cham. https://doi.org/10.1007/978-3-030-77414-1_16

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-77414-1_16

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-77413-4

  • Online ISBN: 978-3-030-77414-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation