Multiscale Analysis of Textual Content Using Eyegaze

  • Aniruddha SinhaEmail author
  • Rikayan Chaki
  • Bikram Kumar De
  • Rajlakshmi Guha
  • Sanjoy Kumar Saha
  • Anupam Basu
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11960)


Reading of a textual content involves a complex coordination between various parts of brain responsible for visual inputs, language processing, cognitive functions and motor response. In addition, psychological factors like attention and perception play a major role in understanding of the content. Many of these factors get reflected in the behaviour of eye movement, as the content is read. In this paper, we present an approach for analysing a textual content in various scales using eyegaze. The scales include (i) individual fixation characteristics, (ii) saccades and fixations within a line (iii) overall difficulty score of the content. An affordable infrared eye tracking device is used to capture the gaze characteristics in an unobtrusive manner. Two types (easy and difficult) of textual contents are designed for the experiment which are benchmarked using standard readability indices. The fixation characteristics include fixation duration, change in drift direction within a fixation and spatial area of a fixation. Using Analysis of Variance (ANOVA), the former two are found to be statistically significant in distinguishing the two types of contents. Within a line, the spatial distance between fixations and the number of switching between saccades and fixations characterize the flow during a reading where the later is found to be statistically significant. A mixture of two partial sigmoid is used as a mapping function to compute the difficulty score of a content from the significant features. For a given content, the variation of these scores among individual readers, enables us to get deeper insights into their cognitive and psychological aspects.


Fixation Eyegaze ANOVA Multiscale Textual content 



Authors would like to thank the participants for their co-operation during the experiment and data collection for the same.


  1. 1.
    Demb, J.B., Boynton, G.M., Heeger, D.J.: Brain activity in visual cortex predicts individual differences in reading performance. Proc. Nat. Acad. Sci. 94(24), 13363–13366 (1997)CrossRefGoogle Scholar
  2. 2.
    Sweller, J.: Cognitive load during problem solving: effects on learning. Cogn. Sci. 12(2), 257–285 (1988)CrossRefGoogle Scholar
  3. 3.
    Czisikszentmihalyi, M.: Flow-the psychology of optimal experience (1990)Google Scholar
  4. 4.
    McConkie, G.W., Rayner, K.: The span of the effective stimulus during a fixation in reading. Percept. Psychophys. 17(6), 578–586 (1975) CrossRefGoogle Scholar
  5. 5.
    Carpenter, R.H.: Eye Movements. Vision and Visual Dysfunction, vol. 8. Nature Publishing Group, London (1991)Google Scholar
  6. 6.
    O’regan, J., Lévy-Schoen, A., Pynte, J., Brugaillère, B.: Convenient fixation location within isolated words of different length and structure. J. Exp. Psychol.: Hum. Percept. Perform. 10(2), 250 (1984)Google Scholar
  7. 7.
    Just, M.A., Carpenter, P.A.: The Psychology of Reading and Language Comprehension. Allyn & Bacon, Boston (1987)Google Scholar
  8. 8.
    Mehlenbacher, B., et al.: Usable e-learning: a conceptual model for evaluation and design. In: 11th Proceedings of HCI International, vol. 2005. Citeseer (2005)Google Scholar
  9. 9.
    Raish, V., Behler, A.: Library connection: an interactive, personalized orientation for online students. J. Libr. Inform. Serv. Dist. Learn. 13(1–2), 129–149 (2019)CrossRefGoogle Scholar
  10. 10.
    Campbell, J.D., Tesser, A.: Motivational interpretations of hindsight bias: an individual difference analysis. J. Pers. 51(4), 605–620 (1983)CrossRefGoogle Scholar
  11. 11.
    Kincaid, J.P., Fishburne Jr., R.P., Rogers, R.L., Chissom, B.S.: Derivation of new readability formulas (automated readability index, fog count and flesch reading ease formula) for navy enlisted personnel. Technical report, Naval Technical Training Command Millington TN Research Branch (1975)Google Scholar
  12. 12.
    Stemler, S.: An overview of content analysis. Pract. Assess. Res. Eval. 7(17), 137–146 (2001)Google Scholar
  13. 13.
    Mayer, R., Mayer, R.E.: The Cambridge Handbook of Multimedia Learning. Cambridge University Press, Cambridge (2005)CrossRefGoogle Scholar
  14. 14.
    Gavas, R., Das, R., Das, P., Chatterjee, D., Sinha, A.: Inactive-state recognition from EEG signals and its application in cognitive load computation. In: 2016 IEEE International Conference on Systems, Man, and Cybernetics (SMC), pp. 003606–003611. IEEE (2016)Google Scholar
  15. 15.
    Just, M.A., Carpenter, P.A.: A theory of reading: from eye fixations to comprehension. Psychol. Rev. 87(4), 329 (1980)CrossRefGoogle Scholar
  16. 16.
    Loewy, A.D., Spyer, K.M.: Central Regulation of Autonomic Functions. Oxford University Press, Oxford (1990)Google Scholar
  17. 17.
    Zhai, J., Barreto, A.: Stress detection in computer users based on digital signal processing of noninvasive physiological variables. In: 28th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS 2006, pp. 1355–1358. IEEE (2006)Google Scholar
  18. 18.
    Shi, Y., Ruiz, N., Taib, R., Choi, E., Chen, F.: Galvanic skin response (GSR) as an index of cognitive load. In: CHI 2007 Extended Abstracts on Human Factors in Computing Systems, pp. 2651–2656. ACM (2007)Google Scholar
  19. 19.
    McGuigan, F.J., Rodier, W.I.: Effects of auditory stimulation on covert oral behavior during silent reading. J. Exp. Psychol. 76(4p1), 649 (1968)CrossRefGoogle Scholar
  20. 20.
    Ryu, K., Myung, R.: Evaluation of mental workload with a combined measure based on physiological indices during a dual task of tracking and mental arithmetic. Int. J. Ind. Ergon. 35(11), 991–1009 (2005)CrossRefGoogle Scholar
  21. 21.
    Hjemdahl, P., Freyschuss, U., Juhlin-Dannfelt, A., Linde, B.: Differentiated sympathetic activation during mental stress evoked by the stroop test. Acta Physiol. Scand. Suppl. 527, 25–29 (1984)Google Scholar
  22. 22.
    Khurana, V., Kumar, P., Saini, R., Roy, P.P.: Eeg based word familiarity using features and frequency bands combination. Cogn. Syst. Res. 49, 33–48 (2018)CrossRefGoogle Scholar
  23. 23.
    Hahn, M., Keller, F.: Modeling human reading with neural attention. arXiv preprint arXiv:1608.05604 (2016)
  24. 24.
    Rayner, K.: Eye movements in reading and information processing: 20 years of research. Psychol. Bull. 124(3), 372 (1998)CrossRefGoogle Scholar
  25. 25.
    Paas, F., Tuovinen, J.E., Tabbers, H., Van Gerven, P.W.: Cognitive load measurement as a means to advance cognitive load theory. Educ. Psychol. 38(1), 63–71 (2003)CrossRefGoogle Scholar
  26. 26.
    Sinha, A., Chaki, R., De Kumar, B., Saha, S.K.: Readability analysis of textual content using eye tracking. In: Chaki, R., Cortesi, A., Saeed, K., Chaki, N. (eds.) Advanced Computing and Systems for Security. AISC, vol. 897, pp. 73–88. Springer, Singapore (2019). Scholar
  27. 27.
    Popelka, S., Stachoň, Z., Šašinka, Č., Doležalová, J.: Eyetribe tracker data accuracy evaluation and its interconnection with hypothesis software for cartographic purposes. Comput. Intell. Neurosci. 2016, 20 (2016)CrossRefGoogle Scholar
  28. 28.
    Sinha, A., Kumar Saha, S., Basu, A.: Determining perceptual similarity among readers based on eyegaze dynamics. In: Chaki, R., Cortesi, A., Saeed, K., Chaki, N. (eds.) Advanced Computing and Systems for Security. AISC, vol. 996, pp. 113–124. Springer, Singapore (2020). In PressCrossRefGoogle Scholar
  29. 29.
    Sinha, A., Kumar Saha, S., Basu, A.: Assessment of reading material with flow of eyegaze using low-cost eye tracker. In: Das, A.K., Nayak, J., Naik, B., Pati, S.K., Pelusi, D. (eds.) Computational Intelligence in Pattern Recognition. AISC, vol. 999, pp. 497–508. Springer, Singapore (2020). In PressCrossRefGoogle Scholar
  30. 30.
    Raney, G.E., Campbell, S.J., Bovee, J.C.: Using eye movements to evaluate the cognitive processes involved in text comprehension. J. Vis. Exp.: JoVE 83, e50780 (2014)Google Scholar
  31. 31.
    Johnson, J.: Designing with the Mind in Mind: Simple Guide to Understanding User Interface Design Guidelines. Elsevier, Amsterdam (2013)Google Scholar
  32. 32.
    Navarro, O., Molina, A.I., Lacruz, M., Ortega, M.: Evaluation of multimedia educational materials using eye tracking. Proc.-Soc. Behav. Sci. 197, 2236–2243 (2015)CrossRefGoogle Scholar
  33. 33.
    Holsanova, J., Rahm, H., Holmqvist, K.: Entry points and reading paths on newspaper spreads: comparing a semiotic analysis with eye-tracking measurements. Vis. Commun. 5(1), 65–93 (2006)CrossRefGoogle Scholar
  34. 34.
    Indrarathne, B., Kormos, J.: The role of working memory in processing L2 input: insights from eye-tracking. Bilingualism: Lang. Cogn. 21(2), 355–374 (2018)CrossRefGoogle Scholar
  35. 35.
    Kliegl, R., Laubrock, J.: Eye-movement tracking during reading. Research Methods in Psycholinguistics and the Neurobiology of Language: A Practical Guide, pp. 68–88 (2017)Google Scholar
  36. 36.
    Deubel, H., O’Regan, K., Radach, R., et al.: Attention, information processing and eye movement control. Read. Percept. Process 355–374 (2000)Google Scholar
  37. 37.
    Reichle, E.D., Pollatsek, A., Fisher, D.L., Rayner, K.: Toward a model of eye movement control in reading. Psychol. Rev. 105(1), 125 (1998) CrossRefGoogle Scholar
  38. 38.
    Feng, S., D’Mello, S., Graesser, A.C.: Mind wandering while reading easy and difficult texts. Psychonom. Bull. Rev. 20(3), 586–592 (2013)CrossRefGoogle Scholar
  39. 39.
    Reichle, E.D., Reineberg, A.E., Schooler, J.W.: Eye movements during mindless reading. Psychol. Sci. 21(9), 1300–1310 (2010)CrossRefGoogle Scholar
  40. 40.
    Forssman, L., et al.: Eye-tracking-based assessment of cognitive function in low-resource settings. Archives of Disease in Childhood, archdischild-2016 (2016)Google Scholar
  41. 41.
    Burton, R., Saunders, L.J., Crabb, D.P.: Areas of the visual field important during reading in patients with glaucoma. Jpn. J. Ophthalmol. 59(2), 94–102 (2015)CrossRefGoogle Scholar
  42. 42.
    Murata, N., Miyamoto, D., Togano, T., Fukuchi, T.: Evaluating silent reading performance with an eye tracking system in patients with glaucoma. PLoS One 12(1), e0170230 (2017)CrossRefGoogle Scholar
  43. 43.
    Gavas, R.D., Roy, S., Chatterjee, D., Tripathy, S.R., Chakravarty, K., Sinha, A.: Enhancing the usability of low-cost eye trackers for rehabilitation applications. PLoS One 13(6), e0196348 (2018)CrossRefGoogle Scholar
  44. 44.
    Chatterjee, D., Gavas, R.D., Chakravarty, K., Sinha, A., Lahiri, U.: Eye movements-an early marker of cognitive dysfunctions. In: 2018 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), pp. 4012–4016. IEEE (2018)Google Scholar
  45. 45.
    Keselman, H., et al.: Statistical practices of educational researchers: an analysis of their ANOVA, MANOVA, and ANCOVA analyses. Rev. Educ. Res. 68(3), 350–386 (1998)CrossRefGoogle Scholar
  46. 46.
    Johansen, S.A., San Agustin, J., Skovsgaard, H., Hansen, J.P., Tall, M.: Low cost vs. high-end eye tracking for usability testing. In: CHI 2011 Extended Abstracts on Human Factors in Computing Systems, pp. 1177–1182. ACM (2011)Google Scholar
  47. 47.
    Hornof, A.J., Halverson, T.: Cleaning up systematic error in eye-tracking data by using required fixation locations. Behav. Res. Methods Instr. Comput. 34(4), 592–604 (2002)CrossRefGoogle Scholar
  48. 48.
    De Boor, C., De Boor, C., Mathématicien, E.U., De Boor, C., De Boor, C.: A Practical guide to Splines, vol. 27. Springer, New York (1978)CrossRefGoogle Scholar
  49. 49.
    Veneri, G., Federighi, P., Rosini, F., Federico, A., Rufa, A.: Influences of data filtering on human-computer interaction by gaze-contingent display and eye-tracking applications. Comput. Hum. Behav. 26(6), 1555–1563 (2010)CrossRefGoogle Scholar
  50. 50.
    Salvucci, D.D., Goldberg, J.H.: Identifying fixations and saccades in eye-tracking protocols. In: Proceedings of the 2000 Symposium on Eye Tracking Research and Applications, pp. 71–78. ACM (2000)Google Scholar
  51. 51.
    Sen, T., Megaw, T.: The effects of task variables and prolonged performance on saccadic eye movement parameters. In: Advances in Psychology. vol. 22, pp. 103–111. Elsevier (1984)Google Scholar
  52. 52.
    Rayner, K., Well, A.D., Pollatsek, A.: Asymmetry of the effective visual field in reading. Percept. Psychophys. 27(6), 537–544 (1980)CrossRefGoogle Scholar
  53. 53.
    Jacobson, A.: Auto-threshold peak detection in physiological signals. In: Engineering in Medicine and Biology Society, Proceedings of the 23rd Annual International Conference of the IEEE. vol. 3, pp. 2194–2195. IEEE (2001)Google Scholar
  54. 54.
    Hinkin, T.R.: A brief tutorial on the development of measures for use in survey questionnaires. Organ. Res. Methods 1(1), 104–121 (1998)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag GmbH Germany, part of Springer Nature 2020

Authors and Affiliations

  • Aniruddha Sinha
    • 1
    Email author
  • Rikayan Chaki
    • 2
  • Bikram Kumar De
    • 2
  • Rajlakshmi Guha
    • 3
  • Sanjoy Kumar Saha
    • 2
  • Anupam Basu
    • 4
    • 5
  1. 1.TCS Research and InnovationTata Consultancy ServicesKolkataIndia
  2. 2.Department of Computer Science and EngineeringJadavpur UniversityKolkataIndia
  3. 3.Center for Educational TechnologyIndian Institute of Technology, KharagpurKharagpurIndia
  4. 4.Department of Computer Science and EngineeringIndian Institute of Technology, KharagpurKharagpurIndia
  5. 5.National Institute of Technology, DurgapurDurgapurIndia

Personalised recommendations