Advertisement

Processing of Verbal and Non-verbal Patterns: An Eye-Tracking Study of Russian

  • Tatiana E. PetrovaEmail author
  • Elena I. RiekhakaynenEmail author
Conference paper
Part of the Advances in Intelligent Systems and Computing book series (AISC, volume 797)

Abstract

The paper describes an eye-tracking experiment on Russian language material. It explores how readers integrate text-figure information when reading and understanding verbal and non-verbal patterns, namely one and the same text in verbal format and infographics. The data from 22 college student participants indicate that their reading patterns were text-directed even while processing infographics. Our results did not show any fundamental differences in the processing of a verbal text and infographics (i.e., in the overall duration of reading, number and duration of fixations, general patterns of eye-movements). We also used questionnaires to check text comprehension and accessibility. For 3 out of 4 pairs of texts analyzed, we got more correct answers and lower estimation of difficulty for the infographic form than for the verbal one.

Keywords

Eye-tracking Text processing Infographics Russian Psycholinguistics Written text 

Notes

Acknowledgements

The study is supported by the research grant No. 14-18-02135 “Psychophysiological and neurolinguistic aspects of the recognition process of verbal and non-verbal patterns” from the Russian Science Foundation. Our thanks to Professor Tatiana Chernigovskaya for the supervision of this project, Professor Elena Kazakova for the research material (infographics and their translations into verbal format) and our students Artem Marajev, Anastasija Kuznetsova and Michail Shatalov for the help with collecting and analyzing the data. We also thank the Educational Centre “Sirius” (Sochi, Russia) for providing the field for the research and allowing access to their equipment and students.

References

  1. 1.
    Sorokin YA, Tarasov EF (1990) Creolized texts and their communication function. Drofa, Moscow (in Russian)Google Scholar
  2. 2.
    Lee W-K, Wu Ch-J (2017) Eye movements in text and integrating geometric figure: scanpaths and given-new effects. Int J Sci Math Educ 1–16.  https://doi.org/10.1007/s10763-016-9790-2CrossRefGoogle Scholar
  3. 3.
    Petrova T (2016) Eye movements in reading the texts of different functional styles: evidence from Russian. In: Czarnowski I, Caballero A, Howlett R, Jain L (eds) Intelligent decision technologies 2016. Smart innovation, systems and technologies, vol. 57. Springer, Cham, pp 285–298.  https://doi.org/10.1007/978-3-319-39627-9_25CrossRefGoogle Scholar
  4. 4.
    Rayner K, Rotello CM, Stewart AJ, Keir J, Duffy SA (2001) Integrating text and pictorial information: eye movements when looking at print advertisements. J Exp Psychol: Appl 7(3):219–226.  https://doi.org/10.1037/1076-898X.7.3.219CrossRefGoogle Scholar
  5. 5.
    Rayner K (1986) Eye movements and the perceptual span in beginning and skilled readers. J Exp Child Psychol 41:211–236CrossRefGoogle Scholar
  6. 6.
    Andrá C, Lindström P, Arzarello F, Holmqvist K, Robutti O, Sabena C (2015) Reading mathematics representations: an eye-tracking study. Int J Sci Math Educ 13(2):237–259.  https://doi.org/10.1007/s10763-013-9484-yCrossRefGoogle Scholar
  7. 7.
    van Gog T, Scheiter K (2010) Eye tracking as a tool to study and enhance multimedia learning. Learn Instr 20:95–99.  https://doi.org/10.1016/j.learninstruc.2009.02.009CrossRefGoogle Scholar
  8. 8.
    Prokopenya V (2017) Perception and description of paintings. In: International multidisciplinary scientific geoconference-SGEM, vol. 3(1). STEF92 Technology Ltd., Sofia, 169–174.  https://doi.org/10.5593/sgemsocial2017/hb31/s10.022
  9. 9.
    Schnotz W (2005) An integrated model of text and picture comprehension. In: Mayer RE (ed) Cambridge handbook of multimedia learning. Cambridge University Press, New York, pp 49–69.  https://doi.org/10.1017/cbo9780511816819.005
  10. 10.
    Murzin LN, Shtern AS (1991) Text and its perception. UGU Press, Sverdlovsk (in Russian)Google Scholar
  11. 11.
    Hannus M, Hyona J (1999) Utilization of illustrations during learning of science textbook passages among low- and high-ability children. Contemp Educ Psychol 24:95–123.  https://doi.org/10.1006/ceps.1998.0987CrossRefGoogle Scholar
  12. 12.
    Hegarty M, Just MA (1993) Constructing mental models of machines from text and diagrams. J Mem Lang 32:717–742.  https://doi.org/10.1006/jmla.1993.1036CrossRefGoogle Scholar
  13. 13.
    Chen CY, Wu CJ (2012) Eye movements during geometry proof reading: text contrasting with figure and the colored effects. J Educ Pract Res 25(2):35–66Google Scholar
  14. 14.
    Beymer D, Orton PZ, Russel DM (2007) An eye tracking study of how pictures influence online reading. In: Baranauskas C, Palanque Ph, Abascal J, Barbosa SDJ (eds) 11th IFIP TC 13 international conference human-computer interaction—INTERACT 2007. Rio de Janeiro, Brazil, 10–14 Sept 2007, Proceedings, Part II. Springer, Heidelberg, pp 456–460.  https://doi.org/10.1007/978-3-540-74800-7_41Google Scholar
  15. 15.
    Sajjacholapunt P, Ball LJ (2014) The influence of banner advertisements on attention and memory: human faces with averted gaze can enhance advertising effectiveness. Front Psychol 5:1–16.  https://doi.org/10.3389/fpsyg.2014.00166CrossRefGoogle Scholar

Copyright information

© Springer Nature Singapore Pte Ltd. 2019

Authors and Affiliations

  1. 1.Saint-Petersburg State UniversitySt. PetersburgRussia

Personalised recommendations