Abstract
Infographics are a new type of reading material comprising textual and visual information that has been used worldwide. Nonetheless, there has been limited research investigating people’s infographic-reading performance and the characteristics of superior readers. This study adopted Chinese texts and infographics as materials and employed eye-tracking technology to assess how working memory and relevant knowledge affected 137 college students’ reading comprehension, as indicated by reading accuracy (ACC), and reading efficiency, which in turn was indicated by reading time (RT) and total fixation duration (TFD). For texts, verbal working memory (VWM) exhibited no effects on individuals’ reading performance; visuospatial working memory (VSWM) exerted positive effects on both ACC and TFD, and participants with higher knowledge demonstrated better ACC. For infographics, higher-VWM participants showed greater ACC, and higher-VSWM participants displayed a longer RT and TFD, though the effect of knowledge was limited. Moreover, a significant interaction effect of VWM and relevant knowledge on the TFD of infographics was observed, indicating that individuals’ prior knowledge or experience might structure schemas in an infographic and then act with VWM to accelerate reading speed. This study improves our understanding of how working memory and relevant knowledge impact the processing of materials with different synthesized levels, and its implications for instruction and research are discussed.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
Data availability
Data available on request from the authors.
References
Agley, J., Xiao, Y., Thompson, E. E., Chen, X., & Golzarri-Arroyo, L. (2021). Intervening on trust in science to reduce belief in COVID-19 misinformation and increase COVID-19 preventive behavioral intentions: Randomized controlled trial. Journal of Medical Internet Research, 23(10), e32425. https://doi.org/10.2196/32425.
Baddeley, A. (2003). Working memory: Looking back and looking forward. Nature Reviews Neuroscience, 4, 829–839. https://doi.org/10.1038/nrn1201.
Baddeley, A. D., & Hitch, G. (1974). Working memory. Psychology of Learning and Motivation, 8, 47–89. https://doi.org/10.1016/s0079-7421(08)60452-1.
Baker, F. B. (2001). The basics of item response theory. ERIC Clearinghouse on Assessment and Evaluation.
Brogan-Hewitt, A., Apekey, T. A., Christian, M. S., & Day, R. E. (2021). Improving vitamin d intake in young children—Can an infographic help parents and carers understand the recommendations? Nutrients, 13, 3140. https://doi.org/10.3390/nu13093140.
Brusnighan, S. M., & Folk, J. R. (2012). Combining contextual and morphemic cues is beneficial during incidental vocabulary acquisition: Semantic transparency in novel compound word processing. Reading Research Quarterly, 47(2), 172–215. https://doi.org/10.1002/RRQ.015.
Brown, N. E., Bussert, K., Hattwig, D., & Medaille, A. (2016). Visual literacy for libraries: A practical, standards-based guide. ALA editions, an imprint of the American Library Association.
Cain, K., Oakhill, J., & Bryant, P. (2004). Children’ s reading comprehension ability: Concurrent prediction by working memory, verbal ability, and component skills. Journal of Educational Psychology, 96(1), 31–42. https://doi.org/10.1037/0022-0663.96.1.31.
Chen, H. C., & Lee, Y. S. (2005). The effect of mnemonic training upon the working memory capacity [in Chinese]. Bulletin of Educational Psychology, 37(1), 41–59. https://doi.org/10.6251/BEP.20050813.
Clinton, V. (2019). Reading from paper compared to screens: A systematic review and meta-analysis. Journal of Research in Reading, 42(2), 288–325. https://doi.org/10.1111/1467-9817.12269.
De Haan, Y., Kruikemeier, S., Lecheler, S., Smit, G., & van der Nat, R. (2018). When does an infographic say more than a thousand words? Journalism Studies, 19(9), 1293–1312. https://doi.org/10.1080/1461670X.2016.1267592.
Daneman, M., & Carpenter, P. A. (1980). Individual differences in working memory and reading. Journal of Verbal Learning and Verbal Behavior, 19(4), 450–466. https://doi.org/10.1016/S0022-5371(80)90312-6.
Eitel, A., & Scheiter, K. (2015). Picture or text first? Explaining sequence effects when learning with pictures and text. Educational Psychology Review, 27, 153–180. https://doi.org/10.1007/s10648-014-9264-4.
Evans, J. D. (1996). Straightforward statistics for the behavioral sciences. Brooks/Cole Publishing.
Freed, E. M., Hamilton, S. T., & Long, D. L. (2017). Comprehension in proficient readers: The nature of individual variation. Journal of Memory and Language, 97, 135–153. https://doi.org/10.1016/j.jml.2017.07.008.
Haider, H., & Frensch, P. A. (1996). The role of information reduction in skill acquisition. Cognitive Psychology, 30, 304–337. https://doi.org/10.1006/cogp.1996.0009.
Harvey, H., & Walker, R. (2018). Reading comprehension and its relationship with working memory capacity when reading horizontally scrolling text. The Quarterly Journal of Experimental Psychology, 71(9), 1887–1897. https://doi.org/10.1080/17470218.2017.1363258.
Hegarty, M., & Just, M. A. (1993). Constructing mental models of machines from text and diagrams. Journal of Memory and Language, 32, 717–742. https://doi.org/10.1006/jmla.1993.1036.
Hernandez-Sanchez, S., Moreno-Perez, V., Garcia-Campos, J., Marco-Lledó, J., Navarrete-Muñoz, E. M., & Lozano-Quijada, C. (2020). Twelve tips to make successful medical infographics. Medical Teacher. https://doi.org/10.1080/0142159X.2020.1855323.
Jian, Y. C. (2022). Using an eye tracker to examine the effect of prior knowledge on reading processes while reading a printed scientific text with multiple representations. International Journal of Science Education. https://doi.org/10.1080/09500693.2022.2072013.
Kendeou, P., & van den Broek, P. (2007). The effects of prior knowledge and text structure on comprehension processes during reading of scientific texts. Memory & Cognition, 35(7), 1567–1577. https://doi.org/10.3758/BF03193491.
Kudo, M. F., Lussier, C. M., & Swanson, H. L. (2015). Reading disabilities in children: A selective meta-analysis of the cognitive literature. Research in Developmental Disabilities, 40, 51–62. https://doi.org/10.1016/j.ridd.2015.01.002.
Landerl, K., Castles, A., & Parrila, R. (2022). Cognitive precursors of reading: A cross-linguistic perspective. Scientific Studies of Reading, 26(2), 111–124. https://doi.org/10.1080/10888438.2021.1983820.
Lankow, J., Ritchie, J., & Crooks, R. (2012). Infographics: The power of visual storytelling. Wiley.
Lee, W. K., & Wu, C. J. (2018). Eye movements in integrating geometric text and figure: Scanpaths and given-new effects. International Journal of Science and Mathematics Education, 16(4), 699–714. https://doi.org/10.1007/s10763-016-9790-2.
Leong, C. K., Tse, S. K., Loh, K. Y., & Ki, W. W. (2011). Orthographic knowledge important in comprehending elementary Chinese text by users of alphasyllabaries. Reading Psychology, 32(3), 237–271. https://doi.org/10.1080/02702711.2010.495605.
Lin, H. Y., Hsu, C. C., Chen, H. C., & Chiu, F. C. (2013). The relationship between the working memory and creativity [in Chinese]. Journal of Chinese Creativity, 4(2), 31–55.
Liu, T. S. W., Liu, Y. T., & Chen, C. Y. D. (2019). Meaningfulness is in the eye of the reader: Eye-tracking insights of L2 learners reading e-books and their pedagogical implications. Interactive Learning Environments, 27(2), 181–199. https://doi.org/10.1080/10494820.2018.1451901.
Majooni, A., Masood, M., & Akhavan, A. (2018). An eye-tracking study on the effect of infographic structures on viewer’s comprehension and cognitive load. Information Visualization, 17(3), 257–266. https://doi.org/10.1177/1473871617701971.
McBride-Chang, C., Cho, J. R., Liu, H., Wagner, R. K., Shu, H., Zhou, A., Cheuk, C. S. M., & Muse, A. (2005). Changing models across cultures: Associations of phonological awareness and morphological structure awareness with vocabulary and word recognition in second graders from Beijing, Hong Kong, Korea, and the United States. Journal of Experimental Child Psychology, 92, 140–160. https://doi.org/10.1016/j.jecp.2005.03.009.
McClelland, J., & Rumelhart, D. (1981). An interactive activation model of context effects in letter perception: Part I. An account of basic findings. Psychological Review, 88, 375–407. https://doi.org/10.1037/0033-295X.88.5.375.
McVay, J. C., & Kane, M. J. (2012). Why does working memory capacity predict variation in reading comprehension? On the influence of mind wandering and executive attention. Journal of Experimental Psychology: General, 141(2), 302–320. https://doi.org/10.1037/a0025250.
Oakhill, J., Yuill, N., & Garnham, A. (2011). The differential relations between verbal, numerical and spatial working memory abilities and children’s reading comprehension. International Electronic Journal of Elementary Education, 4(1), 83–106.
Organisation for Economic Cooperation and Development. (2005). The definition and selection of key competencies [Executive Summary]. Retrieved from: https://www.oecd.org/pisa/35070367.pdf.
Ozdamli, F., & Ozdal, H. (2018). Developing an instructional design for the design of infographics and the evaluation of infographic usage in teaching based on teacher and student opinions. EURASIA Journal of Mathematics, Science and Technology Education, 14(4), 1197–1219. https://doi.org/10.29333/ejmste/81868.
Peng, P., Barnes, M., Wang, C. C., Wang, W., Li, S., Swanson, H. L., Dardick, W., & Tao, S. (2018). A meta-analysis on the relation between reading and working memory. Psychological Bulletin, 144(1), 48–76. https://doi.org/10.1037/bul0000124.
Pérez, A., Joseph, H. S. S. L., Bajo, T., & Nation, K. (2015). Evaluation and revision of inferential comprehension in narrative texts: An eye movement study. Language, Cognition and Neuroscience, 31(4), 549–566. https://doi.org/10.1080/23273798.2015.1115883.
Programme for International Student Assessment. (2021). PISA 2021 creative thinking framework. Retrieved from: https://www.oecd.org/pisa/publications/PISA-2021-creative-thinking-framework.pdf.
R CoreTeam (2017). R: A language and environment for statistical computing. R Foundation for Statistical Computing. Retrieved from https://www.R-project.org.
Rayner, K. (2009). Eye movements and attention in reading, scene perception, and visual search. The Quarterly Journal of Experimental Psychology, 62(8), 1457–1506. https://doi.org/10.1080/17470210902816461.
Reilly, R., & Radach, R. (2006). Some empirical tests of an interactive activation model of eye movement control in reading. Cognitive Systems Research, 7, 34–55. https://doi.org/10.1016/j.cogsys.2005.07.006.
Sanchez, C. A., & Wiley, J. (2006). An examination of the seductive details effect in terms of working memory capacity. Memory & Cognition, 34(2), 344–355. https://doi.org/10.3758/BF03193412.
Smith, J. M., & Robertson, M. K. (2021). (Info)Graphically inclined: A framework of infographic learning. The Reading Teacher, 74(4), 439–449. https://doi.org/10.1002/trtr.1966.
Snijders, T. A. B., & Bosker, R. J. (2012). Multilevel analysis: An introduction to basic and advanced multilevel modeling (2nd ed.). Sage.
Snell, J., van Leipsig, S., Grainger, J., & Meeter, M. (2018). OB1-reader: A model of word recognition and eye movements in text reading. Psychological Review, 125(6), 969–984. https://doi.org/10.1037/rev0000119.
Strobel, B., Grund, S., & Lindner, M. A. (2019). Do seductive details do their damage in the context of graph comprehension? Insights from eye movements. Applied Cognitive Psychology, 33(1), 95–108. https://doi.org/10.1002/acp.3491.
Sung, Y. T., Chang, T. H., Lin, W. C., Hsieh, K. S., & Chang, K. E. (2016). CRIE: An automated analyzer for Chinese texts. Behavior Research Methods, 48(4), 1238–1251. https://doi.org/10.3758/s13428-015-0649-1.
Swanson, H. L. (1999). What develops in working memory? A life span perspective. Development Psychology, 35(4), 986–1000. https://doi.org/10.1037/0012-1649.35.4.986.
Talwar, A., Greenberg, D., & Li, H. (2018). Does memory contribute to reading comprehension in adults who struggle with reading? Journal of Research in Reading, 41(S1), S163–S182. https://doi.org/10.1111/1467-9817.12258.
Turner, M. L., & Engle, R. W. (1989). Is working memory capacity task dependent? Journal of Memory and Language, 28, 127–154. https://doi.org/10.1016/0749-596X(89)90040-5.
Van Dyke, J. A., Johns, C. L., & Kukona, A. (2014). Low working memory capacity is only spuriously related to poor reading comprehension. Cognition, 131, 373–403. https://doi.org/10.1016/j.cognition.2014.01.007.
Weng, X., Li, G., & Li, R. (2016). Mediating effects of working memory in the relation between rapid automatized naming and Chinese reading comprehension. Journal of Psycholinguistic Research, 45, 945–959. https://doi.org/10.1007/s10936-015-9385-z.
Wu, C. J., & Liu, C. Y. (submitted). An eye-tracking study of college students’ infographic-reading processes.
Xu, Z., Wang, L. C., Liu, D., Chen, Y., & Tao, L. (2020). The moderation effect of processing efficiency on the relationship between visual working memory and Chinese character recognition. Frontier Psychology, 11, Article 1899. https://doi.org/10.3389/fpsyg.2020.01899.
Yang, F. Y. (2017). Examining the reasoning of conflicting science information from the information processing perspective: An eye movement analysis. Journal of Research in Science Teaching, 54(10), 1347–1372. https://doi.org/10.1002/tea.21408.
Funding
This research was financially supported by the Ministry of Science and Technology (project number: MOST 108-2410-H-003-046-MY2; 108-2410-H-656-009-MY3; 111-2410-H-003-089-MY2; 111-2410-H-656-010-) as well as the “Institute for Research Excellence in Learning Sciences” of National Taiwan Normal University (NTNU) from The Featured Areas Research Center Program within the framework of the Higher Education Sprout Project by the Ministry of Education (MOE) in Taiwan.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
Not applicable.
Ethical approval
This study has received ethics approval from the Research Ethics Committee, National Taiwan Normal University (Approval Number: 201906HM004).
Permission to reproduce material from other sources
The passages were in the public domain that no exclusive intellectual property rights were applied.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Appendix A: The infographics used in this study
Appendix A: The infographics used in this study
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Liu, CY., Wu, CJ. Effects of working memory and relevant knowledge on reading texts and infographics. Read Writ 36, 2319–2343 (2023). https://doi.org/10.1007/s11145-022-10368-1
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11145-022-10368-1