Abstract
When individuals’ attention shifts away from the primary tasks they are involved in, their minds start to wander. This mental phenomenon, also known as mind-wandering, can interact with other variables and affect the performance of academic tasks. The current study focuses particularly on the mind-wandering (MW) of Omani students while they were taking TIMSS-like science tests and examines the results in relation to their performance levels in the test, their grade level (i.e. age), and the cognitive level of the test items. The participants were 776 Omani students, 342 in Grade 5 and 434 in Grade 9. The tests used were designed to resemble actual TIMSS science tests and are therefore referred to as TIMSS-like science tests. Student MW was measured by the embedding of self-report probes at four points in the tests; the use of self-report probes has been widely adopted in previous research studies. The current researchers designed a mobile application to host the tests; the app was installed on tablets which participants used to take the test. Results indicated that low-scoring learners in both grade levels had significantly higher MW than high-achieving learners, and that this was true when they were doing both lower-order and higher-order test questions. However, there was a difference in the patterns of MW between students in the two different grades. For Grade 5 students, the difference in MW between low and high scorers followed a similar pattern at all stages of the test, while this was not the case with Grade 9 test-takers. There were significant differences in the repeated measures of MW of both low and high performers in Grade 9, while the repeated measures of MW interacted significantly with the levels (low and high) of performance on the lower-level questions in Grade 5 only. No other interaction was detected. The findings of this study have shed light on the importance of taking into consideration students’ MW while they are taking tests, but further research is needed to explore potential methods to keep their attention focused on the test.


Similar content being viewed by others
References
Agnoli, S., Vanucci, M., Pelagatti, C., & Corazza, G. E. (2018). Exploring the link between mind wandering, mindfulness, and creativity: A multidimensional approach. Creativity Research Journal, 30(1), 41–53. https://doi.org/10.1080/10400419.2018.1411423
Al-Balushi, S. M., & Al-Harthy, I. S. (2015). Students’ mind wandering in macroscopic and submicroscopic textual narrations and its relationship with their reading comprehension. Chemistry Education Research and Practice, 16(3), 680–688. https://doi.org/10.1039/C5RP00052A
Al-Balushi, S. M., Ambusaidi, A., Al-Harthy, I. S., Al-Mherzi, R., Al-Saadi, K., Al-Balushi, M. & Al-Balushi, K. (2020). Students’ performance in TIMSS test in Oman: Effect of cognitive and metacognitive variables and effectiveness of an inquiry-based mobile e-formative assessment package. Retrieved 6 Feb, 2022 from ResearchGate https://www.researchgate.net/project/Students-Performance-in-TIMSS-Test-in-Oman-Effect-of-Cognitive-and-Metacognitive-Variables-and-Effectiveness-of-an-Inquiry-Based-Mobile-E-Formative-Assessment-Package
Anderson, O. R., Love, B. C., & Tsai, M.-J. (2014). Neuroscience perspectives for science and mathematics learning in technology-enhanced learning environments. International Journal of Science and Mathematics Education, 12(3), 467–474. https://doi.org/10.1007/s10763-014-9540-2
Baird, B., Smallwood, J., Mrazek, M. D., Kam, J., Franklin, M. S., & Schooler, J. W. (2012). Inspired by distraction: Mind wandering facilitates creative incubation. Psychological Science, 23(10), 1117–1122. https://doi.org/10.1177/0956797612446024
Chiu, M.-S. (2012). Differential psychological processes underlying the skill-development model and self-enhancement model across mathematics and science in 28 countries. International Journal of Science and Mathematics Education, 10(3), 611–642. https://doi.org/10.1007/s10763-011-9309-9
Dempster, E. R., & Reddy, V. (2007). Item readability and science achievement in TIMSS 2003 in South Africa. Science Education, 91(6), 906–925. https://doi.org/10.1002/sce.20225
Dixon, P., & Bortolussi, M. (2013). Construction, integration, and mind wandering in reading. Canadian Journal of Experimental Psychology, 67(1), 1–10. https://doi.org/10.1037/a0031234
Feng, S., D’Mello, S. K., & Graesser, A. C. (2013). Mind wandering while reading easy and difficult texts. Psychonomic Bulletin & Review, 20(3), 586–592. https://doi.org/10.3758/s13423-012-0367-y
Field, A. (2018). Discovering statistics using IBM SPSS statistics. SAGE.
Glynn, S. M. (2012). International assessment: A Rasch model and teachers’ evaluation of TIMSS science achievement items. Journal of Research in Science Teaching, 49(10), 1321–1344. https://doi.org/10.1002/tea.21059
Hutt, S., Krasich, K., Mills, C., Bosch, N., White, S., Brockmole, J. R., & D’Mello, S. K. (2019). Automated gaze-based mind wandering detection during computerized learning in classrooms. User Modeling & User-Adapted Interaction, 29(4), 821–867. https://doi.org/10.1007/s11257-019-09228-5
Huynh, H., & Feldt, L. S. (1976). Estimation of the Box correction for degrees of freedom from sample data in randomized block and split-plot designs. Journal of Educational Statistics, 1(1), 69–82. https://doi.org/10.2307/1164736
Jazaieri, H., Lee, I. A., McGonigal, K., Jinpa, T., Doty, J. R., Gross, J. J., & Goldin, P. R. (2016). A wandering mind is a less caring mind: Daily experience sampling during compassion meditation training. Journal of Positive Psychology, 11(1), 37–50. https://doi.org/10.1080/17439760.2015.1025418
Kane, M. J., Smeekens, B. A., von Bastian, C. C., Lurquin, J. H., Carruth, N. P., & Miyake, A. (2017). A combined experimental and individual-differences investigation into mind wandering during a video lecture. Journal of Experimental Psychology: General, 146(11), 1649–1674. https://doi.org/10.1037/xge0000362
Kang, H., & Cogan, L. (2022). The differential role of socioeconomic status in the relationship between curriculum-based mathematics and mathematics literacy: The link between TIMSS and PISA. International Journal of Science and Mathematics Education, 20(1), 133–148. https://doi.org/10.1007/s10763-020-10133-2
Liou, P.-Y. (2014). Examining the big-fish-little-pond effect on students’ self-concept of learning science in Taiwan based on the TIMSS databases. International Journal of Science Education, 36(12), 2009–2028. https://doi.org/10.1080/09500693.2014.889331
Liou, P.-Y., & Bulut, O. (2020). The effects of item format and cognitive domain on students’ science performance in TIMSS 2011. Research in Science Education, 50(1), 99–121. https://doi.org/10.1007/s11165-017-9682-7
Luo, Y., & Zhang, J. (2020). The effect of tactile training on sustained attention in young adults. Brain Sciences, 10(10), 695. https://doi.org/10.3390/brainsci10100695
Martin, M. O., Mullis, I. V. S., & Hooper, M. (Eds.). (2016). Methods and procedures in TIMSS 2015. Retrieved 25 Nov, 2021 from TIMSS & PIRLS International Study Center http://timssandpirls.bc.edu/publications/timss/2015-methods.html
Mills, C., D’Mello, S. K., Bosch, N., & Olney, A. M. (2015). Mind wandering during learning with an intelligent tutoring system. In C. Conati, N. Heffernan, A. Mitrovic, & M. F. Verdejo (Eds.), Lecture Notes in Computer Science: Vol. 9112. AIED 2015: Artificial intelligence in education. (pp. 267–276). Springer. https://doi.org/10.1007/978-3-319-19773-9_27
Mrazek, M. D., Franklin, M. S., Phillips, D. T., Baird, B., & Schooler, J. W. (2013). Mindfulness training improves working memory capacity and GRE performance while reducing mind wandering. Psychological Science, 24(5), 776–781. https://doi.org/10.1177/0956797612459659
Mrazek, M. D., Zedelius, C. M., Gross, M. E., Mrazek, A. I., Phillips, D. T., & Schooler, J. W. (2017). Mindfulness in education: Enhancing academic achievement and student well-being by reducing mind-wandering. In J. C. Karremans & E. K. Papies (Eds.), Mindfulness in social psychology (pp. 139–152). Routledge. https://doi.org/10.4324/9781315627700
Mullis, I. V. S., & Martin, M. O. (Eds.). (2017). TIMSS 2019 assessment framework. Retrieved November 25, 2021 from International Association for the Evaluation of Educational Achievement https://timss2019.org/wp-content/uploads/frameworks/T19-Assessment-Frameworks.pdf
Mullis, I. V. S., Martin, M. O., Foy, D., Kelly, D. L., & Fishbein, B. (2020). TIMSS 2019 international results in mathematics and science. Retrieved 20 Aug, 2021 from International Association for the Evaluation of Educational Achievement https://timssandpirls.bc.edu/timss2019/international-results/
Pachai, A. A., Acai, A., LoGiudice, A. B., & Kim, J. A. (2016). The mind that wanders: Challenges and potential benefits of mind wandering in education. Scholarship of Teaching and Learning in Psychology, 2(2), 134–146. https://doi.org/10.1037/stl0000060
Peterson, D. J., & Wissman, K. (2020). Using tests to reduce mind-wandering during learning review. Memory, 28(4), 582–587. https://doi.org/10.1080/09658211.2020.1748657
Risko, E. F., Anderson, N., Sarwal, A., Engelhardt, M., & Kingstone, A. (2012). Everyday attention: Variation in mind wandering and memory in a lecture. Applied Cognitive Psychology, 26(2), 234–242. https://doi.org/10.1002/acp.1814
Risko, E. F., Buchanan, D., Medimorec, S., & Kingstone, A. (2013). Everyday attention: Mind wandering and computer use during lectures. Computers & Education, 68, 275–283. https://doi.org/10.1016/j.compedu.2013.05.001
Ruthven, K. (2011). Using international study series and meta-analytic research syntheses to scope pedagogical development aimed at improving student attitude and achievement in school mathematics and science. International Journal of Science and Mathematics Education, 9(2), 419–458. https://doi.org/10.1007/s10763-010-9243-2
Sanchez, C. A., & Naylor, S. N. (2018). Mindwandering while reading not only reduces science learning but also increases content misunderstandings. Journal of Applied Research in Memory and Cognition, 7(3), 332–341. https://doi.org/10.1016/j.jarmac.2018.05.001
Smallwood, J. (2013). Distinguishing how from why the mind wanders: A process-occurrence framework for self-generated mental activity. Psychological Bulletin, 139(3), 519–535. https://doi.org/10.1037/a0030010
Smallwood, J., McSpadden, M., & Schooler, J. W. (2008). When attention matters: The curious incident of the wandering mind. Memory & Cognition, 36(6), 1144–1150. https://doi.org/10.3758/MC.36.6.1144
Smallwood, J., Obonsawin, M., & Reid, H. (2003). The effects of block duration and task demands on the experience of task unrelated thought. Imagination, Cognition and Personality, 22(1), 13–31. https://doi.org/10.2190/TBML-N8JN-W5YB-4L9R
Smallwood, J., & Schooler, J. W. (2006). The restless mind. Psychological Bulletin, 132(6), 946–958. https://doi.org/10.1037/0033-2909.132.6.946
Smallwood, J., & Schooler, J. W. (2015). The science of mind wandering: Empirically navigating the stream of consciousness. Annual Review of Psychology, 66(1), 487–518. https://doi.org/10.1146/annurev-psych-010814-015331
Tang, Y.-Y., & Posner, M. I. (2009). Attention training and attention state training. Trends in Cognitive Sciences, 13(5), 222–227. https://doi.org/10.1016/j.tics.2009.01.009
Tighezza, M. H. (2014). Modeling relationships among learning, attitude, self-perception, and science achievement for grade 8 Saudi students. International Journal of Science and Mathematics Education, 12(4), 721–740. https://doi.org/10.1007/s10763-013-9426-8
Unsworth, N., & McMillan, B. D. (2013). Mind wandering and reading comprehension: Examining the roles of working memory capacity, interest, motivation, and topic experience. Journal of Experimental Psychology: Learning, Memory, and Cognition, 39(3), 832–842. https://doi.org/10.1037/a0029669
Unsworth, N., McMillan, B. D., Brewer, G. A., & Spillers, G. J. (2012). Everyday attention failures: An individual differences investigation. Journal of Experimental Psychology: Learning, Memory, and Cognition, 38(6), 1765–1772. https://doi.org/10.1037/a0028075
Wammes, J. D., Boucher, P. O., Seli, P., Cheyne, J. A., & Smilek, D. (2016). Mind wandering during lectures I: Changes in rates across an entire semester. Scholarship of Teaching and Learning in Psychology, 2(1), 13–32. https://doi.org/10.1037/stl0000053
Wammes, J. D., Seli, P., Cheyne, J. A., Boucher, P. O., & Smilek, D. (2016). Mind wandering during lectures II: Relation to academic performance. Scholarship of Teaching and Learning in Psychology, 2(1), 33–48. https://doi.org/10.1037/stl0000055
Wang, C.-L., & Liou, P.-Y. (2018). Patterns of motivational beliefs in the science learning of total, high-, and low-achieving students: Evidence of Taiwanese TIMSS 2011 data. International Journal of Science and Mathematics Education, 16(4), 603–618. https://doi.org/10.1007/s10763-017-9797-3
Wang, Z., Osterlind, S. J., & Bergin, D. A. (2012). Building mathematics achievement models in four countries using TIMSS 2003. International Journal of Science and Mathematics Education, 10(5), 1215–1242. https://doi.org/10.1007/s10763-011-9328-6
Zavagnin, M., Borella, E., & De Beni, R. (2014). When the mind wanders: Age-related differences between young and older adults. Acta Psychologica, 145, 54–64. https://doi.org/10.1016/j.actpsy.2013.10.016
Funding
This study is part of a research project (RC/EDU/CUTM/15/01) funded by the Research Council of the Ministry of Higher Education, Research and Innovation, Oman. The authors also gratefully acknowledge the financial and technical support of the SAS for Entrepreneurship Center (under the Ministry of Technology and Telecommunications) in designing the TOSS application.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Al-Balushi, S.M., Al-Harthy, I.S. & Almehrizi, R.S. Attention Drifting Away While Test-Taking: Mind-Wandering in Students with Low- and High-Performance Levels in TIMSS-Like Science Tests. Int J of Sci and Math Educ 21, 395–416 (2023). https://doi.org/10.1007/s10763-022-10258-6
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10763-022-10258-6
