Skip to main content
SpringerLink
Log in

Detecting Mind Wandering Episodes in Virtual Realities Using Eye Tracking

  • Conference paper
  • First Online:
Information Systems and Neuroscience (NeuroIS 2020)

Part of the book series: Lecture Notes in Information Systems and Organisation ((LNISO,volume 43))

Included in the following conference series:

Abstract

Virtual Reality (VR) allows users to experience their environment differently and more immersively than traditional information systems (IS). Therefore, it is important to also study cognitive processes in VR settings. In this proposal, we focus on the concept of mind wandering, which is an emerging concept in IS research that can be studied using neurological measures such as eye tracking. Current literature suggests that mind wandering is a complex concept with different dimensions, namely deliberate and spontaneous mind wandering. While previous literature has provided initial evidence on the feasibility of eye tracking to approximate mind wandering, this study seeks to investigate how well eye tracking performs when it comes to a more nuanced perspective on mind wandering applied in an VR setting.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Agarwal, R., Karahanna, E.: Time flies when you’re having fun. Cognitive absorption and beliefs about information technology usage. MIS Q. 24, 665–694 (2000)

    Google Scholar 

  2. Thatcher, J.B., Wright, R.T., Sun, H., Zagenczyk, T.J., Klein, R.: Mindfulness in information technology use. Definitions, distinctions, and a new measure. MIS Q. 42, 831–847 (2018)

    Google Scholar 

  3. Fox, K.C.R., Christoff, K. (eds.): The Oxford Handbook of Spontaneous Thought. Mind-Wandering, Creativity, and Dreaming. Oxford University Press, New York (2018)

    Google Scholar 

  4. Smallwood, J., Schooler, J.W.: The restless mind. Psychol. Bull. 132, 946–958 (2006)

    Article  Google Scholar 

  5. Baird, B., Smallwood, J., Mrazek, M.D., Kam, J.W.Y., Franklin, M.S., Schooler, J.W.: Inspired by distraction. Mind wandering facilitates creative incubation. Psychol. Sci. 23, 1117–1122 (2012)

    Google Scholar 

  6. Agnoli, S., Vanucci, M., Pelagatti, C., Corazza, G.E.: Exploring the link between mind wandering, mindfulness, and creativity. A multidimensional approach. Creat. Res. J. 30, 41–53 (2018)

    Article  Google Scholar 

  7. Thornhill-Miller, B., Dupont, J.-M.: Virtual reality and the enhancement of creativity and innovation: under recognized potential among converging technologies? J. Cogn. Educ. Psychol. 15, 102–121 (2016)

    Article  Google Scholar 

  8. Addas, S., Pinsonneault, A.: E-mail interruptions and individual performance. Is there a silver lining? MIS Q. 42, 381–405 (2018)

    Google Scholar 

  9. Devaraj, S., Kohli, R.: Performance impacts of information technology. Is actual usage the missing link? Manag. Sci. 49, 273–289 (2003)

    Google Scholar 

  10. Christoff, K., Irving, Z.C., Fox, K.C.R., Spreng, R.N., Andrews-Hanna, J.R.: Mind-wandering as spontaneous thought. A dynamic framework. Nat. Rev. Neurosci. 17, 718–731 (2016)

    Article  Google Scholar 

  11. Killingsworth, M.A., Gilbert, D.T.: A wandering mind is an unhappy mind. Science 330, 932 (2010)

    Article  Google Scholar 

  12. Smallwood, J., Schooler, J.W.: The science of mind wandering. Empirically navigating the stream of consciousness. Annu. Rev. Psychol. 66, 487–518 (2015)

    Google Scholar 

  13. Golchert, J., Smallwood, J., Jefferies, E., Seli, P., Huntenburg, J.M., Liem, F., Lauckner, M.E., Oligschläger, S., Bernhardt, B.C., Villringer, A., et al.: Individual variation in intentionality in the mind-wandering state is reflected in the integration of the default-mode, fronto-parietal, and limbic networks. NeuroImage 146, 226–235 (2017)

    Article  Google Scholar 

  14. Andrews-Hanna, J.R., Irving, Z.C., Fox, K.C.R., Spreng, R.N., Christoff, K.: The neuroscience of spontaneous thought. An evolving, interdisciplinary field. In: Fox, K.C.R., Christoff, K. (eds.) The Oxford Handbook of Spontaneous Thought. Mind-Wandering, Creativity, and Dreaming, pp. 143–163. Oxford University Press, New York (2018)

    Google Scholar 

  15. Giambra, L.M.: Task-unrelated thought frequency as a function of age. A laboratory study. Psychol. Aging 4, 136–143 (1989)

    Article  Google Scholar 

  16. Drescher, L.H., van den Bussche, E., Desender, K.: Absence without leave or leave without absence. Examining the interrelations among mind wandering, metacognition and cognitive control. PLoS ONE 13, 1–18 (2018)

    Google Scholar 

  17. Baldwin, C.L., Roberts, D.M., Barragan, D., Lee, J.D., Lerner, N., Higgins, J.S.: Detecting and quantifying mind wandering during simulated driving. Front. Hum. Neurosci. 11, 1–15 (2017)

    Article  Google Scholar 

  18. Mooneyham, B.W., Schooler, J.W.: The costs and benefits of mind-wandering. A review. Can. J. Exp. Psychol. 67, 11–18 (2013)

    Google Scholar 

  19. Smallwood, J., Fishman, D.J., Schooler, J.W.: Counting the cost of an absent mind. Mind wandering as an underrecognized influence on educational performance. Psychon. Bull. Rev. 14, 230–236 (2007)

    Google Scholar 

  20. Zhang, Y., Kumada, T., Xu, J.: Relationship between workload and mind-wandering in simulated driving. PLoS ONE 12, 1–12 (2017)

    Google Scholar 

  21. Smeekens, B.A., Kane, M.J.: Working memory capacity, mind wandering, and creative cognition. An individual-differences investigation into the benefits of controlled versus spontaneous thought. Psychol. Aesthet. Creat. Arts 10, 389–415 (2016)

    Google Scholar 

  22. Fox, K.C.R., Beaty, R.E.: Mind-wandering as creative thinking. Neural, psychological, and theoretical considerations. Curr. Opin. Behav. Sci. 27, 123–130 (2019)

    Google Scholar 

  23. Buckner, R.L., Vincent, J.L.: Unrest at rest. Default activity and spontaneous network correlations. NeuroImage 37, 1091–1096 (2007)

    Google Scholar 

  24. Northoff, G.: How does the brain’s spontaneous activity generate our thoughts? In: Fox, K.C.R., Christoff, K. (eds.) The Oxford Handbook of Spontaneous Thought. Mind-Wandering, Creativity, and Dreaming, pp. 55–70. Oxford University Press, New York (2018)

    Google Scholar 

  25. Oschinsky, F.M., Klesel, M., Ressel, N., Niehaves, B.: Where are your thoughts? On the relationship between technology use and mind wandering. In: Proceedings of the 52nd Hawaii International Conference on System Sciences, Honolulu, Hi, USA, pp. 6709–6718 (2019)

    Google Scholar 

  26. Sullivan, Y., Davis, F., Koh, C.: Exploring mind wandering in a technological setting. In: Proceedings of the 36th International Conference on Information Systems, pp. 1–22. Fort Worth, United States of America (2015)

    Google Scholar 

  27. Wati, Y., Koh, C., Davis, F.: Can you increase your performance in a technology-driven society full of distractions? In: Proceedings of the 35th International Conference on Information Systems, Auckland, New Zealand, pp. 1–11 (2014)

    Google Scholar 

  28. Conrad, C., Newman, A.: Measuring the impact of mind wandering in real time using an auditory evoked potential. In: Davis, F.D., Riedl, R., Vom Brocke, J., Léger, P.-M., Randolph, A.B. (eds.) Information Systems and Neuroscience, pp. 37–45 (2019)

    Google Scholar 

  29. Sullivan, Y., Davis, F.: Self-regulation, mind wandering, and cognitive absorption during technology use. In: Proceedings of the 53rd Hawaii International Conference on System Sciences, Honolulu, Hi, USA, pp. 4483–4492 (2020)

    Google Scholar 

  30. Lin, C.-T., Chuang, C.-H., Kerick, S., Mullen, T., Jung, T.-P., Ko, L.-W., Chen, S.-A., King, J.-T., McDowell, K.: Mind-wandering tends to occur under low perceptual demands during driving. Sci. Rep. 6, 1–11

    Google Scholar 

  31. Bixler, R., D’Mello, S.: Toward fully automated person-independent detection of mind wandering. In: Hutchison, D., Kanade, T., Kittler, J., Houben, G.-J. (eds.) User Modeling, Adaptation, and Personalization. Proceedings of the 22nd International Conference, UMAP 2014, Aalborg, Denmark, 7–11 July 2014, pp. 37–48. Springer, Cham (2014)

    Google Scholar 

  32. Bixler, R., D’Mello, S.: Automatic gaze-based detection of mind wandering with metacognitive awareness. In: Ricci, F. (ed.) User Modeling, Adaptation, and Personalization. Proceedings of the 23th International Conference, UMAP 2015, Dublin, Ireland, 29 June–3 July 2015, pp. 31–43. Springer, Cham (2015)

    Google Scholar 

  33. Bixler, R., D’Mello, S.: Automatic gaze-based user-independent detection of mind wandering during computerized reading. User Model. User Adapt. Interact. 26(1), 33–68 (2015)

    Article  Google Scholar 

  34. Faber, M., Bixler, R., D’Mello, S.K.: An automated behavioral measure of mind wandering during computerized reading. Behav. Res. Methods 50(1), 134–150 (2017)

    Article  Google Scholar 

  35. Foulsham, T., Farley, J., Kingstone, A.: Mind wandering in sentence reading: decoupling the link between mind and eye. Can. J. Exp. Psychol. Revue canadienne de psychologie experimentale 67, 51–59 (2013)

    Google Scholar 

  36. Franklin, M.S., Broadway, J.M., Mrazek, M.D., Smallwood, J., Schooler, J.W.: Window to the wandering mind. Pupillometry of spontaneous thought while reading. Q. J. Exp. Psychol. 66, 2289–2294 (2013)

    Google Scholar 

  37. Gwizdka, J.: Exploring eye-tracking data for detection of mind-wandering on web tasks. In: Davis, F.D., Riedl, R., Vom Brocke, J., Léger, P.-M., Randolph, A.B. (eds.) Information Systems and Neuroscience, vol. 29, pp. 47–55. Springer, Cham (2019)

    Google Scholar 

  38. Hatfield, N., Yamani, Y., Palmer, D.B., Yahoodik, S., Vasquez, V., Horrey, W.J., Samuel, S.: Analysis of visual scanning patterns comparing drivers of simulated L2 and L0 systems. Transp. Res. Rec. 2673, 755–761 (2019)

    Article  Google Scholar 

  39. He, J., Becic, E., Lee, Y.-C., McCarley, J.S.: Mind wandering behind the wheel: performance and oculomotor correlates. Hum. Factors 53, 13–21 (2011)

    Article  Google Scholar 

  40. Huang, G., Liang, N., Wu, C., Pitts, B.J.: The impact of mind wandering on signal detection, semi-autonomous driving performance, and physiological responses. Proc. Hum. Factors Ergon. Soc. Annu. Meet. 63, 2051–2055 (2019)

    Article  Google Scholar 

  41. Hutt, S., Krasich, K., Mills, C., Bosch, N., White, S., Brockmole, J.R., D’Mello, S.K.: Automated gaze-based mind wandering detection during computerized learning in classrooms. User Model. User Adapt. Interact. 29(4), 821–867 (2019)

    Article  Google Scholar 

  42. Hutt, S., Mills, C., White, S., Donnelly, P.J., D’Mello, S.K.: The eyes have it: gaze-based detection of mind wandering during learning with an intelligent tutoring system. In: Proceedings of the 9th International Conference on Educational Data Mining (2016)

    Google Scholar 

  43. Reichle, E.D., Reineberg, A.E., Schooler, J.W.: Eye movements during mindless reading. Psychol. Sci. 21, 1300–1310 (2010)

    Article  Google Scholar 

  44. Robison, M.K., Gath, K.I., Unsworth, N.: The neurotic wandering mind: an individual differences investigation of neuroticism, mind-wandering, and executive control. Q. J. Exp. Psychol. 2006(70), 649–663 (2017)

    Article  Google Scholar 

  45. Smilek, D., Carriere, J.S.A., Cheyne, J.A.: Out of mind, out of sight: eye blinking as indicator and embodiment of mind wandering. Psychol. Sci. 21, 786–789 (2010)

    Article  Google Scholar 

  46. Steindorf, L., Rummel, J.: Do your eyes give you away? A validation study of eye-movement measures used as indicators for mindless reading. Behav. Res. Methods 52(1), 162–176 (2019)

    Article  Google Scholar 

  47. Unsworth, N., Robison, M.K.: Tracking arousal state and mind wandering with pupillometry. Cogn. Affect. Behav. Neurosci. 18(4), 638–664 (2018). https://doi.org/10.3758/s13415-018-0594-4

    Article  Google Scholar 

  48. Zhao, Y., Lofi, C., Hauff, C.: Scalable mind-wandering detection for MOOCs: a webcam-based approach. In: Data Driven Approaches in Digital Education, pp. 330–344. Springer, Cham (2017)

    Google Scholar 

  49. Wammes, J.D., Smilek, D.: Examining the influence of lecture format on degree of mind wandering. J. Appl. Res. Mem. Cogn. 6, 174–184 (2017)

    Article  Google Scholar 

  50. Carriere, J.S.A., Seli, P., Smilek, D.: Wandering in both mind and body. Individual differences in mind wandering and inattention predict fidgeting. Can. J. Exp. Psychol./Revue Canadienne De Psychologie Experimentale 67, 19–31 (2013)

    Google Scholar 

Download references

Acknowledgements

We would like to acknowledge that this research is part of the aSTAR research project, which is funded by the Federal Ministry of Education and Research of the Federal Republic of Germany (BMBF, promotional reference 02L18B010), the European Social Fund and the European Union.

Author information

Authors and Affiliations

  1. University of Siegen, Siegen, Germany

    Michael Klesel, Michael Schlechtinger, Frederike Marie Oschinsky & Bjoern Niehaves

  2. University of Twente, Enschede, The Netherlands

    Michael Klesel

  3. Dalhousie University, Halifax, Canada

    Colin Conrad

Authors
  1. Michael Klesel
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Michael Schlechtinger
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Frederike Marie Oschinsky
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Colin Conrad
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Bjoern Niehaves
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Michael Schlechtinger .

Editor information

Editors and Affiliations

  1. Information Systems and Quantitative Sciences (ISQS), Texas Tech University, Lubbock, TX, USA

    Fred D. Davis

  2. University of Applied Sciences Upper Austria, Steyr, Austria

    René Riedl

  3. Department of Information Systems, University of Liechtenstein, Vaduz, Liechtenstein

    Jan vom Brocke

  4. Department of Information Technology, HEC Montréal, Montreal, QC, Canada

    Pierre-Majorique Léger

  5. Department of Information Systems, Kennesaw State University, Kennesaw, GA, USA

    Adriane B. Randolph

  6. Department for Digital Business, University of Applied Sciences Upper Austria, Steyr, Austria

    Thomas Fischer

Rights and permissions

Reprints and permissions

Copyright information

© 2020 The Editor(s) (if applicable) and The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Klesel, M., Schlechtinger, M., Oschinsky, F.M., Conrad, C., Niehaves, B. (2020). Detecting Mind Wandering Episodes in Virtual Realities Using Eye Tracking. In: Davis, F.D., Riedl, R., vom Brocke, J., Léger, PM., Randolph, A.B., Fischer, T. (eds) Information Systems and Neuroscience. NeuroIS 2020. Lecture Notes in Information Systems and Organisation, vol 43. Springer, Cham. https://doi.org/10.1007/978-3-030-60073-0_18

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-60073-0_18

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-60072-3

  • Online ISBN: 978-3-030-60073-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation