EEG-based prediction of cognitive workload induced by arithmetic: a step towards online adaptation in numerical learning
- 1.1k Downloads
- 10 Citations
Abstract
Numeracy is a key competency for living in our modern knowledge society. Therefore, it is essential to support numerical learning from basic to more advanced competency levels. From educational psychology it is known that learning is most effective when the respective content is neither too easy nor too demanding in relation to learners’ prerequisites. However, so far it is difficult to assess individual’s cognitive workload independently from performance to adapt learning environments accordingly. In the present study, we aim at identifying learners’ cognitive workload induced by addition tasks of varying difficulty using electroencephalography (EEG). To this end, a classifier using specific features in the EEG-signal is trained to differentiate between different levels of task difficulty significantly above chance level and with high consistency over all participants. Importantly, our model even allows for the prediction of cognitive demands induced by the addition tasks in a cross-participant approach. Closer inspection of the crucial EEG features indicates that oscillations in the theta and alpha band recorded from parietal electrodes are most reflective of current task difficulty. In summary, we are able to differentiate cognitive workload of participants independently from performance based on data of only a small number of electrodes. This suggests that a reduced EEG-setup combined with cross-participant classification may be a feasible approach to assess learners’ cognitive workload.
Keywords
Electroencephalography (EEG) Brain-computer interface Numerical cognition Arithmetic Cognitive workloadNotes
Acknowledgments
The authors would like to thank Philipp Wolter for programming the experimental setup and collecting the EEG data. The current research is supported by the Baden-Württemberg Stiftung (GRUENS), the German Research Foundation (DFG; SP 1533/2-1) and the Leibniz ScienceCampus Tübingen “Informational Environments.” Carina Walter is a doctoral student of the LEAD Graduate School [GSC1028], her work is funded by the Excellence Initiative of the German federal and state governments. Elise Klein is supported by the Leibniz-Competition Fund (SAW-2014-IWM-4) as well as by a Margarete-von-Wrangell Fellowship (European Social Fund and the Ministry of Science, Research and the Arts Baden-Württemberg). Korbinian Moeller, Wolfgang Rosenstiel and Peter Gerjets are principle investigators of the LEAD Graduate school at the Eberhard Karls University Tuebingen funded by the Excellence Initiative of the German federal government.
References
- Arsalidou, M., & Taylor, M. J. (2011). Is 2 + 2=4? Meta-analyses of brain areas needed for numbers and calculations. NeuroImage, 54, 2382–2393.CrossRefGoogle Scholar
- Askew, M. (2015). Numeracy for the 21st century: a commentary. ZDM Mathematics Education, 47, 707–712.CrossRefGoogle Scholar
- Butterworth, B., Varma, S., & Laurillard, D. (2011). Dyscalculia: from brain to education. Science, 332, 1049–1053.CrossRefGoogle Scholar
- Calder, N. (2015). Student wonderings: scaffolding student understanding within student-centred inquiry learning. ZDM Mathematics Education. doi: 10.1007/s11858-015-0734-z.Google Scholar
- Cazden, C. B. (2001). Classroom discourse: the language of teaching and learning (2nd ed.). Portsmouth: Heinemann.Google Scholar
- Cover, T. M., & Thomas, J. A. (2006). Elements of information theory. Wiley.Google Scholar
- Dehaene, S. (1996). The organization of brain activations in number comparison: event-related potentials and the additive-factors method. Journal of Cognitive Neuroscience, 8, 47–68.CrossRefGoogle Scholar
- Dehaene, S., & Cohen, L. (1995). Towards an anatomical and functional model of number processing. Mathematical Cognition, 1, 83–120.Google Scholar
- Dehaene, S., Piazza, M., Pinel, P., & Cohen, L. (2003). Three parietal circuits for number processing. Cognitive Neuropsychology, 20, 487–506.CrossRefGoogle Scholar
- Dowker, A. D. (2009). What Works for Children with Mathematical Difficulties?. London: Department for Children, Schools, and Families.Google Scholar
- Galfano, G., Penolazzi, B., Vervaeck, I., Angrilli, A., & Umiltà, C. (2009). Event-related brain potentials uncover activation dynamics in the lexicon of multiplication facts. Cortex, 45, 1167–1177.CrossRefGoogle Scholar
- Geiger, V., Goos, M., & Forgasz, H. (2015). A rich interpretation of numeracy for the 21st century—a survey of the state of the field. ZDM Mathematics Education, 47(4), 531–548.CrossRefGoogle Scholar
- Gerjets, P., & Hesse, F. W. (2004). When are powerful learning environments effective? The role of learning activities and of students’ conceptions of educational technology. International Journal of Educational Research, 41, 445–465.CrossRefGoogle Scholar
- Gerjets, P., Scheiter, K., & Cierniak, G. (2009). The scientific value of cognitive load theory: a research agenda based on the structuralist view of theories. Educational Psychology Review, 21, 43–54.CrossRefGoogle Scholar
- Gerjets, P., Walter, C., Rosenstiel, W., Bogdan, M., & Zander, T. O. (2014). Cognitive state monitoring and the design of adaptive instruction in digital environments: lessons learned from cognitive workload assessment using a passive brain-computer interface approach. Frontiers in Neuroscience, 8, 385.CrossRefGoogle Scholar
- Gevins, A., Smith, M. E., McEvoy, C. L., & Yu, D. (1997). High-resolution EEG mapping of cortical activation related to working memory: effects of task difficulty, type of processing, and practice. Cerebral Cortex, 7, 374–385.CrossRefGoogle Scholar
- Grabner, R. H., & DeSmedt, B. (2011). Neurophysiological evidence for the validity of verbal strategy reports in mental arithmetic. Biological Psychology, 87, 128–136.CrossRefGoogle Scholar
- Grabner, R. H., & DeSmedt, B. (2012). Oscillatory EEG correlates of arithmetic strategies: a training study. Frontiers in Psychology, 3, 428.CrossRefGoogle Scholar
- Gross, J., Hudson, C., & Price, D. (2009). The long term costs of numeracy difficulties. London: Every Child a Chance Trust and KPMG.Google Scholar
- Harmony, T., Fernandez, T., Silva, J., Bosch, J., Valdes, P., Fernandez-Bouzas, A., et al. (1999). Do specific EEG frequencies indicate different processes during mental calculation? Neuroscience Letters, 266, 25–28.CrossRefGoogle Scholar
- Hoerl, A. E. (1962). Application of ridge analysis to regression problems. Chemical Engineering Progress, 1958, 54–59.Google Scholar
- Hsu, Y. F., & Szűcs, D. (2012). The time course of symbolic number adaptation: oscillatory EEG activity and event-related potential analysis. Neuroimage, 15, 3103–3109.CrossRefGoogle Scholar
- Jost, K., Hennighausen, E., & Rösler, F. (2004). Comparing arithmetic and semantic fact retrieval: effects of problem size and sentence constraint on event-related brain potentials. Psychophysiology, 41, 46–59.CrossRefGoogle Scholar
- Karagiannakis, G. N., & Cooreman, A. (2014). Focused MLD intervention based on the classification of MLD subtypes. In S. Chinn (Ed.), The Routledge international handbook of dyscalculia and mathematical learning difficulties (pp. 265–275). New York: Routledge.Google Scholar
- Käser, T., Baschera, G. M., Kohn, J., Kucian, K., Richtmann, V., Grond, U., et al. (2013a). Design and evaluation of the computer-based training program Calcularis for enhancing numerical cognition. Frontiers in Developmental Psychology, 4, 1–13.Google Scholar
- Käser, T., Busetto, A.G., Baschera, G.M., Kohn, J., Kucian, K., von Aster, M., Gross, M. (2012). Modelling and optimizing the process of learning mathematics. Intelligent Tutoring Systems, 7315, 389–398. Berlin/Heidelberg: Springer.Google Scholar
- Käser, T., Busetto, A. G., Solenthaler, B., Kohn, J., von Aster, M., & Gross, M. (2013b). Towards a framework for modelling engagement dynamics in multiple learning domains. International Journal of Artificial Intelligence in Education, 7926, 389–399.CrossRefGoogle Scholar
- Kirschner, P. A., & Gerjets, P. (2006). Instructional design for effective and enjoyable computer-supported learning. Computers in Human Behavior, 22, 1–8.CrossRefGoogle Scholar
- Klein, E., Moeller, K., Glauche, V., Weiller, C., & Willmes, K. (2013). Processing pathways in mental arithmetic—evidence from probabilistic fiber tracking. PLoS One, 8(1), e55455.CrossRefGoogle Scholar
- Klein, E., Suchan, J., Moeller, K., Karnath, H.-O., Knops, A., Wood, G., Nuerk, H.-C., & Willmes K. (2014). Considering structural connectivity in the triple code model of numerical cognition—differential connectivity for magnitude processing and arithmetic facts. Brain Structure & Function. doi: 10.1007/s00429-014-0951-1.Google Scholar
- Klimesch, W. (1999). EEG alpha and theta oscillations reflect cognitive and memory performance: a review and analysis. Brain Research Reviews, 29, 69–195.CrossRefGoogle Scholar
- Klimesch, W., Schack, B., & Sauseng, P. (2005). The functional significance of theta and upper alpha oscillations. Experimental Psycholology, 52, 99–108.CrossRefGoogle Scholar
- Kong, J., Wang, C., Kwong, K., Vangel, M., Chuac, E., & Gollub, R. (2005). The neural substrate of arithmetic operations and procedure complexity. Cognitive Brain Research, 22, 397–405.CrossRefGoogle Scholar
- Krause, C. M., Pesonen, M., & Haemaelaeinen, H. (2010). Brain oscillatory 4–30 Hz electroencephalogram responses in adolescents during a visual memory task. NeuroReport, 21, 767–771.CrossRefGoogle Scholar
- Kucian, K., & von Aster, M. (2015). Developmental dyscalculia. European Journal of Pediatrics, 174, 1–13.CrossRefGoogle Scholar
- Li, Q., & Ma, X. (2010). A meta-analysis of the effects of computer technology on school students’ mathematics learning. Educational Psychology Review, 22, 215–243.CrossRefGoogle Scholar
- Libertus, M. E., Woldorff, M. G., & Brannon, E. M. (2007). Electrophysiological evidence for notation independence in numerical processing. Behavioural and Brain Functions, 10, 31.Google Scholar
- Makar, K., Bakker, A., & Ben-Zvi, D. (2015). Scaffolding norms of argumentation-based inquiry in a primary mathematics classroom. ZDM Mathematics Education. doi: 10.1007/s11858-015-0732-1.Google Scholar
- McFarland, D. J., & Wolpaw, J. R. (2011). Brain-computer interfaces for communication and control. Communications of the ACM, 54, 60–66.CrossRefGoogle Scholar
- Micheloyannis, S., Sakkalis, V., Vourkas, M., Stam, C. J., & Simos, P. G. (2005). Neural networks involved in mathematical thinking: evidence from linear and non-linear analysis of electroencephalographic activity. Neuroscience Letters, 373, 212–217.CrossRefGoogle Scholar
- Moeller, K., Wood, G., Doppelmayr, M., & Nuerk, H.-C. (2010). Oscillatory EEG correlates of an implicit activation of multiplication facts in the number bisection task. Brain Research, 1320, 85–94.CrossRefGoogle Scholar
- Moschkovich, J. N. (2015). Scaffolding student participation in mathematical practices. ZDM Mathematics Education. doi: 10.1007/s11858-015-0730-3.Google Scholar
- Moyer, R. S., & Landauer, T. K. (1967). Time required for judgements of numerical inequality. Nature, 215, 1519–1520.CrossRefGoogle Scholar
- Neuper, C., & Pfurtscheller, G. (2001). Event-related dynamics of cortical rhythms: frequency-specific features and functional correlates. International Journal of Psychophysiology, 43, 41–58.CrossRefGoogle Scholar
- Niedermeyer, E. & da Silva F.L. (2004). Electroencephalography: basic principles, clinical applications, and related fields. Lippincot Williams & Wilkins.Google Scholar
- Okamoto, M., Dan, H., Sakamoto, K., Takeo, K., Shimizu, K., Kohno, S., et al. (2004). Three-dimensional probabilistic anatomical cranio-cerebral correlation via the international 10–20 system oriented for transcranial functional brain mapping. Neuroimage, 21, 99–111.CrossRefGoogle Scholar
- Pesonen, M., Hämäläinen, H., & Krause, C. M. (2007). Brain oscillatory 4–30 Hz responses during a visual n-back memory task with varying memory load. Brain Research, 1138, 171–177.CrossRefGoogle Scholar
- Richards, K. C., Enderlin, C. A., Beck, C., McSweeney, J. C., Jones, T. C., & Roberson, P. K. (2007). Tailored biobehavioral interventions: a literature review and synthesis. Research and theory for nursing practice, 21, 271–285.CrossRefGoogle Scholar
- Sauseng, P., Griesmayr, B., Freunberger, R., & Klimesch, W. (2010). Control mechanisms in working memory: a possible function of EEG theta oscillations. Neuroscience and Biobehavioral Reviews, 34, 1015–1022.CrossRefGoogle Scholar
- Scharinger, C., Kammerer, Y., & Gerjets, P. (2015a). Pupil dilation and EEG alpha frequency band power reveal load on executive functions for link-selection processes during text reading. PLoS One, 10(6), e0130608. doi: 10.1371/journal.pone.0130608.CrossRefGoogle Scholar
- Scharinger, C., Soutschek, A., Schubert, T., & Gerjets, P. (2015b). When flanker meets the n-back: what EEG and pupil dilation data reveal about the interplay between the two central-executive working memory functions inhibition and updating. Psychophysiology, 52, 1293–1304.CrossRefGoogle Scholar
- Schlögl, A., Keinrath, C., Zimmermann, D., Scherer, R., Leeb, R., & Pfurtscheller, G. (2007). A fully automated correction method of EOG artifacts in EEG recordings. Clinical Neurophysiology, 118, 98–104.CrossRefGoogle Scholar
- Smit, J., & Van Eerde, H. A. A. (2013). What counts as evidence for the long-term realisation of whole-class scaffolding? Learning, Culture and Social Interaction, 2, 22–31.CrossRefGoogle Scholar
- Smit, J., Van Eerde, H. A. A., & Bakker, A. (2013). A conceptualization of whole-class scaffolding. British Educational Research Journal., 39(5), 817–834.CrossRefGoogle Scholar
- Spüler, M., Sarasola-Sanz, A., Birbaumer, N., Rosenstiel, W., Ramos-Murguialday, A. (2015). Comparing metrics to evaluate performance of regression methods for decoding of neural signals. In Proceedings of 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC’15) (pp. 1083–1086).Google Scholar
- Stanescu-Cosson, R., Pinel, P., van de Moortele, P. F., Le Bihan, D., Cohen, L., & Dehaene, S. (2000). Understanding dissociations in dyscalculia: a brain imaging study of the impact of number size on the cerebral networks for exact and approximate calculation. Brain, 123, 2240–2255.CrossRefGoogle Scholar
- Sulzer, J., Haller, S., Scharnowski, F., Weiskopf, N., Birbaumer, N., Blefari, M. L., et al. (2013). Real-time fMRI neurofeedback: progress and challenges. Neuroimage, 76, 386–399.CrossRefGoogle Scholar
- Sweller, J., Van Merriënboer, J. J. G., & Paas, F. (1998). Cognitive architecture and instructional design. Educational Psychology Review, 10, 251–296.CrossRefGoogle Scholar
- Thevenot, C., Fanget, M., & Fayol, M. (2007). Retrieval or nonretrieval strategies in mental arithmetic? An operand recognition paradigm. Memory and Cognition, 35(6), 1344–1352.CrossRefGoogle Scholar
- Thomas, H. B. G. (1963). Communication theory and the constellation hypothesis of calculation. Quarterly Journal of Experimental Psychology, 15, 173–191.CrossRefGoogle Scholar
- Turconi, E., Jemel, B., Rossion, B., & Seron, X. (2004). Electrophysiological evidence for differential processing of numerical quantity and order in humans. Cognitive Brain Research, 21, 22–38.CrossRefGoogle Scholar
- Walter, C., Wolter, P., Rosenstiel, W., Bogdan, M., & Spüler, M. (2014). Towards cross-subject workload prediction. In Proceedings of the 6th International Brain-Computer Interface Conference 2014. doi: 10.3217/978-3-85125-378-8-30.
- Willmes, K. & Klein, E. (2014). Akalkulie [Acalculia]. In H.-O. Karnath, W. Ziegler, & G. Goldenberg (Eds.), Klinische Neuropsychologie—Kognitive Neurologie (pp. 133–146). Stuttgart: Thieme-Verlag.Google Scholar
- Wilson, A. J., Dehaene, S., Pinel, P., Revkin, S. K., Cohen, L., & Cohen, D. (2006). Principles underlying the design of “The Number Race”, an adaptive computer game for remediation of dyscalculia. Behavioural and Brain Functions, 30(2), 19.CrossRefGoogle Scholar
- Wischgoll, A., Pauli, C., & Reusser, K. (2015). Scaffolding—how can contingency lead to successful learning when dealing with errors? ZDM Mathematics Education. doi: 10.1007/s11858-015-0714-3.Google Scholar
- Zander, T., & Kothe, C. (2011). Towards passive brain–computer interfaces: applying brain–computer interface technology to human–machine systems in general. Journal of Neural Engeneering, 8, 025005. doi: 10.1088/1741-2560/8/2/025005.CrossRefGoogle Scholar