Advertisement

Brain-Computer Interfaces for Educational Applications

  • Martin Spüler
  • Tanja Krumpe
  • Carina Walter
  • Christian Scharinger
  • Wolfgang Rosenstiel
  • Peter Gerjets
Chapter

Abstract

In this chapter, we present recent developments to utilize Brain-Computer Interface (BCI) technology in an educational context. As the current workload of a learner is a crucial factor for successful learning and should be held in an optimal range, we aimed at identifying the user’s workload by recording neural signals with electroencephalography (EEG). We describe initial studies that identified potential confounds when utilizing BCIs in such a scenario. Taking into account these results, we could show in a follow-up study that EEG could successfully be used to predict workload in students solving arithmetic exercises with increasing difficulty. Based on the obtained prediction model, we developed a digital learning environment that detects the user’s workload by EEG and automatically adapts the difficulty of the presented exercises to hold the learner’s workload level in an optimal range. Beside estimating workload based on EEG recordings, we also show that different executive functions can be detected and discriminated between based on their neural signatures. These findings could be used for a more specific adaptation of complex learning environments. Based on the existing literature and the results presented in this chapter, we discuss the methodological and theoretical prospects and pitfalls of this approach and outline further possible applications of BCI technology in an educational context.

Keywords

Electroencephalography (EEG) Passive brain-computer interface (BCI) Arithmetic learning Closed-loop adaptation Working memory load Executive functions 

Notes

Acknowledgements

This research was financed by the Leibniz ScienceCampus Tübingen “Informational Environments”. It was further supported by the Deutsche Forschungsgemeinschaft (DFG; grant SP-1533∖2-1) and the LEAD Graduate school at the Eberhard-Karls University Tübingen, which is funded by the Excellence Initiative of the German federal government.

References

  1. Askew, M. (2015). Numeracy for the 21st century: A commentary. ZDM: The International Journal on Mathematics Education, 47(4), 707–712.Google Scholar
  2. Berka, C., Levendowski, D. J., Lumicao, M. N., Yau, A., Davis, G., Zivkovic, V. T.,…, Craven, P. L. (2007). EEG correlates of task engagement and mental workload in vigilance, learning, and memory tasks. Aviation, Space and Environmental Medicine, 78(Supplement 1), B231–B244.Google Scholar
  3. Brouwer, A.-M., Hogervorst, M. A., Van Erp, J. B., Heffelaar, T., Zimmerman, P. H., & Oostenveld, R. (2012). Estimating workload using EEG spectral power and ERPs in the n-back task. Journal of Neural Engineering, 9(4), 045008.Google Scholar
  4. Burg, J. P. (1972). The relationship between maximum entropy spectra and maximum likelihood spectra. Geophysics, 37(2), 375–376.Google Scholar
  5. Calder, N. (2015). Student wonderings: Scaffolding student understanding within student-centred inquiry learning. ZDM: The International Journal on Mathematics Education, 47(7), 1121–1131.Google Scholar
  6. Causse, M., Fabre, E., Giraudet, L., Gonzalez, M., & Peysakhovich, V. (2015). EEG/ERP as a measure of mental workload in a simple piloting task. Procedia Manufacturing, 3, 5230–5236.Google Scholar
  7. Corbett, A. (2001). Cognitive computer tutors: Solving the two-sigma problem. In Proceedings of the 8th International Conference on User Modeling (pp. 137–147).Google Scholar
  8. Cover, T., & Thomas, J. (2006). Elements of information theory. Hoboken, NJ: Wiley-Interscience.Google Scholar
  9. Diamond, A. (2013). Executive functions. Annual Review of Psychology, 64, 135.Google Scholar
  10. Dowker, A. (2004). What works for children with mathematical difficulties? (Vol. 554). Nottingham: DfES Publications.Google Scholar
  11. Ecker, U. K., Lewandowsky, S., Oberauer, K., & Chee, A. E. (2010). The components of working memory updating: An experimental decomposition and individual differences. Journal of Experimental Psychology: Learning Memory and Cognition, 36(1), 170.Google Scholar
  12. Eriksen, C. W. (1995). The flankers task and response competition: A useful tool for investigating a variety of cognitive problems. Visual Cognition, 2(2–3), 101–118.Google Scholar
  13. Gerjets, P. H., & Hesse, F. W. (2004). When are powerful learning environments effective? the role of learner activities and of students conceptions of educational technology. International Journal of Educational Research, 41(6), 445–465.Google Scholar
  14. Gerjets, P., Scheiter, K., & Cierniak, G. (2009). The scientific value of cognitive load theory: A research agenda based on the structuralist view of theories. Educational Psychology Review, 21(1), 43–54.Google Scholar
  15. Gerjets, P., Walter, C., Rosenstiel, W., Bogdan, M., & Zander, T. O. (2014). Cognitive state monitoring and the design of adaptive instruction in digital environments: Lessons learned from cognitive workload assessment using a passive brain-computer interface approach. Frontiers in Neuroscience, 8, 385.Google Scholar
  16. Gevins, A., Smith, M., McEvoy, L., & Yu, D. (1997, Jun). High-resolution EEG mapping of cortical activation related to working memory: Effects of task difficulty type of processing, and practice. Cereb Cortex, 7(4), 374–385.Google Scholar
  17. Graesser, A., & McNamara, D. (2010). Self-regulated Learning in Learning Environments with Pedagogical Agents that Interact in Natural Language. Educational Psychologist, 45, 234–244.Google Scholar
  18. Harmony, T., Ferna’ndez, T., Silva, J., Bosch, J., Valde’s, P., Ferna’ndez-Bouzas, A.,…, Rodríguez, D. (1999). Do specific eeg frequencies indicate different processes during mental calculation? Neuroscience Letters, 266(1), 25–28.Google Scholar
  19. Haufe, S., Meinecke, F., Görgen, K., Dähne, S., Haynes, J.-D., Blankertz, B., Bießmann, F. (2014). On the interpretation of weight vectors of linear models in multivariate neuroimaging. Neuroimage, 87, 96–110.Google Scholar
  20. Jasper, H. (1958). The 10/20 international electrode system. EEG and Clinical Neurophysiology, 10, 371–375.Google Scholar
  21. Jonides, J., Schumacher, E. H., Smith, E. E., Lauber E. J., Awh, E., Minoshima, S., Koeppe, R.A. (1997). Verbal working memory load affects regional brain activation as measured by pet. Journal of Cognitive Neuroscience, 9(4), 462–475.Google Scholar
  22. Karagiannakis, G. N., & Cooreman, A. (2014). Focused MLD intervention based on the classification of MLD subtypes. In The Routledge International Handbook of Dyscalculia and Mathematical Learning Difficulties (p. 265).Google Scholar
  23. Käser, T., Baschera, G.-M., Busetto, A. G., Klingler, S., Solenthaler, B., Buhmann, J. M., Gross, M. (2013). Towards a framework for modelling engagement dynamics in multiple learning domains. International Journal of Artificial Intelligence in Education, 22(1–2), 59–83.Google Scholar
  24. Kirschner, P., & Gerjets, P. (2006). Instructional design for effective and enjoyable computer-supported learning. Computers in Human Behavior, 22(1), 1–8.Google Scholar
  25. Kohlmorgen, J., Dornhege, G., Braun, M., Blankertz, B., Müller K.-R., Curio, G.,…, Kincses, W. E. (2007). Improving human performance in a real operating environment through real-time mental workload detection. In Toward Brain-Computer Interfacing (pp. 409–422). Cambridge, MA: MIT Press.Google Scholar
  26. Kong, J., Wang, C., Kwong, K., Vangel, M., Chua, E., & Gollub, R. (2005). The neural substrate of arithmetic operations and procedure complexity. Cognitive Brain Research, 22(3), 397–405.CrossRefPubMedGoogle Scholar
  27. Miyake, A., Friedman, N. P., Emerson, M. J., Witzki, A. H., Howerter A., & Wager, T. D. (2000). The unity and diversity of executive functions and their contributions to complex frontal lobe tasks: A latent variable analysis. Cognitive Psychology, 41(1), 49–100.CrossRefPubMedGoogle Scholar
  28. Monsell, S. (2003). Task switching. Trends in Cognitive Sciences, 7(3), 134–140.CrossRefPubMedGoogle Scholar
  29. Murata, A. (2005). An attempt to evaluate mental workload using wavelet transform of EEG. Human Factors: The Journal of the Human Factors and Ergonomics Society, 47(3), 498–508.CrossRefGoogle Scholar
  30. Oken, B., Salinsky M., & Elsas, S. (2006). Vigilance, alertness, or sustained attention: Physiological basis and measurement. Clinical Neurophysiology, 117(9), 1885–1901.CrossRefPubMedPubMedCentralGoogle Scholar
  31. Richards, K. C., Enderlin, C. A., Beck, C., McSweeney J. C., Jones, T. C., & Rober son, P. K. (2007). Tailored biobehavioral interventions: A literature review and synthesis. Research and Theory for Nursing Practice, 21(4), 271–285.Google Scholar
  32. Samek, W., Meinecke, F. C., & Müller, K.-R. (2013). Transferring subspaces between subjects in brain-computer interfacing. IEEE Transactions on Biomedical Engineering, 60(8), 2289–2298.CrossRefPubMedGoogle Scholar
  33. Sanders, A., & Lamers, J. (2002). The Eriksen flanker effect revisited. Acta Psychologica, 109(1), 41–56.CrossRefPubMedGoogle Scholar
  34. Scharinger, C., Kammerer, Y., & Gerjets, P. (2015a). Pupil dilation and eeg alpha frequency band power reveal load on executive functions for link-selection processes during text reading. PloS One, 10(6), e0130608.CrossRefPubMedPubMedCentralGoogle Scholar
  35. Scharinger, C., Soutschek, A., Schubert, T., & Gerjets, P. (2015b). When flanker meets the n-back: What EEG and pupil dilation data reveal about the interplay between the two central-executive working memory functions inhibition and updating. Psychophysiology, 52(10), 1293–1304.CrossRefPubMedGoogle Scholar
  36. Scheiter, K., Fillisch, B., Krebs, M.-C., Leber, J., Ploetzner, R., Renkl, A., et al. (2017). How to design adaptive multimedia environments to support self-regulated learning. In Informational Environments: Effects of Use Effective Designs (Chap. 9).Google Scholar
  37. Schlögl, A., Keinrath, C., Zimmermann, D., Scherer R., Leeb, R., & Pfurtscheller, G. (2007). A fully automated correction method of EOG artifacts in EEG recordings. Clinical Neurophysiology, 118(1), 98–104.CrossRefPubMedGoogle Scholar
  38. Soltanlou, M., Jung, S., Roesch, S., Ninaus, M., Brandelik, K., Heller, J., et al. (2017). Behavioral and neurocognitive evaluation of a web-based learning platform for orthography and arithmetic. In Informational Environments: Effects of Use Effective Designs (Chap. 7).Google Scholar
  39. Spüler, M. (2015). A Brain-Computer Interface (BCI) system to use arbitrary Windows applications by directly controlling mouse and keyboard. In 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) (pp. 4087–1090).Google Scholar
  40. Spüler, M., Rosenstiel, W., & Bogdan, M. (2012a). Adaptive SVM-based classification increases performance of a MEG-based Brain-Computer Interface (BCI). In International Conference on Artificial Neural Networks (pp. 669–676).Google Scholar
  41. Spüler, M., Rosenstiel, W., & Bogdan, M. (2012b). Principal component based covariate shift adaption to reduce non-stationarity in a MEG-based brain- computer interface. EURASIP Journal on Advances in Signal Processing, 2012(1), 1–7.CrossRefGoogle Scholar
  42. Spüler, M., Walter, A., Rosenstiel, W., & Bogdan, M. (2014). Spatial filtering based on canonical correlation analysis for classification of evoked or event- related potentials in EEG data. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 22(6), 1097–1103.CrossRefPubMedGoogle Scholar
  43. Spüler, M., Sarasola-Sanz, A., Birbaumer, N., Rosenstiel, W., & Ramos-Murguialday, A. (2015). Comparing metrics to evaluate performance of regression methods for decoding of neural signals. In 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) (pp. 1083–1086).Google Scholar
  44. Spüler, M., Walter, C., Rosenstiel, W., Gerjets, P., Moeller K., & Klein, E. (2016). EEG-based prediction of cognitive workload induced by arithmetic: A step towards online adaptation in numerical learning. ZDM: The International Journal on Mathematics Education ZDM, 48(3), 267–278.CrossRefGoogle Scholar
  45. Stanescu-Cosson, R., Pinel, P., van de Moortele, P.-F., Le Bihan, D., Cohen, L., & Dehaene, S. (2000). Understanding dissociations in dyscalculia. Brain, 123(11), 2240–2255.CrossRefPubMedGoogle Scholar
  46. Sweller, J., Van Merrinboer, J. J. G., & Paas, F. (1998). Cognitive architecture and instructional design. Educational Psychology Review, 10, 251–296.CrossRefGoogle Scholar
  47. Thomas, H. B. G. (1963). Communication theory and the constellation hypothesis of calculation. Quarterly Journal of Experimental Psychology, 15(3), 173–191.CrossRefGoogle Scholar
  48. Tu, W., & Sun, S. (2012). A subject transfer framework for eeg classification. Neurocomputing, 82, 109–116.CrossRefGoogle Scholar
  49. Walter, C., Cierniak, G., Gerjets, P., Rosenstiel, W., & Bogdan, M. (2011). Classifying mental states with machine learning algorithms using alpha activity decline. In European Symposium on Artificial Neural Networks Google Scholar
  50. Walter, C., Schmidt, S., Rosenstiel, W., Gerjets, P., & Bogdan, M. (2013). Using cross-task classification for classifying workload levels in complex learning tasks. In Affective Computing and Intelligent Interaction (ACII), 2013 (pp. 876–881).Google Scholar
  51. Walter, C., Wolter, P., Rosenstiel, W., Bogdan, M., & Spüler, M. (2014, 09). Towards cross-subject workload prediction. In Proceedings of the 6th International Brain-Computer Interface Conference, Graz, Austria.Google Scholar
  52. Wang, Z., Hope, R. M., Wang, Z., Ji, Q., & Gray, W. D. (2012). Cross-subject workload classification with a hierarchical bayes model. NeuroImage, 59(1), 64–69.CrossRefPubMedGoogle Scholar
  53. Wolpaw, J. R., Birbaumer, N., McFarland, D. J., Pfurtscheller, G., & Vaughan, T. M. (2002). Brain–computer interfaces for communication and control. Clinical Neurophysiology, 113(6), 767–791.CrossRefPubMedGoogle Scholar

Copyright information

© Springer International Publishing AG 2017

Authors and Affiliations

  • Martin Spüler
    • 1
  • Tanja Krumpe
    • 1
  • Carina Walter
    • 1
  • Christian Scharinger
    • 2
  • Wolfgang Rosenstiel
    • 1
  • Peter Gerjets
    • 2
  1. 1.Department of Computer EngineeringEberhard-Karls University TübingenTübingenGermany
  2. 2.Knowledge Media Research CenterTübingenGermany

Personalised recommendations