MENTOR: A Physiologically Controlled Tutoring System

Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9146)


In this paper we present a tutoring system that automatically sequences the learning content according to the learners’ mental states. The system draws on techniques from Brain Computer Interface and educational psychology to automatically adapt to changes in the learners’ mental states such as attention and workload using electroencephalogram (EEG) signals. The objective of this system is to maintain the learner in a positive mental state throughout the tutoring session by selecting the next pedagogical activity that fits the best to his current state. An experimental evaluation of our approach involving two groups of learners showed that the group who interacted with the mental state-based adaptive version of the system obtained higher learning outcomes and had a better learning experience than the group who interacted with a non-adaptive version.


Intelligent tutoring system Engagement Workload Real-time adaptive system EEG Machine learning Experience and affect 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Pour, P.A., Hussain, M., AlZoubi, O., D’Mello, S., Calvo, R.A.: The impact of system feedback on learners’ affective and physiological states. In: Aleven, V., Kay, J., Mostow, J. (eds.) ITS 2010, Part I. LNCS, vol. 6094, pp. 264–273. Springer, Heidelberg (2010)CrossRefGoogle Scholar
  2. 2.
    Banda, N., Robinson, P.: Multimodal affect recognition in intelligent tutoring systems. In: D’Mello, S., Graesser, A., Schuller, B., Martin, J.-C. (eds.) ACII 2011, Part II. LNCS, vol. 6975, pp. 200–207. Springer, Heidelberg (2011)CrossRefGoogle Scholar
  3. 3.
    Jraidi, I., Chaouachi, M., Frasson, C.: A hierarchical probabilistic framework for recognizing learners’ interaction experience trends and emotions. Advances in Human-Computer Interaction (2013)Google Scholar
  4. 4.
    D’Mello, S.K., Craig, S.D., Gholson, B., Franklin, S., Picard, R.W., Graesser, A.C.: Integrating affect sensors in an intelligent tutoring system. In: Proc of Affective Interactions: The Computer in the Affective Loop Workshop at International Conference on IUI, pp. 7-13 (2005)Google Scholar
  5. 5.
    Jraidi, I., Chaouachi, M., Frasson, C.: A dynamic multimodal approach for assessing learners’ interaction experience. In: Proc of ACM International Conference on Multimodal Interaction (2013)Google Scholar
  6. 6.
    Paas, F.G.: Training strategies for attaining transfer of problem-solving skill in statistics: A cognitive-load approach. Journal of educational psychology 84(4), 429 (1992)CrossRefGoogle Scholar
  7. 7.
    Kalyuga, S., Chandler, P., Tuovinen, J., Sweller, J.: When problem solving is superior to studying worked examples. Journal of educational psychology 93(3), 579 (2001)CrossRefGoogle Scholar
  8. 8.
    Berka, C., Levendowski, D.J., Ramsey, C.K., Davis, G., Lumicao, M.N., Stanney, K., Reeves, L., Regli, S.H., Tremoulet, P.D., Stibler, K.: Evaluation of an EEG workload model in an aegis simulation environment. In: Defense and Security Int. Soc. Optics and Photonics, pp.90-99 (2005)Google Scholar
  9. 9.
    Stevens, R., Galloway, T., Berka, C.: Integrating EEG models of cognitive load with machine learning models of scientific problem solving. In: Augmented Cognition: Past, Present and Future. Strategic Analysis, Inc., Arlington, pp. 55-65 (2006)Google Scholar
  10. 10.
    Sterman, M.B., Mann, C.A.: Concepts and applications of EEG analysis in aviation performance evaluation. Biological Psychology 40(1–2), 115–130 (1995)CrossRefGoogle Scholar
  11. 11.
    Stevens, R.H., Galloway, T., Berka, C.: EEG-related changes in cognitive workload, engagement and distraction as students acquire problem solving skills. In: Conati, C., McCoy, K., Paliouras, G. (eds.) UM 2007. LNCS (LNAI), vol. 4511, pp. 187–196. Springer, Heidelberg (2007)CrossRefGoogle Scholar
  12. 12.
    Berka, C., Levendowski, D.J., Cvetinovic, M.M., Petrovic, M.M., Davis, G., Lumicao, M.N., Zivkovic, V.T., Popovic, M.V., Olmstead, R.: Real-time analysis of EEG indexes of alertness, cognition, and memory acquired with a wireless EEG headset. International Journal of Human-Computer Interaction 17(2), 151–170 (2004)CrossRefGoogle Scholar
  13. 13.
    Van Orden, K.F., Limbert, W., Makeig, S., Jung, T.-P.: Eye activity correlates of workload during a visuospatial memory task. Human Factors: The Journal of the Human Factors and Ergonomics Society 43(1), 111–121 (2001)CrossRefGoogle Scholar
  14. 14.
    Wilson, G.F.: An analysis of mental workload in pilots during flight using multiple sychophysiological measures. Int. J. Aviat. Psychol. 12, 3–18 (2002)CrossRefGoogle Scholar
  15. 15.
    Gevins, A., Smith, M.E.: Neurophysiological measures of cognitive workload during human-computer interaction. Theoretical Issues in Ergonomics Science 4(1–2), 113–131 (2003)CrossRefGoogle Scholar
  16. 16.
  17. 17.
    Pope, A.T., Bogart, E.H., Bartolome, D.S.: Biocybernetic system evaluates indices of operator engagement in automated task. Biological psychology 40(1), 187–195 (1995)CrossRefGoogle Scholar
  18. 18.
    Lubar, J.F.: Discourse on the development of EEG diagnostics and biofeedback for attention-deficit/hyperactivity disorders. Biofeedback and Self-regulation 16(3), 201–225 (1991)CrossRefGoogle Scholar
  19. 19.
    Chaouachi, M., Jraidi, I., Frasson, C.: Modeling mental workload using EEG features for intelligent systems. In: Konstan, J.A., Conejo, R., Marzo, J.L., Oliver, N. (eds.) UMAP 2011. LNCS, vol. 6787, pp. 50–61. Springer, Heidelberg (2011)CrossRefGoogle Scholar
  20. 20.
    Hart, S.G., Staveland, L.E.: Development Of NASA-TLX (Task Load Index): Results of empirical and theoretical research. Human Mental Workload 1(3), 139–183 (1988)CrossRefGoogle Scholar
  21. 21.
    Rasmussen, C.E.: Gaussian processes for machine learning (2006)Google Scholar
  22. 22.
    Nguyen-Tuong, D., Peters, J.R., Seeger, M.: Local gaussian process regression for real time online model learning. In: Advances in Neural Information Processing Systems, pp.1193-1200 (2008)Google Scholar
  23. 23.
    Sweller, J.: Evolution of human cognitive architecture. Psychology of Learning and Motivation, 215-266 (2003)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2015

Authors and Affiliations

  1. 1.Department of Computer Science and OperationsUniversity of MontrealMontrealCanada

Personalised recommendations