Early Prediction of Student Frustration

  • Scott W. McQuiggan
  • Sunyoung Lee
  • James C. Lester
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4738)


Affective reasoning has been the subject of increasing attention in recent years. Because negative affective states such as frustration and anxiety can impede progress toward learning goals, intelligent tutoring systems should be able to detect when a student is anxious or frustrated. Being able to detect negative affective states early, i.e., before they lead students to abandon learning tasks, could permit intelligent tutoring systems sufficient time to adequately prepare for, plan, and enact affective tutorial support strategies. A first step toward this objective is to develop predictive models of student frustration. This paper describes an inductive approach to student frustration detection and reports on an experiment whose results suggest that frustration models can make predictions early and accurately.


Support Vector Machine Learning Environment Affective State Early Prediction Intelligent Tutoring System 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    André, E., Mueller, M.: Learning affective behavior. In: Proceedings of the 10th International Conference on Human-Computer Interaction, pp. 512–516. Lawrence Erlbaum, Mahwah, NJ (2003)Google Scholar
  2. 2.
    Bandura, A.: Self-efficacy: The exercise of control. Freeman, New York (1997)Google Scholar
  3. 3.
    Beal, C., Lee, H.: Creating a pedagogical model that uses student self reports of motivation and mood to adapt ITS instruction. In: Workshop on Motivation and Affect in Educational Software, in conjunction with the 12th International Conference on Artificial Intelligence in Education (2005)Google Scholar
  4. 4.
    Blaylock, N., Allen, J.: Corpus-based, statistical goal recognition. In: Proceedings of the Eighteenth International Joint Conference on Artificial Intelligence, Acapulco, Mexico, pp. 1303–1308 (2003)Google Scholar
  5. 5.
    Burleson, W., Picard, R.: Affective agents: Sustaining motivation to learn through failure and a state of stuck. In: Proceedings of the ITS Workshop of Social and Emotional Intelligence in Learning Environments, Maceio, Alagoas, Brazil (2004)Google Scholar
  6. 6.
    Conati, C., Mclaren, H.: Data-driven refinement of a probabilistic model of user affect. In: Tenth International Conference on User Modeling. New York, NY, pp. 40–49 (2005)Google Scholar
  7. 7.
    de Vicente, A., Pain, H.: Informing the detection of the students’ motivational state: an empirical study. In: Proceedings of the 6th International Conference on Intelligent Tutoring Systems, pp. 933–943. Springer, New York (2002)Google Scholar
  8. 8.
    Gale, A., Sampson, G.: Good-Turing frequency estimation without tears. Journal of Quantitative Linguistics 2(3), 217–237 (1995)CrossRefGoogle Scholar
  9. 9.
    Gratch, J., Marsella, S.: A domain-independent framework for modeling emotion. Journal of Cognitive Systems Research 5(4), 269–306 (2004)CrossRefGoogle Scholar
  10. 10.
    Johnson, L., Rizzo, P.: Politeness in tutoring dialogs: Run the factory, that’s what I’d do. In: 7th International Conference on Intelligent Tutoring Systems, Maceio, Brazil, pp. 67-76 (2004)Google Scholar
  11. 11.
    Lang, P.: The emotion probe: Studies of motivation and attention. American Psychologist 50(5), 285–372 (1995)CrossRefGoogle Scholar
  12. 12.
    Lazarus, R.: Emotion and Adaptation. Oxford University Press, New York (1991)Google Scholar
  13. 13.
    McQuiggan, S., Lester, J.: Learning empathy: A data-driven framework for modeling empathetic companion agents. In: Proceedings of the 5th International Conference on Autonomous Agents and Multiagent Systems, Hakodate, Japan, pp. 961–968 (2006)Google Scholar
  14. 14.
    McQuiggan, S., Lester, J.: Diagnosing self-efficacy in intelligent tutoring systems: An empirical study. In: Proceedings of the 8th International Conference on Intelligent Tutoring Systems, Jhongli, Taiwan, pp. 565–574 (2006)Google Scholar
  15. 15.
    Mitchell, T.: Machine Learning, McGraw-Hill, OH (1997)Google Scholar
  16. 16.
    Mott, B., Lee, S., Lester, J.: Probabilistic goal recognition in interactive narrative environments. In: Proceedings of the Twenty-first National Conference on Artificial Intelligence, Boston, MA, pp. 187–192 (2006)Google Scholar
  17. 17.
    Mott, B., Lester, J.: Narrative-centered tutorial planning for inquiry-based learning environments. In: Proceedings of the 8th International Conference on Intelligent Tutoring Systems, Jhongli, Taiwan, pp. 675–684 (2006)Google Scholar
  18. 18.
    Ormrod, J.: Educational Psychology: Developing Learners, 4th edn. Prentice Hall, Upper Saddle River, NJ (2002)Google Scholar
  19. 19.
    Paiva, A., Dias, J., Sobral, D., Aylett, R., Woods, S., Hall, L., Zoll, C.: Learning by feeling: evoking empathy with synthetic characters. Applied Artificial Intelligence 19, 235–266 (2005)CrossRefGoogle Scholar
  20. 20.
    Picard, R.: Affective Computing. MIT Press, Cambridge, MA (1997)Google Scholar
  21. 21.
    Porayska-Pomsta, K., Pain, H.: Providing cognitive and affective scaffolding through teaching strategies: applying linguistic politeness to the educational context. In: Seventh International Conference on Intelligent Tutoring Systems, Maceio, Alagoas, Brazil, pp. 77–86 (2004)Google Scholar
  22. 22.
    Prendinger, H., Ishizuka, M.: The empathic companion: a character-based interface that addresses users’ affective states. Applied Artificial Intelligence 19, 267–285 (2005)CrossRefGoogle Scholar
  23. 23.
    Seligman, M., Walker, E., Rosenhan, D.: Abnormal psychology, 4th edn. W.W. Norton & Company, Inc, New York (2001)Google Scholar
  24. 24.
    Smith, C., Lazarus, R.: Emotion and adaptation. In: Pervin (ed.) Handbook of Personality: theory & research, pp. 609–637. Guilford Press, NY (1990)Google Scholar
  25. 25.
    Witten, I., Frank, E.: Data Mining: Practical machine learning tools and techniques, 2nd edn. Morgan Kaufman, San Francisco, CA (2005)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2007

Authors and Affiliations

  • Scott W. McQuiggan
    • 1
  • Sunyoung Lee
    • 1
  • James C. Lester
    • 1
  1. 1.Department of Computer Science, North Carolina State University, Raleigh, NC 27695 

Personalised recommendations