Abstract
We have developed and evaluated an affect-sensitive version of AutoTutor, a dialogue based ITS that simulates human tutors. While the original AutoTutor is sensitive to learners’ cognitive states, the affect-sensitive tutor is responsive to their affective states as well. This affective tutor automatically detects learners’ boredom, confusion, and frustration by monitoring conversational cues, gross body language, and facial features. The sensed affective states guide the tutor’s responses in a manner that helps students regulate their negative emotions. The tutor also synthesizes affect via the verbal content of its responses and the facial expressions and speech of an embodied pedagogical agent. An experiment comparing the affect-sensitive and non-affective tutors indicated that the affective tutor improved learning for low-domain knowledge students, particularly at deeper levels of comprehension. We conclude by discussing the conditions upon which affect-sensitivity is effective, and the conditions when it is not.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Aleven, V., Koedinger, K.: An Effective Metacognitive Strategy: Learning by Doing and Explaining with a Computer-Based Cognitive Tutor. Cognitive Science 26(2), 147–179 (2002)
Anderson, J., Douglass, S., Qin, Y.: How Should a Theory of Learning and Cognition Inform Instruction? In: Healy, A. (ed.) Experimental cognitive psychology and it’s applications, pp. 47–58. American Psychological Association, Washington (2005)
Gertner, A., VanLehn, K.: Andes: A Coached Problem Solving Environment for Physics. In: Gauthier, G., VanLehn, K., Frasson, C. (eds.) ITS 2000. LNCS, vol. 1839, pp. 133–142. Springer, Heidelberg (2000)
Koedinger, K., Anderson, J., Hadley, W., Mark, M.: Intelligent Tutoring Goes to School in the Big City. International Journal of Artificial Intelligence in Education 8, 30–43 (1997)
Lesgold, A., Lajoie, S., Bunzo, M., Eggan, G.: SHERLOCK: A Coached Practice Environment for an Electronics Troubleshooting Job. In: Larkin, J.H., Chabay, R.W. (eds.) Computer-assisted instruction and intelligent tutoring systems, pp. 201–238. Erlbaum, Hillsdale (1992)
Sleeman, D., Brown, J. (eds.): Intelligent Tutoring Systems. Academic Press, New York (1982)
Woolf, B.: Building Intelligent Interactive Tutors. Morgan Kaufmann Publishers, Burlington (2009)
Issroff, K., del Soldato, T.: Incorporating Motivation into Computer-Supported Collaborative Learning. In: Proceedings of European Conference on Artificial Intelligence in Education, Ficha Tecnica, Lisbon (1996)
Picard, R.: Affective Computing. MIT Press, Cambridge (1997)
Lepper, M., Woolverton, M.: The wisdom of practice: Lessons Learned from the Study of Highly Effective Tutors. In: Aronson, J. (ed.) Improving academic achievement: Impact of psychological factors on education, pp. 135–158. Academic Press, Orlando (2002)
Goleman, D.: Emotional Intelligence. Bantam Books, New York (1995)
Arroyo, I., Woolf, B., Cooper, D., Burleson, W., Muldner, K., Christopherson, R.: Emotion Sensors Go To School. In: Dimitrova, V., Mizoguchi, R., Du Boulay, B., Graesser, A. (eds.) Proceedings of 14th International Conference on Artificial Intelligence in Education, pp. 17–24. IOS Press, Amsterdam (2009)
Burleson, W., Picard, R.: Evidence for Gender Specific Approaches to the Development of Emotionally Intelligent Learning Companions. IEEE Intelligent Systems 22(4), 62–69 (2007)
Conati, C., Maclaren, H.: Empirically Building and Evaluating a Probabilistic Model of User Affect. User Modeling and User-Adapted Interaction 19(3), 267–303 (2009)
Forbes-Riley, K., Litman, D.: Adapting to Student Uncertainty Improves Tutoring Dialogues. In: Dimitrova, V., Mizoguchi, R., Du Boulay, B. (eds.) Proceedings of the 14th International Conference on Artificial Intelligence in Education, pp. 33–40. IOS Press, Amsterdam (2009)
Chaffar, S., Derbali, L., Frasson, C.: Inducing Positive Emotional State in Intelligent Tutoring Systems. In: Dimitrova, V., Mizoguchi, R., Du Boulay, B., Graesser, A. (eds.) Proceedings of 14th International Conference on Artificial Intelligence in Education, pp. 716–718. IOS Press, Amsterdam (2009)
Robison, J., McQuiggan, S., Lester, J.: Evaluating the Consequences of Affective Feedback in Intelligent Tutoring Systems. In: Proceedings of International Conference on Affective Computing & Intelligent Interaction, pp. 37–42 (2009)
D’Mello, S., Craig, S., Fike, K., Graesser, A.: Responding to Learners’ Cognitive-Affective States with Supportive and Shakeup Dialogues. In: Jacko, J. (ed.) Human-Computer Interaction. Ambient, Ubiquitous and Intelligent Interaction, pp. 595–604. Springer, Heidelberg (2009)
Graesser, A., Lu, S.L., Jackson, G., Mitchell, H., Ventura, M., Olney, A., Louwerse, M.: AutoTutor: A Tutor with Dialogue in Natural Language. Behavioral Research Methods, Instruments, and Computers 36, 180–193 (2004)
D’Mello, S., Graesser, A.: Automatic Detection of Learners’ Affect from Gross Body Language 23(2), 123–150 (2009)
D’Mello, S., Picard, R., Graesser, A.: Towards an Affect-Sensitive AutoTutor. IEEE Intelligent Systems 22(4), 53–61 (2007)
D’Mello, S., Craig, S., Witherspoon, A., McDaniel, B., Graesser, A.: Automatic Detection of Learner’s Affect from Conversational Cues. User Modeling and User-Adapted Interaction 18(1-2), 45–80 (2008)
Rus, V., Graesser, A.: Lexico-Syntactic Subsumption for Textual Entailment. In: Nicolov, N., Bontcheva, K., Angelova, G., Mitkov, R. (eds.) Recent Advances in Natural Language Processing IV: Selected Papers from RANLP 2005, pp. 187–196. John Benjamins Publishing Company, Amsterdam (2007)
Landauer, T., McNamara, D., Dennis, S., Kintsch, W. (eds.): Handbook of Latent Semantic Analysis. Erlbaum, Mahwah (2007)
Baker, R., D’Mello, S., Rodrigo, M., Graesser, A.: Better to be Frustrated than Bored: The Incidence and Persistence of Affect During Interactions with Three Different Computer-Based Learning Environments. International Journal of Human-Computer Studies 68(4), 223–241 (2010)
Batson, C., Turk, C., Shaw, L., Klein, T.: Information Function of Empathic Emotion - Learning That We Value the Others Welfare. Journal of Personality and Social Psychology 68(2), 300–313 (1995)
Heider, F.: The Psychology of Interpersonal Relations. John Wiley & Sons, New York (1958)
Weiner, B.: An Attributional Theory of Motivation and Emotion. Springer, New York (1986)
Piaget, J.: The Origins of Intelligence. International University Press, New York (1952)
Craig, S.D., Graesser, A.C., Sullins, J., Gholson, J.: Affect and Learning: An Exploratory Look into the Role of Affect in Learning. Journal of Educational Media 29, 241–250 (2004)
Festinger, L.: A Theory of Cognitive Dissonance. Stanford University Press, Stanford (1957)
Graesser, A., Olde, B.: How Does One Know Whether a Person Understands a Device? The Quality of the Questions the Person Asks When the Device Breaks Down. Journal of Educational Psychology 95(3), 524–536 (2003)
Wang, N., Johnson, W.L., Mayer, R.E., Rizzo, P., Shaw, E., Collins, H.: The Politeness Effect: Pedagogical Agents and Learning Outcomes. International Journal of Human-Computer Studies 66(2), 98–112 (2008)
Brown, P., Levinson, S.: Politeness: Some Universals in Language Usage. Cambridge University Press, Cambridge (1987)
Lepper, M., Chabay, R.: Socializing the Intelligent Tutor: Bringing Empathy to Computer Tutors. In: Mandl, H., Lesgold, A. (eds.) Learning Issues for Intelligent Tutoring Systems, pp. 242–257. Erlbaum, Hillsdale (1988)
Dweck, C.: Messages that Motivate: How Praise Molds Students’ Beliefs, Motivation, and Performance (In Surprising Ways). In: Aronson, J. (ed.) Improving academic achievement: Impact of psychological factors on education, pp. 61–87. Academic Press, Orlando (2002)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
D’Mello, S. et al. (2010). A Time for Emoting: When Affect-Sensitivity Is and Isn’t Effective at Promoting Deep Learning. In: Aleven, V., Kay, J., Mostow, J. (eds) Intelligent Tutoring Systems. ITS 2010. Lecture Notes in Computer Science, vol 6094. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-13388-6_29
Download citation
DOI: https://doi.org/10.1007/978-3-642-13388-6_29
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-13387-9
Online ISBN: 978-3-642-13388-6
eBook Packages: Computer ScienceComputer Science (R0)