Skip to main content

How to Evaluate Models of User Affect?

  • Conference paper
Affective Dialogue Systems (ADS 2004)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 3068))

Included in the following conference series:

Abstract

Modeling user affect is becoming increasingly important for intelligent interfaces and agents that aim to establish believable interactions with their users. However, evaluating the accuracy and effectiveness of affective user models is extremely challenging because of the many unknowns in affect comprehension. In this paper, we overview existing approaches related to the validation of affective user models, and we describe our own experience with an approach for direct model evaluation that we have used in a recent study.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Ball, G., Breese, J.: Modeling the emotional state of computer users. In: Workshop on ’Attitude, Personality and Emotions in User-Adapted Interaction, Proc. of UM 1999, Banff, Canada (1999)

    Google Scholar 

  2. Bosma, W., André, E.: Recognizing Emotions to Disambiguate Dialogue Acts. In: Proc. of IUI 2004, Madeira, Portugal (2004)

    Google Scholar 

  3. Conati, C.: Probabilistic Assessment of User’s Emotions in Educational Games. Journal of Applied Artificial Intelligence 16(7-8), 555–575 (2002)

    Article  Google Scholar 

  4. Conati, C., Chabbal, R., Maclaren, H.: A study on using biometric sensors for monitoring user emotions in educational games. In: Proc. of Workshop on Modeling User Affect and Actions: Why, When and How. Proc. of UM 2003, Pittsburgh, PA (2003)

    Google Scholar 

  5. Conati, C., Zhao, X.: Building and Evaluating an Intelligent Pedagogical Agent to Improve the Effectiveness of an Educational Game. In: Proc. of IUI 2004, Madeira, Portugal (2004)

    Google Scholar 

  6. Costa, P.T., McCrae, R.R.: Four ways five factors are basic. Personality and Individual Differences 1 13, 653–665 (1992)

    Article  Google Scholar 

  7. Gratch, J., Marsella, S.: Evaluating a General Model of Emotional Appraisal and Coping. In: Proc. of AAAI Spring Symposium 2004 “Architectures for Modeling Emotions” (2004)

    Google Scholar 

  8. Guinn, C., Hubal, R.: Extracting Emotional Information from the Text of Spoken Dialogue, In: (*) (2003)

    Google Scholar 

  9. Healy, J., Picard, R.: SmartCar: Detecting Driver Stress. In: 15th Int. Conf. on Pattern Recognition, Barcelona, Spain (2000)

    Google Scholar 

  10. Hudlicka, E., McNeese, M.: Assessment of User Affective and Belief States for Interface Adaptation: Application to an Air Force Pilot Task. User Modeling and User Adapted Interaction 12(1), 1–47 (2002)

    Article  MATH  Google Scholar 

  11. Mori, J., Prendinger, H., Mayer, S.: Dohi and Ishizuka, M., Using Biosignals to track the effects of a character-based interface. In: (*) (2003)

    Google Scholar 

  12. Nasoz. F., Lisetti, C., Alvarez, K., Finelstein, N., 2003 Emotion recognition from Physiological Signals for User Modeling of Affect. In: (*) (2003).

    Google Scholar 

  13. Ortony, A., Clore, G.L., Collins, A.: The cognitive structure of emotions. Cambridge University Press, Cambridge (1988)

    Google Scholar 

  14. Picard, R.W., Vyzas, E., Healey, J.: Toward Machine Emotional Intelligence: Analysis of Affective Physiological State. IEEE Transactions on Pattern Analysis and Machine Intelligence 23(10), 1175–1191 (2001)

    Article  Google Scholar 

  15. Zhou, X., Conati, C.: Inferring User Goals from Personality and Behavior in a Causal Model of User Affect. In: Proc. of IUI 2003, Miami, FL (2003)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2004 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Conati, C. (2004). How to Evaluate Models of User Affect?. In: André, E., Dybkjær, L., Minker, W., Heisterkamp, P. (eds) Affective Dialogue Systems. ADS 2004. Lecture Notes in Computer Science(), vol 3068. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-24842-2_30

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-24842-2_30

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-22143-2

  • Online ISBN: 978-3-540-24842-2

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics