Skip to main content
SpringerLink
Log in

Affect Listeners: Acquisition of Affective States by Means of Conversational Systems

  • Chapter
Development of Multimodal Interfaces: Active Listening and Synchrony

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 5967))

Abstract

We present the concept and motivations for the development of Affect Listeners, conversational systems aiming to detect and adapt to affective states of users, and meaningfully respond to users’ utterances both at the content- and affect-related level. In this paper, we describe the system architecture and the initial set of core components and mechanisms applied, and discuss the application and evaluation scenarios of Affect Listener systems.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Allwood, J.: The Structure of Dialog. In: The Structure of Multimodal Dialogue II, pp. 3–24. Benjamins, Amsterdam (1999)

    Google Scholar 

  2. Arafa, Y., et al.: Affective Interactions for Real-time Applications: the SAFIRA Project. KI 18(1), 30 (2004)

    Google Scholar 

  3. Bohus, D., Rudnicky, A.: RavenClaw: Dialog Management Using Hierarchical Task, Decomposition and an Expectation Agenda. In: Proc. of the Eurospech 2003, pp. 597–600 (2003)

    Google Scholar 

  4. Fellbaum, C.: WordNet: An Electronic Lexical Database. Bradford Books (1998)

    Google Scholar 

  5. Forsyth, E., Martell, C.: Lexical and Discourse Analysis of Online Chat Dialog. In: Proc. of the First IEEE Int. Conf. on Semantic Computing, pp. 19–26 (2007)

    Google Scholar 

  6. Gill, D., Christensen, A., Fincham, F.: Predicting marital satisfaction from behavior: Do all roads really lead to Rome? Personal Relationships 6, 369–387 (1999)

    Article  Google Scholar 

  7. Kappas, A., Pecchinenda, A.: Don’t wait for the monsters to get you: A video game task to manipulate appraisals in real time. Cognition and Emotion 13, 119–124 (1999)

    Article  Google Scholar 

  8. Li, X., Roth, D.: Learning Question Classifiers. In: Proc. of the 19th Int. Conf. on Computational Linguistics, pp. 556–562 (2002)

    Google Scholar 

  9. Liu, H., Lieberman, H., Selker, T.: A model of textual affect sensing using real-world knowledge. In: Proceedings Int. Conf. on Intelligent User Interfaces (2003)

    Google Scholar 

  10. Mairesse, F., Walker, M., Mehl, M., Moore, R.: Using linguistic cues for the automatic recognition of personality in conversation and text. Journal of Artificial Intelligence Research 30, 457–500 (2007)

    MATH  Google Scholar 

  11. Mann, W., Thompson, S.: Rhetorical structure theory: Rhetorical structure theory: Toward a functional theory of text organization. Text 8(3), 243–281 (1988)

    Google Scholar 

  12. McGlashan, S.: Towards multimodal dialogue management. In: Proceedings of Twente Workshop on Language Technology 11, The Netherlands (1996)

    Google Scholar 

  13. Mihalcea, R., Liu, H.: A corpus-based approach to finding happiness. In: The AAAI Spring Symposium on Computational Approaches to Weblogs (2006)

    Google Scholar 

  14. Neviarouskaya, A., Prendinger, I.M.: Textual Affect Sensing for Social and Expressive Online Communication. In: Paiva, A.C.R., Prada, R., Picard, R.W. (eds.) ACII 2007. LNCS, vol. 4738, pp. 218–229. Springer, Heidelberg (2007)

    Chapter  Google Scholar 

  15. Paiva, A., Prada, R., Picard, R.W.: Affective Computing and Intelligent Interaction. In: Paiva, A.C.R., Prada, R., Picard, R.W. (eds.) ACII 2007. LNCS, vol. 4738. Springer, Heidelberg (2007)

    Chapter  Google Scholar 

  16. Pelachaud, C., Poggi, I.: Towards believable interactive embodied agents. In: Fifth Int. Conf. on Autonomous Agents workshop on Multimodal Communication and Context in Embodied Agents (2001)

    Google Scholar 

  17. Pennebaker, J.W., Mehl, M.R., Niederhoffer, K.G.: Psychological aspects of natural language use: our words, our selves. Annual Review of Psychology 54, 547–577 (2003)

    Article  Google Scholar 

  18. Picard, R.: Affective Computing. MIT Press, Cambridge (1997)

    Book  Google Scholar 

  19. Prabowo, R., Thelwall, M.: Sentiment Analysis: A Combined Approach. Accepted for publication in Journal of Informetrics (2009)

    Google Scholar 

  20. Purandare, A., Litman, D.: Analyzing Dialog Coherence using Transition Patterns in Lexical and Semantic Features (2008)

    Google Scholar 

  21. Reeves, B., Nass, C.: The Media Equation. Cambridge University Press, Cambridge (1996)

    Google Scholar 

  22. Schank, R.C., Abelson, R.: Scripts, Plans, Goals and Understanding (1977)

    Google Scholar 

  23. Schröder, M., Cowie, R.: Developing a consistent view on emotion-oriented computing. In: Machine Learning for Multimodal Interaction, pp. 194–205 (2006)

    Google Scholar 

  24. Schröder, M., Cowie, R., Heylen, D., Pantic, M., Pelachaud, C., Schuller, B.: Towards responsive Sensitive Artificial Listeners. In: Fourth International Workshop on Human-Computer Conversation (2008)

    Google Scholar 

  25. Shaikh, M.A., Prendinger, H., Ishizuka, M.: Sentiment Assessment of Text by Analyzing Linguistic Features and Contextual Valence Assignment. Appl. Artificial Intelligence 22(6) (2008)

    Google Scholar 

  26. Skowron, M.: A Web Based Approach to Factoid and Commonsense Knowledge Retrieval, Doctoral Dissertation, Hokkaido University (2005)

    Google Scholar 

  27. Skowron, M., Araki, K.: Effectiveness of Combined Features for Machine Learning Based Question Classification. Special Issue on Question Answering and Text Summarization, Journal of Natural Language Processing 6, 63–83 (2005)

    Article  Google Scholar 

  28. Skowron, M., Irran, J., Krenn, B.: Computational Framework for and the Realization of Cognitive Agents Providing Intelligent Assistance Capabilities. In: The 6th Int. Cognitive Robotics Workshop (ECAI 2008), pp. 88–96 (2008)

    Google Scholar 

  29. Stephan, W.G., Stephan, C.W.: An integrated threat theory of prejudice. In: Oskamp, S. (ed.) Reducing prejudice and discrimination, pp. 225–246. Erlbaum, Hillsdale (2000)

    Google Scholar 

  30. Tatai, G., Laufer, L.: Extraction of Affective Components from Texts and Their Use in Natural Language Dialogue Systems. Acta Cybernetica 16, 625–642 (2004)

    Google Scholar 

  31. Thelwall, M., Buckley, K., Cai, D., Paltoglou, G.: CyberEmotions project: Internal Report, September 2009, University of Wolverhampton (2009)

    Google Scholar 

  32. Wallace, R.: Don’t Read Me - A.L.I.C.E. and AIML Documentation (2001), http://www.alicebot.com/dont.html

  33. Weischedel, R., Brunstein, A.B.: Pronoun Coreference and Entity Type Corpus, Linguistic Data Consortium, Philadelphia (2005)

    Google Scholar 

  34. Williams, J.D., Poupart, P., Young, S.: Partially Observable Markov Decision Processes with Continuous Observations for Dialogue Management. In: Proceedings of the 6th SigDial Workshop on Discourse and Dialogue (2005)

    Google Scholar 

  35. Valitutti, A., Strapparava, C., Stock, O.: Developing Affective Lexical Resources. Psychology Journal 2(1), 61–83 (2004)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Austrian Research Institute for Artificial Intelligence, Freyung 6, 1010, Vienna, Austria

    Marcin Skowron

Authors
  1. Marcin Skowron
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Second University of Naples, and IIASS, Via Pellegrino, 84019, Vietri sul Mare, SA, Italy

    Anna Esposito

  2. Centre for Language and Communication Studies, Trinity College, The University of Dublin, Dublin 2, Ireland

    Nick Campbell  & Carl Vogel  & 

  3. Department of Computing Science & Mathematics, University of Stirling, FK9 4LA, Stirling, Scotland, UK

    Amir Hussain

  4. Faculty of Electrical Engineering, Mathematics and Computer Science, University of Twente, P.O. Box 217, 7500 AE, Enschede, The Netherlands

    Anton Nijholt

Rights and permissions

Reprints and permissions

Copyright information

© 2010 Springer-Verlag Berlin Heidelberg

About this chapter

Cite this chapter

Skowron, M. (2010). Affect Listeners: Acquisition of Affective States by Means of Conversational Systems. In: Esposito, A., Campbell, N., Vogel, C., Hussain, A., Nijholt, A. (eds) Development of Multimodal Interfaces: Active Listening and Synchrony. Lecture Notes in Computer Science, vol 5967. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-12397-9_14

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-12397-9_14

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-12396-2

  • Online ISBN: 978-3-642-12397-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation