Skip to main content

Exploration of Affect Sensing from Speech and Metaphorical Text

  • Conference paper

Part of the Lecture Notes in Computer Science book series (LNISA,volume 5670)

Abstract

We report new developments on affect detection from textual metaphorical affective expression and affect sensing from speech. The textual affect detection component has been embedded in an intelligent conversational AI agent interacting with human users under loose scenarios. The detected affective states from text also play an important role in producing emotional animation for users’ avatars. Evaluation of the affect detection from speech and text is provided. Our work contributes to the conference themes on engagement and emotion, virtual AI agents, narrative storytelling in education and evaluation of affective social interaction.

Keywords

  • Affect sensing/detection
  • affective speech processing
  • metaphor

This is a preview of subscription content, access via your institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • DOI: 10.1007/978-3-642-03364-3_31
  • Chapter length: 12 pages
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
eBook
USD   109.00
Price excludes VAT (USA)
  • ISBN: 978-3-642-03364-3
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
Softcover Book
USD   139.00
Price excludes VAT (USA)

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Zhang, L., Barnden, J.A., Hendley, R.J., Lee, M.G., Wallington, A.M., Wen, Z.: Affect Detection and Metaphor in E-drama. Int. J. Continuing Engineering Education and Life-Long Learning 18(2), 234–252 (2008)

    CrossRef  Google Scholar 

  2. Liu, H., Singh, P.: ConceptNet: A practical commonsense reasoning toolkit. BT Technology Journal 22 (2004)

    Google Scholar 

  3. Shaikh, M.A.M., Prendinger, H., Mitsuru, I.: Assessing sentiment of text by semantic dependency and contextual valence analysis. In: Paiva, A.C.R., Prada, R., Picard, R.W. (eds.) ACII 2007. LNCS, vol. 4738, pp. 191–202. Springer, Heidelberg (2007)

    CrossRef  Google Scholar 

  4. Mateas, M.: Ph.D. Thesis. Interactive Drama, Art and Artificial Intelligence. School of Computer Science, Carnegie Mellon University (2002)

    Google Scholar 

  5. Zhe, X., Boucouvalas, A.C.: Text-to-Emotion Engine for Real Time Internet Communication. In: Proceedings of International Symposium on Communication Systems, Networks and DSPs, Staffordshire University, UK, pp. 164–168 (2002)

    Google Scholar 

  6. Boucouvalas, A.C.: Real Time Text-to-Emotion Engine for Expressive Internet Communications. In: Riva, G., Davide, F., IJsselsteijn, W. (eds.) Being There: Concepts, Effects and Measurement of User Presence in Synthetic Environments, pp. 305–318 (2002)

    Google Scholar 

  7. Craggs, R., Wood, M.: A Two Dimensional Annotation Scheme for Emotion in Dialogue. In: Proceedings of AAAI Spring Symposium: Exploring Attitude and Affect in Text (2004)

    Google Scholar 

  8. Egges, A., Kshirsagar, S., Magnenat-Thalmann, N.: A Model for Personality and Emotion Simulation. In: Proceedings of Knowledge-Based Intelligent Information & Engineering Systems (KES 2003). LNCS (LNAI), pp. 453–461. Springer, Heidelberg (2003)

    CrossRef  Google Scholar 

  9. Elliott, C., Rickel, J., Lester, J.: Integrating Affective Computing into Animated Tutoring Agents. In: Proceedings of IJCAI 1997 Workshop on Intelligent Interface Agents, pp. 113–121 (1997)

    Google Scholar 

  10. Aylett, R., Louchart, S., Dias, J., Paiva, A., Vala, M., Woods, S., Hall, L.E.: Unscripted Narrative for Affectively Driven Characters. IEEE Computer Graphics and Applications 26(3), 42–52 (2006)

    CrossRef  Google Scholar 

  11. Cavazza, M., Smith, C., Charlton, D., Zhang, L., Turunen, M., Hakulinen, J.: A ‘Companion’ ECA with Planning and Activity Modelling. In: Proceedings of the 7th International Conference on Autonomous Agents and Multi-Agent Systems, Portugal, pp. 1281–1284 (2008)

    Google Scholar 

  12. Murray, I.R., Arnott, J.L.: Implementation and testing of a system for producing emotion-by-rule in synthetic speech. Speech Communication (16), 369–390 (1995)

    Google Scholar 

  13. Nogueiras, A., Moreno, A., Bonafante, A., Maririo, J.: Speech Emotion Recognition Using Hidden Markov Models. In: Eurospeech 2001, pp. 2679–2682 (2001)

    Google Scholar 

  14. Grimm, M., Kroschel, K., Harris, H., Nass, C., Schuller, B., Rigoll, G., Moosmayr, T.: On the Necessity and Feasibility of Detecting a Driver’s Emotional State While Driving. In: Paiva, A.C.R., Prada, R., Picard, R.W. (eds.) ACII 2007. LNCS, vol. 4738, pp. 126–138. Springer, Heidelberg (2007)

    CrossRef  Google Scholar 

  15. Amir, N., Cohen, R.: Characterizing Emotion in the Soundtrack of an Animated Film: Credible or Incredible? In: Paiva, A.C.R., Prada, R., Picard, R.W. (eds.) ACII 2007. LNCS, vol. 4738, pp. 148–158. Springer, Heidelberg (2007)

    CrossRef  Google Scholar 

  16. Cichosz, J., Slot, K.: Emotion recognition in speech signal using emotion-extracting binary decision trees. In: Doctoral Consortium. ACII 2007, Lisbon. ACM, Springer (2007)

    Google Scholar 

  17. Oudeyer, P.Y.: The production and recognition of emotions in speech: features and algorithms. International Journal in Human-Computer Studies 59(1-2), 157–183 (2003); Special Issue on Affective Computing

    CrossRef  Google Scholar 

  18. ATT-Meta Project Databank: Examples of Usage of Metaphors of Mind (2008), http://www.cs.bham.ac.uk/~jab/ATT-Meta/Databank/

  19. Kövecses, Z.: Are There Any Emotion-Specific Metaphors? In: Athanasiadou, A., Tabakowska, E. (eds.) Speaking of Emotions: Conceptualization and Expression, pp. 127–151. Mouton de Gruyter, Berlin (1998)

    Google Scholar 

  20. Strapparava, C., Valitutti, A.: WordNet-Affect: An Affective Extension of WordNet. In: Proceedings of the 4th International Conference on Language Resources and Evaluation (LREC 2004), Lisbon, Portugal, pp. 1083–1086 (2004)

    Google Scholar 

  21. Praat, a speech processing tool (2008), http://www.personal.rdg.ac.uk/~llsroach/phon2/freespeech.htm

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and Permissions

Copyright information

© 2009 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Zhang, L. (2009). Exploration of Affect Sensing from Speech and Metaphorical Text. In: Chang, M., Kuo, R., Kinshuk, Chen, GD., Hirose, M. (eds) Learning by Playing. Game-based Education System Design and Development. Edutainment 2009. Lecture Notes in Computer Science, vol 5670. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-03364-3_31

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-03364-3_31

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-03363-6

  • Online ISBN: 978-3-642-03364-3

  • eBook Packages: Computer ScienceComputer Science (R0)