Abstract
This paper describes ongoing work towards building a multimodal computer system capable of sensing the affective state of a user. Two major problem areas exist in the affective communication research. Firstly, affective states are defined and described in an inconsistent way. Secondly, the type of training data commonly used gives an oversimplified picture of affective expression. Most studies ignore the dynamic, versatile and personalised nature of affective expression and the influence that social setting, context and culture have on its rules of display. We present a novel approach to affective sensing, using a generic model of affective communication and a set of ontologies to assist in the analysis of concepts and to enhance the recognition process. Whilst the scope of the ontology provides for a full range of multimodal sensing, this paper focuses on spoken language and facial expressions as examples.
Chapter PDF
Similar content being viewed by others
References
Picard, R.: Affective Computing. MIT Press, Cambridge (MA), USA (1997)
Scherer, K.: Vocal communication of emotion: A review of research paradigms. Speech Communication 40(1–2), 227–256 (2003)
Cowie, R., Douglas-Cowie, E., Cox, C.: Beyond emotion archetypes: Databases for emotion modelling using neural networks. Neural Networks 18(4), 371–388 (2005)
Stibbard, R.: Vocal expression of emotions in non-laboratory speech: An investigation of the Reading/Leeds Emotion in Speech Project annotation data. PhD thesis, University of Reading, United Kingdom (2001)
Devillers, L., Vidrascu, L., Lamel, L.: Challenges in real-life emotion annotation and machine learning based detection. Neural Networks 18(4), 407–422 (2005)
Liscombe, J., Riccardi, G., Hakkani-T”ur, D.: Using context to improve emotion detection in spoken dialog systems. In: Proceedings of the 9th European Conference on Speech Communication and Technology EUROSPEECH 2005. Lisbon, Portugal, vol. 1, pp. 1845–1848 (September 2005)
HUMAINE: http://emotion-research.net/ (Last accessed 26 October 2006)
Millar, J., Wagner, M., Goecke, R.: Aspects of Speaking-Face Data Corpus Design Methodology. In: Proceedings of the 8th International Conference on Spoken Language Processing ICSLP 2004, Jeju, Korea, vol. II, pp. 1157–1160 (October 2004)
Koike, K., Suzuki, H., Saito, H.: Prosodic Parameters in Emotional Speech. In: Proc. 5th International Conference on Spoken Language Processing ICSLP 1998, Sydney, Australia, ASSTA, vol. 2, pp. 679–682 (December 1998)
Shigeno, S.: Cultural similarities and differences in the recognition of audio-visual speech stimuli. In: Mannell, R., Robert-Ribes, J. (eds.): Proceedings of the International Conference on Spoken Language Processing ICSLP 1998, Sydney, Australia, ASSTA, vol. 1, pp. 281–284 (December 1998)
Schröder, M.: D6e: Report on representation languages (Last accessed 26 October 2006), http://emotionresearch.net/deliverables/D6efinal
Arnold, A.: Automatische Erkennung von Gesichtsausdrücken auf der Basis statistischer Methoden und neuronaler Netze. Masterthesis, University of Applied Sciences Mannheim, Germany (2006)
Cootes, T., Edwards, G., Taylor, C.: Active Appearance Models. In: Burkhardt, H., Neumann, B. (eds.) ECCV 1998. LNCS, vol. 1407, pp. 484–498. Springer, Heidelberg (1998)
Wallhoff, F.: Facial Expressions and Emotion Database. Technische Universität München (Last accessed 6 December 2006) http://www.mmk.ei.tum.de/waf/fgnet/feedtum.html
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
McIntyre, G., Göcke, R. (2007). Towards Affective Sensing. In: Jacko, J.A. (eds) Human-Computer Interaction. HCI Intelligent Multimodal Interaction Environments. HCI 2007. Lecture Notes in Computer Science, vol 4552. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-73110-8_44
Download citation
DOI: https://doi.org/10.1007/978-3-540-73110-8_44
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-73108-5
Online ISBN: 978-3-540-73110-8
eBook Packages: Computer ScienceComputer Science (R0)