Skip to main content

Affective Computing: An Introduction to the Detection, Measurement, and Current Applications

  • Chapter
  • First Online:
Advances in Artificial Intelligence-based Technologies

Part of the book series: Learning and Analytics in Intelligent Systems ((LAIS,volume 22))

Abstract

Affective computing aims to design and develop natural human-user interfaces that respond to the emotional needs of the user, bridging the gap between humans and technology. With the continuing technological advancements affective computing technologies are now available at the consumer level and are revolutionizing the ways in which we interact with computers. From simple entertainment applications to assistive technologies, the field of affective computing holds great promise. The aim of this chapter is to provide the reader with a greater understanding of affective computing while highlighting current issues, example use cases, limitations, and areas of future research.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 149.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 199.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 199.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. A.M. Turing, Computing machinery and intelligence. Mind LIX(236), 433–460 (1950)

    Google Scholar 

  2. P. Branco, L.M. Encarnação, Affective computing for behavior-based UI adaptation, in International Conference on Intelligent User Interfaces (Funchal, Madeira, Portugal, 2004)

    Google Scholar 

  3. B. Kratzwald, S. Ilić, M. Kraus, S. Feuerriegel, H. Prendinger, Deep learning for affective computing: text-based emotion recognition in decision support. Decis. Support Syst. 115, 24–35 (2018)

    Article  Google Scholar 

  4. A. Valitutti, C. Strapparava, O. Stock, Developing affective lexical resources. PsychNology J. 2(1), 61–83 (2004)

    Google Scholar 

  5. K. Amara, N. Ramzan, N. Achour, M. Belhocine, C. Larbas, N. Zenati, Emotion recognition via facial expressions, in 2018 IEEE/ACS 15th International Conference on Computer Systems and Applications (AICCSA) (2018), pp. 1–6

    Google Scholar 

  6. R.W. Picard, Affective computing-MIT media laboratory perceptual computing section. Technical Report No. 321 (Cambridge, MA, 2139, 1995)

    Google Scholar 

  7. R.C. Balabantaray, M. Mohammad, N. Sharma, Multi-class twitter emotion classification: a new approach. Int. J. Appl. Inf. Syst. 4(1), 48–53 (2012)

    Google Scholar 

  8. P.A. Vijaya, G. Shivakumar, Galvanic skin response: a physiological sensor system for affective computing. Int. J. Mach. Learn. Comput. 3(1), 31 (2013)

    Article  Google Scholar 

  9. W.B. Canon, The James-Lange theory of emotions: a critical examination and an alternative theory. Am. J. Psychol. 39(1/4), 106–124 (1927)

    Article  Google Scholar 

  10. M. Saraiva, H. Ayanoğlu, Emotions and emotions in design, in Emotional Design in Human-Robot Interaction. (Springer, Cham, 2019), pp. 57–70

    Chapter  Google Scholar 

  11. S.L. McShane, S.L. Steen, Canadian Organizational Behaviour, 8th edn. (2012)

    Google Scholar 

  12. K.M. Heilman, Emotion and the brain: a distributed modular network mediating emotional experience, in Neuropsychology. ed. by D. Zeidel (San Diego, CA, Academic Press, 1994), pp. 139–158

    Chapter  Google Scholar 

  13. D.G. Myers, Theories of Emotion. Psychology, 7th edn. (Worth Publishers, New York, NY, 2004)

    Google Scholar 

  14. G.L. Clore, A. Ortony, Psychological construction in the OCC model of emotion. Emot. Rev. 5(4), 335–343 (2013)

    Article  Google Scholar 

  15. K.R. Scherer, What are emotions? And how can they be measured? Soc. Sci. Inf. 44, 695–729 (2005)

    Article  Google Scholar 

  16. B. Plotkin, Wild Mind: A Field Guide to the Human Psyche (New World Library, Novato, CA, 2013)

    Google Scholar 

  17. W. Wei, Q. Jia, 3D facial expression recognition based on Kinect. Int. J. Innov. Comput. Inf. Control 13, 1843–1854 (2017)

    Google Scholar 

  18. J.R. Fontaine, K.R. Scherer, E.B. Roesch, P.C. Ellsworth, The world of emotions is not two-dimensional. Psychol. Sci. 18(12), 1050–1057 (2007)

    Article  Google Scholar 

  19. R. Reisenzein, The Schachter theory of emotion: two decades later. Psychol. Bull. 94(2), 239–264 (1983)

    Article  Google Scholar 

  20. A. Patwardhan, G. Knapp, Aggressive actions and anger detection from multiple modalities using Kinect. arXiv preprint arXiv:1607.01076 (2016)

  21. J. Tao, T. Tan, Affective computing: a review, in International Conference on Affective Computing and Intelligent Interaction (Beijing, China, 2005), pp. 981–995

    Google Scholar 

  22. M. Lang, Investigating the Emotiv EPOC for cognitive control in limited training time, Honours Report (Department of Computer Science, University of Canterbury, 2012)

    Google Scholar 

  23. T.N. Malete, K. Moruti, T.S. Thapelo, R.S. Jamisola, EEG-based control of a 3D game using 14-channel Emotiv Epoc+, in 2019 IEEE International Conference on Cybernetics and Intelligent Systems and IEEE Conference on Robotics, Automation and Mechatronics (Bangkok, Thailand, 2019), pp. 463–468

    Google Scholar 

  24. C. Levicán, A. Aparicio, V. Belaunde, R.F. Cádiz, Insight2osc: using the brain and the body as a musical instrument with the Emotiv Insight, in International Conference on New Interfaces for Musical Expression, (2017), pp. 287–290

    Google Scholar 

  25. A.M. Triantafyllou, G.A. Tsihrintzis, Group affect recognition: completed databases & smart uses, in ACM 3th International Conference on E-Education, E-Business and E-Technology (ICEBT) (2019) pp. 38–42

    Google Scholar 

  26. A.M. Triantafyllou, G.A. Tsihrintzis, Group affect recognition: optimization of automatic classification, in Springer 12th Joint Conference on Knowledge-Based Software Engineering (JCKBSE) (2018), pp. 189–196

    Google Scholar 

  27. A.M. Triantafyllou, G.A. Tsihrintzis, Group affect recognition: Visual - facial collection, in IEEE 29th International Conference on Tools with Artificial Intelligence (ICTAI) (2017), pp. 677–681

    Google Scholar 

  28. A.M. Triantafyllou, G.A. Tsihrintzis, Group affect recognition: evaluation of basic automated sorting, in IEEE 9th International Conference on Information, Intelligence, Systems and Applications (IISA) (2018), pp. 1–8

    Google Scholar 

  29. L.F. Barrett, R. Adolphs, S. Marsella, A.M. Martinez, S.D. Pollak, Emotional expressions reconsidered: challenges to inferring emotion from human facial movements. Psychol. Sci. Public Interest 20(1), 1–68 (2019)

    Article  Google Scholar 

  30. S. Tornincasa, E. Vezzetti, S. Moos, M.G. Violante, F. Marcolin, N. Dagnes, L. Ulrich, G.F. Tregnaghi, 3D facial action units and expression recognition using a crisp logic. Comput. Aided Des. Appl. 16, 256–268 (2019)

    Article  Google Scholar 

  31. B. Fasel, J. Luettin, Automatic facial expression analysis: a survey. Pattern Recognit. 36(1), 259–275 (2003)

    Article  Google Scholar 

  32. S. Alghowinem, M. AlShehri, R. Goecke, M. Wagner, Exploring eye activity as an indication of emotional states using an eye-tracking sensor, in Intelligent Systems for Science and Information, eds. By L. Chen, S. Kapoor, R. Bhatia (Springer, 2014), pp. 261–276

    Google Scholar 

  33. P.A. Chiesa, M.T. Liuzza, A. Acciarino, S.M. Aglioti, Subliminal perception of others’ physical pain and pleasure. Exp. Brain Res. 233(8), 2373–2382 (2015)

    Article  Google Scholar 

  34. H.I. Liao, M. Yoneya, S. Kidani, M. Kashino, S. Furukawa, Human pupillary dilation response to deviant auditory stimuli: effects of stimulus properties and voluntary attention. Front Neurosci. 10, 43 (2016)

    Article  Google Scholar 

  35. S.W. Gilroy, M. Cavazza, R. Chaignon, S.M. Mäkelä, M. Niranen, E. André, T. Vogt, M. Billinghurst, H. Seichter, M. Benayoun, E-tree: emotionally driven augmented reality art, in 16th ACM International Conference on Multimedia (Vancouver BC, Canada, 2008), pp. 945–948

    Google Scholar 

  36. M. Munezero, C.S. Montero, E. Sutinen, J. Pajunen, Are they different? Affect, feeling, emotion, sentiment, and opinion detection in text, IEEE Trans. Affect Comput. 5(2), 101–111 (2014)

    Google Scholar 

  37. G. Goth, Deep or shallow, NLP is breaking out. Commun. ACM 59(3), 13–16 (2016)

    Article  Google Scholar 

  38. I. Kotsia, S. Zafeiriou, S. Fotopoulos, Affective gaming: a comprehensive survey, in IEEE Conference on Computer Vision and Pattern Recognition Workshops (Portland, OR, USA, 2013), pp. 663–670

    Google Scholar 

  39. J.K. Argasiński, P. Węgrzyn, P. Strojny, Affective VR serious game for firefighter training, in Workshop on Affective Computing and Context Awareness in Ambient Intelligence (AfCAI) (Valencia, Spain, 2018), p. 43

    Google Scholar 

  40. D. Quesnel, S. DiPaola, B.E. Riecke, Deep learning for classification of peak emotions within virtual reality systems, in International SERIES on Information Systems and Management in Creative eMedia (CreMedia), (2017/2), (2018), pp. 6–11

    Google Scholar 

  41. V. Sharma, M. Goyal, D. Malik, An intelligent behaviour shown by chatbot system. Int. J. Res. Eng. Technol. 3(4), 52–54 (2017)

    Google Scholar 

  42. S. Patil, V.M. Mudaliar, P. Kamat, S. Gite, LSTM based ensemble network to enhance the learning of long-term dependencies in chatbot. Int. J. Simul. Multidiscip. Des. Optim. 11:Article 25 (2020)

    Google Scholar 

  43. Y.T. Wan, C.C. Chiu, K.W. Liang, P.C. Chang, Midoriko Chatbot: LSTM-based emotional 3D avatar, in 2019 IEEE 8th Global Conference on Consumer Electronics (Osaka, Japan, 2019), pp. 937–940

    Google Scholar 

  44. A. Papafragou, Pragmatic development. Lang. Learn. Dev. 14(3), 167–169 (2018)

    Google Scholar 

  45. E. Johnson, R. Hervás, G. López, C. de la Franca, T. Mondéjar, S.F. Ochoa, J. Favela, Assessing empathy and managing emotions through interactions with an affective avatar. Health Inf. J. 24(2), 182–193 (2018)

    Article  Google Scholar 

  46. D. Siegmund, L. Chiesa, O. Hörr, F. Gabler, A. Braun, A. Kuijper, Talis—A design study for a wearable device to assist people with depression, in 2017 IEEE 41st Annual Computer Software and Applications Conference July 4–8. (Italy, Turin, 2017), pp. 543–548

    Google Scholar 

  47. A. Alepis, M. Virvou, Automatic generation of emotions in tutoring agents for affective e-learning in medical education. Expert Syst. Appl. 38(2011), 9840–9847 (2011)

    Article  Google Scholar 

  48. D. Novak, G. Chanel, P. Guillotel, A. Koenig, Guest editorial: toward commercial applications of affective computing. IEEE Trans. Affect Comput. 8(2), 145–147 (2017)

    Article  Google Scholar 

  49. M. Virvou, G.A. Tsihrintzis, E. Alepis, I.-O. Stathopoulou, K. Kabassi, On the use of multi-attribute decision making for combining audio-lingual and visual-facial modalities in emotion recognition, in Tsihrintzis GA. ed. by M. Virvou, L.C. Jain, R.J. Howlett, T. Watanabe (Intelligent Interactive Multimedia Systems and Services in Practice, Springer, 2015), pp. 7–34

    Google Scholar 

  50. E. Politou, E. Alepis, C. Patsakis, A survey on mobile affective computing. Comput. Sci. Rev. 25, 79–100 (2017)

    Article  Google Scholar 

Download references

Acknowledgements

The financial support of the Natural Sciences and Engineering Research Council of Canada (NSERC) and the Social Sciences and Humanities Research Council of Canada (SSHRC), is gratefully acknowledged.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Bill Kapralos .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Gaudi, G., Kapralos, B., Collins, K., Quevedo, A. (2022). Affective Computing: An Introduction to the Detection, Measurement, and Current Applications. In: Virvou, M., Tsihrintzis, G.A., Tsoukalas, L.H., Jain, L.C. (eds) Advances in Artificial Intelligence-based Technologies. Learning and Analytics in Intelligent Systems, vol 22. Springer, Cham. https://doi.org/10.1007/978-3-030-80571-5_3

Download citation

Publish with us

Policies and ethics