Skip to main content

Do You Mean What You Say? Recognizing Emotions in Spontaneous Speech

  • Conference paper
  • First Online:
Frontiers in Electronic Technologies

Abstract

Emotions when explicitly demonstrated by an actor are easy for a machine to recognize by analyzing their speech. However in case of day to day, naturally spoken spontaneous speech it is not easy for machines to identify the expressed emotion even though emotion of the speaker are embedded in their speech. One of the main reasons for this is that people, especially non-actors, do not explicitly demonstrate their emotion when they speak, thus making it difficult to recognize the emotion embedded in their spoken speech. In this paper, based on some of our previous published work (example, Chakraborty et al. in Proceedings of the 20th International Conference KES-2016 96:587–596, 2016 [1], Chakraborty et al. in TENCON 2015—2015 IEEE Region 10 Conference 1–5, 2015 [2], Chakraborty et al. in PACLIC, 2016 [3], Pandharipande and Kopparapu in TENCON 2015—2015 IEEE Region 10 Conference 1–4, 2015 [4], Kopparapu in Non-Linguistic Analysis of Call Center Conversations, 2014 [5], Pandharipande and Kopparapu in ECTI Trans Comput Inf Technol 7(2):146–155, 2013 [6], Chakraborty and Kopparapu in 2016 IEEE International Conference on Multimedia and Expo Workshops, 1–6, 2016 [7]) we identify the challenges in recognizing emotions in spontaneous speech and suggest a framework that can assist in determining the emotions expressed in spontaneous speech.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. R. Chakraborty, M. Pandharipande, S.K. Kopparapu, Knowledge-based framework for intelligent emotion recognition in spontaneous speech, in Procedia Computer Science, 2016, knowledge-Based and Intelligent Information; Engineering Systems: Proceedings of the 20th International Conference KES-2016, vol. 96, pp. 587–596. http://www.sciencedirect.com/science/article/pii/S187705091632049X

  2. R. Chakraborty, M. Pandharipande, S. Kopparapu, Event based emotion recognition for realistic non-acted speech, in TENCON 2015—2015 IEEE Region 10 Conference (2015), pp. 1–5

    Google Scholar 

  3. R. Chakraborty, M. Pandharipande, S.K. Kopparapu, Mining call center conversations exhibiting similar affective states, in PACLIC 2016 (2016)

    Google Scholar 

  4. M.A. Pandharipande, S.K. Kopparapu, Audio segmentation based approach for improved emotion recognition, in TENCON 2015—2015 IEEE Region 10 Conference (2015), pp. 1–4

    Google Scholar 

  5. S.K. Kopparapu, Non-Linguistic Analysis of Call Center Conversations, Springer Briefs in Electrical and Computer Engineering (Springer, 2014)

    Google Scholar 

  6. M.A. Pandharipande, S.K. Kopparapu, A language independent approach to identify problematic conversations in call centers. ECTI Trans. Comput. Inf. Technol. 7(2), 146–155 (2013)

    Google Scholar 

  7. R. Chakraborty, S.K. Kopparapu, Improved speech emotion recognition using error correcting codes, in 2016 IEEE International Conference on Multimedia and Expo Workshops, ICME Workshops 2016, Seattle, WA, USA, July 11–15, 2016. IEEE Computer Society (2016), pp. 1–6. doi:10.1109/ICMEW.2016.7574707

  8. B.W. Schuller, A. Batliner, S. Steidl, D. Seppi, Recognising realistic emotions and affect in speech: state of the art and lessons learnt from the first challenge. Speech Commun. 53, 1062–1087 (2011)

    Article  Google Scholar 

  9. M.E. Ayadi, M.S. Kamel, F. Karray, Survey on speech emotion recognition: features, classification schemes, and databases. Pattern Recogn. 44, 572–587 (2011)

    Article  MATH  Google Scholar 

  10. E. Mower, M. Mataric, S.S. Narayanan, A framework for automatic human emotion classification using emotion profiles. IEEE TASLP 19(5), 1057–1070 (2011)

    Google Scholar 

  11. S. Wu, T.H. Falk, W.Y. Chan, Automatic speech emotion recognition using modulation spectral features. Speech Commun. 53(5), 768–785 (2010)

    Article  Google Scholar 

  12. B.W. Schuller, D. Seppi, A. Batliner, A.K. Maier, S. Steidl, Towards more reality in the recognition of emotional speech, in ICASSP (2007), pp. 941–944

    Google Scholar 

  13. A.J. Viera, J.M. Garrett, Understanding interobserver agreement: the kappa statistic. Family Med. 37(5), 360–363 (2005)

    Google Scholar 

  14. M.L. McHugh, Interrater reliability: the kappa statistic. Biochemia Med. 3, 276–282 (2012)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Sunil Kumar Kopparapu .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer Nature Singapore Pte Ltd.

About this paper

Cite this paper

Chakraborty, R., Pandharipande, M., Kopparapu, S.K. (2017). Do You Mean What You Say? Recognizing Emotions in Spontaneous Speech. In: Prabaharan, S., Thalmann, N., Kanchana Bhaaskaran, V. (eds) Frontiers in Electronic Technologies. Lecture Notes in Electrical Engineering, vol 433. Springer, Singapore. https://doi.org/10.1007/978-981-10-4235-5_3

Download citation

  • DOI: https://doi.org/10.1007/978-981-10-4235-5_3

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-10-4234-8

  • Online ISBN: 978-981-10-4235-5

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics