Skip to main content
SpringerLink
Log in

Performance of deer hunting optimization based deep learning algorithm for speech emotion recognition

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

This paper proposes a speech emotion recognition technique based on Optimized Deep Neural Network. The speech signals are denoised by presenting a novel adaptive wavelet transform with a modified galactic swarm optimization algorithm (AWT_MGSO). From the noise removed speech signals, the spectral features like LPC (Linear Prediction Coefficients), MFCC (Mel frequency cepstral coefficients), PSD (power spectral density) and prosodic features like energy, entropy, formant frequencies and pitch are extracted and certain features are selected by ASFO (Adaptive Sunflower Optimization Algorithm). The optimized DNN-DHO (Deep Neural Network with Deer Hunting Optimization Algorithm) is proposed for emotion classification. An enhanced squirrel search algorithm is proposed to update the weight in the optimized DNN_DHO classifier. In this study, all the eight emotions of the speech from RAVDESS (Ryerson Audio-Visual Database of Emotional Speech and Song) and TESS (Toronto Emotional Speech Set) databases for English and IITKGP-SEHSC (Indian Institute of Technology Kharagpur Simulated Emotion Hindi Speech Corpus) database for Hindi are classified. The experimental results are obtained and compared with the classifiers such as DNN_DHO, DNN (Deep Neural Network) and DAE (Deep Auto Encoder). The experimental results show that the proposed algorithm obtains maximum accuracy as 97.85% by the TESS dataset, 97.14% by the RAVDESS dataset and 93.75% by the IITKGP-SEHSC dataset by the DNN-HHO classifier.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price includes VAT (France)

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14

References

  1. Al-Anzi F, Zeina DA (2018) Literature survey of Arabic speech recognition. In: 2018 International Conference on Computing Sciences and Engineering (ICCSE), Kuwait City, pp 1–6. https://doi.org/10.1109/ICCSE1.2018.8374215

  2. Arafa MN, Elbarougy R, Ewees AA, Behery GM (2018) A dataset for speech recognition to support Arabic phoneme pronunciation. Int J Image Graph Signal Proc 10(4):31

    Google Scholar 

  3. Arora V, Lahiri A, Reetz H (2018) Phonological feature-based speech recognition system for pronunciation training in non-native language learning. J Acoust Soc Am 143(1):98–108

    Article  Google Scholar 

  4. Awan SK, Dunoyer EJ, Genuario KE, Levy AC, O'Connor KP, Serhatli S, Gerling GJ (2018) Using voice recognition enabled smartwatches to improve nurse documentation. In: 2018 Systems and Information Engineering Design Symposium (SIEDS), Charlottesville, VA, pp 159–164. https://doi.org/10.1109/SIEDS.2018.8374728

  5. Badshah MA, Rahim N, Ullah N, Ahmad J, Muhammad K, Lee MY, Kwon S, Baik SW (2019) Deep features-based speech emotion recognition for smart effective services. Multimed Tools Appl 78(5):5571–5589

    Article  Google Scholar 

  6. Barker J, Watanabe S, Vincent E, Trmal J (2018) The fifth 'CHiME' speech separation and recognition challenge: dataset, task and baselines. arXiv preprint arXiv:1803.10609

  7. Bernal E, Castillo O, Soria J, Valdez F (2018) Galactic swarm optimization with adaptation of parameters using fuzzy logic for the optimization of mathematical functions. In: Fuzzy Logic Augmentation of Neural and Optimization Algorithms: Theoretical Aspects and Real Applications. Springer, Cham, vol. 749, no. 1, pp 131–140

  8. Bhavan A, Chauhan P, Shah RR (2019) Bagged support vector machines for emotion recognition from speech. Knowl-Based Syst 184:104886

    Article  Google Scholar 

  9. Brammya G, Praveena S, Ninu Preetha NS, Ramya R, Rajakumar BR, Binu D (2019) Deer hunting optimization algorithm: a new nature-inspired meta-heuristic paradigm. Comput J

  10. Daqrouq K, Tutunji TA (2015) Speaker identification using vowels features through a combined method of formants, wavelets, and neural network classifiers. Appl Soft Comput 27:231–239

    Article  Google Scholar 

  11. Darabkh KA, Haddad L, Sweidan SZ, Hawa M, Saifan R, Alnabelsi SH (2018) An efficient speech recognition system for arm-disabled students based on isolated words. Comput Appl Eng Educ 26(2):285–301

    Article  Google Scholar 

  12. Gardini S (2018) Data preparation and improvement of NLP software modules for parametric speech synthesis

  13. Gomes GF, da Cunha SS, Ancelotti AC (2019) A sunflower optimization (SFO) algorithm applied to damage identification on laminated composite plates. Eng Comput 35(2):619–626

    Article  Google Scholar 

  14. Gong N, Idé T, Kim S, Boybat I, Sebastian A, Narayanan V, Ando T (2018) Signal and noise extraction from analog memory elements for neuromorphic computing. Nat Commun 9(1):2102

    Article  Google Scholar 

  15. Gupta D, Bansal P, Choudhary K (2018) The state of the art of feature extraction techniques in speech recognition. In: Speech and Language Processing for Human-Machine Communications. Springer, Singapore, vol. 2, no. 1, pp 195–207

  16. Hamsa S, Shahin I, Iraqi Y, Werghi N (2020) Emotion recognition from speech using wavelet packet transform Cochlear filter Bank and random Forest classifier. IEEE Access 8:96994–97006. https://doi.org/10.1109/ACCESS.2020.2991811

  17. Haridas VA, Marimuthu R, Sivakumar VG (2018) A critical review and analysis of techniques of speech recognition: the road ahead. Int J Knowl-Based Intell Eng Syst 22(1):39–57

    Google Scholar 

  18. Huang CZ, Epps J (2018) An investigation of partition-based and phonetically-aware acoustic features for continuous emotion prediction from speech. IEEE Trans Affect Comput 1:1–11

    Google Scholar 

  19. Karle KN, Ethofer T, Jacob H, Brück C, Ml E, Lotze M, Nizielski S, Schütz A, Wildgruber D, Kreifelts B (2018) Neurobiological correlates of emotional intelligence in voice and face perception networks. Soc Cogn Affect Neurosci 13(2):233–244

    Article  Google Scholar 

  20. Koolagudi GS, Reddy R, Yadav J, Rao KS (2011) IITKGP-SEHSC: Hindi speech corpus for emotion analysis. In devices and communications (ICDeCom), 2011 international conference on IEEE 1-5

  21. Kwon S (2020) A CNN-assisted enhanced audio signal processing for speech emotion recognition. Sensors 20(1):183

    Google Scholar 

  22. Latif S, Rana R, Khalifa S, Jurdak R, Epps J, Schuller BW (2020) Multi-task semi-supervised adversarial autoencoding for speech emotion recognition. IEEE Trans Affect Comput

  23. Liu J-C, Leu F-Y, Lin G-L, Susanto H (2018) An MFCC-based text-independent speaker identification system for access control. Concurr Comput Pract Exp 30(2):e4255

    Article  Google Scholar 

  24. Livingstone SR, Russo FA (2018) The Ryerson audio-visual database of emotional speech and Song (RAVDESS): a dynamic, multimodal set of facial and vocal expressions in north American English. PLoS One 13(5):e0196391

    Article  Google Scholar 

  25. Mannepalli K, Sastry PN, Suman M (2018) Analysis of emotion recognition system for Telugu using prosodic and formant features. In Speech and Language Processing for Human-Machine Communications. Springer, Singapore, pp 137–144

  26. Mirzaei SM, Meshgi K, Kawahara T (2018) Exploiting automatic speech recognition errors to enhance partial and synchronized caption for facilitating second language listening. Comput Speech Lang 49:17–36

    Article  Google Scholar 

  27. Moro-Velázquez L, Gómez-García JA, Godino-Llorente JI, Villalba J, Orozco-Arroyave JR, Dehak N (2018) Analysis of speaker recognition methodologies and the influence of kinetic changes to automatically detect Parkinson's disease. Appl Soft Comput 62:649–666

    Article  Google Scholar 

  28. Özseven T (2019) A novel feature selection method for speech emotion recognition. Appl Acoust 146:320–326

    Article  Google Scholar 

  29. Patel P, Chaudhari A, Kale R, Pund M (2017) Emotion recognition from speech with gaussian mixture models & via boosted GMM. Int J Res Sci Eng 3(2):47–53

  30. Price M, Glass J, Chandrakasan AP (2018) A low-power speech recognizer and voice activity detector using deep neural networks. IEEE J Solid State Circuits 53:66–75

    Article  Google Scholar 

  31. Sajjad M, Kwon S (2020) Clustering-based speech emotion recognition by incorporating learned features and deep BiLSTM. IEEE Access 8:79861–79875

    Article  Google Scholar 

  32. Song P, Zheng W (2018) Feature selection based transfer subspace learning for speech emotion recognition. IEEE Trans Affect Comput 11:373–382

    Article  Google Scholar 

  33. Vryzas N, Vrysis L, Matsiola M, Kotsakis R, Dimoulas C, Kalliris G (2020) Continuous speech emotion recognition with convolutional neural networks. J Audio Eng Soc 68(1/2):14–24

    Article  Google Scholar 

  34. Wang W-C, Pestana MH and Moutinho L (2018) The effect of emotions on brand recall by gender using voice emotion response with optimal data analysis. In: Innovative research methodologies in management. Palgrave Macmillan, Cham, pp 103–133

  35. Wei P, Zhao Y (2019) A novel speech emotion recognition algorithm based on wavelet kernel sparse classifier in stacked deep auto-encoder model. Pers Ubiquit Comput 23(3–4):521–529

    Article  Google Scholar 

  36. Zhang Y, Zhang E, Chen W (2016) Deep neural network for halftone image classification based on sparse auto-encoder. Eng Appl Artif Intell 50:245–255

    Article  Google Scholar 

  37. Zhao J, Mao X, Chen L (2019) Speech emotion recognition using deep 1D & 2D CNN LSTM networks. Biomed Signal Proc Control 47:312–323

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Computer Science & Engineering, IIT(ISM), Dhanbad, Jharkhand, 826004, India

    Gaurav Agarwal & Hari Om

Authors
  1. Gaurav Agarwal
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Hari Om
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Gaurav Agarwal.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Agarwal, G., Om, H. Performance of deer hunting optimization based deep learning algorithm for speech emotion recognition. Multimed Tools Appl 80, 9961–9992 (2021). https://doi.org/10.1007/s11042-020-10118-x

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-020-10118-x

Keywords

Search

Navigation