International Journal of Speech Technology

, Volume 20, Issue 3, pp 553–562 | Cite as

Using learning automata in brain emotional learning for speech emotion recognition

  • Zeinab Farhoudi
  • Saeed Setayeshi
  • Azam Rabiee


We propose an improved version of brain emotional learning (BEL) model trained via learning automata (LA) for speech emotion recognition. Inspiring from the limbic system in mammalian brain, the original BEL model is composed of two neural network components, namely amygdala and orbitofrontal cortex. In this modified BEL model, named brain emotional learning based on learning automata (BELBLA), we have employed the theory of the stochastic LA in error back-propagation to train the BEL model in decreasing the high computational complexity of the traditional gradient method. Hence, the performance of the model can be enhanced. For a speech emotion recognition task, we extract the usual features, such as energy, pitch, formants, amplitude, zero crossing rate and MFCC, from average short-term signals of the emotional Berlin dataset. The experimental results show that the BELBLA outperforms some opponents, like hidden Markov model, Gaussian mixture model, k-nearest neighbor, support vector machines and artificial neural networks, for this application.


Brain emotional learning Emotional state Learning automata Neural network Speech emotion recognition 


  1. Ayadi, M. M. H. E., Kamel, M. S., Karray, F. (2007). Speech emotion recognition using gaussian mixture vector autoregressive models. In ICASSP 2007 (pp. IV-957–V-960).Google Scholar
  2. Babaie, T., Karimizandi, R., & Lucas, C. (2008). Learning based brain emotional intelligence as a new aspect for development of an alarm system. Soft Computing, 12, 857–873.CrossRefGoogle Scholar
  3. Balkenius, C., & Morén, J. (1998). A computational model of emotional conditioning in the brain. In Proceedings of Workshop on Grounding Emotions in Adaptive Systems, Zurich.Google Scholar
  4. Balkenius, C., & Morén, J. (2001). Emotional learning: A computational model of the amygdala. Cybernetics and Systems, 32, 611–636.CrossRefzbMATHGoogle Scholar
  5. Beigy, H., & Meybodi, M. R. (2001). Backpropagation algorithm adaptation parameters using learning automata. International Journal of Neural Systems, 11, 219–228.CrossRefzbMATHGoogle Scholar
  6. Chandrasekar, P., Chapaneri, S., & Jayaswal, D. (2014). Automatic speech emotion recognition: A survey. In International Conference on Circuits, Systems, Communication and Information Technology Applications (pp. 341–346).Google Scholar
  7. Daryabeigi, E., Markadeh, G.R.A., & Lucas, C. (2010). Emotional controller (BELBIC) for electric drives: A review. In IECON 2010–36th Annual Conference on IEEE Industrial Electronics Society (pp. 2901–2907).Google Scholar
  8. Firoz Shah, A., Raji Sukumar, A., Babu Anto, P. (2009). Automatic emotion recognition from speech using artificial neural networks with gender-dependent databases. In International Conference on Advances in Computing, Control, & Telecommunication Technologies (IEEE) (pp. 162–164).Google Scholar
  9. Gupta, S., Mehra, A., & Vinay (2015). Speech emotion recognition using SVM with thresholding fusion. In 2nd International Conference on Signal Processing and Integrated Networks (SPIN) (pp. 570–574).Google Scholar
  10. Han, K., Yu, D., Tashev, I. (2014). Speech emotion recognition using deep neural network and extreme learning machine. In Proceeding of INTER-SPEECH, ISCA, Singapore (pp. 223–227).Google Scholar
  11. He, L., Lech, M., Maddage, N. C., & Allen, N. B. (2011). Study of empirical mode decomposition and spectral analysis for stress and emotion classification in natural speech. Biomedical Signal Processing and Control, 6, 139–146.CrossRefGoogle Scholar
  12. Kahou, S. E., Michalski, V., Konda, K., Memisevic, R., & Pal, C. (2015). Recurrent neural networks for emotion recognition in video. In Proceedings of the ACM on International Conference on Multimodal Interaction (pp. 467–474). Seattle: ACM.Google Scholar
  13. Kim, Y., & Provost, E. M. (2013). Emotion classification via utterance-level dynamics: A pattern-based approach to characterizing affective expressions. In 2013 IEEE International Conference on Acoustics, Speech and Signal Processing (pp. 3677–3681).Google Scholar
  14. Lotfi, E., & Akbarzadeh-T, M. R. (2012). Supervised brain emotional learning. In 2012 IEEE International Joint Conference on Neural Networks (IJCNN) (pp. 1–6).Google Scholar
  15. Lotfi, E., & Akbarzadeh-T, M. R. (2013). Brain emotional learning-based pattern recognizer. Cybernetics and Systems 44(5), 402–421.CrossRefGoogle Scholar
  16. Lotfi, E., & Akbarzadeh-T, M. R. (2014). Practical emotional neural networks. Neural Network, 59, 61–72.CrossRefGoogle Scholar
  17. Lotfi, E., Setayeshi, S., & Taimory, S. (2014). A neural basis computational model of emotional brain for online visual object recognition. Artificial Intelligence, 28, 814–834.Google Scholar
  18. Lucas, C. (2011). BELBIC and its industrial applications: Towards embedded neuroemotional control codesign. In Integrated systems, design and technology. Springer, Berlin (pp. 203–214).Google Scholar
  19. Lucas, C., Shahmirzadi, D., & Sheikholeslami, N. (2004). Introducing BELBIC: Brain emotional learning based intelligent controller. Intelligent Automation a Soft Computing, 10, 11–21.CrossRefGoogle Scholar
  20. Meybodi, M. R., & Beigy, H. (2002). New learning automata based algorithms for adaptation of backpropagation algorithm parameters. International Journal of Neural Systems, 12, 45–67.CrossRefzbMATHGoogle Scholar
  21. Meybodi, M.R., Beigy, H. (2000). A note on learning automata based schemes for adaptation of BP parameters. In Data Mining, Financial Engineering, and Intelligent Agents: Second International Conference Shatin, N.T., Hong Kong, China, Proceedings. SpringerHeidelberg (pp. 145–151).Google Scholar
  22. Motamed, S., Setayeshi, S., & Rabiee, A. (2017). Speech emotion recognition based on a modified brain emotional learning model. Biologically Inspired Cognitive Architectures, 19, 32–38.CrossRefGoogle Scholar
  23. Narendra, K. S., & Thathachar, M.A.L. (1989). Learning automata: An introduction. Englewood Cliffs: Prentice-Hall, Inc.zbMATHGoogle Scholar
  24. Nicholson, J., Takahashi, K., & Nakatsu, R. (2000). Emotion recognition in speech using neural networks. Neural Computing & Applications, 9, 290–296.CrossRefzbMATHGoogle Scholar
  25. Parsapoor, M., Bilstrup, U. (2012). Brain emotional learning based fuzzy inference system (BELFIS) for solar activity forecasting. In IEEE 24th International Conference on Tools with Artificial Intelligence (Vol. 1, pp. 532–539).Google Scholar
  26. Petrushin, V. A. (2000). Emotional recognition in speech signal: experimental study, development, and application. ICSLP, 2, 222–225.Google Scholar
  27. Picard, R. W., Vyzas, E., & Healey, J. (2001). Toward machine emotional intelligence: Analysis of affective physiological state. IEEE Transactions on Pattern Analysis and Machine Intelligence, 23, 1175–1191.CrossRefGoogle Scholar
  28. Rabiei, M., Gasparetto, A. (2014). A system for feature classification of emotions based on speech analysis. In 2014s RSI/ISM International Conference on applications to human-robot interaction, Robotics and Mechatronics (ICRoM) (pp. 795–800).Google Scholar
  29. Rabiner L.R., Scheafer R.W. (2007) Introduction to digital speech processing. Foundations and Trends in Signal Processing, 1, 1–194).CrossRefGoogle Scholar
  30. Ravi, R., & Mija, S. J. (2014). Design of brain emotional learning based intelligent controller (BELBIC) for uncertain systems. In International Conference on Advanced Communication Control and Computing Technologies (ICACCCT) (pp. 1089–1093).Google Scholar
  31. Rong, J., Li, G., & Chen, Y.-P.P. (2009). Acoustic feature selection for automatic emotion recognition from speech. Information Processing & Management, 45, 315–328.CrossRefGoogle Scholar
  32. Sharafi, Y., Setayeshi, S., Falahiazar, A. (2014). An improved model of brain emotional learning algorithm based on interval knowledge. Journal of Mathematics and Computer Science, 14, 42–53.Google Scholar
  33. Sudareshan, M. K., & Condarcure, T. A. (1998). Recurrent neural-network training by a learning automaton approach for trajectory learning and control system design. IEEE Transactions on Neural Networks, 9, 354–368.CrossRefGoogle Scholar
  34. Thathachar, M.A.L., & Sastry, P. S. (2002). Varieties of learning automata: An overview. IEEE Transactions on Systems, Man, and Cybernetics, 32, 711–722.CrossRefGoogle Scholar
  35. Vondra, M., Vích, R. (2009). Evaluation of speech emotion classification based on GMM and data fusion. In Cross-Modal Analysis of Speech, Gestures, Gaze and Facial Expressions: COST Action 2102 International Conference Prague, Czech Republic, October 15–18, Springer, Berlin, Heidelberg (pp. 98–105).Google Scholar
  36. Wu, S., Falk, T. H., & Chan, W.-Y. (2011). Automatic speech emotion recognition using modulation spectral features. Speech Communication, 53, 768–785.CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media New York 2017

Authors and Affiliations

  1. 1.Department of Computer Engineering, Science and Research BranchIslamic Azad UniversityTehranIran
  2. 2.Department of Medical RadiationAmirkabir University of TechnologyTehranIran
  3. 3.Department of Computer Science, Dolatabad BranchIslamic Azad UniversityIsfahanIran

Personalised recommendations