Skip to main content

Music Emotion Recognition with the Extraction of Audio Features Using Machine Learning Approaches

  • Conference paper
  • First Online:
Proceedings of ICETIT 2019

Part of the book series: Lecture Notes in Electrical Engineering ((LNEE,volume 605))

Abstract

Music is the covered up arithmetical exercise of a mind oblivious that it is figuring. Music not being just an extravagant language for human emotion is also a key itself for identifying the human emotion. Researches indicate that music causes stimulation through specific brain circuits to produce emotions. Listening to a piece of music can manipulate a person to feel joyous or brooding according to the emotion included in the music. But the perennial challenge is to examine the correlation between music and the subsequent effect on emotion. This music emotion recognition (MER) system can be used for simplistic music information retrieval. In this paper using (Music Information Retrieval) MIR Toolbox in Matlab, eight distinct features were extracted from 100 songs of various genres and similar emotions were clustered into four categories using the Russell’s Two Dimensional Emotion Model. Mapping the extracted features into the four emotion classes, several machine-learning classifiers were trained. A set of unknown songs were used to validate the recognition accuracy. Along with the common features like pitch, timbre, rhythm etc. roll-off and brightness were also used. Roll-off showed a great priority in Random Forest feature ranking. With all these features combined, a highest prediction accuracy of 75% was found from artificial neural network (ANN) among the others classifiers like Support Vector Machine (SVM), linear discriminant, and Ensemble learner.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 259.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 329.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 329.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Russell, J.A.: A circumflex model of affect. J. Pers. Soc. Psychol. 39(6), 1161–1178 (1980)

    Article  Google Scholar 

  2. Gabrielsson, A., Lindström, E.: The influence of musical structure on emotional expression. In: Music and Emotion: Theory and Research. Oxford University Press, Oxford (2001)

    Google Scholar 

  3. Pratt, C.C.: Music as the language of emotion a lecture delivered in the Whittall Pavilion of the Library of Congress. U.S. Government Printing Office, Washington, monographic (1952)

    Google Scholar 

  4. Juslin, P.N., Sloboda, J.: Music and Emotion: Theory and Research. Oxford University Press, Oxford (2001)

    Google Scholar 

  5. Casey, M.A., Veltkamp, R., Goto, M., Leman, M., Rhodes, C., Slaney, M.: Content-based music information retrieval: current directions and future challenges. Proc. IEEE 96(4), 668–696 (2008)

    Article  Google Scholar 

  6. Thayer, R.E.: The Biopsychology of Mood and Arousal. Oxford University Press, New York (1989)

    Google Scholar 

  7. Lazarus, R.S., Lazarus, R.S.: Emotion and Adaptation. Oxford University Press, Oxford (1991)

    MATH  Google Scholar 

  8. Han, B.J., Rho, S., Dannenberg, R.B., Hwang, E.: SMERS: music emotion recognition using support vector regression. In: International Society for Music Information Retrieval, pp. 651–656 (2009)

    Google Scholar 

  9. Han, K.M., Zin, T., Tun, H.: Extraction of audio features for emotion recognition system based on music. Int. J. Sci. Technol. Res. 5(6), 53–56 (2016)

    Google Scholar 

  10. Deshmukh, S.H., Bhirud, S.G.: North Indian classical music’s singer identification by timbre recognition using MIR toolbox. Int. J. Comput. Appl. 91(4), 1–5 (2014)

    Google Scholar 

  11. Juslin, P.N., Laukka, P.: Expression, perception, and induction of musical emotions: a review and a questionnaire study of everyday listening. J. New Music Res. 33(3), 217–238 (2004)

    Article  Google Scholar 

  12. Krumhansl, C.L.: Music: a link between cognition and emotion. Curr. Dir. Psychol. Sci. 11(2), 45–50 (2002)

    Article  Google Scholar 

  13. Hevner, K.: Experimental studies of the elements of expression in music. Am. J. Psychol. 48(2), 246–267 (1936)

    Article  Google Scholar 

  14. Rigg, M.G.: The mood effects of music: a comparison of data from four investigators. J. Psychol. 58, 427–438 (1964)

    Article  Google Scholar 

  15. Yang, Y.H., Chen, H.H.: Machine recognition of music emotion: a review article. ACM Trans. Intell. Syst. Technol. 3(3), 40 (2012)

    Article  Google Scholar 

  16. MIRtoolbox. https://www.mathworks.com/matlabcentral/fileexchange/24583-mirtoolbox. Accessed 13 Mar 2019

  17. Lartillot, O., Toiviainen, P.: A Matlab toolbox for musical feature extraction from audio. In: 10th International Conference on Digital Audio Effects, Bordeaux, France (2007)

    Google Scholar 

  18. Zentner, M., Grandjean, D., Scherer, K.R.: Emotions evoked by the sound of music: characterization, classification and measurement. Am. Psychol. Assoc. 8(4), 494–521 (2008)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Jannatul Humayra Juthi .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Juthi, J.H., Gomes, A., Bhuiyan, T., Mahmud, I. (2020). Music Emotion Recognition with the Extraction of Audio Features Using Machine Learning Approaches. In: Singh, P., Panigrahi, B., Suryadevara, N., Sharma, S., Singh, A. (eds) Proceedings of ICETIT 2019. Lecture Notes in Electrical Engineering, vol 605. Springer, Cham. https://doi.org/10.1007/978-3-030-30577-2_27

Download citation

Publish with us

Policies and ethics