Emotion-Based Extraction, Classification and Prediction of the Audio Data

  • Anusha PotluriEmail author
  • Ravi Guguloth
  • Chaitanya Muppala
Conference paper
Part of the Advances in Intelligent Systems and Computing book series (AISC, volume 1090)


With the rapid penetration of the Internet across the globe and increased bandwidth, the rise of audio data is significant. In one of the recent surveys on the Internet, it is mentioned that video and audio streaming will gobble up more than 50% of the Internet traffic. Moreover, with the recent rise of voice assistants, the significance to the audio data, especially voice data is at the zenith. In this background, there is a need to analyze the audio data for gathering significant insights which will have larger implications in the domains of health, marketing and media. In this project, an open-source approach is proposed to analyze the audio data using the acoustic features like Mel frequency cepstral coefficients (MFCCs), unlike converting the audio to text and performing the analysis on the converted textual data. In this work, a convolutional neural network (CNN) model is developed to predict the emotions on the given audio data.


Prediction MFCC Acoustic features Audio data Convolutional neural networks Emotions 


  1. 1.
    Abdel-Hamid, Ossama, Abdel-rahman Mohamed, Hui Jiang, Li Deng, Gerald Penn, and Dong Yu. 2014. Convolutional Neural Networks for Speech Recognition. IEEE/ACM Transactions on Audio, Speech and Language Processing 22 (10).Google Scholar
  2. 2.
    Kaushik, Lakshmish, Abhijeet Sangwan, John H. L. Hansen. 2017. Automatic Sentiment Detection in Naturalistic Audio. IEEE/ACM Transactions on Audio, Speech, and Language Processing 25 (8).Google Scholar
  3. 3.
    Navya Sri, M., M. Ramakrishna Murty, et al. 2017. Robust Features for Emotion Recognition from Speech by using Gaussian Mixture Model Classification. In International Conference and Published Proceeding in SIST Series, Vol. 2, 437–444. Berlin: Springer.Google Scholar
  4. 4.
    Ezgi Küçükbay, Selver, Mustafa Sert. 2015. Audio-Based Event Detection in Office Live Environments Using Optimized MFCC-SVM Approach. In Proceedings of the 2015 IEEE 9th International Conference on Semantic Computing (IEEE ICSC 2015), 475–480.Google Scholar
  5. 5.
    Livingstone, S.R., and F.A. Russo. 2018. The Ryerson Audio-Visual Database of Emotional Speech and Song (RAVDESS): A dynamic, multimodal set of facial and vocal expressions in North American English. PLoS ONE 13 (5): e0196391. Scholar
  6. 6.
    Haq, S., and P.J.B. Jackson. 2010. Multimodal Emotion Recognition. In Machine Audition: Principles, Algorithms and Systems, ed. W. Wang, 398–423. Hershey: IGI Global Press. ISBN 978-1615209194.
  7. 7.
    Sauter, Disa A., Frank Eisner, Paul Ekman, and Sophie K. Scott, Cross-Cultural Recognition of Basic Emotions Through Nonverbal Emotional Vocalizations. Proceedings of the National Academy of Sciences of the USA.Google Scholar
  8. 8.
    Van Rossum, G. 1995. Python Tutorial, Technical Report CS-R9526, Centrum voor Wiskunde en Informatica (CWI), Amsterdam.Google Scholar
  9. 9.
    van der Walt, Stefan, Stefan van der Walt, and Stefan van der Walt. 2011. The NumPy Array: A Structure for Efficient Numerical Computation. Computing in Science and Engineering Journal 13 (2): 22–30.CrossRefGoogle Scholar
  10. 10.
    Pedregosa, et al. 2011. Scikit-learn: Machine Learning in Python. Journal of Machine Learning Research 12: 2825–2830.MathSciNetzbMATHGoogle Scholar
  11. 11.
    Goodfellow, Ian, Derek Murray, and Vincent Vanhoucke. 2015. TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems. Google Research.Google Scholar
  12. 12.
    Keras Documentation—
  13. 13.
    Kalyani, G., M.V.P. Chandra Sekhara Rao. 2017. Particle Swarm Intelligence and Impact Factor-Based Privacy Preserving Association Rule Mining for Balancing Data Utility and Knowledge Privacy. Arabian Journal for Science and Engineering.Google Scholar

Copyright information

© Springer Nature Singapore Pte Ltd. 2020

Authors and Affiliations

  • Anusha Potluri
    • 1
    Email author
  • Ravi Guguloth
    • 1
  • Chaitanya Muppala
    • 1
  1. 1.Department of Computer Science and EngineeringMalla Reddy College of Engineering and Technology (JNTUH Hyderabad)HyderabadIndia

Personalised recommendations