Abstract
With the rapid penetration of the Internet across the globe and increased bandwidth, the rise of audio data is significant. In one of the recent surveys on the Internet, it is mentioned that video and audio streaming will gobble up more than 50% of the Internet traffic. Moreover, with the recent rise of voice assistants, the significance to the audio data, especially voice data is at the zenith. In this background, there is a need to analyze the audio data for gathering significant insights which will have larger implications in the domains of health, marketing and media. In this project, an open-source approach is proposed to analyze the audio data using the acoustic features like Mel frequency cepstral coefficients (MFCCs), unlike converting the audio to text and performing the analysis on the converted textual data. In this work, a convolutional neural network (CNN) model is developed to predict the emotions on the given audio data.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Abdel-Hamid, Ossama, Abdel-rahman Mohamed, Hui Jiang, Li Deng, Gerald Penn, and Dong Yu. 2014. Convolutional Neural Networks for Speech Recognition. IEEE/ACM Transactions on Audio, Speech and Language Processing 22 (10).
Kaushik, Lakshmish, Abhijeet Sangwan, John H. L. Hansen. 2017. Automatic Sentiment Detection in Naturalistic Audio. IEEE/ACM Transactions on Audio, Speech, and Language Processing 25 (8).
Navya Sri, M., M. Ramakrishna Murty, et al. 2017. Robust Features for Emotion Recognition from Speech by using Gaussian Mixture Model Classification. In International Conference and Published Proceeding in SIST Series, Vol. 2, 437–444. Berlin: Springer.
Ezgi Küçükbay, Selver, Mustafa Sert. 2015. Audio-Based Event Detection in Office Live Environments Using Optimized MFCC-SVM Approach. In Proceedings of the 2015 IEEE 9th International Conference on Semantic Computing (IEEE ICSC 2015), 475–480.
Livingstone, S.R., and F.A. Russo. 2018. The Ryerson Audio-Visual Database of Emotional Speech and Song (RAVDESS): A dynamic, multimodal set of facial and vocal expressions in North American English. PLoS ONE 13 (5): e0196391. https://doi.org/10.1371/journal.pone.0196391.
Haq, S., and P.J.B. Jackson. 2010. Multimodal Emotion Recognition. In Machine Audition: Principles, Algorithms and Systems, ed. W. Wang, 398–423. Hershey: IGI Global Press. ISBN 978-1615209194. https://doi.org/10.4018/978-1-61520-919-4.
Sauter, Disa A., Frank Eisner, Paul Ekman, and Sophie K. Scott, Cross-Cultural Recognition of Basic Emotions Through Nonverbal Emotional Vocalizations. Proceedings of the National Academy of Sciences of the USA.
Van Rossum, G. 1995. Python Tutorial, Technical Report CS-R9526, Centrum voor Wiskunde en Informatica (CWI), Amsterdam.
van der Walt, Stefan, Stefan van der Walt, and Stefan van der Walt. 2011. The NumPy Array: A Structure for Efficient Numerical Computation. Computing in Science and Engineering Journal 13 (2): 22–30.
Pedregosa, et al. 2011. Scikit-learn: Machine Learning in Python. Journal of Machine Learning Research 12: 2825–2830.
Goodfellow, Ian, Derek Murray, and Vincent Vanhoucke. 2015. TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems. Google Research.
Keras Documentation—https://keras.io/.
Kalyani, G., M.V.P. Chandra Sekhara Rao. 2017. Particle Swarm Intelligence and Impact Factor-Based Privacy Preserving Association Rule Mining for Balancing Data Utility and Knowledge Privacy. Arabian Journal for Science and Engineering.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Potluri, A., Guguloth, R., Muppala, C. (2020). Emotion-Based Extraction, Classification and Prediction of the Audio Data. In: Raju, K., Govardhan, A., Rani, B., Sridevi, R., Murty, M. (eds) Proceedings of the Third International Conference on Computational Intelligence and Informatics . Advances in Intelligent Systems and Computing, vol 1090. Springer, Singapore. https://doi.org/10.1007/978-981-15-1480-7_26
Download citation
DOI: https://doi.org/10.1007/978-981-15-1480-7_26
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-15-1479-1
Online ISBN: 978-981-15-1480-7
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)