Emotion-Based Extraction, Classification and Prediction of the Audio Data
- 18 Downloads
With the rapid penetration of the Internet across the globe and increased bandwidth, the rise of audio data is significant. In one of the recent surveys on the Internet, it is mentioned that video and audio streaming will gobble up more than 50% of the Internet traffic. Moreover, with the recent rise of voice assistants, the significance to the audio data, especially voice data is at the zenith. In this background, there is a need to analyze the audio data for gathering significant insights which will have larger implications in the domains of health, marketing and media. In this project, an open-source approach is proposed to analyze the audio data using the acoustic features like Mel frequency cepstral coefficients (MFCCs), unlike converting the audio to text and performing the analysis on the converted textual data. In this work, a convolutional neural network (CNN) model is developed to predict the emotions on the given audio data.
KeywordsPrediction MFCC Acoustic features Audio data Convolutional neural networks Emotions
- 1.Abdel-Hamid, Ossama, Abdel-rahman Mohamed, Hui Jiang, Li Deng, Gerald Penn, and Dong Yu. 2014. Convolutional Neural Networks for Speech Recognition. IEEE/ACM Transactions on Audio, Speech and Language Processing 22 (10).Google Scholar
- 2.Kaushik, Lakshmish, Abhijeet Sangwan, John H. L. Hansen. 2017. Automatic Sentiment Detection in Naturalistic Audio. IEEE/ACM Transactions on Audio, Speech, and Language Processing 25 (8).Google Scholar
- 3.Navya Sri, M., M. Ramakrishna Murty, et al. 2017. Robust Features for Emotion Recognition from Speech by using Gaussian Mixture Model Classification. In International Conference and Published Proceeding in SIST Series, Vol. 2, 437–444. Berlin: Springer.Google Scholar
- 4.Ezgi Küçükbay, Selver, Mustafa Sert. 2015. Audio-Based Event Detection in Office Live Environments Using Optimized MFCC-SVM Approach. In Proceedings of the 2015 IEEE 9th International Conference on Semantic Computing (IEEE ICSC 2015), 475–480.Google Scholar
- 6.Haq, S., and P.J.B. Jackson. 2010. Multimodal Emotion Recognition. In Machine Audition: Principles, Algorithms and Systems, ed. W. Wang, 398–423. Hershey: IGI Global Press. ISBN 978-1615209194. https://doi.org/10.4018/978-1-61520-919-4.
- 7.Sauter, Disa A., Frank Eisner, Paul Ekman, and Sophie K. Scott, Cross-Cultural Recognition of Basic Emotions Through Nonverbal Emotional Vocalizations. Proceedings of the National Academy of Sciences of the USA.Google Scholar
- 8.Van Rossum, G. 1995. Python Tutorial, Technical Report CS-R9526, Centrum voor Wiskunde en Informatica (CWI), Amsterdam.Google Scholar
- 11.Goodfellow, Ian, Derek Murray, and Vincent Vanhoucke. 2015. TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems. Google Research.Google Scholar
- 12.Keras Documentation—https://keras.io/.
- 13.Kalyani, G., M.V.P. Chandra Sekhara Rao. 2017. Particle Swarm Intelligence and Impact Factor-Based Privacy Preserving Association Rule Mining for Balancing Data Utility and Knowledge Privacy. Arabian Journal for Science and Engineering.Google Scholar