Abstract
Recently, increasing attention in the field of gesture recognition, has become a key strategy in analyzing the emotional states of human body movements for social communication. Most real-life scenarios include identifying emotions from facial expressions, vocal synthesis, hand recognition and body gestures. The body posture powerfully conveys the micro emotions of a person in depth. The prediction of human - gait is significantly harder, because the pattern of the human pose estimation has additional degrees of self-determination than the facial emotions, and the overall shape varies robustly during the articulated motion. In this paper, we propose a novel method to recognize 17 different micro emotions from GEMEP dataset based on human upper body gestures dynamics features extracted from the abstract representations of patterns from videos. In the experimental results, KNN exhibit the proposed architecture’s effectiveness with an accuracy rate of 97.1% for the GEMEP dataset, 95.2% for SVM, 51.6% for Decision Tree and 49.7% Naive Bayes, respectively.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Ko, B.C.: A brief review of facial emotion recognition based on visual information. Sensors 18(2), 401 (2018)
Baltrušaitis, T., et al.: Real-time inference of mental states from facial expressions and upper body gestures. In: Face and Gesture 2011, pp. 909–914. IEEE (2011)
Arunnehru, J., Chamundeeswari, G., Prasanna Bharathi, S.: Human action recognition using 3D convolutional neural networks with 3d motion cuboids in surveillance videos. Procedia Comput. Sci. 133, 471–477 (2018)
Michael Revina, I., Sam Emmanuel, W.R.: A survey on human face expression recognition techniques. J. King Saud Univ.-Comput. Inf. Sci. 33(6), 619–628 (2021)
Minaee, S., Bouazizi, I., Kolan, P., Najafzadeh, H.: Ad-Net: audio-visual convolutional neural network for advertisement detection in videos. arXiv preprint arXiv:1806.08612 (2018)
Elfaramawy, N., Barros, P., Parisi, G.I., Wermter, S.: Emotion recognition from body expressions with a neural network architecture. In: Proceedings of the 5th International Conference on Human Agent Interaction, pp. 143–149 (2017)
Oommen, D.K., Arunnehru, J.: A comprehensive study on early detection of Alzheimer disease using convolutional neural network. In: AIP Conference Proceedings, vol. 2385, pp. 050012. AIP Publishing LLC (2022)
Arunnehru, J., Kalaiselvi Geetha, M.: Behavior recognition in surveillance video using temporal features. In: 2013 Fourth International Conference on Computing, Communications and Networking Technologies (ICCCNT), pp. 1–5. IEEE (2013)
Bhargavi, G., Vaijayanthi, S., Arunnehru, J., Reddy, P.R.D.: A survey on recent deep learning architectures. In: Manoharan, K.G., Nehru, J.A., Balasubramanian, S. (eds.) Artificial Intelligence and IoT. SBD, vol. 85, pp. 85–103. Springer, Singapore (2021). https://doi.org/10.1007/978-981-33-6400-4_5
Arunnehru, J., Geetha, M.K.: Motion intensity code for action recognition in video using PCA and SVM. In: Prasath, R., Kathirvalavakumar, T. (eds.) MIKE 2013. LNCS (LNAI), vol. 8284, pp. 70–81. Springer, Cham (2013). https://doi.org/10.1007/978-3-319-03844-5_8
Santhoshkumar, R., Kalaiselvi Geetha, M., Arunnehru, J.: Activity based human emotion recognition in video. Int. J. Pure Appl. Math. 117(15), 1185–1194 (2017)
Arunnehru, J., Kalaiselvi Geetha, M.: Automatic human emotion recognition in surveillance video. In: Dey, N., Santhi, V. (eds.) Intelligent Techniques in Signal Processing for Multimedia Security. SCI, vol. 660, pp. 321–342. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-44790-2_15
Holden, D., Saito, J., Komura, T.: A deep learning framework for character motion synthesis and editing. ACM Trans. Graph. (TOG) 35(4), 1–11 (2016)
Krizhevsky, A., Sutskever, I., Hinton, G.E.: ImageNet classification with deep convolutional neural networks. In: Advances in Neural Information Processing Systems, 25 (2012)
Arunnehru, J., Kalaiselvi Geetha, M.: Difference intensity distance group pattern for recognizing actions in video using support vector machines. Pattern Recogn. Image Anal. 26(4), 688–696 (2016)
Noroozi, F., Corneanu, C.A., Kamińska, D., Sapiński, T., Escalera, S., Anbarjafari, G.: Survey on emotional body gesture recognition. IEEE Trans. Affect. Comput. 12(2), 505–523 (2018)
Khorrami, P., Paine, T.L., Brady, K., Dagli, C., Huang, T.S.: How deep neural networks can improve emotion recognition on video data. In: 2016 IEEE International Conference on Image Processing (ICIP), pp. 619–623. IEEE (2016)
Santhoshkumar, R., Kalaiselvi Geetha, M.: Human emotion recognition in static action sequences based on tree based classifiers
Bashirov, R., et al.: Real-time RGBD-based extended body pose estimation. In: Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, pp. 2807–2816 (2021)
Arunnehru, J., Nandhana Davi, A.K., Sharan, R.R., Nambiar, P.G.: Human pose estimation and activity classification using machine learning approach. In: Reddy, V.S., Prasad, V.K., Wang, J., Reddy, K.T.V. (eds.) ICSCSP 2019. AISC, vol. 1118, pp. 113–123. Springer, Singapore (2020). https://doi.org/10.1007/978-981-15-2475-2_11
Vaijayanthi, S., Arunnehru, J.: Synthesis approach for emotion recognition from cepstral and pitch coefficients using machine learning. In: Bindhu, V., Tavares, J.M.R.S., Boulogeorgos, A.-A.A., Vuppalapati, C. (eds.) International Conference on Communication, Computing and Electronics Systems. LNEE, vol. 733, pp. 515–528. Springer, Singapore (2021). https://doi.org/10.1007/978-981-33-4909-4_39
Bänziger, T., Scherer, K.R.: Using actor portrayals to systematically study multimodal emotion expression: the GEMEP corpus. In: Paiva, A.C.R., Prada, R., Picard, R.W. (eds.) ACII 2007. LNCS, vol. 4738, pp. 476–487. Springer, Heidelberg (2007). https://doi.org/10.1007/978-3-540-74889-2_42
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Vaijayanthi, S., Arunnehru, J. (2022). Human Emotion Recognition from Body Posture with Machine Learning Techniques. In: Singh, M., Tyagi, V., Gupta, P.K., Flusser, J., Ören, T. (eds) Advances in Computing and Data Sciences. ICACDS 2022. Communications in Computer and Information Science, vol 1613. Springer, Cham. https://doi.org/10.1007/978-3-031-12638-3_20
Download citation
DOI: https://doi.org/10.1007/978-3-031-12638-3_20
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-12637-6
Online ISBN: 978-3-031-12638-3
eBook Packages: Computer ScienceComputer Science (R0)