Abstract
Human pose estimation is the process of continuously monitoring a person’s action and movement to track and monitor the activity of a person or an object. Human pose estimation is usually done by capturing the key points which describe the pose of a person. A guiding practicing framework that enables people to learn and exercise activities like yoga, fitness, dancing, etc., might be built using human posture recognition remotely and accurately without the help of a personal trainer. This work has proposed a framework to detect and recognize various yoga and exercise poses to help the individual practice the same correctly. A popular Blaze-pose model extracts key points from the student end and compares the same with the instructor pose. The extracted key points are fed to the Human Pose Juxtaposition model (HPJT) to compare the student pose with the instructor. The model will assess the correctness of the pose by comparing the extracted key points and give feedback to students if any corrections need to be made. The proposed model is trained with 40+ yoga and exercise poses, and evaluated the model’s performance with the mAP, and the model achieved an accuracy of 99.04%. The results proved that any person could use the proposed framework in real-time to practice exercise, yoga, dance, etc. At their respective location without the help of a physical instructor with precision and accuracy, leading to a healthy life.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Bazarevsky, V., Grishchenko, I., Raveendran, K., Zhu, T., Zhang, F., Grundmann, M.: BlazePose: on-device real-time body pose tracking. arXiv preprint arXiv:2006.10204 (2020)
Chen, Y., Tian, Y., He, M.: Monocular human pose estimation: a survey of deep learning-based methods. Comput. Vis. Image Underst. 192, 102897 (2020)
Chong Loo, K.B.K., et al.: Detection of violent behavior in open environments using pose estimation and neural networks (2020)
Erol, A., Bebis, G., Nicolescu, M., Boyle, R.D., Twombly, X.: Vision-based hand pose estimation: a review. Comput. Vis. Image Underst. 108(1–2), 52–73 (2007)
Kasman, K., Moshnyaga, V.G.: New technique for posture identification in smart prayer mat. Electronics 6(3), 61 (2017)
Koolstra, J.H.: Dynamics of the human masticatory system. Crit. Rev. Oral Biol. Med. 13(4), 366–376 (2002)
Koprinska, I., Carrato, S.: Temporal video segmentation: a survey. Signal Process.: Image Commun. 16(5), 477–500 (2001)
LaViola Jr., J.J., Feliz, D.A., Keefe, D.F., Zeleznik, R.C.: Hands-free multi-scale navigation in virtual environments. In: Proceedings of the 2001 Symposium on Interactive 3D Graphics, pp. 9–15 (2001)
Liu, Z., Zhu, J., Bu, J., Chen, C.: A survey of human pose estimation: the body parts parsing based methods. J. Vis. Commun. Image Represent. 32, 10–19 (2015)
Mikolov, T., Karafiát, M., Burget, L., Cernockỳ, J., Khudanpur, S.: Recurrent neural network based language model. In: Interspeech, vol. 2, pp. 1045–1048. Makuhari (2010)
Muhammad Sayem, A.S., Hon Teay, S., Shahariar, H., Luise Fink, P., Albarbar, A.: Review on smart electro-clothing systems (SeCSs). Sensors 20(3), 587 (2020)
Osokin, D.: Real-time 2D multi-person pose estimation on CPU: lightweight openpose. arXiv preprint arXiv:1811.12004 (2018)
Rafi, U., Leibe, B., Gall, J., Kostrikov, I.: An efficient convolutional network for human pose estimation. In: BMVC, vol. 1, p. 2 (2016)
Sawant, C.: Human activity recognition with OpenPose and long short-term memory on real time images. EasyChair Preprint (2297) (2020)
Smisek, J., Jancosek, M., Pajdla, T.: 3D with kinect. In: Fossati, A., Gall, J., Grabner, H., Ren, X., Konolige, K. (eds.) Consumer Depth Cameras for Computer Vision. Advances in Computer Vision and Pattern Recognition, pp. 3–25. Springer, London (2013). https://doi.org/10.1007/978-1-4471-4640-7_1
Staudemeyer, R.C., Morris, E.R.: Understanding LSTM–a tutorial into long short-term memory recurrent neural networks. arXiv preprint arXiv:1909.09586 (2019)
Takahashi, K., Sakaguchi, T., Ohya, J.: Remarks on a real-time 3D human body posture estimation method using trinocular images. In: Proceedings 15th International Conference on Pattern Recognition. ICPR-2000, vol. 4, pp. 693–697. IEEE (2000)
Tawar, R., Jagtap, S., Hirve, D., Gundgal, T., Kale, N.: Real-time yoga pose detection
Xu, T., Zhou, Y., Zhu, J.: New advances and challenges of fall detection systems: a survey. Appl. Sci. 8(3), 418 (2018)
Yoshida, K., Murao, K.: Load position estimation method for wearable devices based on difference in pulse wave arrival time. Sensors 22(3), 1090 (2022)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Ethics declarations
Disclosure of Interests.
The authors have no competing interests to declare that are relevant to the content of this article.
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Ashraf, T., Balaji Prabu, B.V., Jois Narasipura, O.S. (2024). PoseWatch: Advancing Real Time Human Pose Tracking and Juxtaposition with Deep Learning. In: Kaur, H., Jakhetiya, V., Goyal, P., Khanna, P., Raman, B., Kumar, S. (eds) Computer Vision and Image Processing. CVIP 2023. Communications in Computer and Information Science, vol 2009. Springer, Cham. https://doi.org/10.1007/978-3-031-58181-6_2
Download citation
DOI: https://doi.org/10.1007/978-3-031-58181-6_2
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-58180-9
Online ISBN: 978-3-031-58181-6
eBook Packages: Computer ScienceComputer Science (R0)