Skip to main content

Pose Estimation and Joint Angle Detection Using Mediapipe Machine Learning Solution

  • Conference paper
  • First Online:
Applied Artificial Intelligence: Medicine, Biology, Chemistry, Financial, Games, Engineering (AAI 2022)

Part of the book series: Lecture Notes in Networks and Systems ((LNNS,volume 659))

Included in the following conference series:

Abstract

Health is one of the central aspects of life and innovative ways for its improvement are constantly being studied. Artificial intelligence has an extensive application and its contribution to health and medicine is widely recognized. In this paper, the application of machine learning algorithms in the field of health care is presented. A model for physical activity injury prevention based on the MediaPipe solution for body pose tracking has been developed. The solutions for pose estimation and detection of joint angles and angles relative to the horizontal are integrated into a comprehensive system that detects all key body landmarks and angles during the movement of the observed person. In addition, one of the goals of this research is to develop a flexible system with the ability to process a variety of inputs in terms of video content and format. The system is trained and tested on video inputs and can process front, left, and right perspectives. In the processing phase, a graph of posture and angle estimation is generated. The graph represents detected joints and the corresponding angles that vary depending on the observed perspective. The input is integrated with the graph and thus provides valuable information about body posture and alignment. The results provide support to professionals in physical activity monitoring and injury prevention.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Vuori, I.: Does physical activity enhance health? Patient Educ. Couns. 33, S95–S103 (1998)

    Article  Google Scholar 

  2. Health Education Authority: Sports Council. Belmont Press, Allied Dunbar Fitness Survey. London (1992)

    Google Scholar 

  3. Schmidt, S.C., Tittlbach, S., Bös, K., Woll, A.: Different types of physical activity and fitness and health in adults: an 18-year longitudinal study. BioMed Res. Int. (2017)

    Google Scholar 

  4. Mendonça, L.D., Ley, C., Schuermans, J., Wezenbeek, E., Witvrouw, E.: How injury prevention programs are being structured and implemented worldwide: an international survey of sports physical therapists. Phys. Ther. Sport 53, 143–150 (2022)

    Article  Google Scholar 

  5. Mitrović, K., Milošević, D.: Classification of malaria-infected cells using convolutional neural networks. In: 15th International Symposium on Applied Computational Intelligence and Informatics (SACI), pp. 323–328. IEEE (2021)

    Google Scholar 

  6. Narayanan, B.N., Ali, R., Hardie, R.C.: Performance analysis of machine learning and deep learning architectures for malaria detection on cell images. Appl. Mach. Learn. SPIE 11139, 240–247 (2019)

    Google Scholar 

  7. Agarwal, S., et al.: FitMe: a fitness application for accurate pose estimation using deep learning. In: 2nd International Conference on Secure Cyber Computing and Communications, pp. 232–237. IEEE (2021)

    Google Scholar 

  8. Chen, S., Yang, R.R.: Pose trainer: correcting exercise posture using pose estimation. ArXiv preprint arXiv:2006.11718 (2020)

  9. Zou, J., et al.: Intelligent fitness trainer system based on human pose estimation. In: Sun, S., Fu, M., Xu, L. (eds.) Signal and Information Processing, Networking and Computers. ICSINC 2018. Lecture Notes in Electrical Engineering, vol. 550, pp. 593–599. Springer, Singapore (2019). https://doi.org/10.1007/978-981-13-7123-3_69

  10. Jeon, H., Yoon, Y., Kim, D.: Lightweight 2D human pose estimation for fitness coaching system. In: 36th International Technical Conference on Circuits/Systems, Computers and Communications, pp. 1–4. IEEE (2021)

    Google Scholar 

  11. Eivindsen, J.E., Kristensen, B.Y.: Human Pose Estimation Assisted Fitness Technique Evaluation System, Master's thesis, NTNU (2020)

    Google Scholar 

  12. Sivakumar, S., Gopalai, A.A., Lim, K.H., Gouwanda, D., Chauhan, S.: Joint angle estimation with wavelet neural networks. Sci. Rep. 11(1), 1–15 (2021)

    Article  Google Scholar 

  13. Mundt, M., Johnson, W.R., Potthast, W., Markert, B., Mian, A., Alderson, J.: A comparison of three neural network approaches for estimating joint angles and moments from inertial measurement units. Sensors 21(13), 4535 (2021)

    Article  Google Scholar 

  14. Koch, P., et al.: sEMG-based hand movement regression by prediction of joint angles with recurrent neural networks. In: 43rd Annual International Conference of the IEEE Engineering in Medicine & Biology Society, pp. 6519–6523 (2021)

    Google Scholar 

  15. Mitrović, K., Milošević, D.: Flower classification with convolutional neural networks. In: 23rd International Conference on System Theory, Control and Computing (ICSTCC), pp. 845–850 (2019)

    Google Scholar 

  16. MediaPipe Pose. https://google.github.io/mediapipe/. Accessed 23 July 2022

  17. On-device, Real-time Body Pose Tracking with MediaPipe BlazePose. https://ai.googleblog.com/2020/08/on-device-real-time-body-pose-tracking.html. Accessed 23 July 2022

Download references

Acknowledgments

This study was supported by the Ministry of Education, Science and Technological Development of the Republic of Serbia, and these results are parts of the Grant No. 451–03-68/2022–14/200132 with University of Kragujevac - Faculty of Technical Sciences Čačak.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Katarina Mitrović .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Mitrović, K., Milošević, D. (2023). Pose Estimation and Joint Angle Detection Using Mediapipe Machine Learning Solution. In: Filipovic, N. (eds) Applied Artificial Intelligence: Medicine, Biology, Chemistry, Financial, Games, Engineering. AAI 2022. Lecture Notes in Networks and Systems, vol 659. Springer, Cham. https://doi.org/10.1007/978-3-031-29717-5_8

Download citation

Publish with us

Policies and ethics