Skip to main content

Using Microsoft Kinect V2 for Custom Upper-Limb Rehabilitation Exercises

  • Conference paper
  • First Online:
Proceedings of the 12th International Conference on Soft Computing and Pattern Recognition (SoCPaR 2020) (SoCPaR 2020)

Abstract

Motor disability due to stroke, accident, or other illnesses in many cases can be partially or fully recovered with guided and/or prescribed physiotherapy. Moreover, due to the nature of the problem, in most of the case, the treatment is needed to be continued for years. Thus, one of the main challenges in this is the availability of an expert physiotherapist to guide the treatment. Most of the time, after initial guided physiotherapy sessions, patients are prescribed exercises to practice at home by themselves. Patients may be able to perform the task at home; however, the expert is present during home sessions, hence, no performance assessment. In this paper, we present a prototype system to resolve this problem using 3D sensor technology: Microsoft Kinect v2. An expert can record an exercise by performing it in front of the 3D camera and provide the prescription (how many times and when the exercise should be performed) on the system. At home, the patient performs the exercise in front of our Kinect-powered system which guides the patient through visual cues on the monitor. In this initial study, five occupational arthritis exercises on the right arm were recorded. We matched these exercises with 15 healthy volunteers (10 male, 5 female) standing 1.5 ms from the system. To overcome different body shapes, we used geometric coordinates from recorded frames and recreated the visual cues. Our system matched the exercises with uncertainty of 10px (2% of depth resolution) and volunteers adapted to screen instructions with minimum supervision.

Supported by a grant from the ICT Division of the People’s Republic of Bangladesh Government.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Adams, R.J., Lichter, M.D., Krepkovich, E.T., Ellington, A., White, M., Diamond, P.T.: Assessing upper extremity motor function in practice of virtual activities of daily living. IEEE Trans. Neural Syst. Rehabil. Eng. 23(2), 287–296 (2015). https://doi.org/10.1109/tnsre.2014.2360149

    Article  Google Scholar 

  2. Chang, Y.J., Chen, S.F., Huang, J.D.: A kinect-based system for physical rehabilitation: a pilot study for young adults with motor disabilities. Res. Dev. Disabil. 32(6), 2566–2570 (2011). https://doi.org/10.1016/j.ridd.2011.07.002

    Article  Google Scholar 

  3. Chowdhury, R., Hasan, A., Rahman, Y., Khan, S., Hussain, A., Ahsan, S.: Pattern of neurological disease seen among patients admitted in tertiary care hospital. BMC. Res. Notes 7(1), 202 (2014). https://doi.org/10.1186/1756-0500-7-202

    Article  Google Scholar 

  4. Demers, M., Kong, D.C.C., Levin, M.F.: Acceptability of using a kinect-based virtual reality intervention to remediate arm motor impairments in subacute stroke. In: 2017 International Conference on Virtual Rehabilitation (ICVR). IEEE (2017). https://doi.org/10.1109/icvr.2017.8007496

  5. Joreg: Kinect documentation. https://vvvv.org/documentation/kinect (2017). Accessed 03 Nov 2018

  6. Lai, C.L., Huang, Y.L., Liao, T.K., Tseng, C.M., Chen, Y.F., Erdenetsogt, D.: A microsoft kinect-based virtual rehabilitation system to train balance ability for stroke patients. In: 2015 International Conference on Cyberworlds (CW). IEEE (2015). https://doi.org/10.1109/cw.2015.44

  7. Lee, S., Lee, Y.S., Kim, J.: Automated evaluation of upper-limb motor function impairment using Fugl-Meyer assessment. IEEE Trans. Neural Syst. Rehabil. Eng. 26(1), 125–134 (2018). https://doi.org/10.1109/tnsre.2017.2755667

    Article  Google Scholar 

  8. Lin, S., Mann, J., Mansfield, A., Wang, R.H., Harris, J.E., Taati, B.: Investigating the feasibility and acceptability of real-time visual feedback in reducing compensatory motions during self-administered stroke rehabilitation exercises: a pilot study with chronic stroke survivors. J. Rehabil. Assist. Technol. Eng. 6, 205566831983163 (2019). https://doi.org/10.1177/2055668319831631

    Article  Google Scholar 

  9. Moldovan, I.M., Tric, L., Ursu, R., Podar, A., Calin, A.D., Cantea, A.C., Dascalu, L.A., Mihaiu, C.A.: Virtual rehabilitation programme using the MIRA platform, kinect and leap motion sensors in an 81 years old patient with ischemic stroke. In: 2017 E-Health and Bioengineering Conference (EHB). IEEE (2017). https://doi.org/10.1109/ehb.2017.7995427

  10. Nisabel: Occupational therapy fieldwork toolki. http://speakingofot.blogspot.com/2012/04/toolkit-of-all-toolkits.html (2012). Accessed 03 Nov 2018

  11. Sanford, J., Moreland, J., Swanson, L.R., Stratford, P.W., Gowland, C.: Reliability of the Fugl-Meyer assessment for testing motor performance in patients following stroke. Phys. Therapy 73(7), 447–454 (1993). https://doi.org/10.1093/ptj/73.7.447

    Article  Google Scholar 

  12. Urmi, U.K.: Barriers of stroke patients during receiving treatment at CRP. http://dspace.crp-bangladesh.org:8080/xmlui/handle/123456789/322 (2017). Accessed 03 Nov 2018

Download references

Acknowledgement

We thank all the 15 volunteers who donated their time for this study. This work is part of the Human Activity Recognition project for partially disabled patients seeking rehabilitation. It is supported by a grant from the ICT Division of the People’s Republic of Bangladesh Government.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to M. Ashraful Amin .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2021 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Rabbani, S.B., Ali, A.A., Amin, M.A. (2021). Using Microsoft Kinect V2 for Custom Upper-Limb Rehabilitation Exercises. In: Abraham, A., et al. Proceedings of the 12th International Conference on Soft Computing and Pattern Recognition (SoCPaR 2020). SoCPaR 2020. Advances in Intelligent Systems and Computing, vol 1383. Springer, Cham. https://doi.org/10.1007/978-3-030-73689-7_49

Download citation

Publish with us

Policies and ethics