Skip to main content
SpringerLink
Log in

Application of Forearm FMG signals in Closed Loop Modality-matched Sensory Feedback Stimulation

  • Published:
Journal of Bionic Engineering Aims and scope Submit manuscript

Abstract

This study is aimed at exploring a technology that can use the human physiological information, such as Force Myography (FMG) signals to provide sensory feedback to prosthetic hand users. This is based on the principle that with the intent to move the prosthetic hand, the existing limbs in the arm recruit specific group of muscles. These muscles react with a change in the cross-sectional area; piezoelectric sensors placed on these muscles will generate a voltage (FMG signals), in response to the change in muscle volume. The correlation between the amplitude of the FMG signals and intensity of pressure on fingertips during grasping is then computed and a dynamic relation (model) is established through system identification in MATLAB. The estimated models generated a fitting accuracy of more than 80%. The model is then programmed into the Arduino microcontroller, so that a real-time and proportional force feedback is channeled to amputees through a micro actuator. Obtaining such percentages of accuracy in sensory feedback without relying on touch sensors on the prosthetic hand that could be affected by mechanical wear and other interaction factors is promising. Applying advanced signal processing and classification techniques may also refine the findings to better capture and correlate the force variations with the sensory feedback.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Ziegler-Graham K, MacKenzie E J, Ephraim P L, Travison T G, Brookmeyer R. Estimating the prevalence of limb loss in the United States: 2005 to 2050. Archives of Physical Medicine and Rehabilitation, 2008, 89, 422–429.

    Article  Google Scholar 

  2. Nghiem B T, Sando I C, Gillespie R B, McLaughlin B L, Gerling G J, Langhals N B, Urbanchek M G, Cederna P S. Providing a sense of touch to prosthetic hands. Plastic and Reconstructive Surgery, 2015, 135, 1652–1663.

    Article  Google Scholar 

  3. Cheesborough J E, Smith L H, Kuiken T A, Dumanian G A. Targeted muscle reinnervation and advanced prosthetic arms. Seminars in Plastic Surgery, 2015, 29, 062–072.

    Article  Google Scholar 

  4. Deng H, Luo H X, Wang R, Zhang Y. Grasping force planning and control for tendon-driven anthropomorphic prosthetic hands. Journal of Bionic Engineering, 2018, 15, 795–804.

    Article  Google Scholar 

  5. Antfolk C, D’Alonzo M, Rosén B, Lundborg G, Sebelius F, Cipriani C. Sensory feedback in upper limb prosthetics. Expert Review of Medical Devices, 2013, 10, 45–54.

    Article  Google Scholar 

  6. Schofield J S, Evans K R, Carey J P, Hebert J S. Applications of sensory feedback in motorized upper extremity prosthesis: A review. Expert Review of Medical Devices, 2014, 11, 499–511.

    Article  Google Scholar 

  7. Arana R C, Mena L, Montes H, Cajo R. Design of a gripping movement control system for a robotic hand prosthesis. Memorias de Congresos UTP, 2018, 413–419.

  8. Kuiken T A, Marasco P D, Lock B A, Harden R N, Dewald J P A. Redirection of cutaneous sensation from the hand to the chest skin of human amputees with targeted reinnervation. Proceedings of the National Academy of Sciences of the United States of America, 2007, 104, 20061–20066.

    Article  Google Scholar 

  9. Liu H, Yang D P, Jiang L, Fan S W. Development of a multi-DOF prosthetic hand with intrinsic actuation, intuitive control and sensory feedback. Industrial Robot, 2014, 41, 381–392.

    Article  Google Scholar 

  10. Rosén B, Ehrsson H H, Antfolk C, Cipriani C, Sebelius F, Lundborg G. Referral of sensation to an advanced humanoid robotic hand prosthesis. Scandinavian Journal of Plastic and Reconstructive Surgery and Hand Surgery, 2009, 43, 260–266.

    Article  Google Scholar 

  11. Newby B, Youngers N, Adhikari V, Yihun Y, Lankarani H. Design and control of an active palm roll joint for the human prosthetic hand. ASME International Design Engineering Technical Conferences and Computers and Information in Engineering Conference, Charlotte, North Carolina, USA, 2016, V003T11A013.

  12. Geethanjali P. Myoelectric control of prosthetic hands: State-of-the-art review. Medical Devices (Auckland, NZ), 2016, 9, 247–255.

    Google Scholar 

  13. Osborn L E, Iskarous M M, Thakor N V. Sensing and control for prosthetic hands in clinical and research applications. Wearable Robotics, 2020, 445–468.

  14. Downey J E, Brooks J, Bensmaia S J. Artificial sensory feedback for bionic hands. Intelligent Biomechatronics in Neurorehabilitation, 2020, 131–145.

  15. Chen A, Yao J, Kuiken T, Dewald J P. Cortical motor activity and reorganization following upper-limb amputation and subsequent targeted reinnervation. NeuroImage: Clinical, 2013, 3, 498–506.

    Article  Google Scholar 

  16. Bergmeister K D, Aman M, Muceli S, Vujaklija I, Manzano-Szalai K, Unger E, Byrne R A, Scheinecker C, Riedl O, Salminger S, Frommlet F, Borschel G H, Farina D, Aszmann O C. Peripheral nerve transfers change target muscle structure and function. Science Advances, 2019, 5, eaau2956.

    Article  Google Scholar 

  17. Hebert J S, Olson J L, Morhart M J, Dawson M R, Marasco P D, Kuiken T A, Chan K M. Novel targeted sensory reinnervation technique to restore functional hand sensation after transhumeral amputation. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 2013, 22, 765–773.

    Google Scholar 

  18. Hebert J S, Chan K M, Dawson M R. Cutaneous sensory outcomes from three transhumeral targeted reinnervation cases. Prosthetics and Orthotics International, 2016, 40, 303–310.

    Article  Google Scholar 

  19. Kuiken T. Targeted reinnervation for improved prosthetic function. Physical Medicine and Rehabilitation Clinics, 2006, 17, 1–13.

    Google Scholar 

  20. Kuiken T A, Miller L A, Lipschutz R D, Lock B A, Stubble field K, Marasco P D, Zhou P, Dumanian G A. Targeted reinnervation for enhanced prosthetic arm function in a woman with a proximal amputation: A case study. The Lancet, 2007, 369, 371–380.

    Article  Google Scholar 

  21. Kuiken T A, Miller L A, Lipschutz R D, Stubble field K A, Dumanian G A. Prosthetic command signals following targeted hyper-reinnervation nerve transfer surgery. 27th Annual Conference of the IEEE Engineering in Medicine and Biology, Shanghai, China, 2006, 7652–7655.

  22. Stephens-Fripp B, Alici G, Mutlu R. A review of noninvasive sensory feedback methods for transradial prosthetic hands. IEEE Access, 2018, 6, 6878–6899.

    Article  Google Scholar 

  23. Jiang X T, Merhi L K, Menon C. Force exertion affects grasp classification using force myography. IEEE Transactions on Human-Machine Systems, 2017, 48, 219–226.

    Article  Google Scholar 

  24. Prakash A, Sharma N, Sharma S. Novel force myography sensor to measure muscle contractions for controlling hand prostheses. Instrumentation Science & Technology, 2020, 48, 43–62.

    Article  Google Scholar 

  25. Desai J, Schabron B, Yihun Y. Force myography controlled intelligent assistive wheelchair-mounted robotic exoskeleton for arm movements. IEEE International Symposium on Measurement and Control in Robotics (ISMCR), Houston, TX, USA, 2019, D2–5.

  26. Ha N, Withanachchi G P, Yihun Y. Performance of forearm fmg for estimating hand gestures and prosthetic hand control. Journal of Bionic Engineering, 2019, 16, 88–98.

    Article  Google Scholar 

  27. Marasco P D, Hebert J S, Sensinger J W, Shell C E, Schofield J S, Thumser Z C, Nataraj R, Beckler D T, Dawson M R, Blustein D H, Gill S, Mensh B D, Granja-Vazquez R, Newcomb M D, Carey J P, Orzell B M. Illusory movement perception improves motor control for prosthetic hands. Science Translational Medicine, 2018, 10, eaao6990.

    Article  Google Scholar 

  28. Zhao J D, Xie Z W, Jiang L, Cai H G, Liu H, Hirzinger G. EMG control for a five-fingered underactuated prosthetic hand based on wavelet transform and sample entropy. IEEE/RSJ International Conference on Intelligent Robots and Systems, Beijing, China, 2006, 3215–3220.

  29. Joshi D, Atreya S, Arora A, Anand S. Trends in EMG based prosthetic hand development: A review. Indian Journal of Biomechanics, 2009, 228–232.

  30. Potluri C, Yihun Y, Kumar P, Molitor J, Chiu S C, Naidu D S, Mousavinezhad S H. sEMG based real-time embedded force control strategy for a prosthetic hand prototype. IEEE International Conference on Electro/Information Technology (EIT), Mankato, MN, USA, 2011, 1–6.

  31. Nishikawa D, Yu W, Yokoi H, Kakazu Y. On-line learning method for EMG prosthetic hand control. Electronics and Communications in Japan (Part III: Fundamental Electronic Science), 2001, 84, 35–46.

    Article  Google Scholar 

  32. Xiao Z G, Menon C. A review of force myography research and development. Sensors, 2019, 19, 4557.

    Article  Google Scholar 

  33. Haggstrom M. Medical gallery of mikael haggstrom 2014. Wikiversity Journal of Medicine, 2014, 1, 1.

    Google Scholar 

  34. Kawala-Janik A, Podpora M, Konieczny M. Innovative approach in signal processing of electromyography signals. Journal of Combat Sports & Martial Arts, 2014. 5, 101–112.

    Article  Google Scholar 

  35. Gray H, Carter H V. Gray’s Anatomy: A Facsimile. Grange Books, Rochester, UK, 1858.

    Google Scholar 

  36. Ha N, Withanachchi G P, Yihun Y. Force myography signal-based hand gesture classification for the implementation of real-time control system to a prosthetic hand. Design of Medical Devices Conference, Minneapolis, Minnesota, USA, 2018, DMD2018–6937.

  37. Gamier H, Mensler M. CONTSID — A continuous-time system identification toolbox for matlab®. European Control Conference (ECC), Karlsruhe, Germany, 1999, 3322–3327.

Download references

Author information

Authors and Affiliations

  1. Department of Mechanical Engineering, Wichita State University, Wichita, Kansas, 67260, USA

    Jing Wei Tan & Yimesker Yihun

Authors
  1. Jing Wei Tan
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yimesker Yihun
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Yimesker Yihun.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Tan, J.W., Yihun, Y. Application of Forearm FMG signals in Closed Loop Modality-matched Sensory Feedback Stimulation. J Bionic Eng 17, 899–908 (2020). https://doi.org/10.1007/s42235-020-0077-5

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s42235-020-0077-5

Keywords

Search

Navigation