Skip to main content
SpringerLink
Log in

Performance of Forearm FMG for Estimating Hand Gestures and Prosthetic Hand Control

  • Published:
Journal of Bionic Engineering Aims and scope Submit manuscript

Abstract

This study is aimed at exploring the prediction of the various hand gestures based on Force Myography (FMG) signals generated through piezoelectric sensors banded around the forearm. In the study, the muscles extension and contraction during specific movements were mapped, interpreted, and a control algorithm has been established to allow predefined grips and individual finger movements. Decision Tree Learning (DTL) and Support Vector Machine (SVM) have been used for classification and model recognition. Both of these estimated models generated an averaged accuracy of more than 80.0%, for predicting grasping, pinching, left flexion, and wrist rotation. As the classification showed a distinct feature in the signal, a real-time control system based on the threshold value has been implemented in a prosthetic hand. The hand motion has also been recorded through Virtual Motion Glove (VMD) to establish dynamic relationship between the FMG data and the different hand gestures. The classification of the hand gestures based on FMG signal will provide a useful foundation for future research in the interfacing and utilization of medical devices.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. De Laurentis K J, Mavroidis C. Mechanical design of a shape memory alloy actuated prosthetic hand. Technology and Health Care, 2002, 10, 91.106.

    Google Scholar 

  2. Engeberg E D, Meek S G. Adaptive sliding mode control for prosthetic hands to simultaneously prevent slip and minimize deformation of grasped objects. IEEE/ASME Transactions on Mechatronics, 2013, 18, 376–385.

    Article  Google Scholar 

  3. Collinger J L, Wodlinger B, Downey J E, Wang W, Tyler-Kabara E C, Weber D J, McMorland A J, Velliste M, Boninger M L, Schwartz A B. High-performance neuroprosthetic control by an individual with tetraplegia. The Lancet, 2013, 381, 557–564.

    Article  Google Scholar 

  4. Engeberg E D. A physiological basis for control of a prosthetic hand. Biomedical Signal Processing and Control, 2013, 8, 6–15.

    Article  Google Scholar 

  5. Cipriani C, Segil J L, Birdwell J A, Weir R F F. Dexterous control of a prosthetic hand using fine-wire intramuscular electrodes in targeted extrinsic muscles. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 2014, 22, 828–836.

    Article  Google Scholar 

  6. Pistohl T, Cipriani C, Jackson A, Nazarpour K. Abstract and proportional myoelectric control for multi-fingered hand prostheses. Annals of Biomedical Engineering, 2013, 41, 2687–2698.

    Article  Google Scholar 

  7. Dalley S, Wiste T E, Withrow T J, Goldfarb M, et al. Design of a multifunctional anthropomorphic prosthetic hand with extrinsic actuation. Mechatronics, IEEE/ASME Transactions on, 2009, 14, 699–706.

    Article  Google Scholar 

  8. Belter J T, Segil J L, Dollar A M, Weir R F. Mechanical design and performance specifications of anthropomorphic prosthetic hands: A review. Journal of Rehabilitation Research Development, 2013, 50, 599–618.

    Article  Google Scholar 

  9. Chandrasekhar P, Anugolu M, Yihun Y, Jensen A, Chiu S, Schoen M P, Naidu D S. Optimal tracking of a sEMG based force model for a prosthetic hand. Annual International Conference of the IEEE Engineering in Medicine and Biology Society, Boston, MA, USA, 2011, 1604–1607.

  10. Potluri C, Anugolu M, Chiu S, Naidu D S, Schoen M P. A sEMG-based real-time adaptive joint angle estimation and control for a prosthetic hand prototype. Proceedings of WSEAS International Conference on Advances in Systems Theory, Signal Processing and Computational Science, Istanbul, Turkey, 2012, 124–129.

  11. Potluri C, Yihun Y, Kumar P, Molitor J, Chiu S C, Naidu D S, Mousavinezhad S H. sEMG based real-time embedded force control strategy for a prosthetic hand prototype. IEEE International Conference on Electro/Information Technology, Mankato, MN, USA, 2011, 1–6.

  12. Andrianesis K, Tzes A. Design of an innovative prosthetic hand with compact shape memory alloy actuators. 21st Mediterranean Conference on Control & Automation, Chania, Greece, 2013, 697–702.

  13. Fite K B, Withrow T J, Shen X, Wait K W, Mitchell J E, Goldfarb M. A gas-actuated anthropomorphic prosthesis for transhumeral amputees. IEEE Transactions on Robotics, 2008, 24, 159–169.

    Article  Google Scholar 

  14. Schulz S, Pylatiuk C, Reischl M, Martin J, Mikut R, Bretthauer G. A hydraulically driven multifunctional prosthetic hand. Robotica, 2005, 23, 293–299.

    Article  Google Scholar 

  15. Massa B, Roccella S, Carrozza M C, Dario P. Design and development of an underactuated prosthetic hand. In Robotics and Automation. Proceedings IEEE International Conference on Robotics and Automation, 2002, Washington, DC, USA, 3374–3379.

    Google Scholar 

  16. Pfeiffer C, DeLaurentis K, Mavroidis C. Shape memory alloy actuated robot prostheses: Initial experiments. Proceedings IEEE International Conference on Robotics and Automation, 1999, 3, 2385–2391.

    Article  Google Scholar 

  17. Ceccarelli M. Finger mechanisms for robotic hands. In Recent Advances in Mechanism Design for Robotics, Bai S and Ceccarelli M eds, Springer International Publishing Switzerland, Cham, Switzerland, 2015, 3–13.

  18. Ceccarelli M. Kinematic design problems for low-cost easy-operation humanoid robots. In Interdisciplinary Applications of Kinematics, Kecskeméthy A, Geu Flores F (eds), Springer International Publishing Switzerland, Cham, Switzerland, 2015, 91–99.

  19. Lin L R, Huang H P. Mechanism design of a new multi-fingered robot hand. Proceedings of IEEE International Conference on Robotics and Automation, 1996, 2, 1471–1476.

    Article  Google Scholar 

  20. Yu W, Chattopadhyay S, Lim T C, Acharya U R. Advances in Therapeutic Engineering, CRC Press, Boca Raton, USA, 2012.

    Book  Google Scholar 

  21. Cordella F, Ciancio A L, Sacchetti R, Davalli A, Cutti A G, Guglielmelli E, Zollo L. Literature review on needs of upper limb prosthesis users. Frontiers in Neuroscience, 2016, 10, 209.

  22. Connan M, Ruiz Ramirez E, Vodermayer B, Castellini C. Assessment of a wearable force-and electromyography device and comparison of the related signals for myocontrol. Frontiers in Neurorobotics, 2016, 10, 17.

    Article  Google Scholar 

  23. Cho E, Chen R, Merhi L K, Xiao Z, Pousett B, Menon C. Force myography to control robotic upper extremity prostheses: A feasibility study. Frontiers in Bioengineering and Biotechnology, 2016, 4, 18.

    Article  Google Scholar 

  24. Ha N, Withanachchi G P, Yihun Y. Force myography signal-based hand gesture classification for the implementation of real-time control system to a prosthetic hand. Design of Medical Devices Conference, Minneapolis, Minnesota, USA, 2018, DMD2018-6937.

    Book  Google Scholar 

  25. Radmand A, Scheme E, Englehart K. High-density force myography: A possible alternative for upper-limb prosthetic control. Journal of Rehabilitation Research & Development, 2016, 53, 443–456.

    Article  Google Scholar 

  26. Kadkhodayan A, Jiang X, Menon C. Continuous prediction of finger movements using force myography. Journal of Medical and Biological Engineering, 2016, 36, 594–604.

    Article  Google Scholar 

  27. Xiao Z G, Menon C. Performance of forearm FMG and sEMG for estimating elbow, forearm and wrist positions. Journal of Bionic Engineering, 2017, 14, 284–295.

    Article  Google Scholar 

  28. Nissler C, Mouriki N, Castellini C. Optical myography: Detecting finger movements by looking at the forearm. Frontiers in Neurorobotics, 2016, 10, 3.

    Article  Google Scholar 

  29. Jiang X, Merhi L K, Xiao Z G, Menon C. Exploration of force myography and surface electromyography in hand gesture classification. Medical Engineering & Physics, 2017, 41, 63–73.

    Article  Google Scholar 

  30. Tatu L, Parratte B. Functional anatomy of the muscle. In Muscle Injuries in Sport Athletes, Roger B, Guermazi A, Skaf A (eds), Springer, Cham, Switzerland, 2017, 19–44.

  31. Bluetooth VMG 30TM data glove. [2018-09-30], https://www.vrealities.com/products/data-gloves/vmg30.

  32. Zecca M, Micera S, Carrozza M C, Dario P. Control of multifunctional prosthetic hands by processing the electromyographic signal. Critical ReviewsTM in Biomedical Engineering, 2002, 30, 459–485.

    Article  Google Scholar 

  33. Tang J, Alelyani S, Liu H. Feature selection for classification: A review. In Data Classification: Algorithms and applications, Aggarwal C C ed, CRC Press, Boca Raton, USA, 2014, 37.

  34. Haykin S. Neural Networks: A Comprehensive Foundation, Prentice-Hall PTR Upper Saddle River, NJ, USA, 1994.

    MATH  Google Scholar 

  35. Tascillo A, Bourbakis N. Neural and fuzzy robotic hand control. IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics), 1999, 29, 636–642.

    Article  Google Scholar 

  36. Cortes C, Vapnik V. Support-vector networks. Machine Learning, 1995, 20, 273–297.

    MATH  Google Scholar 

  37. Kotsiantis S B. Supervised machine learning: A review of classification techniques. Informatica, 2007, 31, 249.

    MathSciNet  MATH  Google Scholar 

  38. Quinlan J R. Learning decision tree classifiers. ACM Computing Surveys (CSUR), 1996, 28, 71–72.

    Article  Google Scholar 

  39. Dietterich T G. Ensemble methods in machine learning, in Multiple Classifier Systems, Springer, Berlin, Heidelberg, Germany, 2000, 1–15.

  40. Nazmi N, Abdul Rahman M A, Yamamoto S I, Ahmad S A, Zamzuri H, Mazlan S A. A review of classification techniques of EMG signals during isotonic and isometric contractions. Sensors, 2016, 16, 1304.

    Article  Google Scholar 

  41. Matsubara T, Morimoto J. Bilinear modeling of EMG signals to extract user-independent features for multiuser myoelectric interface. IEEE Transactions on Biomedical Engineering, 2013, 60, 2205–2213.

    Article  Google Scholar 

  42. Subasi A. Classification of EMG signals using PSO optimized SVM for diagnosis of neuromuscular disorders. Computers in Biology and Medicine, 2013, 43, 576–586.

    Article  Google Scholar 

  43. Newby B, Youngers N, Adhikari V, Yihun Y, Lankarani H. Design and control of an active palm roll joint for the human prosthetic hand. ASME International Design Engineering Technical Conferences and Computers and Information in Engineering Conference, Charlotte, North Carolina, USA, 2016, DETC2016-60237.

    Book  Google Scholar 

  44. Yang D P, Zhao J D, Gu Y K, Wang X Q, Li N, Jiang L, Liu H, Huang H, Zhao D W. An anthropomorphic robot hand developed based on underactuated mechanism and controlled by EMG signals. Journal of Bionic Engineering, 2009, 6, 255–263.

    Article  Google Scholar 

  45. Wang N, Lao K, Zhang X. Design and myoelectric control of an anthropomorphic prosthetic hand. Journal of Bionic Engineering, 2017, 14, 47–59.

    Article  Google Scholar 

  46. Shi W T, Lyu Z J, Tang S T, Chia T L, Yang C Y. A bionic hand controlled by hand gesture recognition based on surface EMG signals: A preliminary study. Biocybernetics and Biomedical Engineering, 2018, 38, 126–135.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Mechanical Engineering, Wichita State University, Washington, USA

    Nguon Ha & Yimesker Yihun

  2. Department of Electrical Engineering, Wichita State University, Washington, USA

    Gaminda Pankaja Withanachchi

Authors
  1. Nguon Ha
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Gaminda Pankaja Withanachchi
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Yimesker Yihun
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Yimesker Yihun.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Ha, N., Withanachchi, G.P. & Yihun, Y. Performance of Forearm FMG for Estimating Hand Gestures and Prosthetic Hand Control. J Bionic Eng 16, 88–98 (2019). https://doi.org/10.1007/s42235-019-0009-4

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s42235-019-0009-4

Keywords

Search

Navigation