Advertisement

Journal of Bionic Engineering

, Volume 16, Issue 1, pp 88–98 | Cite as

Performance of Forearm FMG for Estimating Hand Gestures and Prosthetic Hand Control

  • Nguon Ha
  • Gaminda Pankaja Withanachchi
  • Yimesker YihunEmail author
Article
  • 11 Downloads

Abstract

This study is aimed at exploring the prediction of the various hand gestures based on Force Myography (FMG) signals generated through piezoelectric sensors banded around the forearm. In the study, the muscles extension and contraction during specific movements were mapped, interpreted, and a control algorithm has been established to allow predefined grips and individual finger movements. Decision Tree Learning (DTL) and Support Vector Machine (SVM) have been used for classification and model recognition. Both of these estimated models generated an averaged accuracy of more than 80.0%, for predicting grasping, pinching, left flexion, and wrist rotation. As the classification showed a distinct feature in the signal, a real-time control system based on the threshold value has been implemented in a prosthetic hand. The hand motion has also been recorded through Virtual Motion Glove (VMD) to establish dynamic relationship between the FMG data and the different hand gestures. The classification of the hand gestures based on FMG signal will provide a useful foundation for future research in the interfacing and utilization of medical devices.

Keywords

Force Myography (FMG) Surface Electromyography (sEMG) prosthetic hand gesture predictions and classifications bionic robot 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. [1]
    De Laurentis K J, Mavroidis C. Mechanical design of a shape memory alloy actuated prosthetic hand. Technology and Health Care, 2002, 10, 91.106.Google Scholar
  2. [2]
    Engeberg E D, Meek S G. Adaptive sliding mode control for prosthetic hands to simultaneously prevent slip and minimize deformation of grasped objects. IEEE/ASME Transactions on Mechatronics, 2013, 18, 376–385.CrossRefGoogle Scholar
  3. [3]
    Collinger J L, Wodlinger B, Downey J E, Wang W, Tyler-Kabara E C, Weber D J, McMorland A J, Velliste M, Boninger M L, Schwartz A B. High-performance neuroprosthetic control by an individual with tetraplegia. The Lancet, 2013, 381, 557–564.CrossRefGoogle Scholar
  4. [4]
    Engeberg E D. A physiological basis for control of a prosthetic hand. Biomedical Signal Processing and Control, 2013, 8, 6–15.CrossRefGoogle Scholar
  5. [5]
    Cipriani C, Segil J L, Birdwell J A, Weir R F F. Dexterous control of a prosthetic hand using fine-wire intramuscular electrodes in targeted extrinsic muscles. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 2014, 22, 828–836.CrossRefGoogle Scholar
  6. [6]
    Pistohl T, Cipriani C, Jackson A, Nazarpour K. Abstract and proportional myoelectric control for multi-fingered hand prostheses. Annals of Biomedical Engineering, 2013, 41, 2687–2698.CrossRefGoogle Scholar
  7. [7]
    Dalley S, Wiste T E, Withrow T J, Goldfarb M, et al. Design of a multifunctional anthropomorphic prosthetic hand with extrinsic actuation. Mechatronics, IEEE/ASME Transactions on, 2009, 14, 699–706.CrossRefGoogle Scholar
  8. [8]
    Belter J T, Segil J L, Dollar A M, Weir R F. Mechanical design and performance specifications of anthropomorphic prosthetic hands: A review. Journal of Rehabilitation Research Development, 2013, 50, 599–618.CrossRefGoogle Scholar
  9. [9]
    Chandrasekhar P, Anugolu M, Yihun Y, Jensen A, Chiu S, Schoen M P, Naidu D S. Optimal tracking of a sEMG based force model for a prosthetic hand. Annual International Conference of the IEEE Engineering in Medicine and Biology Society, Boston, MA, USA, 2011, 1604–1607.Google Scholar
  10. [10]
    Potluri C, Anugolu M, Chiu S, Naidu D S, Schoen M P. A sEMG-based real-time adaptive joint angle estimation and control for a prosthetic hand prototype. Proceedings of WSEAS International Conference on Advances in Systems Theory, Signal Processing and Computational Science, Istanbul, Turkey, 2012, 124–129.Google Scholar
  11. [11]
    Potluri C, Yihun Y, Kumar P, Molitor J, Chiu S C, Naidu D S, Mousavinezhad S H. sEMG based real-time embedded force control strategy for a prosthetic hand prototype. IEEE International Conference on Electro/Information Technology, Mankato, MN, USA, 2011, 1–6.Google Scholar
  12. [12]
    Andrianesis K, Tzes A. Design of an innovative prosthetic hand with compact shape memory alloy actuators. 21st Mediterranean Conference on Control & Automation, Chania, Greece, 2013, 697–702.Google Scholar
  13. [13]
    Fite K B, Withrow T J, Shen X, Wait K W, Mitchell J E, Goldfarb M. A gas-actuated anthropomorphic prosthesis for transhumeral amputees. IEEE Transactions on Robotics, 2008, 24, 159–169.CrossRefGoogle Scholar
  14. [14]
    Schulz S, Pylatiuk C, Reischl M, Martin J, Mikut R, Bretthauer G. A hydraulically driven multifunctional prosthetic hand. Robotica, 2005, 23, 293–299.CrossRefGoogle Scholar
  15. [15]
    Massa B, Roccella S, Carrozza M C, Dario P. Design and development of an underactuated prosthetic hand. In Robotics and Automation. Proceedings IEEE International Conference on Robotics and Automation, 2002, Washington, DC, USA, 3374–3379.Google Scholar
  16. [16]
    Pfeiffer C, DeLaurentis K, Mavroidis C. Shape memory alloy actuated robot prostheses: Initial experiments. Proceedings IEEE International Conference on Robotics and Automation, 1999, 3, 2385–2391.CrossRefGoogle Scholar
  17. [17]
    Ceccarelli M. Finger mechanisms for robotic hands. In Recent Advances in Mechanism Design for Robotics, Bai S and Ceccarelli M eds, Springer International Publishing Switzerland, Cham, Switzerland, 2015, 3–13.Google Scholar
  18. [18]
    Ceccarelli M. Kinematic design problems for low-cost easy-operation humanoid robots. In Interdisciplinary Applications of Kinematics, Kecskeméthy A, Geu Flores F (eds), Springer International Publishing Switzerland, Cham, Switzerland, 2015, 91–99.Google Scholar
  19. [19]
    Lin L R, Huang H P. Mechanism design of a new multi-fingered robot hand. Proceedings of IEEE International Conference on Robotics and Automation, 1996, 2, 1471–1476.CrossRefGoogle Scholar
  20. [20]
    Yu W, Chattopadhyay S, Lim T C, Acharya U R. Advances in Therapeutic Engineering, CRC Press, Boca Raton, USA, 2012.CrossRefGoogle Scholar
  21. [21]
    Cordella F, Ciancio A L, Sacchetti R, Davalli A, Cutti A G, Guglielmelli E, Zollo L. Literature review on needs of upper limb prosthesis users. Frontiers in Neuroscience, 2016, 10, 209.Google Scholar
  22. [22]
    Connan M, Ruiz Ramirez E, Vodermayer B, Castellini C. Assessment of a wearable force-and electromyography device and comparison of the related signals for myocontrol. Frontiers in Neurorobotics, 2016, 10, 17.CrossRefGoogle Scholar
  23. [23]
    Cho E, Chen R, Merhi L K, Xiao Z, Pousett B, Menon C. Force myography to control robotic upper extremity prostheses: A feasibility study. Frontiers in Bioengineering and Biotechnology, 2016, 4, 18.CrossRefGoogle Scholar
  24. [24]
    Ha N, Withanachchi G P, Yihun Y. Force myography signal-based hand gesture classification for the implementation of real-time control system to a prosthetic hand. Design of Medical Devices Conference, Minneapolis, Minnesota, USA, 2018, DMD2018-6937.CrossRefGoogle Scholar
  25. [25]
    Radmand A, Scheme E, Englehart K. High-density force myography: A possible alternative for upper-limb prosthetic control. Journal of Rehabilitation Research & Development, 2016, 53, 443–456.CrossRefGoogle Scholar
  26. [26]
    Kadkhodayan A, Jiang X, Menon C. Continuous prediction of finger movements using force myography. Journal of Medical and Biological Engineering, 2016, 36, 594–604.CrossRefGoogle Scholar
  27. [27]
    Xiao Z G, Menon C. Performance of forearm FMG and sEMG for estimating elbow, forearm and wrist positions. Journal of Bionic Engineering, 2017, 14, 284–295.CrossRefGoogle Scholar
  28. [28]
    Nissler C, Mouriki N, Castellini C. Optical myography: Detecting finger movements by looking at the forearm. Frontiers in Neurorobotics, 2016, 10, 3.CrossRefGoogle Scholar
  29. [29]
    Jiang X, Merhi L K, Xiao Z G, Menon C. Exploration of force myography and surface electromyography in hand gesture classification. Medical Engineering & Physics, 2017, 41, 63–73.CrossRefGoogle Scholar
  30. [30]
    Tatu L, Parratte B. Functional anatomy of the muscle. In Muscle Injuries in Sport Athletes, Roger B, Guermazi A, Skaf A (eds), Springer, Cham, Switzerland, 2017, 19–44.Google Scholar
  31. [31]
    Bluetooth VMG 30TM data glove. [2018-09-30], https://www.vrealities.com/products/data-gloves/vmg30.Google Scholar
  32. [32]
    Zecca M, Micera S, Carrozza M C, Dario P. Control of multifunctional prosthetic hands by processing the electromyographic signal. Critical ReviewsTM in Biomedical Engineering, 2002, 30, 459–485.CrossRefGoogle Scholar
  33. [33]
    Tang J, Alelyani S, Liu H. Feature selection for classification: A review. In Data Classification: Algorithms and applications, Aggarwal C C ed, CRC Press, Boca Raton, USA, 2014, 37.Google Scholar
  34. [34]
    Haykin S. Neural Networks: A Comprehensive Foundation, Prentice-Hall PTR Upper Saddle River, NJ, USA, 1994.zbMATHGoogle Scholar
  35. [35]
    Tascillo A, Bourbakis N. Neural and fuzzy robotic hand control. IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics), 1999, 29, 636–642.CrossRefGoogle Scholar
  36. [36]
    Cortes C, Vapnik V. Support-vector networks. Machine Learning, 1995, 20, 273–297.zbMATHGoogle Scholar
  37. [37]
    Kotsiantis S B. Supervised machine learning: A review of classification techniques. Informatica, 2007, 31, 249.MathSciNetzbMATHGoogle Scholar
  38. [38]
    Quinlan J R. Learning decision tree classifiers. ACM Computing Surveys (CSUR), 1996, 28, 71–72.CrossRefGoogle Scholar
  39. [39]
    Dietterich T G. Ensemble methods in machine learning, in Multiple Classifier Systems, Springer, Berlin, Heidelberg, Germany, 2000, 1–15.Google Scholar
  40. [40]
    Nazmi N, Abdul Rahman M A, Yamamoto S I, Ahmad S A, Zamzuri H, Mazlan S A. A review of classification techniques of EMG signals during isotonic and isometric contractions. Sensors, 2016, 16, 1304.CrossRefGoogle Scholar
  41. [41]
    Matsubara T, Morimoto J. Bilinear modeling of EMG signals to extract user-independent features for multiuser myoelectric interface. IEEE Transactions on Biomedical Engineering, 2013, 60, 2205–2213.CrossRefGoogle Scholar
  42. [42]
    Subasi A. Classification of EMG signals using PSO optimized SVM for diagnosis of neuromuscular disorders. Computers in Biology and Medicine, 2013, 43, 576–586.CrossRefGoogle Scholar
  43. [43]
    Newby B, Youngers N, Adhikari V, Yihun Y, Lankarani H. Design and control of an active palm roll joint for the human prosthetic hand. ASME International Design Engineering Technical Conferences and Computers and Information in Engineering Conference, Charlotte, North Carolina, USA, 2016, DETC2016-60237.CrossRefGoogle Scholar
  44. [44]
    Yang D P, Zhao J D, Gu Y K, Wang X Q, Li N, Jiang L, Liu H, Huang H, Zhao D W. An anthropomorphic robot hand developed based on underactuated mechanism and controlled by EMG signals. Journal of Bionic Engineering, 2009, 6, 255–263.CrossRefGoogle Scholar
  45. [45]
    Wang N, Lao K, Zhang X. Design and myoelectric control of an anthropomorphic prosthetic hand. Journal of Bionic Engineering, 2017, 14, 47–59.CrossRefGoogle Scholar
  46. [46]
    Shi W T, Lyu Z J, Tang S T, Chia T L, Yang C Y. A bionic hand controlled by hand gesture recognition based on surface EMG signals: A preliminary study. Biocybernetics and Biomedical Engineering, 2018, 38, 126–135.CrossRefGoogle Scholar

Copyright information

© Jilin University 2019

Authors and Affiliations

  • Nguon Ha
    • 1
  • Gaminda Pankaja Withanachchi
    • 2
  • Yimesker Yihun
    • 1
    Email author
  1. 1.Department of Mechanical EngineeringWichita State UniversityWashingtonUSA
  2. 2.Department of Electrical EngineeringWichita State UniversityWashingtonUSA

Personalised recommendations