Advertisement

Journal of Bionic Engineering

, Volume 11, Issue 2, pp 236–248 | Cite as

Anthropomorphic Control of a Dexterous Artificial Hand via Task Dependent Temporally Synchronized Synergies

  • Benjamin A. KentEmail author
  • John Lavery
  • Erik D. Engeberg
Article

Abstract

Despite the recent influx of increasingly dexterous prostheses, there remains a lack of sufficiently intuitive control methods to fully utilize this dexterity. As a solution to this problem, a control framework is proposed which allows the control of an arbitrary number of Degrees of Freedom (DOF) through a single electromyogram (EMG) control input. Initially, the joint motions of nine test subjects were recorded while grasping and catching a cylinder. Inherent differences emerged depending upon whether the cylinder was grasped or caught. These data were used to form a distinct synergy for each task, described as the families of parametric functions of time that share a mutual time vector. These two Temporally Synchronized Synergies (TSS) were derived to reflect the task dependent control strategies adopted by the initial participants. These synergies were then mapped to a dexterous artificial hand that was subsequently controlled by two subjects with transradial amputations. The EMG signals from these subjects were used to replace the time vector shared by the synergies, enabling the subjects to perform both tasks with a dexterous artificial hand using only a single EMG input. After a ten minute training period, the subjects learned to use the dexterous artificial hand to grasp and catch the cylinder with 100.0% and 65.0% average success rates, respectively.

Keywords

electromyogram dexterous hands grasp synergy prosthetics sliding mode control 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. [1]
    Connolly C. Prosthetic hands from touch bionics. Industrial Robot, 2008, 35, 290–293.CrossRefGoogle Scholar
  2. [2]
    Muzumdar A. Powered Upper Limb Prostheses, Springer, Berlin, Germany, 2004.CrossRefGoogle Scholar
  3. [3]
    Engeberg E, Meek S, Minor M. Hybrid force-velocity sliding mode control of a prosthetic hand. IEEE Transactions on Biomedical Engineering, 2008, 55, 1572–1581.CrossRefGoogle Scholar
  4. [4]
    Zollo L, Roccella S, Guglielmelli E, Carrozza M C, Dario P. Biomechatronic design and control of an anthropomorphic artificial hand for prosthetic and robotic applications. IEEE/ASME Transactions on Mechatronics, 2007, 12, 418–429.CrossRefGoogle Scholar
  5. [5]
    Miguelez J M. Clinical experiences with the michelangelo hand, a four-year review. MyoElectric Controls/Powered Prosthetics Symposium, New Brunswick, Canada, 2011.Google Scholar
  6. [6]
    Schulz S. First experiences with the vincent hand. Myoelectric Controls/Powered Prosthetics Symposium, Fredericton, Canada, 2011.Google Scholar
  7. [7]
    Medynski C, Rattray B. Bebionic prosthetic design. MyoElectric Controls/Powered Prosthetics Symposium, Fredericton, Canada, 2011.Google Scholar
  8. [8]
    Matrone G, Cipriani C, Carrozza M, and Magenes G. Real-time myoelectric control of a multi-fingered hand prosthesis using principal components analysis. Journal of NeuroEngineering and Rehabilitation, 2012, 9, 40.CrossRefGoogle Scholar
  9. [9]
    Young A J, Smith L H, Rouse E J, Hargrove L J. Classification of simultaneous movements using surface emg pattern recognition. IEEE Transactions on Biomedical Engineering, 2013, 60, 1250–1258.CrossRefGoogle Scholar
  10. [10]
    Sears H, Shaperman J. Proportional myoelectric hand control: An evaluation. American Journal of Physical Medicine and Rehabilitation, 1991, 70, 20–28.CrossRefGoogle Scholar
  11. [11]
    Biddiss E, Beaton D, Chau T. Consumer design priorities for upper limb prosthetics. Disability and Rehabilitation: Assistive Technology, 2007, 2, 346–357.CrossRefGoogle Scholar
  12. [12]
    Kyberd P, Wartenberg C, Sandsjo L, Jonsson S, Gow D, Frid J, Almstrom C, Sperling L. Survey of upper-extremity prosthesis users in sweden and the united kingdom. Journal of Prosthetics and Orthotics, 2007, 19, 55–62.CrossRefGoogle Scholar
  13. [13]
    Zecca M, Micera S, Carrozza M, Dario P. Control of multi-functional prosthetic hand by processing the electromyographic signal. Critical Reviews in Biomedical Engineering, 2002, 30, 459–485.CrossRefGoogle Scholar
  14. [14]
    Fougner A, Stavdahl O, Kyberd P J, Losier Y G, Parker P A. Control of upper limb prostheses: Terminology and proportional myoelectric control-a review. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 2012, 20, 663–677.CrossRefGoogle Scholar
  15. [15]
    Oskoei M, Hu H. Myoelectric control systems-a survey. Biomedical Signal Processing and Control, 2007, 2, 275–294.CrossRefGoogle Scholar
  16. [16]
    Yang D P, Zhao J D, Gu Y K, Wang X Q, Li N, Jiang L, Liu H, Huang H, Zhao D W. An anthropomorphic robot hand developed based on underactuated mechanism and controlled by EMG signals. Journal of Bionic Engineering, 2009, 6, 255–263.CrossRefGoogle Scholar
  17. [17]
    Merrill D R, Lockhart J, Troyk P R, Weir R F, Hankin D L. Development of an implantable myoelectric sensor for advanced prosthesis control. Artificial Organs, 2011, 35, 249–252.CrossRefGoogle Scholar
  18. [18]
    Ahsan M R, Ibrahimy M I, Khalifa O O. Electromygraphy (EMG) signal based hand gesture recognition using artificial neural network (ANN). 4th International Conference On Mechatronics, Kuala Lumpur, Malaysia, 2011, 1–6.Google Scholar
  19. [19]
    Jun-Uk C, Inhyuk M, Museong M. A real-time emg pattern recognition system based on linear-nonlinear feature projection for a multifunction myoelectric hand. IEEE Transactions on Biomedical Engineering, 2006, 53, 2232–2239.CrossRefGoogle Scholar
  20. [20]
    Baofeng S, Wanzhong C, Yantao T. The pattern recognition of surface EMG based on wavelet transform and BP neural network. 5th International Conference on iCBBE, Wuhan, China, 2011, 1–4.Google Scholar
  21. [21]
    Vinjamuri R, Sun M, Chang C, Lee H, Sclabassi R, Mao Z H. Dimensionality reduction in control and coordination of the human hand. IEEE Transactions on Biomedical Engineering, 2010, 57, 284–295.CrossRefGoogle Scholar
  22. [22]
    Mason C, Gomez J, and Ebner T. Hand synergies during reachto-grasp. Journal of Neurophysiology, 2001, 86, 2896–2910.CrossRefGoogle Scholar
  23. [23]
    Niu X, Latash M, Zatsiorsky V. Prehension synergies in the grasps with complex frictional patterns: Local versus synergic effects and the template control. Journal of Neurophysiology, 2007, 98, 16–28.CrossRefGoogle Scholar
  24. [24]
    Vinjamuri R, Mao Z, Sclabassi R, Sun M. Time-varying synergies in velocity profiles of finger joints of the hand during reach and grasp. 29th Annual International Conference of the IEEE EMBS, Lyon, France, 2007, 4846–4849.Google Scholar
  25. [25]
    Vinjamuri R, Mingui S, Cheng-Chun C, Heung-No L, Sclabassi R J, Zhi-Hong M. Temporal postural synergies of the hand in rapid grasping tasks. IEEE Transactions on Information Technology in Biomedicine, 2010, 14, 986–994.CrossRefGoogle Scholar
  26. [26]
    Grinyagin I V, Biryukova E V, Maier M A. Kinematic and dynamic synergies of human precisiongrip movements. Journal of Neurophysiology, 2005, 94, 2284–2294.CrossRefGoogle Scholar
  27. [27]
    Santello M, Flanders M, Soechting J F. Postural hand synergies for tool use. The Journal of Neuroscience, 1998, 18, 10105–10115.Google Scholar
  28. [28]
    Ficuciello F, Palli G, Melchiorri C, Siciliano B. Experimental evaluation of postural synergies during reach to grasp with the UB hand IV. IEEE/RSJ International Conference on IROS, San Fransisco, USA, 2011, 1775–1780.Google Scholar
  29. [29]
    Ciocarlie M, Allen P. Hand posture subspaces for dexterous robotic grasping. The International Journal of Robotics Research, 2009, 28, 851–867.CrossRefGoogle Scholar
  30. [30]
    Brown C Y, Asada H H. Interfinger coordination and postural synergies in robot hands via mechanical implementation of principal components analysis. IEEE/RSJ International Conference on IROS, San Diego, Canada, 2007, 2877–2882.Google Scholar
  31. [31]
    Vinjamuri R, Weber D J, Mao Z H, Collinger J L, Degenhart A D, Kelly J W, Boninger M L, Tyler-Kabara E C, Wei W. Toward synergy-based brain-machine interfaces. IEEE Transactions on Information Technology in Biomedicine, 2011, 15, 726–736.CrossRefGoogle Scholar
  32. [32]
    Kamper D G, Cruz E G, Siegel M P. Stereotypical fingertip trajectories during grasp. Journal of Neurophysiology, 2003, 90, 3702–3710.CrossRefGoogle Scholar
  33. [33]
    Cianchetti F A, Valero-Cuevas F. Anticipatory control of motion-to-force transitions with the fingertips adapts optimally to task difficulty. Journal of Neurophysiology, 2010, 103, 108–116.CrossRefGoogle Scholar
  34. [34]
    Belter J T, Segil J L, Dollar A M, Weir R F. Mechanical design and performance specifications of anthropomorphic prosthetic hands: A review. Journal of Rehabilitation Research and Development, 2013, 50, 599–618.CrossRefGoogle Scholar
  35. [35]
    Davidson J. A survey of the satisfaction of upper limb amputees with their prostheses, their lifestlyes, and their abilities. Journal of Hand Therapy, 2002, 15, 62–70.CrossRefGoogle Scholar
  36. [36]
    Kochan A. Shadow delivers first hand. Industrial Robot, 2005, 32, 15–16.CrossRefGoogle Scholar
  37. [37]
    Lavery J, Kent B, Engeberg E D. Biologically inspired grasp primitives for a dexterous robotic hand to catch and lift a sphere. 12th International Conference on ICCAS, Jeju, Korea, 2012, 1710–1715.Google Scholar
  38. [38]
    Lavery J, Kent B, Engeberg E D. Bioinspired grasp primitives for a dexterous robotic hand to catch and lift a cylinder. IEEE International Conference on ROBIO, 2011, 1102–1107.Google Scholar
  39. [39]
    Jones L A, Lederman S J. Human hand function. Oxford University Press, New York, USA, 2006.CrossRefGoogle Scholar
  40. [40]
    Karnati N, Kent B A, Engeberg E D. Bioinspired sinusoidal finger joint synergies for a dexterous robotic hand to screw and unscrew objects with different diameters. IEEE/ASME Transactions on Mechatronics, 2013, 18, 612–623.CrossRefGoogle Scholar
  41. [41]
    Kent B, Karnati N, Engeberg E. Electromyogram synergy control of a dexterous artificial hand. Journal of Neuro Engineering and Rehabilitation, 2014, 11, Doi: http://dx.doi.org/10.1186/1743–0003–11–41
  42. [42]
    Puchhammer G. The tactile slip sensor: Integration of a miniaturized sensory device on an myoelectric hand. Or-thopädie-Technik Quarterly, 2000, 1, 7–12.Google Scholar
  43. [43]
    Engeberg E. Human model reference adaptive control of a prosthetic hand. Journal of Intelligent and Robotic Systems, 2013, 72, 41–56.CrossRefGoogle Scholar
  44. [44]
    Karnati N, Kent B A, Engeberg E D. Adaptive synergy control for a dexterous hand based on grasped object orientation. International Conference on Control and Automation Systems, Jeju Island, South Korea, 2012.Google Scholar
  45. [45]
    Thakur P H, Bastian A J, Hsiao S S. Multidigit movement synergies of the human hand in an unconstrained haptic exploration task. The Journal of Neuroscience, 2008, 28, 1271–1281.CrossRefGoogle Scholar
  46. [46]
    Ouellette E A, McAuliffe J A, Caneiro R. Partialhand amputations: Surgical principles (Atlas of limb prosthetics: Surgical, prosthetic, and rehabilitation principles. St. Louis, MO, USA, 1992.Google Scholar
  47. [47]
    Dosen S, Cipriani C, Kostic M, Controzzi M, Carrozza M, Popovic D. Cognitive vision system for control of dexterous prosthetic hands: Experimental evaluation. Journal of NeuroEngineering and Rehabilitation, 2010, 7, 42.CrossRefGoogle Scholar

Copyright information

© Jilin University 2014

Authors and Affiliations

  • Benjamin A. Kent
    • 1
    Email author
  • John Lavery
    • 1
  • Erik D. Engeberg
    • 1
    • 2
  1. 1.Department of Mechanical EngineeringUniversity of AkronAkronUSA
  2. 2.Department of Biomedical EngineeringUniversity of AkronAkronUSA

Personalised recommendations