Principal components analysis based control of a multi-dof underactuated prosthetic hand
- First Online:
- Cite this article as:
- Matrone, G.C., Cipriani, C., Secco, E.L. et al. J NeuroEngineering Rehabil (2010) 7: 16. doi:10.1186/1743-0003-7-16
- 20k Downloads
Functionality, controllability and cosmetics are the key issues to be addressed in order to accomplish a successful functional substitution of the human hand by means of a prosthesis. Not only the prosthesis should duplicate the human hand in shape, functionality, sensorization, perception and sense of body-belonging, but it should also be controlled as the natural one, in the most intuitive and undemanding way. At present, prosthetic hands are controlled by means of non-invasive interfaces based on electromyography (EMG). Driving a multi degrees of freedom (DoF) hand for achieving hand dexterity implies to selectively modulate many different EMG signals in order to make each joint move independently, and this could require significant cognitive effort to the user.
A Principal Components Analysis (PCA) based algorithm is used to drive a 16 DoFs underactuated prosthetic hand prototype (called CyberHand) with a two dimensional control input, in order to perform the three prehensile forms mostly used in Activities of Daily Living (ADLs). Such Principal Components set has been derived directly from the artificial hand by collecting its sensory data while performing 50 different grasps, and subsequently used for control.
Trials have shown that two independent input signals can be successfully used to control the posture of a real robotic hand and that correct grasps (in terms of involved fingers, stability and posture) may be achieved.
This work demonstrates the effectiveness of a bio-inspired system successfully conjugating the advantages of an underactuated, anthropomorphic hand with a PCA-based control strategy, and opens up promising possibilities for the development of an intuitively controllable hand prosthesis.
In the last thirty years several examples of robotic hands have been developed by research or industry, some designed to mimic the human hand in its manipulation dexterity and functionality, some aimed at achieving better anthropomorphism and cosmetic appearance . Great research effort has been focused on the design of both articulated articulated end-effectors and smart dexterous anthropomorphic hands, for humanoid robotics and prosthetics. An exhaustive summary of the various approaches and solutions is given in  and .
An advanced neuro-controlled prosthetic hand bi-directionally interfaced with a human being should address both functional and cosmetic issues; it should be dexterous enough to allow the execution of Activities of Daily Living (ADLs), and include proprioceptive and exteroceptive sensors for the delivery of consciously perceived sensory feedback . Market available myoelectric hand prostheses [4, 5, 6] are instead similar to rough pincers , having just one (open/close the hand) or two (prono/supinate the wrist) degrees of freedom (DoFs), therefore poor manipulation capabilities. They are controlled by means of electromyographic (EMG) signals picked up from the residual muscles by surface electrodes, amplified and processed to functionally operate the hand [8, 9, 10]. Also the recently commercialized multi-fingered I-Limb prosthesis (Touch EMAS Ltd., Edinburgh, UK)  is controlled using a traditional two-input EMG scheme where all fingers open/close simultaneously.
The communication interface between the user and the machine is the technological bottle-neck  which explains why current hand prostheses are very simple from a biomechanical point of view, even if more sophisticated solutions would be possible. Still nowadays there is no way to easily interface the amputee with the multi-DoF dexterous prostheses developed in the past decades (e.g. the Southampton-REMEDI , the RTR II , the MANUS , the Karlsruhe hands , the SmartHand , the IOWA hand ), since it requires either too many independent control signals or a controller able to compensate for the limited bandwidth of the source signal.
As a matter of fact, increasing the number of DoFs (i.e. dexterity) means either that the system should take care of carrying out the grasp with some level of automatism, as in the SAMS [10, 13, 19], or that the user should learn how to correctly and selectively modulate different muscular contractions so as to move each prosthesis joint independently (as in [20, 21]). In all cases, a certain level of shared-control between the user's intention and the automatic controller is required, as formally introduced by . If the control relies on the automatic controller of the prosthesis, this must include a high number of sensors and intelligent control algorithms to achieve the grasp; on the other hand, if the control system is based on user's intentions decoded from bio-signals extracted by an appropriate interface, (possibly) complex EMG processing algorithms and a high level of training for the user may be required, which could cause fatiguing burden . This could potentially induce the subject to reject the prosthesis, particularly when the amputation is mono-lateral and he/she can supply with the healthy limb to his/her motor deficiency.
An innovative shared-control strategy could be achieved by observing and mimicking the natural biomechanical behaviour. As several studies in the neurophysiology literature report, low-dimensional modules formed by muscles activated in synchrony - also called "muscular synergies" - are used by the human nervous system to build complex motor output patterns during motor tasks [24, 25]. In 1997/8 Santello and Soechting reported a series of interesting experimental results on the analysis of human hand grasping postures [26, 27], demonstrating that such synergies exist also in hand postural data, which can thus be described in a reduced dimensionality space [26, 27, 28, 29, 30].
This concept has been exploited with the aim of controlling robotic grippers and dexterous hands by means of a lower-dimension input space, in a limited number of works. Brown and Asada explored the concept of biomechanical synergies and how they can be applied to a 17 DoFs robot anthropomorphic hand, by mechanically implementing Principal Components Analysis (PCA) and using common patterns of actuation called eigenpostures . Ciocarlie et al.  used PCA to design an automatic grasp planning system for integration into the control system of a prosthetic arm and hand driven by cortical activity. Ciocarlie, Goldfeder and Allen [33, 34] applied the eigengrasp concept to 5 dexterous hand virtual models (and to a real three-fingered gripper) and derived a grasp planning algorithm. Tsoli and Jenkins  compared several different dimensionality reduction techniques used to extract 2D non linear manifolds from human hand motion data and drive the DLR/HIT robotic hand ; they also showed how it could be controlled simply using a 2 DoFs input signal like the mouse pointer position . Rossel et al.  used the SAH hand  and the concept of principal motion directions to reduce the hand workspace dimension.
In the present work a control method based on PCA (preliminary introduced in  and ) and its implementation in a 16-DoFs underactuated hand (the CyberHand prototype ) are presented. The developed strategy allows to achieve a dimension reduction of the control both algorithmically (using PCA) and also mechanically (by means of underactuation). By this way, two independent input signals can be used to drive the hand and to make it grasp different objects representing the prehensile grasping forms mostly used in ADLs. A direct interaction between the user and the robot hand is made possible by combining the user input signals and the matrix which operates the transformation between the input 2D space and the 16-dimensional hand DoFs space. By this way, fingers are somehow directly moved by the user's intention, albeit each single joint position cannot be actively controlled. The final joints configuration is in the end achieved thanks to the hand underactuated mechanism.
The feasibility of exploiting such a control method for achieving real stable grasps is shown here on an anthropomorphic, underactuated prosthesis for the first time. This paper first of all describes the underactuated hand used, the proposed PCA-based control algorithm and particularly how the PCs matrix has been ad-hoc built collecting data from the CyberHand sensors, in order to operate dimensionality reduction. The employment of this control strategy in driving the hand during the most typical grasps in ADLs is then presented. Different working conditions have been considered, in order to test the algorithm feasibility both simulating EMG user-generated control signals (more realistic noisy inputs) and in the ideal case. The results obtained performing different grasping trials are finally described and discussed.
The robot hand
The hand contains position (encoders integrated in the motors) and tendon tension sensors (able to measure the grasp force ), that can be read externally by means of a standard RS232 bus and an implemented communication protocol. The control is embedded in the hand in a 8-bit microcontroller-based hierarchical architecture (Microchip Inc. microcontrollers) and triggered by external commands from the communication bus. According to the serial communication protocol, the set-point positions for each finger are encoded using 8 bits, i.e. from 0 (finger completely extended: all joint angles = 0 deg) to 255 (finger completely flexed: all joint angles = 90 deg).
PCA-based control algorithm
The PCA algorithm  allows to convert an original data set into a new space where dimensions are uncorrelated; it can be briefly summarized as follows. If we suppose to have a (N × M) dataset matrix, where N is the dimension of the original amount of data and M is the dimension of each datum, its covariance matrix is a (M × M) matrix whose eigenvectors are the PCs, and their respective eigenvalues are the PCs weights (i.e. the amount of explained variance). The PCs can then be ordered in descending order according to their weights and used to constitute the columns of the PCs matrix (M × M). Therefore, by multiplying the original dataset by this matrix, a new (N × M) dataset is obtained, where rows/data are uncorrelated. Moreover, if the last PCs have a very low weight, they can be neglected (i.e. set to zero), obtaining a new dataset with reduced dimensionality, if compared to the original one.
here the output vector consists of the desired M-DoFs of the hand. The remaining components of the input vector, which are to be multiplied by the last PCs, are set to zero, in order to neglect the less significant PCs contribution.
This strategy could be exploited with a myoelectric hand prosthesis, where only few signals are available for control, but dexterity is desirable. By employing this "inverse PCA" algorithm, all DoFs of a dexterous robotic hand may be controlled in synergy by means of a simple two-signals control interface, e.g. two independent EMG channels tapped from the residual limb.
In a previous work, this control method had been firstly tested onto a virtual-reality model of a 15 DoFs hand . Simulations of hand movement were performed employing a real human hand PCs matrix available from Santello et al. , and the 2-DoFs mouse signal was assumed as the input control signal. The controller received the x y real time coordinates of the mouse pointer over the monitor screen, properly calibrated into In1and In2range values (found in ), and finally, multiplying by Santello's PCs matrix, the virtual hand instantaneous movements were calculated and virtually performed.
Grasped objects, used to constitute the CyberHand postures data-set
Diam = 80; height = 100
Diam = 65; height = 90
Small plastic cylinder
Diam = 36; height = 125
Medium plastic cylinder
Diam = 41; height = 120
Big plastic cylinder
Diam = 71; height = 120
Diam = 100; height = 36
Diam = 45; height = 130
Diam = 50; height = 135
Twine roll 1
Diam = 106; height = 21
Twine roll 2
Diam = 40; height = 75
Diam = 65
Power & precision grasp
Plastic sphere 1
Diam = 40
Plastic sphere 2
Diam = 49
Plastic sphere 3
Diam = 59
Diam = 70
2 liters bottle
Diam = 90
500 ml bottle
Diam = 65
Boxes seal tape
Diam = 90; height = 50
Power & precision grasp
Felt tip pen
Diam = 16; height = 130
L = 50
Diam = 120
Electric adapter plug
Diam = 41
Diam = 125; height = 70
Diam = 90
Power & precision grasp
20 × 55 × 85
Power & lateral grasp
Card box 1
103 × 58 × 45
Card box 2
103 × 45 × 40
55 × 39 × 11
Height = 1
Lateral grasp (× 10)
The obtained new matrix allows to calculate the 6 motor set-point positions (6 elements output vector in eq. (1)). Only the first two PCs have been considered significant (accounting for more than 90% of the data variance) and used subsequently to drive the hand (the remaining four PCs have been multiplied by a zero input).
Two-inputs control interface
As a proof of concept, two independent signals like the mouse vertical and horizontal position signals have been used to modulate the two first PCs with the aim of demonstrating that they can be employed to achieve significant hand dexterity.
A neutral position area has been established in the left bottom corner of the map. With the mouse cursor in this area (a 15 × 15 pixels square area) the hand opens shaping in a relaxed posture. This option is fundamental for the application under investigation, as a grasp usually starts from the hand being opened. The farthest end area chosen is easily reached with a wide movement of the mouse (or a strong contraction of the residual muscles, considering a myoelectric controller) and does not require a precise positioning (as e.g. with the neutral area in the centre of the screen). Besides, the left bottom corner corresponds to an almost opened hand posture also when using the PCs matrix by itself.
The maps in Figure 5 help to approximately evaluate the direction along which grasp strength increases for each grasp type, and how grip force changes when moving along different directions in the neighborhood of stable grasp points. Due to the mechanical configuration of the hand, for what concerns power and lateral postures (partially form-closure grasps ), an increase of the tendon tensions summation actually represents an increase in resistance to slipping [22, 50]. This is not true for precision grasps, for which high tendon tensions summation values (high strength grasp) could lead to roll-back phenomenon with consequent loss of stability .
In order to simulate EMG user-generated control trajectories, i.e. a more realistic condition, trials have been conducted also using noisy input signals. White noise with different amplitudes (a maximum of 50, 70 and 100 pixels added to both x and y position signals) was generated with Matlab and added to the linear trajectories described above (see for example Figure 6b).
Further trials have been performed imagining "worst-case" user-generated trajectories, i.e. moving along "right angle" trajectories (i.e. horizontal and vertical line segments), joining the initial rest position with the identified stable points (Figure 6a, thin lines).
All trajectories have been stored in text files and used by the C program to continuously drive the robotic hand (new posture sent every 100 ms). Each time a target point was reached (circular markers in Figure 6a), the program was paused for about 2 seconds (thus stopping new positions sending).
The pre-calculated trajectories have been used to grasp the three prototypical objects held out by an operator to the robotic hand. During the experiments the hand was bind to its support platform and neither a prosthetic arm nor any wrist DoFs were implied. Thus, there was no way to perform any reaching movement towards the object, which was held out by a human operator in the artificial hand palm/fingers proximity, where we expected the CyberHand to be able to grasp it. The object was kept still and wasn't released by the operator until the robotic fingers closed and the CyberHand sustained it by itself. Twenty one trials for each grasp type have been done, for a total amount of 63 grasp trials. Position and tendon tension signals were acquired during the grasps and stored for data analysis.
The objective of this experimental setup was to understand if the "inverse-PCA" algorithm, using the specifically-built PCs matrix, practically works when coupled with an underactuated anthropomorphic hand. To this aim, xy trajectories both with different levels of noise - simulating the user-generated input signals - and ideally linear have been used to drive the hand. Visible factors like the tendon tensions summation trend during the grasp have been considered for qualitatively assessing the grasp and evaluate the hand behaviour in the considered conditions. The final objective of this work, indeed, is to develop a prosthesis easily controllable by an amputee and not a robotic manipulator for which many restricted precision requirements exist.
Three objects, whose shapes represent most daily used grasp types, have been grasped 21 times each using pre-calculated trajectories with different levels of added noise, for a total amount of 63 trials. The experiments showed that the hand, using such control strategy, was able to achieve stable grasps thanks to the PCs matrix specifically calculated for the CyberHand. An analysis on how tensions vary in the three considered prototypical cases, using the automatic ideal, noisy and "right-angle" trajectories, has been performed and is here presented. Graphs showing tensions variations and pictures illustrating the hand behaviour have been reported only for the more interesting precision grasp case. Nevertheless, from here forth results obtained also while performing power and lateral grasps in the considered different conditions are described and commented.
For what concerns power grasp, the interpretation of the 5 fingers tensions summation curve is almost immediate: tension globally rises while the hand closes, until reaching a stable posture (constant tension pleateau).
The lateral grasp instead involves most of all thumb, which opposes to the volar aspect of the index: when the grasp force is sufficient, the object can be held between the thumb and index fingers. Thumb ab/adduction plays a role in influencing the thumb tension trend in time, causing tension oscillations; while the thumb is pressing against the object, an ab/adduction movement establishes a different thumb posture, with a consequent variation of its tendon tension.
In tripod/precision grasps, only thumb index and middle fingers are involved and especially the first one exerts the most of grip force, opposing to the other two fingers.
The described behaviours are obtained when the hand is controlled by ideal linear trajectories in the monitor screen reference system.
These same observations can be made when adding noise to the trajectories, with different noise gains (a displacement of 50 or 70 or 100 pixels at most). Obviously, the hand ability to firmly grasp the objects worsens while increasing noise amplitude. In all cases, a stable grasp is in the end achieved, even if with some delay and many more tension oscillations with respect to the ideal case (see for example the coloured curves in Figure 7, concerning precision grasp).
Stable grasps are obtained with some more difficulty when using "right-angle" trajectories to drive the CyberHand motion. The hand behaviour remains almost unchanged only during power grasps. On the other hand, following such a path doesn't allow to correctly perform lateral grasps any more. Firm precision grasps are obtained at lower tension values with respect to the first trials (Figure 7, dotted curve, first plateau). For this reason, when the hand is made to close more and more, the spherical object slips away almost immediately after the stable grasp point has been reached, justifying the absence of the tension peak at ~8 seconds on the dotted curve in Figure 7 (which is instead well visible on the solid curves in the same figure).
In carrying out the trials, the objective was to assess whether the PCA-based control algorithm is successful in driving an underactuated hand, like the CyberHand, during the most typical grasps in ADLs , and this issue is here discussed. Moreover, we aimed at understanding if the purposely created CyberHand PCs map works well.
The PCs matrix, resulting from postural data collected directly from the CyberHand, allows to obtain stable grasps. Despite its reduced dexterity if compared to the human hand, the robotic limb moves almost like the simulated virtual hand previously presented by the authors in . Postures modulate in a gradual manner in the two-dimensional PCs space (Figure 4); i.e., fingers move without colliding, while switching between grasp areas. This map is not subject-dependent and completely fits the CyberHand, reflecting its mechanism dynamic and adaptive features. Driving the artificial hand with its own PCs map makes it able to hold objects firmly; moreover, the precision grasps area is rather wide, easily reachable and almost overlapped to the power grasps region (Figure 4 and 5). This latter feature best reflects the adaptive mechanism behaviour: the hand moulds itself in order to perform a cylindrical grasp and conforms to the object it is grasping; with the same PCs combination, if the object is small and only the thumb, index, and middle fingertips are involved, a precision grasp is achieved; if instead all fingers wrap around the object, a power grasp is obtained. In both cases, the CyberHand PCs matrix allows a well-performed and stable enclosure of the object inside the hand fingers and palm.
In order to perform a first approximation assessment of the PCA-based algorithm feasibility when dealing with the control of a real robotic hand, Santello's PCs matrix  was first of all used to drive the CyberHand. The artificial limb (even if not able to perform any ab/adduction movements) resulted to be almost correctly drivable also with the map resulting from a human hand dataset. A significant difference has been observed in the hand behaviour when driven with Santello's and our map. The performed trials revealed that the former facilitates lateral grasp-like hand configurations but makes the hand not capable to perfectly wrap around objects, being the thumb not completely adduced. Moreover, the hand is not able to bring fingertips close enough to steadily grip small objects in precision grasps. Drawbacks are due to the application of a human hand based mapping onto an underactuated system, which mechanically only approximates the natural hand (joints rotation axes placement, phalanxes length, etc.) but is actually unable to perform all its complex manipulative movements.
When using the new CyberHand PCs map, the first two PCs better represent the most common grasping positions, accounting for more than 90% of data variance. Grips are more stable and characterized by well defined hand joints configurations, probably only to the detriment of a less gradual overall hand motion which can be observed while varying the input signal into the In1, In2space (cf. eq. (1)). When using the CyberHand map to perform the three considered grasps following the ideal linear trajectories, tension data show only very small fluctuations (e.g. Figure 7, thick black line). Each time all the necessary fingers are involved in grasping the object; even in precision grasps, both thumb, index and middle fingers correctly play a significant role.
Further trials have demonstrated the feasibility of our approach also in the presence of noisy inputs, used to simulate a more real working condition (i.e. myoelectric control). Even if adding random noise varying into the range between 0 and 100 pixels (which is almost high, if we consider the screen dimensions) to the original x and y position signals, the hand is able to perform the three prototypical grasps considered. Things change when moving along cathets in "right-angle" trajectories; following such a path, the hand movements appear to much less gradually vary, especially when an abrupt change from the horizontal to the vertical direction occurs. Precision grasps are far less firm and much more difficultly achievable; moreover, the hand is no more able to correctly perform lateral grasps.
These results show that not only the hand target point in the two inputs space influences grasp feasibility and stability, but also the trajectory followed in order to reach it and obviously the presence/absence of significant noise over the inputs. Linear diagonal trajectories are to be preferred to "right-angle" ones since they allow to operate a more balanced mixture between the contributions of the first input signal (In1, related to fingers flexion/extension) and the second input (In2, coupled to thumb ab/adduction movements).
In this paper a control algorithm based on PCA is proposed for driving an underactuated prosthetic hand with 16 DoFs and 6 DoMs. The objective of this work has been to verify such a control strategy feasibility in different conditions, that is when driving the hand with ideal, noisy and "worst-case" user-dependant control inputs.
Similarly to what Santello did in his experiments on human hand postures , a new PCs matrix was obtained directly collecting a data-set of the CyberHand fingers positions from its motor encoders. In this case, the resulting two first PCs accounted for more than 90% of the variance of motion. Thus, the PCs matrix was used to drive the hand by means of a simple 2 channel (DoFs) input signal, by just "inverting" the PCA algorithm and coupling these first two PCs with the mouse cursor x and y positions. Three objects based on Iberall's and Arbib's grasp taxonomy  were then chosen to perform several grasping trials (power, precision and lateral grasps) and to verify whether this method could be applied to a real anthropomorphic, underactuated robotic hand.
The hand postural behaviour (Figure 4) with respect to the two inputs variation was evaluated during several grasping trials. This analysis allowed to identify where the two input signals result into a power, a precision or a lateral grasp posture, as well as to experimentally investigate positions to grasp objects in a more stable way (i.e. stability in lateral and power grasps) and in which directions fingers tendon tension increases (Figure 5).
Results obtained driving the CyberHand with ideal linear xy trajectories show that it is actually able to reach, correctly grasp (in terms of involved fingers, stability and hand posture while shaping around the objects) and hold objects tightly if driven with this PCA-based algorithm. The feasibility of this approach has been demonstrated evaluating the hand performances also in a more real condition, that is in the presence of noisy input control signals. Trajectories in the inputs space (i.e. couplings of the two input signals), where abrupt changes in the predominance of one of the input signals over the other one do not occur, should preferably be followed. Otherwise, grasps are achieved with much more difficulty (sometimes grasps could even fail) and the hand performances significantly worsen.
Perspective work would firstly imply the acquisition of real efferent voluntary EMG signals picked up by surface sensors, then processed in order to extract significant intention-based features to be used as input signals. By this way, it would be possible to create an advanced, intuitive and biomimetic interface modulating PCs with EMG, thus setting up a complete 2-channel controller for a bio-inspired hand prosthesis, such as the CyberHand.
The authors would like to thank Prof. M. Santello and Prof. J. Soetching for providing PCs data.
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.