Abstract
Brain machine interfaces (BMIs) have demonstrated lots of successful arm-related reach decoding in past decades, which provide a new hope for restoring the lost motor functions for the disabled. On the other hand, the more sophisticated hand grasp movement, which is more fundamental and crucial for daily life, was less referred. Current state of arts has specified some grasp related brain areas and offline decoding results; however, online decoding grasp movement and real-time neuroprosthetic control have not been systematically investigated. In this study, we obtained neural data from the dorsal premotor cortex (PMd) when monkey reaching and grasping one of four differently shaped objects following visual cues. The four grasp gesture types with an additional resting state were classified asynchronously using a fuzzy k-nearest neighbor model, and an artificial hand was controlled online using a shared control strategy. The results showed that most of the neurons in PMd are tuned by reach and grasp movement, using which we get a high average offline decoding accuracy of 97.1%. In the online demonstration, the instantaneous status of monkey grasping could be extracted successfully to control the artificial hand, with an event-wise accuracy of 85.1%. Overall, our results inspect the neural firing along the time course of grasp and for the first time enables asynchronous neural control of a prosthetic hand, which underline a feasible hand neural prosthesis in BMIs.
Article PDF
Similar content being viewed by others
Avoid common mistakes on your manuscript.
References
Carmena J M, Lebedev M A, Crist R E, et al. Learning to control a brain-machine interface for reaching and grasping by primates. PLoS Biol, 2003, 1: 193–208
Hochberg L R, Serruya M D, Friehs G M, et al. Neuronal ensemble control of prosthetic devices by a human with tetraplegia. Nature, 2006, 442: 164–171
Velliste M, Perel S, Spalding M C, et al. Cortical control of a prosthetic arm for self-feeding. Nature, 2008, 453: 1098–1101
Soechting J F, Flanders M. Flexibility and repeatability of finger movements during typing: analysis of multiple degrees of freedom. J Comput Neurosci, 1997, 4: 29–46
Murata A, Gallese V, Luppino G, et al. Selectivity for the shape, size, and orientation of objects for grasping in neurons of monkey parietal area aip. J Neurophysiol, 2000, 83: 2580–2601
Fogassi L, Luppino G. Motor functions of the parietal lobe. Curr Opin Neurobiol, 2005, 15: 626–631
Murata A, Fadiga L, Fogassi L, et al. Object representation in the ventral premotor cortex (area F5) of the monkey. J Neurophysiol, 1997, 78: 2226–2230
Raos V, Umilta M A, Gallese V, et al. Functional properties of grasping-related neurons in the dorsal premotor area F2 of the macaque monkey. J Neurophysiol, 2004, 92: 1990–2002
Grafton S T. The cognitive neuroscience of prehension: Recent developments. Exp Brain Res, 2010, 204: 475–491
Brochier T, Umilta M A. Cortical control of grasp in non-human primates. Curr Opin Neurobiol, 2007, 17: 637–643
Aggarwal V, Acharya S, Tenore F, et al. Asynchronous decoding of dexterous finger movements using M1 neurons. IEEE T Neur Sys Reh, 2008, 16: 3–14
Vargas-Irwin C E, Shakhnarovich G, Yadollahpour P, et al. Decoding complete reach and grasp actions from local primary motor cortex populations. J Neurosci, 2010, 30: 9659–9669
Santello M, Flanders M, Soechting J F. Postural hand synergies for tool use. J Neurosci, 1998, 18: 10105–10115
Schieber M H, Santello M. Hand function: Peripheral and central constraints on performance. J Appl Physiol, 2004, 96: 2293–2300
Stark E, Abeles M. Predicting movement from multiunit activity. J Neurosci, 2007, 27: 8387–8394
Carpaneto J, Umilta M A, Fogassi L, et al. Decoding the activity of grasping neurons recorded from the ventral premotor area F5 of the macaque monkey. Neuroscience, 2011, 188: 80–94
Townsend B R, Subasi E, Scherberger H. Grasp movement decoding from premotor and parietal cortex. J Neurosci, 2011, 31: 14386–14398
Hoshi E, Tanji J. Differential involvement of neurons in the dorsal and ventral premotor cortex during processing of visual signals for action planning. J Neurophysiol, 2006, 95: 3596–3616
Zhang Q S, Zhang S M, Hao Y Y, et al. Development of an invasive brain-machine interface with a monkey model. Chin Sci Bull, 2012, 57: 2036–2045
Nicolelis M A, Dimitrov D, Carmena J M, et al. Chronic, multisite, multielectrode recordings in macaque monkeys. Proc Natl Acad Sci USA, 2003, 100: 11041–11046
Keller J M, Gray M R, Givens J A. A fuzzy k-nearest neighbor algorithm. IEEE T Sys Man Cyber, 1985, 15: 581
Aggarwal V, Acharya S, Tenore F, et al. Asynchronous decoding of dexterous finger movements using m1 neurons. IEEE T Neur Sys Reh, 2008, 16: 3–14
Pistohl T, Schulze-Bonhage A, Aertsen A, et al. Decoding natural grasp types from human ecog. Neuroimage, 2012, 59: 248–260
Muller-Putz G R, Scherer R, Pfurtscheller G, et al. Brain-computer interfaces for control of neuroprostheses: From synchronous to asynchronous mode of operation. Biomed Tech, 2006, 51: 57–63
Kim H K, Biggs S J, Schloerb D W, et al. Continuous shared control for stabilizing reaching and grasping with brain-machine interfaces. IEEE T Bio-Med Eng, 2006, 53: 1164–1173
Vanacker G, Mill D R, Lew E, et al. Context-based filtering for assisted brain-actuated wheelchair driving. Comput Intell Neurosci, 2007, doi:10.1155/2007/25130
Davare M, Kraskov A, Rothwell J C, et al. Interactions between areas of the cortical grasping network. Curr Opin Neurobiol, 2011, 21: 565–570
Raos V, Franchi G, Gallese V, et al. Somatotopic organization of the lateral part of area F2 (dorsal premotor cortex) of the macaque monkey. J Neurophysiol, 2003, 89: 1503–1518
Stark E, Asher I, Abeles M. Encoding of reach and grasp by single neurons in premotor cortex is independent of recording site. J Neurophysiol, 2007, 97: 3351–3364
Hendrix C M, Mason C R, Ebner T J. Signaling of grasp dimension and grasp force in dorsal premotor cortex and primary motor cortex neurons during reach to grasp in the monkey. J Neurophysiol, 2009, 102: 132–145
Geyer S, Matelli M, Luppino G, et al. Functional neuroanatomy of the primate isocortical motor system. Anat Embryol (Berl), 2000, 202: 443–474
Gamberini M, Passarelli L, Fattori P, et al. Cortical connections of the visuomotor parietooccipital area v6ad of the macaque monkey. J Comp Neurol, 2009, 513: 622–642
Wang W, Chan S S, Heldman D A, et al. Motor cortical representation of hand translation and rotation during reaching. J Neurosci, 2010, 30: 958–962
Bansal A K, Truccolo W, Vargas-Irwin C E, et al. Decoding 3-D reach and grasp from hybrid signals in motor and premotor cortices: Spikes, multiunit activity and local field potentials. J Neurophysiol, 2012, 107: 1337–1355
Author information
Authors and Affiliations
Corresponding author
Additional information
This article is published with open access at Springerlink.com
Rights and permissions
This article is published under an open access license. Please check the 'Copyright Information' section either on this page or in the PDF for details of this license and what re-use is permitted. If your intended use exceeds what is permitted by the license or if you are unable to locate the licence and re-use information, please contact the Rights and Permissions team.
About this article
Cite this article
Hao, Y., Zhang, Q., Zhang, S. et al. Decoding grasp movement from monkey premotor cortex for real-time prosthetic hand control. Chin. Sci. Bull. 58, 2512–2520 (2013). https://doi.org/10.1007/s11434-013-5840-0
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11434-013-5840-0