The goal of this project is to build and demonstrate an anthropomorphic prosthetic arm and hand that is controlled by cortical output. The human arm and hand have approximately 30 degrees- of-freedom (dot- independent joint rotations) and are very complex mechanical structures. Hands are an example of an advanced evolutionary specialization, which along with binocular vision and bipedal locomotion, led to tool use- a major determinant of human brain development and behavior. Yet, little is known about the neural control of the hand during natural behavior. Regarding active prosthetic hands, there has been a paucity of work on robot hand control and only recently has there been an effort to make a truly accurate functioning hand replica. Primate reach-to-grasp behavior is characterized by four components- reach, hand shaping, orientation and the closing of the fingers around the object. Dexterity, characterized by the active generation of force through the fingertips to maintain stable grasp and/or to manipulate an object, can be considered as an additional component of hand behavior. Given our success in developing an anthropomorphic arm prosthesis, we expect to extract the signals necessary to achieve dexterous prosthetic hand control using activity recorded from populations of single neurons. In our present arm-only control scheme, we have successfully extracted the velocity of the arm from the recorded brain activity. To reach our ultimate goal of dexterous control, we will also need to control wrist orientation, hand shape and finger force application. Since each of these control categories is multidimensional, the overall control problem is very difficult. We will use a number of strategies to address this difficult problem. An interdisciplinary team of neurophysiologists, engineers, statisticians, robotocists and psychophysicists with a strong history of collaboration has been assembled to develop the pieces needed for this project. The project will be led by Andrew Schwartz at the University of Pittsburgh where the prosthetic control will take place. Yoky Matsuoka at Carnegie Mellon will build the highly anthropomorphic robots and behavioral manipulanda. Rob Kass, also at Carnegie Mellon, will develop the extraction algorithms relating neural activity to movement. Marco Santello and Stephen Helms-Tillery at Arizona State University will develop the behavioral tasks using a primate model and then record cortical activity as these tasks are performed. Dr. Soechting, at the University of Minnesota, will provide detailed psychophysical data describing the way subjects exert finger forces to manipulate objects. Peter Allen, at Columbia, will develop automated robotic grasp and finger placement algorithms for the brain-controlled prosthetic hand.

Agency
National Institute of Health (NIH)
Institute
National Institute of Neurological Disorders and Stroke (NINDS)
Type
Research Project (R01)
Project #
5R01NS050256-05
Application #
7922526
Study Section
Special Emphasis Panel (ZRG1-IFCN-K (50))
Program Officer
Chen, Daofen
Project Start
2006-09-18
Project End
2014-08-31
Budget Start
2010-09-01
Budget End
2014-08-31
Support Year
5
Fiscal Year
2010
Total Cost
$1,026,041
Indirect Cost
Name
University of Pittsburgh
Department
Biology
Type
Schools of Medicine
DUNS #
004514360
City
Pittsburgh
State
PA
Country
United States
Zip Code
15213
Helou, Leah B; Rosen, Clark A; Wang, Wei et al. (2018) Intrinsic Laryngeal Muscle Response to a Public Speech Preparation Stressor. J Speech Lang Hear Res 61:1525-1543
Degenhart, Alan D; Hiremath, Shivayogi V; Yang, Ying et al. (2018) Remapping cortical modulation for electrocorticographic brain-computer interfaces: a somatotopy-based approach in individuals with upper-limb paralysis. J Neural Eng 15:026021
Yang, Ying; Dickey, Michael Walsh; Fiez, Julie et al. (2017) Sensorimotor experience and verb-category mapping in human sensory, motor and parietal neurons. Cortex 92:304-319
Schwartz, Andrew B (2016) Movement: How the Brain Communicates with the World. Cell 164:1122-1135
Degenhart, Alan D; Eles, James; Dum, Richard et al. (2016) Histological evaluation of a chronically-implanted electrocorticographic electrode grid in a non-human primate. J Neural Eng 13:046019
Hiremath, Shivayogi V; Chen, Weidong; Wang, Wei et al. (2015) Brain computer interface learning for systems based on electrocorticography and intracortical microelectrode arrays. Front Integr Neurosci 9:40
Perel, Sagi; Schwartz, Andrew B; Ventura, Valérie (2014) Single-snippet analysis for detection of postspike effects. Neural Comput 26:40-56
Ghuman, Avniel Singh; Brunet, Nicolas M; Li, Yuanning et al. (2014) Dynamic encoding of face information in the human fusiform gyrus. Nat Commun 5:5672
Perel, Sagi; Schwartz, Andrew B; Ventura, Valérie (2014) Automatic scan test for detection of functional connectivity between cortex and muscles. J Neurophysiol 112:490-9
Velliste, Meel; Kennedy, Scott D; Schwartz, Andrew B et al. (2014) Motor cortical correlates of arm resting in the context of a reaching task and implications for prosthetic control. J Neurosci 34:6011-22

Showing the most recent 10 out of 39 publications