Millions of people worldwide suffer from neurological injury and disease resulting in profound movement impairment. Often the disability is so severe that it is not possible to feed oneself or readily communicate. A new class of medical system termed brain-machine interfaces (BMIs) has emerged from research labs in the past decade and is now poised to dramatically improve these patients'quality of life. BMIs """"""""read out"""""""" neural electrical activity directly from motor structures in the brain and decode these electrical impulses in order to determine the intended movement. Initial versions of BMI systems that control a computer cursor are now in FDA Phase-I clinical trials, and numerous agencies are actively engaged in clinical translation (e.g., NIH, DARPA, VA). Creating control signals to enable an amputee to feed himself with a prosthetic (robotic) arm and hand will require decoding signals from thousands of electrodes, rather than the hundred or so signals current systems read, as well as encoding thousands of sensor signals from the arm and hand into thousands of artificial neural signals to be """"""""written into"""""""" the brain, which has not yet been attempted. The lack of low-power (so that it can be implanted) electronic circuitry needed to run BMIs'encoding and decoding algorithms (termed codecs) is a fundamental barrier to successful clinical translation. The technologies available until now are too power-hungry (digital) or too algorithmically inflexible (analog) to meet the challenge. Recent advances in neuromorphic engineering make it now possible to build a fully implantable and programmable codec chip. This innovative approach combines digital's and analog's best features-programmability and efficiency-while offering far greater robustness than either. Meanwhile recent advances in neuroscience techniques make it now possible to obtain the knowledge needed to design the right algorithms to run on our codec chip. Optogenetic stimulaton can now be used to drive neurons in macaque cortex and computer vision can now be used to track freely moving monkeys while recording wirelessly. We propose to leverage these recent advances to dramatically increase prosthetic performance through the principled design of: (1) An entirely new class of encoders that can spatio-temporally pattern neural activity via optogenetic techniques. (2) An entirely new class of decoders that can operate in the real world with animals moving freely around in far less constrained settings. (3) An entirely new class of implantable programmable electronics that achieves the level of energy- efficiency required to run these complex algorithms. We will demonstrate our success by having a freely moving primate, with a 96-microelectrode recording array and a 9-channel optogenetic stimulator implanted in its premotor and somatosensory cortex, respectively, control a human-like robotic arm. Our ultimate goal is to realize the neuromorphic engineer's dream: Helping untold millions with neurological injury by replacing damaged neural tissue with chips that work like the brain.
Millions of people worldwide suffer from neurological injury and disease resulting in profound movement impairment. Brain-machine interfaces (BMIs) read out neural electrical activity directly from motor structures in the brain and decodes these signals in order to execute the intended movement with a robotic arm. This project seeks to increase BMI performance dramatically by leveraging recent advances in systems neuroscience and neuromorphic engineering.
|Kao, Jonathan C; Nuyujukian, Paul; Ryu, Stephen I et al. (2015) Single-trial dynamics of motor cortex and their applications to brain-machine interfaces. Nat Commun 6:7759|
|Even-Chen, Nir; Stavisky, Sergey D; Kao, Jonathan C et al. (2015) Auto-deleting brain machine interface: Error detection using spiking neural activity in the motor cortex. Conf Proc IEEE Eng Med Biol Soc 2015:71-5|
|Sussillo, David; Churchland, Mark M; Kaufman, Matthew T et al. (2015) A neural network that finds a naturalistic solution for the production of muscle activity. Nat Neurosci 18:1025-33|
|Nuyujukian, Paul; Fan, Joline M; Kao, Jonathan C et al. (2015) A high-performance keyboard neural prosthesis enabled by task optimization. IEEE Trans Biomed Eng 62:21-9|
|Stavisky, Sergey D; Kao, Jonathan C; Nuyujukian, Paul et al. (2015) A high performing brain-machine interface driven by low-frequency local field potentials alone and together with spikes. J Neural Eng 12:036009|
|Shenoy, Krishna V; Carmena, Jose M (2014) Combining decoder design and neural adaptation in brain-machine interfaces. Neuron 84:665-80|
|Fan, Joline M; Nuyujukian, Paul; Kao, Jonathan C et al. (2014) Intention estimation in brain-machine interfaces. J Neural Eng 11:016004|
|Foster, Justin D; Nuyujukian, Paul; Freifeld, Oren et al. (2014) A freely-moving monkey treadmill model. J Neural Eng 11:046020|
|Power, Jonathan D; Schlaggar, Bradley L; Petersen, Steven E (2014) Studying brain organization via spontaneous fMRI signal. Neuron 84:681-96|
|Nuyujukian, Paul; Kao, Jonathan C; Fan, Joline M et al. (2014) Performance sustaining intracortical neural prostheses. J Neural Eng 11:066003|
Showing the most recent 10 out of 16 publications