Functional Electrical Stimulation (FES) is the electrical activation of peripheral nerves and muscles to restore motor function lost due to injury or disease (e.g., spinal cord injury, stroke, cerebral palsy). Optimal implementation of FES requires muscle activation patterns such that resulting movements functionally duplicate those of healthy individuals. Current FES technology utilizes fixed stimulation patterns, and movements do not yet have the smoothness, flexibility, and efficiency of normal human movement. A more desirable approach would be to develop intelligent control systems that can self-optimize by learning from experience. Reinforcement learning is a technique in which learning rules and reinforcement of successful parameters are used to achieve improvements in control over time. To date, reinforcement learning has not been used to refine control of upper extremity FES systems. For my project, I will initially apply reinforcement learning methods to FES control using a computer model of a FES-activated arm. In the subsequent stage of this project, I will apply reinforcement learning to the control of FES systems implanted in paralyzed individuals and quantify the improvements in arm movement quality.

Agency
National Institute of Health (NIH)
Institute
Eunice Kennedy Shriver National Institute of Child Health & Human Development (NICHD)
Type
Predoctoral Individual National Research Service Award (F31)
Project #
5F31HD049326-04
Application #
7417563
Study Section
Special Emphasis Panel (ZRG1-BDCN-A (29))
Program Officer
Nitkin, Ralph M
Project Start
2005-04-01
Project End
2010-03-31
Budget Start
2008-04-01
Budget End
2009-03-31
Support Year
4
Fiscal Year
2008
Total Cost
$45,327
Indirect Cost
Name
Case Western Reserve University
Department
Biomedical Engineering
Type
Schools of Engineering
DUNS #
077758407
City
Cleveland
State
OH
Country
United States
Zip Code
44106
Jagodnik, Kathleen M; Blana, Dimitra; van den Bogert, Antonie J et al. (2015) An optimized proportional-derivative controller for the human upper extremity with gravity. J Biomech 48:3701-9
Jagodnik, Kathleen M; van den Bogert, Antonie J (2010) Optimization and evaluation of a proportional derivative controller for planar arm movement. J Biomech 43:1086-91
Thomas, Philip; Branicky, Michael; van den Bogert, Antonie et al. (2009) Application of the Actor-Critic Architecture to Functional Electrical Stimulation Control of a Human Arm. Proc Innov Appl Artif Intell Conf 2009:165-172