Adaptation is central to biological motor control because our muscles, our motor plant, and the environment that we interact with have time varying properties. Some of these properties change suddenly and temporarily while others change slowly and may last a long time. We suggest that the way that the brain learns motor control is to a great extent a reflection of these time scales of change. In effect, we propose that the brain treats adaptation as a statistical problem that includes prior information about timescales of change. Our new approach solves two major problems which have significantly curtailed our current understanding of the neural basis of adaptation: (1) Current models of movement adaptation focus almost exclusively on error. On every trial, the error is associated with the present context and the system adapts its internal model by changing parameter values or weights. However, there is ample evidence that behavior can change not only as a function of the magnitude of errors, but also as a function of when these errors are made. Our approach predicts the strong dependence on the temporal and contextual history of the training trials in adaptation experiments. (2) Traditional motor adaptation theories assume that the CNS chooses a desired trajectory, estimates internal model parameters through trial and error, and then produces motor commands that move the limb along this desired trajectory. However, movements have costs and gains that are often described in terms of their end result, not a specific trajectory. Indeed, close inspection of behavior during adaptation reveals clear deviations from the predictions of a desired trajectory assumption. Here we treat the problems of uncertainty about the world and our motor plant as well as cost functions in a single framework. We suggest a new theory to guide experiments in sensorimotor learning. What we are proposing here is a fundamental shift away from the current focus on motor error and desired trajectories - ideas that have been the mainstays of sensorimotor research. First, we link learning of internal models to a causal structure of how the body might be affected by real world perturbations. Next, we link changes in internal models to changes in sensorimotor control. As a result, we suggest that the adaptive behavior that we and others have measured is really a result of two concurrent computational processes: statistical formulation of internal models (a process akin to system identification), and the use of those internal models in the framework of optimal control to produce motor commands. Development of this new theoretical framework will ultimately shed light on the computations that are performed by structures in the brain that participate in control of our movements.

Agency
National Institute of Health (NIH)
Institute
National Institute of Neurological Disorders and Stroke (NINDS)
Type
Research Project (R01)
Project #
5R01NS057814-04
Application #
7661547
Study Section
Special Emphasis Panel (ZRG1-IFCN-B (50))
Program Officer
Liu, Yuan
Project Start
2006-08-02
Project End
2010-07-31
Budget Start
2009-08-01
Budget End
2010-07-31
Support Year
4
Fiscal Year
2009
Total Cost
$242,183
Indirect Cost
Name
Johns Hopkins University
Department
Biomedical Engineering
Type
Schools of Medicine
DUNS #
001910777
City
Baltimore
State
MD
Country
United States
Zip Code
21218
Wei, Kunlin; Yan, Xiang; Kong, Gaiqing et al. (2014) Computer use changes generalization of movement learning. Curr Biol 24:82-85
Albert, Mark V; McCarthy, Cliodhna; Valentin, Juliana et al. (2013) Monitoring functional capability of individuals with lower limb amputations using mobile phones. PLoS One 8:e65340
Yan, Xiang; Wang, Qining; Lu, Zhengchuan et al. (2013) Generalization of unconstrained reaching with hand-weight changes. J Neurophysiol 109:137-46
Dam, Gregory; Kording, Konrad; Wei, Kunlin (2013) Credit assignment during movement reinforcement learning. PLoS One 8:e55352
Izawa, Jun; Criscimagna-Hemminger, Sarah E; Shadmehr, Reza (2012) Cerebellar contributions to reach adaptation and learning sensory consequences of action. J Neurosci 32:4230-9
Ahmadi-Pajouh, Mohammad Ali; Towhidkhah, Farzad; Shadmehr, Reza (2012) Preparing to reach: selecting an adaptive long-latency feedback controller. J Neurosci 32:9537-45
Vilares, Iris; Dam, Gregory; Kording, Konrad (2011) Trust and reciprocity: are effort and money equivalent? PLoS One 6:e17113
Vilares, Iris; Kording, Konrad (2011) Bayesian models: the structure of the world, uncertainty, behavior, and the brain. Ann N Y Acad Sci 1224:22-39
Orban de Xivry, Jean-Jacques; Marko, Mollie K; Pekny, Sarah E et al. (2011) Stimulation of the human motor cortex alters generalization patterns of motor learning. J Neurosci 31:7102-10
Albert, Mark V; Kording, Konrad P (2011) Determining posture from physiological tremor. Exp Brain Res 215:247-55

Showing the most recent 10 out of 29 publications