Humans make decisions and perform actions in situations in which all aspects of the decision or action are potentially stochastic. There are five components to the planning of an action based on sensory information. First, the subject has prior information about the state of the environment including the current positions and velocities of nearby objects and of the subject's own body; this information is almost certainly incomplete, and can be summarized as a probability distribution across possible world states. Second, the subject has sensory input about the current state of the environment, and that input will also be uncertain due to physical and neural noise sources. Third, the subject combines these two sources of information and decides on an intended action (button press, reaching movement, eye movement, or a more complex movement plan that includes responses to potential subsequent sensory inputs). Fourth, the resulting action can differ from the intended one due to motor noise. Finally, the interaction of the resulting action with the current environment leads to a consequence (a loss or gain) for the subject, and this consequence may be random as well. As a result of all these stochastic components, both visual tasks and movement planning require a calculation that is equivalent to that required for decision-making under risk. In our recent work, we have delineated situations in which humans are nearly optimal in visuo-motor tasks in that they maximize expected gain, and other circumstances in which human behavior is suboptimal. We propose experiments to better understand the nature of human behavior in visual and visuo-motor tasks. We continue to use tasks with an experimenter-specified reward/penalty structure so that we may compare behavior with the optimal strategy that maximizes expected gain. We ask the following questions and propose experiments to address each: (1) What aspects of task uncertainty are estimated well by human observers and used optimally to select a movement plan? We will determine whether humans optimally plan movements under risk as sensory input and/or motor output is made noisier by a variety of means. (2) How flexible is movement planning in response to changes in different components of a visuo-motor task? We will measure the progress of learning in visuo-motor tasks in which prior probabilities, motor outcome or payoff are uncertain and changing over time. (3) In daily life, detection, discrimination and search for visual targets are required to guide action toward those targets as a means of obtaining later rewards. Here, we ask if humans are optimal in typical visual tasks when clearly defined gains and losses are involved. We will determine whether human performance in visual detection, discrimination and search tasks is optimal by comparing human performance to ideal-observer models that maximize expected gain in situations with asymmetric payoffs.

Public Health Relevance

The proposed work benefits public health by characterizing the neural mechanisms that are involved with making perceptual decisions or using sensory information to control movements. We show how optimal decisions and movement plans must take into account prior knowledge, the uncertainty of visual information, the variability of motor response and unknown or changing payoffs. A variety of medical conditions can impact both the reliability of visual information (e.g., cataract, amblyopia, etc.) and the quality of motor output (e.g., Parkinson's disease, stroke). The proposed research will improve our understanding of what is meant by an optimal perceptual decision or movement plan, and thus can serve to help in the design of rehabilitative plans when sensory input or motor output is disrupted (change in bias, gain and/or variability) by disease or other health-related conditions. ? ? ?

Agency
National Institute of Health (NIH)
Institute
National Eye Institute (NEI)
Type
Research Project (R01)
Project #
2R01EY008266-19
Application #
7474253
Study Section
Central Visual Processing Study Section (CVP)
Program Officer
Oberdorfer, Michael
Project Start
1989-08-01
Project End
2011-06-30
Budget Start
2008-07-01
Budget End
2009-06-30
Support Year
19
Fiscal Year
2008
Total Cost
$318,685
Indirect Cost
Name
New York University
Department
Psychology
Type
Schools of Arts and Sciences
DUNS #
041968306
City
New York
State
NY
Country
United States
Zip Code
10012
Aschner, Amir; Solomon, Samuel G; Landy, Michael S et al. (2018) Temporal Contingencies Determine Whether Adaptation Strengthens or Weakens Normalization. J Neurosci 38:10129-10142
Protonotarios, Emmanouil D; Griffin, Lewis D; Johnston, Alan et al. (2018) A spatial frequency spectral peakedness model predicts discrimination performance of regularity in dot patterns. Vision Res 149:102-114
Locke, Shannon M; Landy, Michael S (2017) Temporal causal inference with stochastic audiovisual sequences. PLoS One 12:e0183776
Rizzo, John-Ross; Hosseini, Maryam; Wong, Eric A et al. (2017) The Intersection between Ocular and Manual Motor Control: Eye-Hand Coordination in Acquired Brain Injury. Front Neurol 8:227
Norton, Elyse H; Fleming, Stephen M; Daw, Nathaniel D et al. (2017) Suboptimal Criterion Learning in Static and Dynamic Environments. PLoS Comput Biol 13:e1005304
Rizzo, John-Ross; Fung, James K; Hosseini, Maryam et al. (2017) Eye Control Deficits Coupled to Hand Control Deficits: Eye-Hand Incoordination in Chronic Cerebral Injury. Front Neurol 8:330
Rizzo, John-Ross; Hudson, Todd E; Abdou, Andrew et al. (2017) Disrupted Saccade Control in Chronic Cerebral Injury: Upper Motor Neuron-Like Disinhibition in the Ocular Motor System. Front Neurol 8:12
Sun, Peng; Landy, Michael S (2016) A Two-Stage Process Model of Sensory Discrimination: An Alternative to Drift-Diffusion. J Neurosci 36:11259-11274
Westrick, Zachary M; Heeger, David J; Landy, Michael S (2016) Pattern Adaptation and Normalization Reweighting. J Neurosci 36:9805-16
Hudson, Todd E; Landy, Michael S (2016) Sinusoidal error perturbation reveals multiple coordinate systems for sensorymotor adaptation. Vision Res 119:82-98

Showing the most recent 10 out of 113 publications