Decisions about visual stimuli are frequently shaped by inputs from other sensory modalities. The goal of this proposal is to gain a deeper understanding of the neural mechanisms that enable integration of visual and auditory inputs for decision-making. Behavioral experiments have established that subjects can integrate information across sensory modalities to make better decisions. Further, subjects weight each sensory modality in proportion to its reliability. Experimenters can estimate subjects'""""""""perceptual weights"""""""" by presenting conflicting information to two sensory modalities and examining the degree to which decisions are biased toward one modality or the other. Despite a wealth of data about the behavioral consequences of multisensory stimuli, much remains unknown about the underlying neural mechanisms. By collecting electrophysiological and behavioral data together, we are in an ideal position to connect multisensory decision-making to its underlying neural mechanism. My central hypothesis is that neurons will show greater stimulus-driven modulation for multisensory stimuli than for unisensory stimuli and that the """"""""neural weights"""""""" that we estimate by comparing unisensory and multisensory responses will be similar for reliable and unreliable stimuli. The posterior parietal cortex is a candidate area for supporting multisensory improvements in rats: it receives inputs from auditory/visual areas and plays a role in motor planning.
In Aim 1, we will estimate humans'and rats'""""""""perceptual weights"""""""" on a novel decision-making task in which subjects judge the overall rate of a stream of """"""""events"""""""": i.e. flashes, clicks or both together.
In Aim 2, we will collect electrophysiological data from posterior parietal corte of rats while they are engaged in the task to establish that responses reflect decision-related activity.
In Aim 3, we will measure responses for unisensory vs. multisensory stimuli at different levels of stimulus reliability. For each level of reliability, we will estimate the """"""""neural weights that describe the degree of stimulus-driven modulation for auditory vs. visual inputs. If the neural weights, like the perceptual weights, change with reliability, this would suggest that stimulus reliability is explicitly encoded by single neurons. If, instead, the neural weights remain unchanged for high- vs. low-reliability stimuli, this would suggest that reliability is automaticaly encoded by a population response that naturally become more variable when it has a lower gain. The latter possibility is predicted by an optimal model of decision-making.

Public Health Relevance

Abnormalities in multisensory processing are associated with several developmental disorders including Autism Spectrum Disorders. Impairments in multisensory processing have also been observed in patients with a poorly understood collection of sensory abnormalities known together as Sensory Processing Disorder. The research studies proposed here will define the neural mechanisms involved in multisensory integration. These studies will inform our clinical understanding of disorders characterized by deficits in multisensory processing, and may in turn lead to new therapeutic interventions.

National Institute of Health (NIH)
National Eye Institute (NEI)
Research Project (R01)
Project #
Application #
Study Section
Special Emphasis Panel (SPC)
Program Officer
Steinmetz, Michael A
Project Start
Project End
Budget Start
Budget End
Support Year
Fiscal Year
Total Cost
Indirect Cost
Cold Spring Harbor Laboratory
Cold Spring Harbor
United States
Zip Code
Juavinett, Ashley L; Erlich, Jeffrey C; Churchland, Anne K (2018) Decision-making behaviors: weighing ethology, complexity, and sensorimotor compatibility. Curr Opin Neurobiol 49:42-50
Licata, Angela M; Kaufman, Matthew T; Raposo, David et al. (2017) Posterior Parietal Cortex Guides Visual Decisions in Rats. J Neurosci 37:4954-4966
Pennock, Steven; Kim, Leo A; Kazlauskas, Andrius (2016) Vascular Endothelial Cell Growth Factor A Acts via Platelet-Derived Growth Factor Receptor ? To Promote Viability of Cells Enduring Hypoxia. Mol Cell Biol 36:2314-27
Churchland, A K; Kiani, R (2016) Three challenges for connecting model to mechanism in decision-making. Curr Opin Behav Sci 11:74-80
Raposo, David; Kaufman, Matthew T; Churchland, Anne K (2014) A category-free neural population supports evolving demands during decision-making. Nat Neurosci 17:1784-1792
Sheppard, John P; Raposo, David; Churchland, Anne K (2013) Dynamic weighting of multisensory stimuli shapes decision-making in rats and humans. J Vis 13:
Carandini, Matteo; Churchland, Anne K (2013) Probing perceptual decisions in rodents. Nat Neurosci 16:824-31
Churchland, Anne K; Ditterich, Jochen (2012) New advances in understanding decisions among multiple alternatives. Curr Opin Neurobiol 22:920-6