Integration of multiple sensory inputs is required for robust perception and behavioral performance. Recent psychophysical studies indicate that humans combine cues according to a statistically optimal weighting scheme derived from Bayesian probability theory. When we make perceptual judgments that rely on two separate cues, we are able to take into account the reliability of each cue, even when this reliability varies randomly from trial to trial. Bayesian theory also predicts an improvement in behavioral performance when two sensory cues are present, as compared with only one cue. One particularly vital task that involves multisensory integration is the estimation of self-motion, or heading. Information from both visual (`optic flow') and vestibular cues can be useful for heading perception, yet little is known about the principles and neural substrates for cue integration. Using a sophisticated virtual reality system, we have developed a novel behavioral paradigm for studying cue integration in rhesus monkeys. Here we propose to test specific hypotheses regarding a role of the dorsal medial superior temporal area (MSTd) and ventral intraparietal area (VIP) in visual/vestibular cue integration.
In aim 1, we will record from MSTd and VIP neurons while the monkey performs a heading discrimination task, based on vestibular cues alone, visual cues alone and combined presentation of both cues. We hypothesize that MSTd/VIP neurons with `congruent'visual/vestibular responses constitute a neural substrate for Bayesian cue integration, including cue re-weighting when visual reliability changes.
In aim 2, we will probe for causal links between MSTd/VIP neurons and multi-sensory cue integration for heading perception by manipulating neural activity using microstimulation and reversible chemical inactivation techniques.
In aim 3, we explore the functional roles of MSTd/VIP neurons having `opposite', as compared to `congruent', visual/vestibular responses. We will test specific hypotheses, the most prominent of which is a potential role of neurons with opposite visual/vestibular preferences on disambiguating the components of visual motion that are due to object motion from those due to self-motion. Combined these aims will provide a fundamental breakthrough in our understanding of multisensory cortex, as well as more generally how the brain computes using probabilities. The general principles that we uncover regarding sensory integration should have wide application to many issues in systems-level neuroscience. Understanding the neural basis of multisensory integration and self-motion perception would also promote new strategies for treating spatial disorientation deficits common to many brain dysfunctions, including Alzheimer's disease. One of these deficits is an impaired ability to judge heading from optic flow, and this impairment is correlated with patients'difficulty in navigating through their surroundings. Better localization of these functions in a primate animal model would help targeting new Alzheimer's therapies to the appropriate brain regions.
Understanding the neural basis of multisensory integration and self-motion perception would also promote new strategies for treating spatial disorientation deficits common to many brain dysfunctions, including Alzheimer's disease. One of these deficits is an impaired ability to judge heading from optic flow, and this impairment is correlated with patients'difficulty in navigating through their surroundings. Better localization of these functions in a primate animal model would help targeting new Alzheimer's therapies to the appropriate brain regions.
| Seilheimer, Robert L; Rosenberg, Ari; Angelaki, Dora E (2014) Models and processes of multisensory cue combination. Curr Opin Neurobiol 25:38-46 |
| Nadler, Jacob W; Barbash, Daniel; Kim, HyungGoo R et al. (2013) Joint representation of depth from motion parallax and binocular disparity cues in macaque area MT. J Neurosci 33:14061-74, 14074a |
| Fetsch, Christopher R; DeAngelis, Gregory C; Angelaki, Dora E (2013) Bridging the gap between theories of sensory cue integration and the physiology of multisensory neurons. Nat Rev Neurosci 14:429-42 |
| Chen, Aihua; Deangelis, Gregory C; Angelaki, Dora E (2013) Functional specializations of the ventral intraparietal area for multisensory heading discrimination. J Neurosci 33:3567-81 |
| Fetsch, Christopher R; Pouget, Alexandre; DeAngelis, Gregory C et al. (2012) Neural correlates of reliability-based cue weighting during multisensory integration. Nat Neurosci 15:146-54 |
| Gu, Yong; Deangelis, Gregory C; Angelaki, Dora E (2012) Causal links between dorsal medial superior temporal area neurons and multisensory heading perception. J Neurosci 32:2299-313 |
| Zaidel, Adam; Turner, Amanda H; Angelaki, Dora E (2011) Multisensory calibration is independent of cue reliability. J Neurosci 31:13949-62 |
| Yang, Yun; Liu, Sheng; Chowdhury, Syed A et al. (2011) Binocular disparity tuning and visual-vestibular congruency of multisensory neurons in macaque parietal cortex. J Neurosci 31:17905-16 |
| Gu, Yong; Liu, Sheng; Fetsch, Christopher R et al. (2011) Perceptual learning reduces interneuronal correlations in macaque visual cortex. Neuron 71:750-61 |
| Ohshiro, Tomokazu; Angelaki, Dora E; DeAngelis, Gregory C (2011) A normalization model of multisensory integration. Nat Neurosci 14:775-82 |
Showing the most recent 10 out of 19 publications
