Objects move through the environment in three dimensions, and humans are clearly capable of perceiving such motion in depth. Visual neuroscientists do not, however, know how our nervous system encodes this fundamental aspect of the visual world. Despite large literatures motion and depth perception, there is a surprising lack of knowledge integrating these two visual features to directly characterize how the brain processes the three-dimensional direction of moving objects. The goal of this proposed research is to understand how neural circuits in the primate brain exploit binocular information to represent the direction of objects moving through a 3D environment. First, we will psychophysically characterize the binocular cues to 3D motion. Recent work suggests that the perception of motion through depth relies on two binocular cues, one based on changing disparities over time, and one based on an inter-ocular comparison of velocities. Our overarching hypothesis is that the velocity-based cue is of great importance for the perception of 3D motion. We will therefore perform psychophysical experiments that isolate eye-specific motion signals and characterize them relative to (and in interaction with) disparity-based signals. These experiments will unpack the psychophysical building blocks and signatures of this important perceptual information, and refine visual displays used for neuroimaging and electrophysiological studies. Second, we will use neuroimaging to identify the neural circuits that process 3D motion. Taking stimuli and insights from our psychophysical experiments, we will perform fMRI experiments to visualize this processing in the human brain. Direction-selective adaptation protocols will be used to characterize both the disparity-based and velocity-based cues and their interactions, and to understand how (or if) these cues are integrated into a single (cue-independent) representation of 3D motion. These experiments will also assess how directly psychophysical assays of the system map on to neural signals. Third, we will perform electrophysiology to specify the underlying neural computations. Guided by the psychophysics and neuroimaging, we will perform single-neuron recordings to characterize the binocular neural signals that encode 3D motion. Recordings in V1 will employ multi-electrode arrays;recordings in MT will employ both multiple-tetrode and single-electrode awake preparations. This work will test the hypothesis that eye-specific motion signals are represented at the level of V1 and are then integrated (by single neurons) in MT. This 3D motion pathway may be exposed at slower speeds, and thus may be multiplexed in the same circuitry known to extract 2D/frontoparallel direction when assessed using faster speeds.
Objects in the real world move through three dimensions, and humans rely on their ability to sense motion in depth in order to guide appropriate actions. A thorough understanding of the neural basis of the perception of 3D motion will prove valuable for the refinement of biomedical technologies involving the visually-guided control of robotic or prosthetic devices in a dynamic three-dimensional environment.
| Pattadkal, Jagruti J; Mato, German; van Vreeswijk, Carl et al. (2018) Emergent Orientation Selectivity from Random Networks in Mouse Visual Cortex. Cell Rep 24:2042-2050.e6 |
| Huk, Alexander; Bonnen, Kathryn; He, Biyu J (2018) Beyond Trial-Based Paradigms: Continuous Behavior, Ongoing Neural Activity, and Natural Stimuli. J Neurosci 38:7551-7558 |
| Cormack, Lawrence K; Czuba, Thaddeus B; Knöll, Jonas et al. (2017) Binocular Mechanisms of 3D Motion Processing. Annu Rev Vis Sci 3:297-318 |
| Bonnen, Kathryn; Huk, Alexander C; Cormack, Lawrence K (2017) Dynamic mechanisms of visually guided 3D motion tracking. J Neurophysiol 118:1515-1531 |
| Joo, Sung Jun; Czuba, Thaddeus B; Cormack, Lawrence K et al. (2016) Separate Perceptual and Neural Processing of Velocity- and Disparity-Based 3D Motion Signals. J Neurosci 36:10791-10802 |
| Joo, Sung Jun; Katz, Leor N; Huk, Alexander C (2016) Decision-related perturbations of decision-irrelevant eye movements. Proc Natl Acad Sci U S A 113:1925-30 |
| Greer, Devon A; Bonnen, Kathryn; Huk, Alexander C et al. (2016) Speed discrimination in the far monocular periphery: A relative advantage for interocular comparisons consistent with self-motion. J Vis 16:7 |
| Katz, Leor N; Hennig, Jay A; Cormack, Lawrence K et al. (2015) A Distinct Mechanism of Temporal Integration for Motion through Depth. J Neurosci 35:10212-6 |
| Bonnen, Kathryn; Burge, Johannes; Yates, Jacob et al. (2015) Continuous psychophysics: Target-tracking to measure visual sensitivity. J Vis 15: |
| Goonetilleke, Samanthi C; Katz, Leor; Wood, Daniel K et al. (2015) Cross-species comparison of anticipatory and stimulus-driven neck muscle activity well before saccadic gaze shifts in humans and nonhuman primates. J Neurophysiol 114:902-13 |
Showing the most recent 10 out of 15 publications
