The visual system has developed robust mechanisms to solve the complex computational problem of object recognition. The responses of neurons at the highest level of the macaque visual processing system, anterior inferotemporal cortex (AIT), are selective for complex objects and are critical for object identification. The responses of AIT neurons depend not only on the stimuli encountered in any given moment, but are also strongly influenced by the recent history of stimulation (adaptation). The overall aim of this proposal is a systematic understanding of factors that influence the adaptive state of AIT neurons and to determine the effects of adaptation on the coding of visual objects. Our inquiries into adaptation in AIT are two-fold. First, we propose to use adaptation as a tool to probe stimulus selectivity in AIT. At earlier stages of the visual system (such as V1 and MT), adaptation to prolonged visual stimulation results in shifted tuning functions and these shifts are correlated with shifts in perception. These adaptive shifts are thought to arise as a consequence of disrupting the circuitry that acts to mold tuning in these areas, and have provided insight into the mechanisms underlying stimulus selectivity. In AIT, adaptation is strong and is selective for shape.
Our aim i s to determine whether and how adaptation changes the stimulus selectivity of AIT neurons. Specifically, we propose to explore the effect of adaptation on a variety of AIT 'tuning' dimensions to gain insight into the mechanisms underlying these complex and little-understood receptive fields. Second, our aim is to understand how adaptation impacts the encoding of objects during natural vision. On the timescales of natural vision, adaptation in AIT is robust and shape-selective. This suggests that adaptation alters object coding across the AIT population. In particular, natural temporal image sequences are likely to produce strong adaptation effects and may thus provide important clues into the role of adaptation in object coding in the ventral visual stream. Understanding the neural coding of objects is critical to a deep understanding of human visual perception and long-term memory, and is needed to meaningfully repair the disruption of these brain processes or to create prosthetics that may stand in for such disruption. ? ? ?
Rust, Nicole C; DiCarlo, James J (2012) Balanced increases in selectivity and tolerance produce constant sparseness along the ventral visual stream. J Neurosci 32:10170-82 |
Rust, Nicole C; Dicarlo, James J (2010) Selectivity and tolerance (""invariance"") both increase as visual information propagates from cortical area V4 to IT. J Neurosci 30:12978-95 |