The human visual system parses the information that reaches our eyes into a meaningful arrangement of regions and objects. This process, called image segmentation, is one of the most challenging computations accomplished by the primate brain. To discover its neural basis we will study neuronal processes in two brain areas in the macaque monkey-V4, a fundamental stage of form processing along the occipito-temporal pathway, and the prefrontal cortex (PFC), important for executive control. Dysfunctions of both areas impair shape discrimination behavior in displays that require the identification of segmented objects, strongly suggesting that they are important for image segmentation. Our experimental techniques will include single and multielectrode recordings, behavioral manipulations, perturbation methods and computer models.
In Aim 1 we will identify the neural signals that reflect segmentation in visual cortex. Using a variety of parametric stimuli with occlusion, clutter and shadows-stimulus features known to challenge segmentation in natural vision-we will evaluate whether segmentation is achieved by grouping regions with similar surface properties, such as surface color, texture and depth, or by grouping contour segments that are likely to form the boundary of an object or some interplay between these two strategies. We will test the hypothesis that contour grouping mechanisms are most effective under low clutter and close to the fovea.
In Aim 2, we will investigate how feedback from PFC modulates shape responses in V4 and facilitates segmentation: we will test the longstanding hypothesis that object recognition in higher cortical stages precedes and facilitates segmentation in the midlevels of visual form processing. We will simultaneously study populations of V4 and PFC neurons while animals engage in shape discrimination behavior. We will use single-trial decoding methods and correlation analyses to relate the content and timing of neuronal responses in the two areas. To causally test the role of feedback from PFC, we will reversibly inactivate PFC by cooling and study V4 neurons. Our results will provide the first detailed, analytical models of V4 neuronal response dynamics in the presence of occlusion and clutter and advance our understanding of how complex visual scenes are processed in area V4. They will also reveal how V4 and PFC together mediate performance on a complex shape discrimination task, how executive function and midlevel vision may be coordinated during behavior and how feedback is used in cortical computation. Object recognition is impaired in visual agnosia, a dysfunction of the occipito-temporal pathway, and in dysfunctions of the PFC (e.g. schizophrenia). Results from these experiments will constitute a major advance in our understanding of the brain computations that underlie segmentation and object recognition and will bring us closer to devising strategies to alleviate and treat brain disorders in which these capacities are impaired.
A fundamental capacity of the primate visual system is its ability to segment visual scenes into component objects and then recognize those objects regardless of partial occlusions and clutter. Using a combination of primate neurophysiology experiments, computational modeling, animal behavior and reversible inactivation methods, we hope to achieve a new level of understanding about visual processing in the context of object recognition; these findings will ultimately bring us closer to devising strategies to alleviate and treat brain disorders of impaired object recognition resulting from dysfunctions in the occipito-temporal pathway (e.g. agnosia) and the prefrontal cortex (e.g. schizophrenia).
| Choi, Hannah; Pasupathy, Anitha; Shea-Brown, Eric (2018) Predictive Coding in Area V4: Dynamic Shape Discrimination under Partial Occlusion. Neural Comput 30:1209-1257 |
| Oleskiw, Timothy D; Nowack, Amy; Pasupathy, Anitha (2018) Joint coding of shape and blur in area V4. Nat Commun 9:466 |
| Fyall, Amber M; El-Shamayleh, Yasmine; Choi, Hannah et al. (2017) Dynamic representation of partially occluded objects in primate prefrontal and visual cortex. Elife 6: |
| El-Shamayleh, Yasmine; Pasupathy, Anitha (2016) Contour Curvature As an Invariant Code for Objects in Visual Area V4. J Neurosci 36:5532-43 |
| Pasupathy, A (2015) The neural basis of image segmentation in the primate brain. Neuroscience 296:101-9 |
| Oleskiw, Timothy D; Pasupathy, Anitha; Bair, Wyeth (2014) Spectral receptive fields do not explain tuning for boundary curvature in V4. J Neurophysiol 112:2114-22 |
| Kosai, Yoshito; El-Shamayleh, Yasmine; Fyall, Amber M et al. (2014) The role of visual area V4 in the discrimination of partially occluded shapes. J Neurosci 34:8570-84 |
| Yau, Jeffrey M; Pasupathy, Anitha; Brincat, Scott L et al. (2013) Curvature processing dynamics in macaque area V4. Cereb Cortex 23:198-209 |
| Bushnell, Brittany N; Pasupathy, Anitha (2012) Shape encoding consistency across colors in primate V4. J Neurophysiol 108:1299-308 |
| Bushnell, Brittany N; Harding, Philip J; Kosai, Yoshito et al. (2011) Equiluminance cells in visual cortical area v4. J Neurosci 31:12398-412 |
Showing the most recent 10 out of 11 publications
