The goal of this proposal is to test several hypotheses about how structural and semantic information is represented in human visual cortex, and how these representations are modulated by attention. The proposal rests on a key technical innovation, a nonlinear system identification framework for estimating quantitative voxel-based receptive field (VRF) models from functional MRI data. These VRF models embody specific hypotheses about visual representation, and they provide clear predictions that can be tested and evaluated.
In Aim 1 we propose to investigate the representation of structural information in several retinotopically-organized visual areas (i.e., V1, V2, V3, V4 and lateral occipital). To address this issue we will compare several potential VRF models that encode different sorts of information about shape, motion and color.
In Aim 2 we propose to investigate semantic representation in non-retinotopic visual cortex anterior to lateral occipital. To accomplish this we will explore a range of semantic encoding models that describe how each voxel represents the semantic content of natural images (e.g., whether an image is an indoor or outdoor scene, or whether it contains faces, etc.). We will use these semantic VRF models to investigate functional regions-of-interest proposed in previous studies (e.g., the fusiform face area FFA), and to characterize non-retinotopic cortex whose function is currently unknown.
In Aim 3 we propose to examine how spatial and feature- based attention can affect the way structural and semantic information are represented. We will characterize attentional modulation in terms of its effects on response gain, orientation and spatial frequency tuning, and semantic tuning. These experiments will provide new insights about visual representations, and will produce new computational encoding models that accurately predict how visual cortex responds during natural vision.

Public Health Relevance

Disorders of central vision can severely affect quality of life. The design treatments and devices for improving visual function will depend critically on the availability of computational algorithms that accurately describe and predict visual function under natural viewing conditions. This proposal aims to develop quantitative predictive models for visual areas that represent structural and semantic visual information.

Agency
National Institute of Health (NIH)
Institute
National Eye Institute (NEI)
Type
Research Project (R01)
Project #
5R01EY019684-04
Application #
8448730
Study Section
Cognitive Neuroscience Study Section (COG)
Program Officer
Steinmetz, Michael A
Project Start
2010-04-01
Project End
2015-03-31
Budget Start
2013-04-01
Budget End
2015-03-31
Support Year
4
Fiscal Year
2013
Total Cost
$328,675
Indirect Cost
$100,675
Name
University of California Berkeley
Department
Psychology
Type
Schools of Arts and Sciences
DUNS #
124726725
City
Berkeley
State
CA
Country
United States
Zip Code
94704
Cukur, Tolga; Huth, Alexander G; Nishimoto, Shinji et al. (2013) Functional subdomains within human FFA. J Neurosci 33:16748-66
Cukur, Tolga; Nishimoto, Shinji; Huth, Alexander G et al. (2013) Attention during natural vision warps semantic representation across the human brain. Nat Neurosci 16:763-70
Stansbury, Dustin E; Naselaris, Thomas; Gallant, Jack L (2013) Natural scene statistics account for the representation of scene categories in human visual cortex. Neuron 79:1025-34
Naselaris, Thomas; Kay, Kendrick N; Nishimoto, Shinji et al. (2011) Encoding and decoding in fMRI. Neuroimage 56:400-10