The overarching goal of this research is to characterize how perception and memory interact, in terms of both the learning mechanisms that help transform visual experience into memory, and the intentional mechanisms that regulate this transformation. The specific goal of this proposal is to test the hypothesis that incidental learning about statistical regularities in vision (visual statistical learning) is limited to selectively attend visual information, and that this behavioral interaction arises because of how selective attention modulates neural interactions between human visual and memory systems. We propose a two-stage framework in which selective attention to a high-level visual feature/category increases neural interactions between regions of occipital cortex that represent low-level features and the region of inferior temporal cortex (IT) that represents the attended feature/category, and in turn between this IT region and medial temporal lobe (MTL) sub regions involved in visual learning and memory. In addition to assessing how feature-based selective attention influences learning at a behavioral level, we will use functional magnetic resonance imaging to assess how attention influences evoked neural responses in task-relevant brain regions, as well as neural interactions between these regions in the background of ongoing tasks. We will develop an innovative approach for studying neural interactions in which evoked responses and global noise sources are scrubbed from the data and regional correlations are assessed in the residuals. This background connectivity approach provides a new way to study how intentional goals affect perception and learning.
Aim 1 examines the first stage of our framework, testing: how selective attention modulates background connectivity between IT and occipital cortex, where in retinotopic visual cortex this modulation occurs, and how these changes are controlled by frontal and parietal cortex.
Aim 2 examines the second stage of our framework, first establishing the role of the MTL in visual statistical learning, and then testing: how selective attention modulates interactions between IT and the MTL, where in cortical and hippocampal sub regions of the MTL this modulation occurs, and how these changes facilitate incidental learning about statistical regularities and later retrieval of this knowledge. In sum, we relate behavioral interactions between selective attention and learning to neural interactions between the mechanisms that represent visual features and those that learn about their relations. This proposal addresses several key issues in the field, including: how attention modulates the MTL, how feature-based attention is controlled, whether different neural mechanisms support rapid versus long-term visual learning, how tasks and goals are represented, and how attention and memory retrieval are related. This research will improve our understanding of how humans learn from visual experience, and how visual processing is in turn influenced by learning. These advances will shed light on the plasticity that occurs during development and during the recovery and rehabilitation of visual function following eye disease, injury, or brain damage.

Public Health Relevance

This research will improve our understanding of how humans learn from visual experience, and how visual processing is in turn influenced by learning. These advances will shed light on the plasticity that occurs during development and during the recovery from visual impairment caused by eye disease, injury, or brain damage. The behavioral tasks that we develop to enhance learning with attention will inform practices for rehabilitating visual function, and the methods that we develop to study neural interactions during tasks will lead to new approaches for diagnosing disorders of visual processing.

Agency
National Institute of Health (NIH)
Type
Research Project (R01)
Project #
5R01EY021755-04
Application #
8708870
Study Section
Cognition and Perception Study Section (CP)
Program Officer
Araj, Houmam H
Project Start
Project End
Budget Start
Budget End
Support Year
4
Fiscal Year
2014
Total Cost
Indirect Cost
Name
Princeton University
Department
None
Type
Organized Research Units
DUNS #
City
Princeton
State
NJ
Country
United States
Zip Code
08543
Kool, Wouter; Conway, Andrew R A; Turk-Browne, Nicholas B (2014) Sequential dynamics in visual short-term memory. Atten Percept Psychophys 76:1885-901
Schapiro, Anna C; Gregory, Emma; Landau, Barbara et al. (2014) The necessity of the medial temporal lobe for statistical learning. J Cogn Neurosci 26:1736-47
Kim, Ghootae; Lewis-Peacock, Jarrod A; Norman, Kenneth A et al. (2014) Pruning of memories by context-based prediction error. Proc Natl Acad Sci U S A 111:8997-9002
Shohamy, Daphna; Turk-Browne, Nicholas B (2013) Mechanisms for widespread hippocampal involvement in cognition. J Exp Psychol Gen 142:1159-70
Mende-Siedlecki, Peter; Verosky, Sara C; Turk-Browne, Nicholas B et al. (2013) Robust selectivity for faces in the human amygdala in the absence of expressions. J Cogn Neurosci 25:2086-106
Zhao, Jiaying; Al-Aidroos, Naseem; Turk-Browne, Nicholas B (2013) Attention is spontaneously biased toward regularities. Psychol Sci 24:667-77
Verosky, Sara C; Todorov, Alexander; Turk-Browne, Nicholas B (2013) Representations of individuals in ventral temporal cortex defined by faces and biographies. Neuropsychologia 51:2100-8
Schapiro, Anna C; Rogers, Timothy T; Cordova, Natalia I et al. (2013) Neural representations of events arise from temporal community structure. Nat Neurosci 16:486-92
Fan, Judith E; Turk-Browne, Nicholas B (2013) Internal attention to features in visual short-term memory guides object learning. Cognition 129:292-308
Turk-Browne, Nicholas B (2013) Functional interactions as big data in the human brain. Science 342:580-4

Showing the most recent 10 out of 11 publications