This study answers fundamental questions of large-scale neural networks in the human brain supporting crossmodal cognition. To reveal how auditory and visual stimuli and motor acts are arbitrarily combined as a result of crossmodal learning and integrated to supramodal symbolic representations, we will study the neural representations of the letters of the Roman alphabet. These consist of four unimodal representations (visual, auditory, and motor representations for writing and speaking) and learned connections between these, that is, the processes that underlie their audiovisual recognition and motor production. Accurate experimental control is facilitated by the fact that letters exhibit all the necessary properties of symbolic crossmodal representations but in a physically simple and exact format carrying no semantic associations that could confound the neurophysiological interpretation of results. Combined 3-Tesla functional magnetic resonance imaging (fMRI) and 306-channel magnetoencephalographic / 128-channel electroencephalographic (MEG/EEG) techniques with simultaneous behavioral recordings will be applied to pinpoint the exact underlying neural mechanisms. This approach combines the advantages of spatially accurate fMRI with temporally specific MEG/EEG, enabling accurate spatiotemproal characterization of brain activity totally noninvasively. To directly observe how large-scale neurocognitive networks evolve during crossmodal associative learning, we will also conduct fMRI/MEG/EEG measurements before and after our subjects are taught (previously unfamiliar) Japanese kana-letters.
The specific aims are to elucidate structure, function, and oscillatory mechanisms of fully established crossmodal neural networks based on previous extensive associative learning (Roman letters) and currently evolving networks representing novel crossmodal associations (Japanese letters). We will characterize the relative roles of deep brain nuclei, cerebellum, medial temporal lobe, and sensory-specific and multisensory association cortices in such networks. The multidimensional experimental design allows isolation of neural mechanisms utilized by perception, working memory, memory encoding, and recall. ? ?

Agency
National Institute of Health (NIH)
Institute
National Eye Institute (NEI)
Type
Research Project (R01)
Project #
5R01EY017071-02
Application #
7289796
Study Section
Special Emphasis Panel (ZRG1-IFCN-E (03))
Program Officer
Agarwal, Neeraj
Project Start
2006-09-22
Project End
2009-08-31
Budget Start
2007-09-01
Budget End
2008-08-31
Support Year
2
Fiscal Year
2007
Total Cost
$248,940
Indirect Cost
Name
Smith-Kettlewell Eye Research Institute
Department
Type
DUNS #
073121105
City
San Francisco
State
CA
Country
United States
Zip Code
94115
Tsai, Jeffrey J; Norcia, Anthony M; Ales, Justin M et al. (2011) Contrast gain control abnormalities in idiopathic generalized epilepsy. Ann Neurol 70:574-82
Lauritzen, Thomas Z; Ales, Justin M; Wade, Alex R (2010) The effects of visuospatial attention measured across visual cortex using source-imaged, steady-state EEG. J Vis 10:
Wade, Alex R; Rowland, Jess (2010) Early suppressive mechanisms and the negative blood oxygenation level-dependent response in human visual cortex. J Neurosci 30:5008-19
Wade, Alex R (2009) Long-range suppressive interactions between S-cone and luminance channels. Vision Res 49:1554-62
Petrov, Yury; McKee, Suzanne P (2009) The time course of contrast masking reveals two distinct mechanisms of human surround suppression. J Vis 9:21.1-11
Petrov, Yury; Popple, Ariella V (2007) Crowding is directed to the fovea and preserves only feature contrast. J Vis 7:8.1-9
Petrov, Yury; Popple, Ariella V; McKee, Suzanne P (2007) Crowding and surround suppression: not to be confused. J Vis 7:12.1-9