Sign languages provide a powerful tool for investigating the neurobiology and cognitive architecture of human language. For perception, these languages depend upon high-level vision and motion processing systems; for production, they require the integration of motor systems involving the hands and face. What impact does this different biological base have on language processing? How does it affect non-linguistic cognitive functions? Are the same neural systems involved? We investigate these issues by studying neurologically-intact deaf signers, focusing on a coherent set of cognitive functions implicated in the processing of sign language. We proceed along the primary lines of inquiry: I. The effects of spatialization on language. We investigate a unique aspect of sign language: the linguistic use of physical space. We will examine on-line comprehension of spatialized co- reference, the nature of linguistic use of physical space. We will examine on-line comprehension of spatialized co-reference, the nature of linguistic versus cognitive spatial categories, and the relation between spatial gestures and spatial signs. For the first time, we will investigate the representation and processing of cross-linguistic study of how different sign languages express topological spatial relations. Together, these studies will indicate how the visual-spatial modality impacts grammatical form and language processing. II. The interplay between language and visual-spatial cognition. Our proposed studies are motivated by exciting findings under the current grant which show that processing the complex spatial system of American Sign Language (ASL) exerts selective enhancement of non-linguistic visual-spatial processing. We investigate the impact of sign language use on the following cognitive functions; motion perception and analysis, the recognition and categorization of human faces and facial expressions, and visual-spatial imagery. A major goal is to determine how the language one uses can affect cognitive processes in non-linguistic domains. III. The neural bases for language and spatial cognition in deaf signers. The unusual sensory and linguistic experience of deaf ASL signers provides a natural opportunity to investigate neural plasticity and the determinants of brain organization. We will investigate cerebral specialization for sign language and its cognitive underpinnings, using standard hemifield techniques. We also propose two studies using fMRI which investigate face processing and visual imagery; fMRI will provide an exquisitely detailed picture of the brain bases for these linguistic and cognitive functions.

Agency
National Institute of Health (NIH)
Institute
Eunice Kennedy Shriver National Institute of Child Health & Human Development (NICHD)
Type
Research Project (R01)
Project #
5R01HD013249-24
Application #
6636784
Study Section
Human Development and Aging Subcommittee 3 (HUD)
Program Officer
Freund, Lisa S
Project Start
1979-07-01
Project End
2004-03-31
Budget Start
2003-04-01
Budget End
2004-03-31
Support Year
24
Fiscal Year
2003
Total Cost
$380,151
Indirect Cost
Name
Salk Institute for Biological Studies
Department
Type
DUNS #
078731668
City
La Jolla
State
CA
Country
United States
Zip Code
92037
Emmorey, Karen; Xu, Jiang; Gannon, Patrick et al. (2010) CNS activation and regional connectivity during pantomime observation: no engagement of the mirror neuron system for deaf signers. Neuroimage 49:994-1005
Saygin, Ayse Pinar; McCullough, Stephen; Alac, Morana et al. (2010) Modulation of BOLD response in motion-sensitive lateral temporal cortex by real and fictive motion sentences. J Cogn Neurosci 22:2480-90
Wilson, Margaret; Lancaster, Jessy; Emmorey, Karen (2010) Representational momentum for the human body: awkwardness matters, experience does not. Cognition 116:242-50
Emmorey, Karen; McCullough, Stephen (2009) The bimodal bilingual brain: effects of sign language experience. Brain Lang 109:124-32
Emmorey, Karen; Gertsberg, Nelly; Korpics, Franco et al. (2009) The influence of visual feedback and register changes on sign language production: A kinematic study with deaf signers. Appl Psycholinguist 30:187-203
Emmorey, Karen; Korpics, Franco; Petronio, Karen (2009) The use of visual feedback during signing: evidence from signers with impaired vision. J Deaf Stud Deaf Educ 14:99-104
Emmorey, Karen; Bosworth, Rain; Kraljic, Tanya (2009) Visual feedback and self-monitoring of sign language. J Mem Lang 61:398-411
McCullough, Stephen; Emmorey, Karen (2009) Categorical perception of affective and linguistic facial expressions. Cognition 110:208-21
Thompson, Robin L; Vinson, David P; Vigliocco, Gabriella (2009) The link between form and meaning in American Sign Language: lexical processing effects. J Exp Psychol Learn Mem Cogn 35:550-7
Pyers, Jennie E; Emmorey, Karen (2008) The face of bimodal bilingualism: grammatical markers in American Sign Language are produced when bilinguals speak to English monolinguals. Psychol Sci 19:531-6

Showing the most recent 10 out of 33 publications