The investigation of signed languages is crucial to our understanding of the neurobiology of human language, as well as to our understanding of deafness and the design of policies and programs for deaf individuals. This project is divided into three major sections, each focusing on a different facet of our general research question: What is the impact of the visual-gestural nature of sign language on the characteristics of linguistic systems and their neural and cognitive underpinnings? In Section One ("Effects of modality on language processing"), we address theoretical claims about the representation of the non-dominant hand in sign language production by examining the nature of compensatory articulation using novel "sign block" techniques (paralleling bite block experiments for speech). We also investigate the effects of language modality on the expression of spatial information, focusing on how distinct linguistic resources for encoding visual shape and viewpoint affect communication in spoken vs. signed languages. In Section Two ("The interplay between language and visual-spatial cognition"), our goals are to identify the ramifications of language modality for sign-based memory (Is visual-spatial working memory distinct from linguistic working memory for sign language?);for interactions between language and spatial cognition (Does the "spatialized" expression of locative relationships affect non-linguistic spatial categorization?);and for how perceptual categories are linguistically coded (Do iconic properties of signed languages affect linguistic encoding of sense information?). In Section Three ("The functional neural organization for language"), we use transcranial magnetic stimulation and functional Magnetic Resonance Imaging to investigate a) the neural systems underlying sign language production and b) the neural basis for the structural similarity between vision and sign language. We address the following specific questions: What are the optimal parameters for fMRI studies that examine overt sign production? What are the roles of the ventral intraparietal area and the posterior superior parietal lobule in sign production? How do the iconic properties of sign language (specifically, the structural mappings between classifier constructions and elements within a visual scene) impact the neural bases of language comprehension? Our overall aim is to understand the nature of sign language processing, while at the same time addressing issues of theoretical importance within linguistics, psycholinguistics, and cognitive neuroscience that also result in practical applications for deaf individuals.

Public Health Relevance

The information gained from this research will benefit individuals who are deaf and use sign language as their primary language and the educational and rehabilitative organizations that serve them. The findings will be of use in designing appropriate educational programs for deaf students, which maximally utilize knowledge of the nature of sign language and the spatial cognitive abilities of deaf people. Knowledge of where sign language is represented in the brain can potentially provide crucial information to clinicians treating deaf patients with neurological injury or disease.

Agency
National Institute of Health (NIH)
Institute
National Institute on Deafness and Other Communication Disorders (NIDCD)
Type
Research Project (R01)
Project #
5R01DC010997-35
Application #
8642633
Study Section
Language and Communication Study Section (LCOM)
Program Officer
Cooper, Judith
Project Start
1979-07-01
Project End
2015-03-31
Budget Start
2014-04-01
Budget End
2015-03-31
Support Year
35
Fiscal Year
2014
Total Cost
$549,825
Indirect Cost
$182,049
Name
San Diego State University
Department
Other Health Professions
Type
Schools of Allied Health Profes
DUNS #
073371346
City
San Diego
State
CA
Country
United States
Zip Code
92182
Emmorey, Karen; Mehta, Sonya; McCullough, Stephen et al. (2016) The neural circuits recruited for the production of signs and fingerspelled words. Brain Lang 160:30-41
Caselli, Naomi K; Sehyr, Zed Sevcikova; Cohen-Goldberg, Ariel M et al. (2016) ASL-LEX: A lexical database of American Sign Language. Behav Res Methods :
Iversen, John R; Patel, Aniruddh D; Nicodemus, Brenda et al. (2015) Synchronization to auditory and visual rhythms in hearing and deaf individuals. Cognition 134:232-44
Pyers, Jennie E; Perniss, Pamela; Emmorey, Karen (2015) Viewpoint in the Visual-Spatial Modality: The Coordination of Spatial Perspective. Spat Cogn Comput 15:143-169
Secora, Kristen; Emmorey, Karen (2015) The Action-Sentence Compatibility Effect in ASL: the role of semantics vs. perception. Lang Cogn 7:305-318
Emmorey, Karen (2014) Iconicity as structure mapping. Philos Trans R Soc Lond B Biol Sci 369:20130301
Emmorey, Karen; McCullough, Stephen; Mehta, Sonya et al. (2014) How sensory-motor systems impact the neural organization for language: direct contrasts between spoken and signed language. Front Psychol 5:484
Allen, John S; Emmorey, Karen; Bruss, Joel et al. (2013) Neuroanatomical differences in visual, motor, and language cortices between congenitally deaf signers, hearing signers, and hearing non-signers. Front Neuroanat 7:26
Emmorey, Karen (2013) The neurobiology of sign language and the mirror system hypothesis. Lang Cogn 5:205-210
Baus, Cristina; Carreiras, Manuel; Emmorey, Karen (2013) When does Iconicity in Sign Language Matter? Lang Cogn Process 28:261-271

Showing the most recent 10 out of 19 publications