The investigation of signed languages is crucial to our understanding of the neurobiology of human language, as well as to our understanding of deafness and the design of policies and programs for deaf individuals. This project is divided into three major sections, each focusing on a different facet of our general research question: What is the impact of the visual-gestural nature of sign language on the characteristics of linguistic systems and their neural and cognitive underpinnings? In Section One (""""""""Effects of modality on language processing""""""""), we address theoretical claims about the representation of the non-dominant hand in sign language production by examining the nature of compensatory articulation using novel """"""""sign block"""""""" techniques (paralleling bite block experiments for speech). We also investigate the effects of language modality on the expression of spatial information, focusing on how distinct linguistic resources for encoding visual shape and viewpoint affect communication in spoken vs. signed languages. In Section Two (""""""""The interplay between language and visual-spatial cognition""""""""), our goals are to identify the ramifications of language modality for sign-based memory (Is visual-spatial working memory distinct from linguistic working memory for sign language?);for interactions between language and spatial cognition (Does the """"""""spatialized"""""""" expression of locative relationships affect non-linguistic spatial categorization?);and for how perceptual categories are linguistically coded (Do iconic properties of signed languages affect linguistic encoding of sense information?). In Section Three (""""""""The functional neural organization for language""""""""), we use transcranial magnetic stimulation and functional Magnetic Resonance Imaging to investigate a) the neural systems underlying sign language production and b) the neural basis for the structural similarity between vision and sign language. We address the following specific questions: What are the optimal parameters for fMRI studies that examine overt sign production? What are the roles of the ventral intraparietal area and the posterior superior parietal lobule in sign production? How do the iconic properties of sign language (specifically, the structural mappings between classifier constructions and elements within a visual scene) impact the neural bases of language comprehension? Our overall aim is to understand the nature of sign language processing, while at the same time addressing issues of theoretical importance within linguistics, psycholinguistics, and cognitive neuroscience that also result in practical applications for deaf individuals.

Public Health Relevance

The information gained from this research will benefit individuals who are deaf and use sign language as their primary language and the educational and rehabilitative organizations that serve them. The findings will be of use in designing appropriate educational programs for deaf students, which maximally utilize knowledge of the nature of sign language and the spatial cognitive abilities of deaf people. Knowledge of where sign language is represented in the brain can potentially provide crucial information to clinicians treating deaf patients with neurological injury or disease.

National Institute of Health (NIH)
National Institute on Deafness and Other Communication Disorders (NIDCD)
Research Project (R01)
Project #
Application #
Study Section
Language and Communication Study Section (LCOM)
Program Officer
Cooper, Judith
Project Start
Project End
Budget Start
Budget End
Support Year
Fiscal Year
Total Cost
Indirect Cost
San Diego State University
Other Health Professions
Schools of Allied Health Profes
San Diego
United States
Zip Code
Blanco-Elorrieta, Esti; Emmorey, Karen; Pylkkänen, Liina (2018) Language switching decomposed through MEG and evidence from bimodal bilinguals. Proc Natl Acad Sci U S A 115:9708-9713
Mooney, Aimee; Beale, Naomi; Fried-Oken, Melanie (2018) Group Communication Treatment for Individuals with PPA and Their Partners. Semin Speech Lang 39:257-269
Giustolisi, Beatrice; Emmorey, Karen (2018) Visual Statistical Learning With Stimuli Presented Sequentially Across Space and Time in Deaf and Hearing Adults. Cogn Sci 42:3177-3190
Majid, Asifa; Roberts, Seán G; Cilissen, Ludy et al. (2018) Differential coding of perception in the world's languages. Proc Natl Acad Sci U S A 115:11369-11376
Blanco-Elorrieta, Esti; Kastner, Itamar; Emmorey, Karen et al. (2018) Shared neural correlates for building phrases in signed and spoken language. Sci Rep 8:5492
Emmorey, Karen (2018) Variation in late L1 acquisition? Biling (Camb Engl) 21:917-918
Caselli, Naomi K; Sehyr, Zed Sevcikova; Cohen-Goldberg, Ariel M et al. (2017) ASL-LEX: A lexical database of American Sign Language. Behav Res Methods 49:784-801
Emmorey, Karen; Giezen, Marcel R; Petrich, Jennifer A F et al. (2017) The relation between working memory and language comprehension in signers and speakers. Acta Psychol (Amst) 177:69-77
Emmorey, Karen (2016) Consequences of the Now-or-Never bottleneck for signed versus spoken languages. Behav Brain Sci 39:e70
Emmorey, Karen; Mehta, Sonya; McCullough, Stephen et al. (2016) The neural circuits recruited for the production of signs and fingerspelled words. Brain Lang 160:30-41

Showing the most recent 10 out of 31 publications