Sign language is important to the health of deaf individuals who rely on this mode of communication to access medical, judicial, and other critical information. A priority area for NIDCD is the investigation of the acquisition, processing, and neural underpinnings of languages within the visual-manual modality. This project investigates two modality-specific properties of sign languages (iconicity and the interface between perception and production) in order to address questions of theoretical importance for psycholinguistic theories of language processing and for the functional neuroanatomy of human language.
Aim 1 of the project is to determine the impact of lexical iconicity on language processing and its neural underpinnings. Spoken languages do not exhibit ubiquitous conceptually motivated form-meaning mappings, and therefore this phenomenon is best examined through the study of signed languages. New evidence indicates that iconicity plays a role in the organization of sign phonology, morphological patterns, and semantics. This project uses a new model of iconicity (Structure-Mapping) to test predictions about a) the governing principles and patterns of iconicity, b) how iconicity affects form-based decisions, c) cross-linguistic differences in lexical iconicity and image generation, and d) the role of alignable differences in making comparisons involving iconic signs and referent objects. The project utilizes Event-Related Potentials (ERPs) to assess the neural response to iconic signs, as well as to identify neurophysiological correlates of lexical access in American Sign Language.
Aim 2 of the project is to determine how language production and perception are integrated for visual-manual languages. For speech, mostly unseen articulators give rise to an acoustic signal that is perceived by both the speaker and comprehender, whereas for sign the articulators are fully observable, but the visual signal is only perceived by the comprehender (signers do not watch their hands while signing). These modality differences impact how sensory-motor information is integrated and the role of sensory-feedback in determining articulatory targets. This project investigates the nature of internal models for sign production through novel behavioral methods (e.g., close shadowing of oneself vs. another signer; use of visual imagery vs. covert articulation in a sign-learning paradigm), as well as through both ERP and fMRI techniques. Neuroimaging methods are used to test predictions of a dual stream model of sign language processing vs. a direct matching model of action recognition. Overall, the project aims to enhance our understanding of the neurobiology of visual-manual language, which will provide a translational foundation for treating injury to the language system, for employing iconic signs/gestures in therapy, and for diagnosing language impairments in deaf individuals.
This research will benefit individuals who are deaf and use sign language as their primary language and will support the educational and rehabilitative organizations that serve this population. The findings will help to design appropriate programs that maximally utilize our knowledge of the structure and processing of visual-manual languages. Knowledge of the neural underpinnings of sign language can provide crucial information to clinicians and neurologists who are treating deaf patients with brain injury or disease.
| Emmorey, Karen (2018) Variation in late L1 acquisition? Biling (Camb Engl) 21:917-918 |
| Blanco-Elorrieta, Esti; Emmorey, Karen; Pylkkänen, Liina (2018) Language switching decomposed through MEG and evidence from bimodal bilinguals. Proc Natl Acad Sci U S A 115:9708-9713 |
| Mooney, Aimee; Beale, Naomi; Fried-Oken, Melanie (2018) Group Communication Treatment for Individuals with PPA and Their Partners. Semin Speech Lang 39:257-269 |
| Giustolisi, Beatrice; Emmorey, Karen (2018) Visual Statistical Learning With Stimuli Presented Sequentially Across Space and Time in Deaf and Hearing Adults. Cogn Sci 42:3177-3190 |
| Majid, Asifa; Roberts, Seán G; Cilissen, Ludy et al. (2018) Differential coding of perception in the world's languages. Proc Natl Acad Sci U S A 115:11369-11376 |
| Blanco-Elorrieta, Esti; Kastner, Itamar; Emmorey, Karen et al. (2018) Shared neural correlates for building phrases in signed and spoken language. Sci Rep 8:5492 |
| Caselli, Naomi K; Sehyr, Zed Sevcikova; Cohen-Goldberg, Ariel M et al. (2017) ASL-LEX: A lexical database of American Sign Language. Behav Res Methods 49:784-801 |
| Emmorey, Karen; Giezen, Marcel R; Petrich, Jennifer A F et al. (2017) The relation between working memory and language comprehension in signers and speakers. Acta Psychol (Amst) 177:69-77 |
| Emmorey, Karen (2016) Consequences of the Now-or-Never bottleneck for signed versus spoken languages. Behav Brain Sci 39:e70 |
| Emmorey, Karen; Mehta, Sonya; McCullough, Stephen et al. (2016) The neural circuits recruited for the production of signs and fingerspelled words. Brain Lang 160:30-41 |
Showing the most recent 10 out of 31 publications
