Speech-sign bilingualism is exceptional because distinct sensory-motoric modalities allow for the simultaneous production and perception of two languages. Whereas unimodal (speech-speech) bilinguals may code-switch between their two languages, bimodal (speech-sign) bilinguals produce code-blends (simultaneous sign and speech). We investigate the consequences of the sensory-motoric differences in language modality for the psycholinguistics of bilingualism, for the features of co-speech gesture, and for the nature of the bilingual brain. Hearing ASL-English bilinguals will be studied because both languages are naturally accessible in the environment for these individuals. We proceed along three lines of inquiry: I. The psycholinguistics of bimodal bilingualism: Using behavioral tasks, we investigate the architecture of the bilingual lexicon across two modalities, the levels at which a bimodal bilinguars languages are interconnected, and how bimodal bilinguals control their two language systems. We hypothesize that, in general, bimodal and unimodal bilinguals are quite similar, but unique effects of bimodal bilingualism will be found in the recognition and production of code-blends. II. The relation between bimodal bilingualism and co-speech gesture: Unlike code-switching, code-blending shares certain properties with co-speech gesture (the spontaneous gestures that accompany spoken language). For both, meaningful manual gestures are produced simultaneously with speech. We explore 1) parallels and differences between bimodal code blending and unimodal code-switching, 2) parallels and differences between code-blending and co-speech gesture, and 3) the impact of acquiring a signed language on co-speech gesture. III. The cognitive neuropsychology of bimodal bilingualism: Using functional imaging, we address the following questions: What patterns of overlapping and distinct activation are observed for ASL and spoken English at the lexical and sentential levels? How does age of ASL acquisition impact the neural systems recruited during sign comprehension? Does acquisition of two spoken languages early in development differ from early acquisition of a signed and a spoken language with respect to the neural organization of language systems? Does becoming a bimodal bilingual impact the neural organization for non-linguistic visual processing? Answers to these questions will not only inform us about the development of the bilingual brain but will also provide insight into the determinants of neural plasticity and the hemispheric specialization for language.

Agency
National Institute of Health (NIH)
Institute
Eunice Kennedy Shriver National Institute of Child Health & Human Development (NICHD)
Type
Research Project (R01)
Project #
5R01HD047736-05
Application #
7485580
Study Section
Special Emphasis Panel (ZRG1-BBBP-A (02))
Program Officer
Mccardle, Peggy D
Project Start
2004-09-01
Project End
2010-07-31
Budget Start
2008-08-01
Budget End
2010-07-31
Support Year
5
Fiscal Year
2008
Total Cost
$297,005
Indirect Cost
Name
San Diego State University
Department
Other Health Professions
Type
Schools of Allied Health Profes
DUNS #
073371346
City
San Diego
State
CA
Country
United States
Zip Code
92182
Blanco-Elorrieta, Esti; Emmorey, Karen; Pylkkänen, Liina (2018) Language switching decomposed through MEG and evidence from bimodal bilinguals. Proc Natl Acad Sci U S A 115:9708-9713
Emmorey, Karen; Giezen, Marcel R; Petrich, Jennifer A F et al. (2017) The relation between working memory and language comprehension in signers and speakers. Acta Psychol (Amst) 177:69-77
Giezen, Marcel R; Emmorey, Karen (2017) Evidence for a bimodal bilingual disadvantage in letter fluency. Biling (Camb Engl) 20:42-48
Li, Le; Abutalebi, Jubin; Emmorey, Karen et al. (2017) How bilingualism protects the brain from aging: Insights from bimodal bilinguals. Hum Brain Mapp 38:4109-4124
Weisberg, Jill; Hubbard, Amy Lynn; Emmorey, Karen (2017) Multimodal integration of spontaneously produced representational co-speech gestures: an fMRI study. Lang Cogn Neurosci 32:158-174
Li, Le; Emmorey, Karen; Feng, Xiaoxia et al. (2016) Functional Connectivity Reveals Which Language the ""Control Regions"" Control during Bilingual Production. Front Hum Neurosci 10:616
Giezen, Marcel R; Emmorey, Karen (2016) Semantic Integration and Age of Acquisition Effects in Code-Blend Comprehension. J Deaf Stud Deaf Educ 21:213-21
Emmorey, Karen; Giezen, Marcel R; Gollan, Tamar H (2016) Psycholinguistic, cognitive, and neural implications of bimodal bilingualism. Biling (Camb Engl) 19:223-242
Emmorey, Karen; Giezen, Marcel R; Gollan, Tamar H (2016) Insights from bimodal bilingualism: Reply to commentaries. Biling (Camb Engl) 19:261-263
Giezen, Marcel R; Emmorey, Karen (2016) Language co-activation and lexical selection in bimodal bilinguals: Evidence from picture-word interference. Biling (Camb Engl) 19:264-276

Showing the most recent 10 out of 30 publications