The representation of speech and other complex auditory signals in the human brain constitutes a major interdisciplinary challenge for cognitive neuroscience. Understanding in a principled manner how acoustic signals are transformed and ultimately recognized as words in a speaker's mental dictionary requires the integration of knowledge across fields ranging from single-cell recording in auditory cortex to linguistic theory. The research program outlined here is focused on two subroutines in speech processing. In the context of the first specific aim, the hypothesis is investigated that speech is analyzed concurrently on two time scales in human auditory cortex, with one corresponding to analysis at the syllabic scale, another at the segmental (phonemic) scale. This multi-time resolution model, which provides an account of hemispheric asymmetry in audition, is tested in a series of behavioral and electrophysiological studies. The goal is to provide a theoretically motivated and neurobiologically sensible answer to how acoustic signals are fractionated in time and how they map to words stored in the brain.
The second aim encompasses both behavioral (often audio- visual) and electrophysiological studies that test how (specifically, how abstractly) speech and words are represented in the human brain. The goal is to test models of the cortical encoding of speech sounds and words. The principal method used in this research program is magnetoencephalography (MEG), typically with parallel behavioral studies performed. Other non-invasive recording modalities are also employed (EEG, fMRI) to validate and extend data from any single approach.

Public Health Relevance

Successfully perceiving speech and recognizing words are processes at the basis of human communication. A mechanistic characterization of the brain structures that mediate these skills is essential to understand the range of disorders associated with problems in speech processing. Health-related phenomena ranging from dyslexia and autism in childhood to aphasia and Alzheimer's disease in the aging population have been repeatedly linked to problems with the auditory analysis of complex signals and the ability to process words appropriately. The development of innovative diagnostic, interventional, and therapeutic approaches critically depends on our enriched knowledge of the brain basis of the processes underlying human speech.

Agency
National Institute of Health (NIH)
Institute
National Institute on Deafness and Other Communication Disorders (NIDCD)
Type
Research Project (R01)
Project #
5R01DC005660-10
Application #
8304130
Study Section
Language and Communication Study Section (LCOM)
Program Officer
Shekim, Lana O
Project Start
2002-08-01
Project End
2013-07-31
Budget Start
2012-08-01
Budget End
2013-07-31
Support Year
10
Fiscal Year
2012
Total Cost
$484,303
Indirect Cost
$149,483
Name
New York University
Department
Psychology
Type
Schools of Arts and Sciences
DUNS #
041968306
City
New York
State
NY
Country
United States
Zip Code
10012
Getz, Heidi; Ding, Nai; Newport, Elissa L et al. (2018) Cortical tracking of constituent structure in language acquisition. Cognition 181:135-140
Teng, Xiangbin; Tian, Xing; Doelling, Keith et al. (2018) Theta band oscillations reflect more than entrainment: behavioral and neural evidence demonstrates an active chunking process. Eur J Neurosci 48:2770-2782
Gwilliams, Laura; Linzen, Tal; Poeppel, David et al. (2018) In Spoken Word Recognition, the Future Predicts the Past. J Neurosci 38:7585-7599
Dikker, Suzanne; Wan, Lu; Davidesco, Ido et al. (2017) Brain-to-Brain Synchrony Tracks Real-World Dynamic Group Interactions in the Classroom. Curr Biol 27:1375-1380
Tal, Idan; Large, Edward W; Rabinovitch, Eshed et al. (2017) Neural Entrainment to the Beat: The ""Missing-Pulse"" Phenomenon. J Neurosci 37:6331-6341
Teng, Xiangbin; Tian, Xing; Rowland, Jess et al. (2017) Concurrent temporal channels for auditory processing: Oscillatory neural entrainment reveals segregation of function at different scales. PLoS Biol 15:e2000812
Ding, Nai; Melloni, Lucia; Yang, Aotian et al. (2017) Characterizing Neural Entrainment to Hierarchical Linguistic Units using Electroencephalography (EEG). Front Hum Neurosci 11:481
Ten Oever, Sanne; Schroeder, Charles E; Poeppel, David et al. (2017) Low-Frequency Cortical Oscillations Entrain to Subthreshold Rhythmic Auditory Stimuli. J Neurosci 37:4903-4912
Krakauer, John W; Ghazanfar, Asif A; Gomez-Marin, Alex et al. (2017) Neuroscience Needs Behavior: Correcting a Reductionist Bias. Neuron 93:480-490
Ding, Nai; Melloni, Lucia; Tian, Xing et al. (2017) Rule-based and Word-level Statistics-based Processing of Language: Insights from Neuroscience. Lang Cogn Neurosci 32:570-575

Showing the most recent 10 out of 104 publications