Speech perception is the process by which listeners hear and interpret the sounds of language. It is defined by the unique mapping of a highly variable and complex acoustic signal to a phonetic representation. A convergence of studies has implicated the human posterior superior temporal cortex for the specialized processing of speech sounds. Although localized, the basic neural mechanisms by which linguistic information is extracted are entirely unclear. We propose an innovative methodological approach using customized intracranial high-density electrode arrays to record detailed neural activity directly from the posterior temporal cortex in awake, behaving subjects undergoing clinical evaluation for epilepsy surgery. This method offers the highest possible spatial and temporal resolution, thereby overcoming many limitations of non-invasive imaging approaches. This research is positioned at a critical interface between the fields of auditory neuroscience and linguistics. Our previous results demonstrate that cortical representation of speech sounds manifest important non-linearities that correspond to perceptual boundaries over acoustic parameters (Chang et al, Nature Neuroscience 2010). Building on these findings, we propose experiments to determine: 1) the functional organization of the posterior temporal gyrus for acoustic and phonetic features, 2) the distributed, population-level encoding of emergent phonetic representation, and 3) the correlates of robust speech representation in the context of a multi-speaker listening environment. The results of these proposed experiments will have significant impact on the field of neurolinguistics and broader research on sensory perception and cognition.

Public Health Relevance

Alterations in the cortical mechanisms supporting speech perception underlie the pathogenesis of an increasing number of acquired and developmental language disabilities, including aphasia, language learning delay, autism, and dyslexia. Revealing mechanisms by which the brain encodes speech sounds bears tremendous implications for our understanding of these disorders, and more importantly, will guide strategies for their remediation.

National Institute of Health (NIH)
National Institute on Deafness and Other Communication Disorders (NIDCD)
Research Project (R01)
Project #
Application #
Study Section
Auditory System Study Section (AUD)
Program Officer
Shekim, Lana O
Project Start
Project End
Budget Start
Budget End
Support Year
Fiscal Year
Total Cost
Indirect Cost
University of California San Francisco
Schools of Medicine
San Francisco
United States
Zip Code
Breshears, Jonathan D; Hamilton, Liberty S; Chang, Edward F (2018) Spontaneous Neural Activity in the Superior Temporal Gyrus Recapitulates Tuning for Speech Features. Front Hum Neurosci 12:360
Khoshkhoo, Sattar; Leonard, Matthew K; Mesgarani, Nima et al. (2018) Neural correlates of sine-wave speech intelligibility in human frontal and temporal cortex. Brain Lang 187:83-91
Haller, Matar; Case, John; Crone, Nathan E et al. (2018) Persistent neuronal activity in human prefrontal cortex links perception and action. Nat Hum Behav 2:80-91
Muller, Leah; Rolston, John D; Fox, Neal P et al. (2018) Direct electrical stimulation of human cortex evokes high gamma activity that predicts conscious somatosensory perception. J Neural Eng 15:026015
Chang, Edward F; Kurteff, Garret; Wilson, Stephen M (2018) Selective Interference with Syntactic Encoding during Sentence Production by Direct Electrocortical Stimulation of the Inferior Frontal Gyrus. J Cogn Neurosci 30:411-420
Baud, Maxime O; Kleen, Jonathan K; Mirro, Emily A et al. (2018) Multi-day rhythms modulate seizure risk in epilepsy. Nat Commun 9:88
McCarron, Angelica; Chavez, Ashley; Babiak, Miranda et al. (2017) Connected speech in transient aphasias after left hemisphere resective surgery. Aphasiology 31:1266-1281
Rao, Vikram R; Leonard, Matthew K; Kleen, Jonathan K et al. (2017) Chronic ambulatory electrocorticography from human speech cortex. Neuroimage 153:273-282
Tang, C; Hamilton, L S; Chang, E F (2017) Intonational speech prosody encoding in the human auditory cortex. Science 357:797-801
Moses, David A; Mesgarani, Nima; Leonard, Matthew K et al. (2016) Neural speech recognition: continuous phoneme decoding using spatiotemporal representations of human cortical activity. J Neural Eng 13:056004

Showing the most recent 10 out of 36 publications