The basic mechanisms underlying comprehension of spoken language are unknown. We do not understand, for example, how the human brain extracts the most fundamental linguistic elements (consonants and vowels) from a complex and highly variable acoustic signal. An investigation of the cortical representation of speech sounds can likely shed light on this fundamental question. Previous research has implicated the superior temporal cortex in the processing of speech sounds. However, how the cortex actually represents (i.e. encodes) phonemes is undetermined. The recording of neural activity directly from the cortical surface is a promising approach since it can provide both high spatial and temporal resolution. Here, I propose to examine the mechanisms of phonetic encoding by utilizing neurophysiological recordings obtained during neurosurgical procedures. High-density electrode arrays, advanced signal processing, and direct electrocortical stimulation will be utilized to unravel both local population encoding of speech sounds in the lateral temporal cortex as well as global processing across multiple sensory and cognitive areas.

Public Health Relevance

The aim of this research is to reveal the fundamental mechanisms that underlie comprehension of spoken language. An understanding of how speech is coded in the brain has significant implications for the development of new diagnostic and rehabilitative strategies for language disorders (e.g. aphasia, dyslexia, autism, et alia). Abnormal perception of phonemes is a central component to language disability in all of these conditions.

National Institute of Health (NIH)
National Institute on Deafness and Other Communication Disorders (NIDCD)
Research Project (R01)
Project #
Application #
Study Section
Auditory System Study Section (AUD)
Program Officer
Shekim, Lana O
Project Start
Project End
Budget Start
Budget End
Support Year
Fiscal Year
Total Cost
Indirect Cost
University of California San Francisco
Schools of Medicine
San Francisco
United States
Zip Code
Breshears, Jonathan D; Hamilton, Liberty S; Chang, Edward F (2018) Spontaneous Neural Activity in the Superior Temporal Gyrus Recapitulates Tuning for Speech Features. Front Hum Neurosci 12:360
Khoshkhoo, Sattar; Leonard, Matthew K; Mesgarani, Nima et al. (2018) Neural correlates of sine-wave speech intelligibility in human frontal and temporal cortex. Brain Lang 187:83-91
Haller, Matar; Case, John; Crone, Nathan E et al. (2018) Persistent neuronal activity in human prefrontal cortex links perception and action. Nat Hum Behav 2:80-91
Muller, Leah; Rolston, John D; Fox, Neal P et al. (2018) Direct electrical stimulation of human cortex evokes high gamma activity that predicts conscious somatosensory perception. J Neural Eng 15:026015
Chang, Edward F; Kurteff, Garret; Wilson, Stephen M (2018) Selective Interference with Syntactic Encoding during Sentence Production by Direct Electrocortical Stimulation of the Inferior Frontal Gyrus. J Cogn Neurosci 30:411-420
Baud, Maxime O; Kleen, Jonathan K; Mirro, Emily A et al. (2018) Multi-day rhythms modulate seizure risk in epilepsy. Nat Commun 9:88
McCarron, Angelica; Chavez, Ashley; Babiak, Miranda et al. (2017) Connected speech in transient aphasias after left hemisphere resective surgery. Aphasiology 31:1266-1281
Rao, Vikram R; Leonard, Matthew K; Kleen, Jonathan K et al. (2017) Chronic ambulatory electrocorticography from human speech cortex. Neuroimage 153:273-282
Tang, C; Hamilton, L S; Chang, E F (2017) Intonational speech prosody encoding in the human auditory cortex. Science 357:797-801
Moses, David A; Mesgarani, Nima; Leonard, Matthew K et al. (2016) Neural speech recognition: continuous phoneme decoding using spatiotemporal representations of human cortical activity. J Neural Eng 13:056004

Showing the most recent 10 out of 36 publications