Engaging in face-to-face communication involves the integration of co-occurring auditory and visual cues displayed by the entire bodies of speakers. The proposed research will examine how the brain integrates two of these cues-speech and beat gesture (an important subcategory of hand gesture that represents speech prosody)-during natural social communication in typically developing children, normal adults, and children with autistic spectrum disorder (ASD). First, normative patterns in the typically developing brain, developmental endpoints, and multisensory integration sites of speech and beat gesture will be characterized. Typically developing children and normal adults will undergo functional magnetic resonance imaging (fMRI) while viewing extracts of a video recording where speech is accompanied by naturally-occurring beat gesture, random meaningless movements with speech, and a still body with speech. Comparing brain activation in response to viewing these three audiovisual combinations will reveal the brain areas that respond more significantly to speech when it is accompanied by naturally-occurring beat gesture as well as the neural areas underlying multisensory integration of speech-related audio and visual information. Second, children with ASD and typically developing matched controls will undergo fMRI while viewing the same gesture stimuli. Comparisons between these groups will allow us to assess whether children with ASD-who have well-documented deficits in social communication and production of naturalistic speech prosody-utilize abnormal networks and/or demonstrate significant differences in activation when integrating speech and beat gesture. As the first fMRI studies of natural speech-accompanying beat gesture, the proposed research will have important implications for public health. These findings will not only lead to a better understanding of the neural foundations of ASD but will also inform developmental interventions for ASD. In addition, the findings will impact speech therapy techniques for a variety of language and communication disorders. ? ? ?
| Hubbard, Amy L; McNealy, Kristin; Scott-Van Zeeland, Ashley A et al. (2012) Altered integration of speech and gesture in children with autism spectrum disorders. Brain Behav 2:606-19 |
| Hubbard, Amy L; Wilson, Stephen M; Callan, Daniel E et al. (2009) Giving speech a hand: gesture modulates activity in auditory cortex during speech perception. Hum Brain Mapp 30:1028-37 |
