We live in a multisensory world, which requires us to continually, dynamically, and effectively process stimuli from across the sensory modalities. To do so successfully, we need to integrate corresponding unisensory stimulus components together to perceive coherent multisensory objects, while also appropriately segregating out concurrent non-corresponding stimuli. In the next period of this grant, we propose a new set of studies to continue our programmatic investigation of the mechanisms by which attention and related cognitive factors facilitate effective functioning in complex multisensory environments. In particular, we will investigate three fundamental facets of these mechanisms. First, we will study the influence of the top-down cognitive factors of spatial attention and reward prospect on multisensory (auditory/visual) integration and segregation processes. Second, we will examine the commonality across the auditory and visual modalities of the mechanisms underlying rapid attentional target-search processes in complex stimulus environments, including the cross- modality coupling of such attentional processes. Third, we will investigate the multisensory integration and segregation processes when input from one particular modality is relevant, but there is conflicting concurrent input from a second modality;we will also compare these crossmodal processes to those invoked in response to conflicting input from within the same modality. As before, we will use a combination of behavioral measures, oscillatory electroencephalography (EEG), event-related potentials (ERPs), and functional MRI (fMRI) to perform these studies, with the aim to delineate the timing, sequence, and location of underlying neural processes. Additionally, we will acquire EEG and fMRI measures of brain activity simultaneously for several of the proposed experiments using our new MR- compatible EEG system purchased via a supplement from this project. Such an approach will enable us to perform trial-to-trial covariational analyses on the EEG and fMRI data patterns, providing powerful new ways to link the high-temporal-resolution EEG signals to the associated cortical generators measured in the fMRI. Moreover, the simultaneous recording will also allow us to examine the modulating influence on the cortical EEG of the subcortical brain regions involved in attention, reward, and multisensory integration but whose influence cannot be assessed with EEG alone. Thus, these experiments will delineate with unprecedented precision the neural mechanisms by which attention and related cognitive functions enable successful navigation of our complex multisensory world.

Public Health Relevance

A number of neurological and psychiatric disorders, including attention-deficit disorder, Alzheimer's disease, and autism, have adverse effects on attentional and multisensory-integration capabilities. Moreover, traumatic brain injury (e.g., following concussions) and or stroke can also result in dramatic impairments in sensory processing and attention (e.g., poor attentional focus, hemispatial neglect). Given that individuals with disordered brain function need to interact and cope in a multisensory world, the proposed studies of multi- sensory attentional mechanisms will provide important and fundamental knowledge for better understanding these deficits and developing effective treatments.

National Institute of Health (NIH)
National Institute of Neurological Disorders and Stroke (NINDS)
Research Project (R01)
Project #
Application #
Study Section
Cognition and Perception Study Section (CP)
Program Officer
Gnadt, James W
Project Start
Project End
Budget Start
Budget End
Support Year
Fiscal Year
Total Cost
Indirect Cost
Duke University
Other Basic Sciences
Schools of Arts and Sciences
United States
Zip Code
Gamble, Marissa L; Woldorff, Marty G (2015) The Temporal Cascade of Neural Processes Underlying Target Detection and Attentional Processing During Auditory Search. Cereb Cortex 25:2456-65
van den Berg, Berry; Krebs, Ruth M; Lorist, Monicque M et al. (2014) Utilization of reward-prospect enhances preparatory attention and reduces stimulus conflict. Cogn Affect Behav Neurosci 14:561-77
Appelbaum, L Gregory; Boehler, C Nicolas; Davis, Lauren A et al. (2014) The dynamics of proactive and reactive cognitive control processes in the human brain. J Cogn Neurosci 26:1021-38
Donohue, Sarah E; Appelbaum, Lawrence G; Park, Christina J et al. (2013) Cross-modal stimulus conflict: the behavioral effects of stimulus input timing in a visual-auditory Stroop task. PLoS One 8:e62802
Green, Jessica J; Gamble, Marissa L; Woldorff, Marty G (2013) Resolving conflicting views: Gaze and arrow cues do not trigger rapid reflexive shifts of attention. Vis cogn 21:61-71
Donohue, Sarah E; Todisco, Alexandra E; Woldorff, Marty G (2013) The rapid distraction of attentional resources toward the source of incongruent stimulus input during multisensory conflict. J Cogn Neurosci 25:623-35
Donohue, Sarah E; Liotti, Mario; Perez 3rd, Ricardo et al. (2012) Is conflict monitoring supramodal? Spatiotemporal dynamics of cognitive control processes in an auditory Stroop task. Cogn Affect Behav Neurosci 12:1-15
Boehler, C Nicolas; Appelbaum, L Gregory; Krebs, Ruth M et al. (2012) The influence of different Stop-signal response time estimation procedures on behavior-behavior and brain-behavior correlations. Behav Brain Res 229:123-30
Green, Jessica J; Woldorff, Marty G (2012) Arrow-elicited cueing effects at short intervals: Rapid attentional orienting or cue-target stimulus conflict? Cognition 122:96-101
Krebs, Ruth M; Boehler, Carsten N; Egner, Tobias et al. (2011) The neural underpinnings of how reward associations can both guide and misguide attention. J Neurosci 31:9752-9

Showing the most recent 10 out of 29 publications