Skilled interaction with objects in peripersonal space during visual navigation, object acquisition and manipulation (e.g., eating), and object avoidance is crucial in everyday life, not the least to avoid damage to the face and head. These abilities are impaired after parietal strokes that cause neglect. The goal of this investigation is to map the location and internal organization of parietal, temporal, and frontal cortical areas involved in combining visual and somatosensory information in peripersonal space. Studies in several areas in non-human primates including the ventral intraparietal area (VIP), area 7b, and the precentral polysensory zone (PZ) have shown that they contain multisensory neurons. In the case of VIP, neurons have aligned visual and somatosensory receptive fields on the face and upper body. VIP can be thought of as a parietal face area alongside the better known temporal lobe face areas involved in face recognition. The visual receptive fields of some VIP neurons shift relative to the retina in order to maintain responsiveness to the same part of visual space defined with respect to the head, suggesting that VIP uses a head-centered coordinate system. Neurons in VIP respond vigorously to optical flow stimuli like those produced by object movement and self-movement through complex environment (e.g., expansion).
Our first aim i s to retinotopically map the three multisensory areas. This extends our previous work mapping early and intermediate visual areas.
Our second aim i s to map the internal structure of the somatosensory responses in these areas using phase-encoded spatial air-puff stimuli on the face, neck, shoulders, and arms, to determine how stimuli from visual and somatosensory modalities interact, and to determine if the visual maps in human VIP, as well as 7b and PZ are head-centered.
The third aim i s to see whether these multisensory areas respond when subjects simply imagine navigating through familiar environments or imagine objects (e.g., a bee) approaching their face.
The fourth aim i s to determine to what extent these same areas automatically participate in cognitive tasks involving metaphorical ego or object movements in ordinary sentences such as, """"""""We are coming up on the holidays"""""""" or """"""""Thanksgiving is approaching"""""""".

Public Health Relevance

The head contains the brain and key sense organs that must be protected in everyday encounters with objects, some of which need to be avoided and others of which need to be approached and sometimes eaten. These abilities are impaired in several different brain diseases.
This research aims to understand how visual and touch information is combined and processed during near-face encounters with moving objects.

National Institute of Health (NIH)
National Institute of Mental Health (NIMH)
Research Project (R01)
Project #
Application #
Study Section
Cognitive Neuroscience Study Section (COG)
Program Officer
Rossi, Andrew
Project Start
Project End
Budget Start
Budget End
Support Year
Fiscal Year
Total Cost
Indirect Cost
University of California San Diego
Schools of Arts and Sciences
La Jolla
United States
Zip Code
Ganepola, Tharindu; Nagy, Zoltan; Ghosh, Aurobrata et al. (2018) Using diffusion MRI to discriminate areas of cortical grey matter. Neuroimage 182:456-468
Moutsiana, Christina; Soliman, Radwa; de Wit, Lee et al. (2018) Unexplained Progressive Visual Field Loss in the Presence of Normal Retinotopic Maps. Front Psychol 9:1722
Huang, Ruey-Song; Chen, Ching-Fu; Sereno, Martin I (2018) Spatiotemporal integration of looming visual and tactile stimuli near the face. Hum Brain Mapp 39:2156-2176
Huang, Ruey-Song; Chen, Ching-Fu; Sereno, Martin I (2017) Mapping the complex topological organization of the human parietal face area. Neuroimage 163:459-470
Chen, Ching-Fu; Kreutz-Delgado, Kenneth; Sereno, Martin I et al. (2017) Validation of periodic fMRI signals in response to wearable tactile stimulation. Neuroimage 150:99-111
Sood, Mariam R; Sereno, Martin I (2016) Areas activated during naturalistic reading comprehension overlap topological visual, auditory, and somatotomotor maps. Hum Brain Mapp 37:2784-810
Apps, Matthew A J; Tajadura-Jiménez, Ana; Sereno, Marty et al. (2015) Plasticity in unimodal and multimodal brain areas reflects multisensory changes in self-face identification. Cereb Cortex 25:46-55
Strappini, Francesca; Pitzalis, Sabrina; Snyder, Abraham Z et al. (2015) Eye position modulates retinotopic responses in early visual areas: a bias for the straight-ahead direction. Brain Struct Funct 220:2587-601
Huang, Ruey-Song; Chen, Ching-Fu; Sereno, Martin I (2015) Neural substrates underlying the passive observation and active control of translational egomotion. J Neurosci 35:4258-67
Dekker, Tessa M; Ban, Hiroshi; van der Velde, Bauke et al. (2015) Late development of cue integration is linked to sensory fusion in cortex. Curr Biol 25:2856-2861

Showing the most recent 10 out of 27 publications