Neurons in different regions within the visual system carry out different aspects of visual pattern analysis needed for visual perception. We are studying how and where the pieces that make up a visually perceived object are brought together. We recorded the activity of single neurons in the primary visual cortex (the first cortical stage of visual processing), and inferior temporal cortex (the last cortical stage) to study the mechanisms underlying visual perception. When we ask how the eye movements that occur on a screenful of images affect the responses of primary visual cortical neurons we find that even though the eyes take 300-400 ms to stabilize completely (including the parts of the message depending on the temporal structure of the response), the amount of stimulus-related information found in these responses is almost as much as that found after they have stabilized. This toleration of instability in the retinal location of a visual stimulus suggests that primary visual cortical neurons react to the overall structure of the features within a stimulus, not the features themselves. The latency before neurons start firing after a pattern appears is one important aspect of the time structure of a neuronal message. We find that the latency indicates how easily the pattern can be seen, and the intensity of the firing, the response strength, is a code indicating what the pattern is. Finding that the latency is related to how easily the pattern can be seen suggests that the features within in a pattern are grouped. We construct a model to show how the neuronal signals entering visual cortex from the lateral geniculate nucleus can be combined to make this feature grouping occur. When inferior temporal cortical neurons respond to a pattern obscured by visual noise, the time it takes for the monkey to respond to the pattern correctly is closely predicted by the time it takes for the neuronal messages to indicate which pattern is present. Our results at both ends of the visual cortical streams suggests there is a template of what constitutes a valid stimulus pattern that gates the neuronal responses. All of these findings taken together suggest that the visual system is sending messages that describe messages that describe stimuli as complex, integrated objects from the earliest cortical stages, and that this integration becomes more general as the signals pass to later stages of visual processing.
Showing the most recent 10 out of 13 publications
