Active vision requires encoding and remembering relevant information based on current task goals. Classic accounts posit that sensory encoding, attentional selection and working memory are mediated by persistent changes in the firing rates, or the gain, of visually responsive neurons that have a fixed tuning profile (termed ?pure? or ?fixed-selectivity? neurons). The focus on gain modulations in fixed-selectivity neurons has revealed a great deal about the basic mechanisms of attention and memory. However, it is becoming increasingly clear that dynamic changes in task demands may require more flexible coding schemes. For example, holding information in working memory in the same format as the stimulus-evoked response may lead to interference with new sensory inputs. Similarly, flexibly encoding sensory representations to complete one task ? say a simple choice between two motor responses ? might require a reconfiguration of the representation if another stimulus- response mapping suddenly becomes relevant. Finally, sensory codes must be flexible in the sense that early in processing they should form high-dimensional representations to represent as much information as possible about the current state of the world. Later in processing, when a decision or motor response needs to be made, the code should collapse to only represent the smaller subset of relevant choices. All of these computations are more naturally accomplished via the operation of neurons that have flexible tuning for both sensory features and for task demands (termed ?mixed-selectivity? neurons). Based on these considerations, we hypothesize that flexible behaviors are supported by mixed-selectivity neurons that ?rotate? high-dimensional neural codes to become robust to interference or to sub-serve other changes in task demands. We will use modelling, psychophysics, and functional magnetic resonance imaging (fMRI) to test predictions about how mixed-selectivity should modulate large-scale activation patterns that are measured non-invasively in human subjects. Collectively, this work will challenge traditional theories of sensory encoding, attention, and working memory that are based on the notion of fixed-selectivity, and will provide important constraints on models of visual information processing to support more targeted diagnoses and interventions in clinical settings.
Whether listening to a teacher in a classroom or driving a car down the road, the ability to selectively attend to and remember only the most important objects in the environment is critical to making situation-appropriate decisions. Traditional accounts hold that selective attention and short-term memory are mediated by increasing or decreasing the firing rates (or the gain) of the neurons that encode currently relevant objects, analogous to adjusting the equalizer controls on a stereo to selectively enhance or suppress different features (i.e. power in different frequency bands). Here we will use modelling, psychophysics, and functional magnetic resonance imaging (fMRI) to test the alternative theory that flexible behaviors are supported by transformations in high- dimensional population codes that are driven by changes in the state of the sensory environment and by changes in behavioral goals.
| Nobre, Anna C; Serences, John T (2018) Building on a Solid Baseline: Anticipatory Biases in Attention. Trends Neurosci 41:120-122 |
| Itthipuripat, Sirawaj; Cha, Kexin; Deering, Sean et al. (2018) Having More Choices Changes How Human Observers Weight Stable Sensory Evidence. J Neurosci 38:8635-8649 |
| Vo, Vy A; Sprague, Thomas C; Serences, John T (2017) Spatial Tuning Shifts Increase the Discriminability and Fidelity of Population Codes in Visual Cortex. J Neurosci 37:3386-3401 |
| Itthipuripat, Sirawaj; Cha, Kexin; Byers, Anna et al. (2017) Two different mechanisms support selective attention at different phases of training. PLoS Biol 15:e2001724 |
| Rademaker, Rosanne L; Serences, John T (2017) Pinging the brain to reveal hidden memories. Nat Neurosci 20:767-769 |
| Cowell, Rosemary A; Leger, Krystal R; Serences, John T (2017) Feature-coding transitions to conjunction-coding with progression through human visual cortex. J Neurophysiol 118:3194-3214 |
| Nelli, Stephanie; Itthipuripat, Sirawaj; Srinivasan, Ramesh et al. (2017) Fluctuations in instantaneous frequency predict alpha amplitude during visual perception. Nat Commun 8:2071 |
| Sprague, Thomas C; Ester, Edward F; Serences, John T (2016) Restoring Latent Visual Working Memory Representations in Human Cortex. Neuron 91:694-707 |
| Serences, John T (2016) Neural mechanisms of information storage in visual short-term memory. Vision Res 128:53-67 |
