Visual object recognition is crucial for most everyday tasks including face identification, reading and navigation. In spite of the massive increase in computational power over the last two decades, a 3-year-old still outperforms the most sophisticated algorithms even in simple recognition tasks. Understanding the computations performed by the human visual system to recognize objects will have profound implications not only to understand the functions (and malfunction) of the cerebral cortex but also for developing visual prosthetic devices for the visually impaired. We combine neurophysiology, electrical stimulation and tools from machine learning to further our understanding of the neuronal circuits, algorithms and computations performed by the human visual system to perform visual pattern recognition. In the vast majority of visually impaired or blind people, the problems originate at the level of the retina while the visual cortex remains unimpaired. Our proposal constitutes a proof- of-principle approach towards developing visual prosthetic devices that rely on electrical stimulation of visual cortex.
The specific aims of this proposal are designed to test the possibility of decoding and recoding information in visual cortex: (1) Read-out of visual information from human visual cortex on line (2) Write-in of visual information in human visual cortex. We take advantage of a rare opportunity to study the human brain at high spatial and temporal resolution by studying patients who have electrodes implanted for clinical reasons. Our electrophysiological recordings provide us with a unique view of the human temporal lobe circuitry and allow us to test the feasibility of cortical visual prosthetics in behaving human subjects.

Public Health Relevance

Towards cortical visual prosthetics one of the key challenges for the visually impaired and blind people is the lack of visual object recognition capabilities. Visual recognition is crucial for most everyday tasks including navigation and face identification. Our proposal is a proof-of-principle approach towards the development of visual prosthetics devices based on electrical stimulation in visual cortex.

Agency
National Institute of Health (NIH)
Institute
National Eye Institute (NEI)
Type
Exploratory/Developmental Grants (R21)
Project #
5R21EY019710-02
Application #
7903931
Study Section
Central Visual Processing Study Section (CVP)
Program Officer
Steinmetz, Michael A
Project Start
2009-08-01
Project End
2011-07-31
Budget Start
2010-08-01
Budget End
2011-07-31
Support Year
2
Fiscal Year
2010
Total Cost
$212,644
Indirect Cost
Name
Children's Hospital Boston
Department
Type
DUNS #
076593722
City
Boston
State
MA
Country
United States
Zip Code
02115
Burbank, Kendra S; Kreiman, Gabriel (2012) Depression-biased reverse plasticity rule is required for stable learning at top-down connections. PLoS Comput Biol 8:e1002393
Kreiman, Gabriel (2011) Decoding ensemble activity from neurophysiological recordings in the temporal cortex. Conf Proc IEEE Eng Med Biol Soc 2011:5904-7
Tang, Hanlin; Kreiman, Gabriel (2011) Face recognition: vision and emotions beyond the bubble. Curr Biol 21:R888-90
Anderson, William S; Kreiman, Gabriel (2011) Neuroscience: what we cannot model, we do not understand. Curr Biol 21:R123-5
Hemberg, Martin; Kreiman, Gabriel (2011) Conservation of transcription factor binding events predicts gene expression across species. Nucleic Acids Res 39:7092-102
Quian Quiroga, Rodrigo; Kreiman, Gabriel (2010) Measuring sparseness in the brain: comment on Bowers (2009). Psychol Rev 117:291-7
Kim, Tae-Kyung; Hemberg, Martin; Gray, Jesse M et al. (2010) Widespread transcription at neuronal activity-regulated enhancers. Nature 465:182-7
Agam, Yigal; Liu, Hesheng; Papanastassiou, Alexander et al. (2010) Robust selectivity to two-object images in human visual cortex. Curr Biol 20:872-9
Blumberg, Julie; Kreiman, Gabriel (2010) How cortical neurons help us see: visual recognition in the human brain. J Clin Invest 120:3054-63
Rasch, Malte; Logothetis, Nikos K; Kreiman, Gabriel (2009) From neurons to circuits: linear estimation of local field potentials. J Neurosci 29:13785-96

Showing the most recent 10 out of 12 publications