Three-dimensional computer graphics plays a key role in basic research on visual space perception and in numerous applications such as virtual reality. The goal in 3d graphics has been to create the display on a digital display screen that yields the same 2d retinal images as the real 3d scene itself. This can be done stereoscopically by presenting two images on the display screen, one for each eye. The resulting 3d impression can be very compelling. However, the resulting percept is frequently different from that obtained with real scenes and objects. Part, if not all, of the problem can be attributed to inappropriate screen cues that signal the distance to (and shape of' the display screen rather than simulated scene or object. Here we propose to measure the contributions of those screen cues and to develop a novel, multi-focal graphics display system that will circumvent the most problematic of the screen cues. The research effort requires the combined talents of psychophysicists, optical scientists, and computer graphic engineers, so we are requesting funds to put together this collaborative research program. There are four specific aims.1. Measure the influence of digital display cues on perceived 3-dimensionality. We will investigate the contributions of three such cues: a) inappropriate motion parallax during head movements, b) pixelization, and c) inappropriate focus cues.2. Develop an adaptive lens. The requirements are a) high image quality, b) ability to change power by 2 diopters or more, c) frequency response of 180Hz or higher, d) synchronizing lens power changes with the graphic display, and e) small and light enough to be worn by a human observer.3. Develop and evaluate the graphic display algorithm required to simulate focus cues accurately.4. Construct and evaluate the lens and graphical display algorithm. We will test human observers with and without the system in use. We will assess the quality of the resultant in terms of apparent depth, flicker, sharpness, smoothness of motion, and more. We will be particularly interested in using depth-judgment tasks to evaluate the effectiveness of the system in producing more veridical 3d percepts.

Agency
National Institute of Health (NIH)
Institute
National Eye Institute (NEI)
Type
Research Project (R01)
Project #
5R01EY014194-04
Application #
6936515
Study Section
Visual Sciences B Study Section (VISB)
Program Officer
Oberdorfer, Michael
Project Start
2002-09-15
Project End
2007-08-31
Budget Start
2005-09-01
Budget End
2007-08-31
Support Year
4
Fiscal Year
2005
Total Cost
$226,370
Indirect Cost
Name
University of California Berkeley
Department
Type
Schools of Optometry/Ophthalmol
DUNS #
124726725
City
Berkeley
State
CA
Country
United States
Zip Code
94704
Kim, Joohwan; Johnson, Paul V; Banks, Martin S (2014) Stereoscopic 3D display with color interlacing improves perceived depth. Opt Express 22:31924-34
Banks, Martin S; Kim, Joohwan; Shibata, Takashi (2013) Insight into Vergence-Accommodation Mismatch. Proc SPIE Int Soc Opt Eng 8735:
Vangorp, Peter; Richardt, Christian; Cooper, Emily A et al. (2013) Perception of Perspective Distortions in Image-Based Rendering. ACM Trans Graph 32:
Hoffman, David M; Karasev, Vasiliy I; Banks, Martin S (2011) Temporal presentation protocols in stereoscopic displays: Flicker visibility, perceived motion, and perceived depth. J Soc Inf Disp 19:271-297
O'Shea, James P; Agrawala, Maneesh; Banks, Martin S (2010) The influence of shape cues on the perception of lighting direction. J Vis 10:21
Held, Robert T; Cooper, Emily A; O'Brien, James F et al. (2010) Using Blur to Affect Perceived Distance and Size. ACM Trans Graph 29:
Hoffman, David M; Banks, Martin S (2010) Focus information is used to interpret binocular images. J Vis 10:13
Burge, Johannes; Girshick, Ahna R; Banks, Martin S (2010) Visual-haptic adaptation is determined by relative reliability. J Neurosci 30:7714-21
Burge, Johannes; Fowlkes, Charless C; Banks, Martin S (2010) Natural-scene statistics predict how the figure-ground cue of convexity affects human depth perception. J Neurosci 30:7269-80
Hoffman, David M; Hands, Philip J W; Kirby, Andrew K et al. (2009) Stereo display with time-multiplexed focal adjustment. Proc SPIE Int Soc Opt Eng 7237:72370R

Showing the most recent 10 out of 18 publications