This is a collaborative project leveraging expertise of Ashok Veeraraghavan, William Marsh Rice University (IIS-1116718) and Ramesh Raskar, Massachusetts Institute of Technology (IIS-1116452). Imaging and display devices are all around us and are used in a variety of applications. The spatial resolution, depth range, depth resolution, temporal resolution, frame-rate and bandwidth of these devices are usually fixed a priori. When the resolution and other properties of the content being imaged or displayed does not exactly mimic those that were assumed a priori, this leads to inefficiencies (in utilizing available resources) and undesirable artifacts (aliasing, blurring and noise). Since both imaging and display devices are fast becoming multi-purpose, there is a need to develop imaging and display architectures (and algorithms) that are capable of adapting their resolution and bandwidth characteristics to match those of the content.
The goal of this project is to develop imaging and display devices that adapt to scene, motion, geometry, viewer, or illumination conditions. Such adaptive devices lead to performance improvements and novel capabilities hitherto unexplored. This research agenda is organized into four intellectual thrusts: (1) the establishment a theoretical framework for Adaptive Coded Imaging and Displays (AdaCID) that enables efficient exploration of the space of designs (2) the design of adaptive coded imaging systems that adapt to scene geometry, motion, and illumination (3) the design of adaptive and interactive coded 2D/3D displays that adapt in real-time to content, viewer position, and the human visual system enhancing visual appearance and allowing intuitive 3D interaction and (4) the demonstration of coded feedback projector-camera systems enabling rapid acquisition of range and material characteristics.
It is expected that AdaCID will have far-reaching impact to diverse applications spanning consumer imaging and displays, machine vision and automation, scientific/medical imaging and displays and surveillance. Since AdaCID and the broader field of computational imaging and displays is increasingly important, they will be integrated into various courses offered at Rice University and MIT. Broad dissemination of the educational material will be achieved through participation in the free, open-licensed Connexions program and OpenCourseWare and in public-domain museum initiatives (at the MIT Museum). This project also offers collaborative research opportunities for students at the two institutions. Project Website (http://cameraculture.media.mit.edu/AdaCID/) provides additional information.
