Innovative 3-D computer vision algorithms that can enable a new generation of """"""""spatially aware"""""""" instruments by providing real-time absolute positioning capability non- invasively, similar to the Global Positioning Satellite System for terrestrial applications, are proposed. They rely on a spatial reference map that is constructed during the diagnostic exploration. The position information can be used for numerous purposes, including surgical navigation, guidance, planning, on-line treatment monitoring, error detection, alarms and safety shutoffs is when the tool strays from the target, change analysis, and even surgical simulation. This is a much better paradigm for instrument design than (the largely unsuccessful) tracking algorithms that measure relative displacements, and are thus prone to drift and tracking loss. The proposed algorithms will operate robustly and accurately at frame rates for extended periods in poor and variable imaging conditions. They could be incorporated into existing clinical instruments without the need for precise calibration, which is often not possible anyway, because the patient's anatomy (e.g., the eye) is part of the imaging system. The algorithms will be validated in the context of laser retinal surgery - compelling as the only long-term proven treatment for the leading blindness- causing conditions affecting over 20 million people in the US. Yet, the current success rate of this procedure is less than 50%, largely due to the lack of spatial mapping and navigation aids in current clinical instruments. Beyond laser retinal surgery, the algorithms may be applied whenever: (1) precise locations on the retina are important (e.g., perimetry); (2) the retinal periphery is of interest (AIDS/CMV, diabetes); (3) motion compensation is needed; (4) a tool such as a laser or endoscope is to be monitored or guided precisely at a chosen location; or 5) even when stable measurements of the vasculature (retinopathy of prematurity) and retinal changes are of interest (e.g., angiogenesis research). Overall, the core methods are expected to be broadly useful in a number of minimally-invasive surgical techniques, including emerging alternatives to laser.

Agency
National Institute of Health (NIH)
Institute
National Center for Research Resources (NCRR)
Type
Exploratory/Developmental Grants (R21)
Project #
1R21RR014038-01A1
Application #
6085479
Study Section
Special Emphasis Panel (ZRR1-BT-1 (01))
Program Officer
Marron, Michael T
Project Start
2000-05-01
Project End
2002-04-30
Budget Start
2000-05-01
Budget End
2001-04-30
Support Year
1
Fiscal Year
2000
Total Cost
$98,763
Indirect Cost
Name
Rensselaer Polytechnic Institute
Department
Engineering (All Types)
Type
Schools of Engineering
DUNS #
002430742
City
Troy
State
NY
Country
United States
Zip Code
12180
Tsai, Chia-Ling; Stewart, Charles V; Tanenbaum, Howard L et al. (2004) Model-based method for improving the accuracy and repeatability of estimating vascular bifurcations and crossovers from retinal fundus images. IEEE Trans Inf Technol Biomed 8:122-30
Tyrrell, James Alexander; LaPre, Justin M; Carothers, Christopher D et al. (2004) Efficient migration of complex off-line computer vision software to real-time system implementation on generic computer hardware. IEEE Trans Inf Technol Biomed 8:142-53
Lin, Gang; Stewart, Charles V; Roysam, Badrinath et al. (2004) Predictive scheduling algorithms for real-time feature extraction and spatial referencing: application to retinal image sequences. IEEE Trans Biomed Eng 51:115-25
Stewart, Charles V; Tsai, Chia-Ling; Roysam, Badrinath (2003) The dual-bootstrap iterative closest point algorithm with application to retinal image registration. IEEE Trans Med Imaging 22:1379-94
Shen, H; Roysam, B; Stewart, C V et al. (2001) Optimal scheduling of tracing computations for real-time vascular landmark extraction from retinal fundus images. IEEE Trans Inf Technol Biomed 5:77-91