The objective of the Evaluation Core is to provide the practical infrastructure and expertise for the coordinated effort of each Project's evaluation. Evaluation will measure the effectiveness of developed technologies and their impact on well defined patient populations and health care providers. To achieve this goal, the Evaluation Core will specifically: (1) assist the Projects in the laboratory evaluation of technologies by aiding in the implementation of evaluation instruments and tools; (2) assign and managed dedicated staff members to each Project, charged with collecting data from clinical sites; (3) perform data checks for consistency and range (i.e. quality control); (4) archive evaluation data into a central repository; and (5) analyze the collected data. These five tasks are inclusive of both technical and clinical evaluations. For each Project, technical, process, and satisfaction measurement endpoints are clearly described within the Project-specific sections of the Evaluation Core. Technical measures encompass the evaluation of information retrieval results, machine learning, end-user satisfaction, and other Project-specific technical metrics. Primary process measures include time to final disposition: time to stabilization; time spent by physicians for chart review; and the length of time for medical document coding. Secondary process measures include the number of primary care and specialty visits, and the number and types of procedures performed. Finally, physician and patient satisfaction are also evaluated in appropriate domains. The totality of these measures is designed to evaluate the impact of the described technologies in a real-world clinical environment. These initial measures, along with technical development described in this Program Project may also lay the appropriate groundwork for future cost-effectiveness evaluation by: (1) defining characterizations of appropriate imaging based """"""""episodes"""""""" of care; (2) recording resource utilization; (3) gathering patient-specific information related to presenting symptoms and """"""""final disposition""""""""; and (4) storing patient-specific information in a structured format to facilitate recall. Three different designs (natural experiment, time series, and """"""""off/on/off"""""""") are used. The choice of experimental design for each Project was influenced by its real-world clinical patient settings and the availability of data for a control group. Power calculations are defined and presented to determine the appropriate sample sizes required for meaningful evaluation. Interaction between the Projects and the Evaluation Core is enhanced by: (1) regular meetings of the Project leaders, Core directors, and the PI; and (2) the assignment of dedicated Evaluation Core is enhanced by: (1) regular meetings of the Project leaders; Core directors, and the PI; and (2) the assignment of dedicated Evaluation Core staff to each Project who are familiar with the details of the Project while working under the direct supervision of the Core faculty.

Agency
National Institute of Health (NIH)
Institute
National Institute of Biomedical Imaging and Bioengineering (NIBIB)
Type
Research Program Projects (P01)
Project #
8P01EB000216-11
Application #
7305964
Study Section
Subcommittee G - Education (NCI)
Project Start
Project End
Budget Start
Budget End
Support Year
11
Fiscal Year
2002
Total Cost
$305,280
Indirect Cost
Name
University of California Los Angeles
Department
Type
DUNS #
119132785
City
Los Angeles
State
CA
Country
United States
Zip Code
90095
Bashyam, Vijayaraghavan; Hsu, William; Watt, Emily et al. (2009) Problem-centric organization and visualization of patient imaging and clinical data. Radiographics 29:331-43
Taira, Ricky K; Taira, Ricky; Bui, Alex et al. (2008) A tool for improving the longitudinal imaging characterization for neuro-oncology cases. AMIA Annu Symp Proc :712-6
Son, Roderick Y; Taira, Ricky K; Kangarloo, Hooshang et al. (2008) Context-sensitive correlation of implicitly related data: an episode creation methodology. IEEE Trans Inf Technol Biomed 12:549-60
Bui, Alex A T; Morioka, Craig; Dionisio, John David N et al. (2007) OpenSourcePACS: an extensible infrastructure for medical image management. IEEE Trans Inf Technol Biomed 11:94-109
Taira, Ricky K; Bashyam, Vijayaraghavan; Kangarloo, Hooshang (2007) A field theoretical approach to medical natural language processing. IEEE Trans Inf Technol Biomed 11:364-75
Bui, Alex A T; Aberle, Denise R; Kangarloo, Hooshang (2007) TimeLine: visualizing integrated patient records. IEEE Trans Inf Technol Biomed 11:462-73
Ardekani, Siamak; Kumar, Anand; Bartzokis, George et al. (2007) Exploratory voxel-based analysis of diffusion indices and hemispheric asymmetry in normal aging. Magn Reson Imaging 25:154-67
Ardekani, Siamak; Selva, Luis; Sayre, James et al. (2006) Quantitative metrics for evaluating parallel acquisition techniques in diffusion tensor imaging at 3 Tesla. Invest Radiol 41:806-14
Ardekani, Siamak; Sinha, Usha (2006) Statistical representation of mean diffusivity and fractional anisotropy brain maps of normal subjects. J Magn Reson Imaging 24:1243-51
Ardekani, Siamak; Sinha, Usha (2005) Geometric distortion correction of high-resolution 3 T diffusion tensor brain images. Magn Reson Med 54:1163-71

Showing the most recent 10 out of 21 publications