Advances in digital imaging technologies have led to a substantial growth in the number of digital images being created and stored in hospitals, medical systems, and on the Internet in recent years. Effective medical image retrieval systems can play an important role in teaching, research, diagnosis and treatment. Images were historically retrieved using text-based methods. The quality of annotations associated with images can reduce the effectiveness of text-based image retrieval. Despite recent advances, purely content- based image retrieval techniques lag significantly behind their textual counterparts in their ability to capture the semantic essence of the user's query. Preliminary research suggests that a more promising approach is to adaptively combine these complementary techniques to suit the user and their information needs. However, for these approaches to succeed, the researcher needs to enhance her computational skills in addition to acquiring a comprehensive understanding of the relevant clinical domain. This Pathway to Independence (K99/R00) grant application describes a training and career development plan that will allow the candidate, an NLM postdoctoral fellow in Medical Informatics at Oregon Health &Science University to achieve these objectives. The training component will be carried out under the mentorship of Dr. W. Hersh with Dr. Gorman (user studies). Dr. Fuss (radiation medicine) and Dr. Erdogmus (machine learning) providing additional mentoring in their areas of expertise. The long-term goal of this Pathway to Independence (K99/R00) project is to improve visual information retrieval by better understanding user needs and proposing adaptive methodologies for multimodal image retrieval that will close the semantic gap. During the award period, activities will be focused on the following specific aims: (1) Understand the image retrieval needs of novice and expert users in radiation oncology and develop gold standards for evaluation;(2) Develop algorithms for semantic, multimodal image retrieval;(3) Perform user based evaluation of adaptive image retrieval in radiation oncology;(4) Extend the techniques developed to create a multimodal image retrieval system in pathology

National Institute of Health (NIH)
National Library of Medicine (NLM)
Research Transition Award (R00)
Project #
Application #
Study Section
Special Emphasis Panel (ZLM1-ZH-C (M3))
Program Officer
Sim, Hua-Chuan
Project Start
Project End
Budget Start
Budget End
Support Year
Fiscal Year
Total Cost
Indirect Cost
Massachusetts General Hospital
United States
Zip Code
Obuchowski, Nancy A; Reeves, Anthony P; Huang, Erich P et al. (2015) Quantitative imaging biomarkers: a review of statistical methods for computer algorithm comparisons. Stat Methods Med Res 24:68-106
Obuchowski, Nancy A; Barnhart, Huiman X; Buckler, Andrew J et al. (2015) Statistical issues in the comparison of quantitative imaging biomarker algorithms using pulmonary nodule volume as an example. Stat Methods Med Res 24:107-40
Kalpathy-Cramer, Jayashree; de Herrera, Alba GarcĂ­a Seco; Demner-Fushman, Dina et al. (2015) Evaluating performance of biomedical image retrieval systems--an overview of the medical image retrieval task at ImageCLEF 2004-2013. Comput Med Imaging Graph 39:55-61
Kalpathy-Cramer, Jayashree; Freymann, John Blake; Kirby, Justin Stephen et al. (2014) Quantitative Imaging Network: Data Sharing and Competitive AlgorithmValidation Leveraging The Cancer Imaging Archive. Transl Oncol 7:147-52
Gutman, David A; Dunn Jr, William D; Cobb, Jake et al. (2014) Web based tools for visualizing imaging data and development of XNATView, a zero footprint image viewer. Front Neuroinform 8:53
Huang, Wei; Li, Xin; Chen, Yiyi et al. (2014) Variations of dynamic contrast-enhanced magnetic resonance imaging in evaluation of breast cancer therapy response: a multicenter data analysis challenge. Transl Oncol 7:153-66
Pinho, Marco C; Polaskova, Pavlina; Kalpathy-Cramer, Jayashree et al. (2014) Low incidence of pseudoprogression by imaging in newly diagnosed glioblastoma patients treated with cediranib in combination with chemoradiation. Oncologist 19:75-81
Kalpathy-Cramer, Jayashree; Gerstner, Elizabeth R; Emblem, Kyrre E et al. (2014) Advanced magnetic resonance imaging of the physical processes in human glioblastoma. Cancer Res 74:4622-37
Awan, Musaddiq; Kalpathy-Cramer, Jayashree; Gunn, G Brandon et al. (2013) Prospective Assessment of an Atlas-Based Intervention Combined With Real-Time Software Feedback in Contouring Lymph Node Levels and Organs-at-Risk in the Head and Neck: Quantitative Assessment of Conformance to Expert Delineation. Pract Radiat Oncol 3:186193
Keck, Katie M; Kalpathy-Cramer, Jayashree; Ataer-Cansizoglu, Esra et al. (2013) Plus disease diagnosis in retinopathy of prematurity: vascular tortuosity as a function of distance from optic disk. Retina 33:1700-7

Showing the most recent 10 out of 11 publications