This project is to develop, deploy, and disseminate a suite of open source tools and integrated informatics platform that will facilitate multi-scale, correlative analyses of high resolution whole slide tissue image data, spatially mapped genetics and molecular data for cancer research. This platform will play an essential role in supporting studies of tumor initiation, development, heterogeneity, invasion, and metastasis. These tools will allow quantitative analyses of the interplay between morphology and spatially mapped genetics and molecular data and will be used in studies that predict outcome and response to treatment, in radiogenomic and quantitative radiology imaging studies and in studies to identify cancer targets. The software and methods will enable researchers to assemble and visualize detailed, multi-scale descriptions of tissue morphologic changes originating from a wide range of microscopy instruments and make it possible to efficiently manage, interrogate, and explore microscopy imaging data at multiple scales and to identify and analyze features across individuals and cohorts. The project will build on and extend the software and methods we have developed in microscopy imaging, integrative image analysis, high performance computing, databases, and visualization over the past fifteen years and will also leverage, integrate and adapt the Harvard Slicer platform. The design and implementation of the informatics platform will be driven by four well funded, leading edge cancer focused studies along with many additional collaborative efforts including the Cancer Imaging Archive (TCIA), the Mayo Clinic Quantitative Imaging Network site, the Colon Cancer Family Registry and the Polyp Prevention Study.

Public Health Relevance

Cancer is a disease that involves complex interactions between cancer cells, surrounding and distant tissue. Within a given cancer, cancer cells can differ from one another in many ways and cancer cells can exert a variety of types of influence on other tissue. In order to develop effective diagnostic and treatment methods for cancer, we need to understand these complex patterns of interaction. This project will develop and deploy a suite of informatics tools that will enable researchers to study tumors - their structure, their genetics and protein expression - at microscopic scales. Our tools will be employed by basic cancer researchers who study cancer mechanisms, by researchers who seek to discover new therapies and by researchers who employ quantitative imaging methods to assess results of clinical cancer trials.

National Institute of Health (NIH)
National Cancer Institute (NCI)
Resource-Related Research Projects--Cooperative Agreements (U24)
Project #
Application #
Study Section
Special Emphasis Panel (ZCA1)
Program Officer
Ossandon, Miguel
Project Start
Project End
Budget Start
Budget End
Support Year
Fiscal Year
Total Cost
Indirect Cost
State University New York Stony Brook
Other Clinical Sciences
Schools of Medicine
Stony Brook
United States
Zip Code
Saltz, Joel; Gupta, Rajarsi; Hou, Le et al. (2018) Spatial Organization and Molecular Correlation of Tumor-Infiltrating Lymphocytes Using Deep Learning on Pathology Images. Cell Rep 23:181-193.e7
Thorsson, Vésteinn; Gibbs, David L; Brown, Scott D et al. (2018) The Immune Landscape of Cancer. Immunity 48:812-830.e14
Cooper, Lee Ad; Demicco, Elizabeth G; Saltz, Joel H et al. (2018) PanCancer insights from The Cancer Genome Atlas: the pathologist's perspective. J Pathol 244:512-524
Gomes, Jeremias; de Melo, Alba C M A; Kong, Jun et al. (2018) Cooperative and out-of-core execution of the irregular wavefront propagation pattern on hybrid machines with Intel? Xeon Phi™. Concurr Comput 30:
Pantanowitz, Liron; Sharma, Ashish; Carter, Alexis B et al. (2018) Twenty Years of Digital Pathology: An Overview of the Road Travelled, What is on the Horizon, and the Emergence of Vendor-Neutral Archives. J Pathol Inform 9:40
Saltz, Joel; Sharma, Ashish; Iyer, Ganesh et al. (2017) A Containerized Software System for Generation, Management, and Exploration of Features from Whole Slide Tissue Images. Cancer Res 77:e79-e82
Baig, Furqan; Vo, Hoang; Kurc, Tahsin et al. (2017) SparkGIS: Resource Aware Efficient In-Memory Spatial Query Processing. Proc ACM SIGSPATIAL Int Conf Adv Inf 2017:
Penha, Emanuel Diego S; Iriabho, Egiebade; Dussaq, Alex et al. (2017) Isomorphic semantic mapping of variant call format (VCF2RDF). Bioinformatics 33:547-548
Teodoro, George; Kurc, Tahsin; Andrade, Guilherme et al. (2017) Application Performance Analysis and Efficient Execution on Systems with multi-core CPUs, GPUs and MICs: A Case Study with Microscopy Image Analysis. Int J High Perform Comput Appl 31:32-51
Konen, J; Summerbell, E; Dwivedi, B et al. (2017) Image-guided genomics of phenotypically heterogeneous populations reveals vascular signalling during symbiotic collective cancer invasion. Nat Commun 8:15078

Showing the most recent 10 out of 30 publications