Each brain imaging modality reports on a different aspect of the brain (e.g. gray matter integrity, blood flow changes, white matter integrity) and each has strengths and weaknesses. However the vast majority of studies analyzes each imaging modality separately and interprets the results independently of one another. Many mental illnesses, such as schizophrenia, bipolar disorder, depression, and others, currently lack definitive biological markers and rely primarily on symptom assessments for diagnosis. One area which can benefit greatly from the combination of multimodal data is the study of schizophrenia. The brain imaging findings in schizophrenia are widespread and heterogeneous and have limited replicability. We show evidence that, in part, the lack of consistent findings is because most models do not combine imaging modalities in an integrated manner and miss important changes which are partially detected by each modality separately. Combining multimodal imaging data is not easy since, among other reasons, the combination of multiple data sets consisting of thousands of voxels or time points yields a very high dimensional problem, requiring appropriate data reduction strategies. There are two important areas that we focus on in this new phase of the project. First, we will focus on developing data fusion strategies that will leverage our initial success in developing ICA-based tools for combining multiple tasks and modalities. We will develop and validate approaches which can scale easily from one to many different data types. In the first funding period we focused mainly on pair-wise combinations of multimodal data. However, the results have convinced us that allowing higher order relationships is also important (e.g. we show pilot data in which using 3-way relationships improves our ability to discriminate schizophrenia and control groups). In this proposal we will significantly expand this work and develop novel methods to efficiently exploit high-order joint information not just pair-wise. Next, we will develop new tools that will identify correspondences among modalities. For example we show that structural and functional patterns of covariation are in some cases remarkably similar to one another and in others cases quite distinct and these relationships can predict diagnosis. We will thoroughly test our approach using a well characterized data set involving multiple illnesses that have overlapping symptoms and which can sometimes be misdiagnosed and treated with the wrong medications for months or years (schizophrenia, bipolar disorder, and unipolar depression). As before, we will provide open source tools and release data throughout the duration of the project via a web portal and the NITRIC repository, hence enabling other investigators to compare their own methods with our own as well as to apply them to a large variety of brain disorders. 36

Public Health Relevance

Each brain imaging modality reports on a different aspect of the brain with different strengths and weaknesses and there are now literally thousands of putative imaging biomarkers. This project will develop multivariate methods which use higher order statistics to combine diverse information in a scalable manner, identify correspondence among data types and also provide a sophisticated data sharing and management system.

National Institute of Health (NIH)
National Institute of Biomedical Imaging and Bioengineering (NIBIB)
Research Project (R01)
Project #
Application #
Study Section
Special Emphasis Panel (ZRG1-NT-B (08))
Program Officer
Pai, Vinay Manjunath
Project Start
Project End
Budget Start
Budget End
Support Year
Fiscal Year
Total Cost
Indirect Cost
The Mind Research Network
United States
Zip Code
Zille, Pascal; Calhoun, Vince D; Stephen, Julia M et al. (2017) Fused estimation of sparse connectivity patterns from rest fMRI. Application to comparison of children and adult brains. IEEE Trans Med Imaging :
Dillon, Keith; Calhoun, Vince; Wang, Yu-Ping (2017) A robust sparse-modeling framework for estimating schizophrenia biomarkers from fMRI. J Neurosci Methods 276:46-55
Savio, Alexandre; F√ľnger, Sarah; Tahmasian, Masoud et al. (2017) Resting-State Networks as Simultaneously Measured with Functional MRI and PET. J Nucl Med 58:1314-1317
Arbabshirani, Mohammad R; Plis, Sergey; Sui, Jing et al. (2017) Single subject prediction of brain disorders in neuroimaging: Promises and pitfalls. Neuroimage 145:137-165
Vergara, Victor M; Mayer, Andrew R; Damaraju, Eswar et al. (2017) The effect of preprocessing pipelines in subject classification and detection of abnormal resting state functional network connectivity using group ICA. Neuroimage 145:365-376
Lerman-Sinkoff, Dov B; Sui, Jing; Rachakonda, Srinivas et al. (2017) Multimodal neural correlates of cognitive control in the Human Connectome Project. Neuroimage 163:41-54
Agcaoglu, O; Miller, R; Damaraju, E et al. (2017) Decreased hemispheric connectivity and decreased intra- and inter- hemisphere asymmetry of resting state functional network connectivity in schizophrenia. Brain Imaging Behav :
Yu, Qingbao; Du, Yuhui; Chen, Jiayu et al. (2017) Comparing brain graphs in which nodes are regions of interest or independent components: A simulation study. J Neurosci Methods 291:61-68
Premi, Enrico; Calhoun, V D; Garibotto, V et al. (2017) Source-Based Morphometry Multivariate Approach to Analyze [123I]FP-CIT SPECT Imaging. Mol Imaging Biol 19:772-778
Jiang, Rongtao; Abbott, Christopher C; Jiang, Tianzi et al. (2017) SMRI Biomarkers Predict Electroconvulsive Treatment Outcomes: Accuracy with Independent Data Sets. Neuropsychopharmacology :

Showing the most recent 10 out of 165 publications