Each brain imaging modality reports on a different aspect of the brain (e.g. gray matter integrity, blood flow changes, white matter integrity) and each has strengths and weaknesses. However the vast majority of studies analyzes each imaging modality separately and interprets the results independently of one another. Many mental illnesses, such as schizophrenia, bipolar disorder, depression, and others, currently lack definitive biological markers and rely primarily on symptom assessments for diagnosis. One area which can benefit greatly from the combination of multimodal data is the study of schizophrenia. The brain imaging findings in schizophrenia are widespread and heterogeneous and have limited replicability. We show evidence that, in part, the lack of consistent findings is because most models do not combine imaging modalities in an integrated manner and miss important changes which are partially detected by each modality separately. Combining multimodal imaging data is not easy since, among other reasons, the combination of multiple data sets consisting of thousands of voxels or time points yields a very high dimensional problem, requiring appropriate data reduction strategies. There are two important areas that we focus on in this new phase of the project. First, we will focus on developing data fusion strategies that will leverage our initial success in developing ICA-based tools for combining multiple tasks and modalities. We will develop and validate approaches which can scale easily from one to many different data types. In the first funding period we focused mainly on pair-wise combinations of multimodal data. However, the results have convinced us that allowing higher order relationships is also important (e.g. we show pilot data in which using 3-way relationships improves our ability to discriminate schizophrenia and control groups). In this proposal we will significantly expand this work and develop novel methods to efficiently exploit high-order joint information not just pair-wise. Next, we will develop new tools that will identify correspondences among modalities. For example we show that structural and functional patterns of covariation are in some cases remarkably similar to one another and in others cases quite distinct and these relationships can predict diagnosis. We will thoroughly test our approach using a well characterized data set involving multiple illnesses that have overlapping symptoms and which can sometimes be misdiagnosed and treated with the wrong medications for months or years (schizophrenia, bipolar disorder, and unipolar depression). As before, we will provide open source tools and release data throughout the duration of the project via a web portal and the NITRIC repository, hence enabling other investigators to compare their own methods with our own as well as to apply them to a large variety of brain disorders. 36

Public Health Relevance

Each brain imaging modality reports on a different aspect of the brain with different strengths and weaknesses and there are now literally thousands of putative imaging biomarkers. This project will develop multivariate methods which use higher order statistics to combine diverse information in a scalable manner, identify correspondence among data types and also provide a sophisticated data sharing and management system.

National Institute of Health (NIH)
National Institute of Biomedical Imaging and Bioengineering (NIBIB)
Research Project (R01)
Project #
Application #
Study Section
Special Emphasis Panel (ZRG1-NT-B (08))
Program Officer
Pai, Vinay Manjunath
Project Start
Project End
Budget Start
Budget End
Support Year
Fiscal Year
Total Cost
Indirect Cost
The Mind Research Network
United States
Zip Code
Chen, Jiayu; Calhoun, Vince D; Pearlson, Godfrey D et al. (2016) Independent component analysis of SNPs reflects polygenic risk scores for schizophrenia. Schizophr Res :
Bridwell, David A; Rachakonda, Srinivas; Silva, Rogers F et al. (2016) Spatiospectral Decomposition of Multi-subject EEG: Evaluating Blind Source Separation Algorithms on Real and Realistic Simulated Data. Brain Topogr :
Calhoun, Vince D; Sui, Jing (2016) Multimodal fusion of brain imaging data: A key to finding the missing link(s) in complex mental illness. Biol Psychiatry Cogn Neurosci Neuroimaging 1:230-244
Mokhtari, Mohammadreza; Narayanan, Balaji; Hamm, Jordan P et al. (2016) Multivariate Genetic Correlates of the Auditory Paired Stimuli-Based P2 Event-Related Potential in the Psychosis Dimension From the BSNIP Study. Schizophr Bull 42:851-62
Du, Yuhui; Pearlson, Godfrey D; Yu, Qingbao et al. (2016) Interaction among subsystems within default mode network diminished in schizophrenia patients: A dynamic connectivity approach. Schizophr Res 170:55-65
Du, Yuhui; Allen, Elena A; He, Hao et al. (2016) Artifact removal in the context of group ICA: A comparison of single-subject and group approaches. Hum Brain Mapp 37:1005-25
Liu, Peng; Wang, Geliang; Liu, Yanfei et al. (2016) White matter microstructure alterations in primary dysmenorrhea assessed by diffusion tensor imaging. Sci Rep 6:25836
Lowe, Mark J; Sakaie, Ken E; Beall, Erik B et al. (2016) Modern Methods for Interrogating the Human Connectome. J Int Neuropsychol Soc 22:105-19
Liu, P; Yang, J; Wang, G et al. (2016) Altered regional cortical thickness and subcortical volume in women with primary dysmenorrhoea. Eur J Pain 20:512-20
Steele, Vaughn R; Anderson, Nathaniel E; Claus, Eric D et al. (2016) Neuroimaging measures of error-processing: Extracting reliable signals from event-related potentials and functional magnetic resonance imaging. Neuroimage 132:247-60

Showing the most recent 10 out of 109 publications