Discussion on the Application of Multi-modal Magnetic Resonance Imaging Fusion in Schizophrenia

  • Xiaohong Wang
  • Na Zhao
  • Jingjing Shi
  • Yuhua Wu
  • Jun Liu
  • Qiang Xiao
  • Jian HuEmail author
Image & Signal Processing
Part of the following topical collections:
  1. Artificial Intelligence Application in Health Informatics


In order to study the application of multi-modal magnetic resonance imaging (MRI) fusion technology in schizophrenia, a 4-way multi-modal fusion method based on mCCA+jICA is used to fuse the local consistency and functional network connection of resting-state functional MRI, gray matter volume of structural MRI, and partial anisotropy of diffusion MRI four characteristics of large sample of schizophrenic patients in multi-site China, trying to find out the common characteristics of function and structure of significant differences between schizophrenia and healthy controls. It is found that compared with normal people, schizophrenic patients show higher local consistency, lower gray matter volume, lower functional network connectivity and decreased white matter integrity in the anterior thalamic radiation, upper bundle and other bundles in brain areas such as basal ganglia network, hippocampus and prominence network. There is a significant correlation between a thalamocortical perceptual loop and auditory hallucination in schizophrenia, and there is a high degree of spatial consistency and commonality among the three MRI features. The higher the volume of gray matter in the dorsolateral and medial prefrontal cortex is, the higher the integrity of white matter fibers such as corticospinal tract, superior longitudinal tract and anterior thalamic radiation is, the higher the digital backward score is, and the better the working memory ability of the subjects is.


MR Multi-modal fusion Auditory hallucination Schizophrenia 



There was no dedicated funding regarding this study.

Compliance with Ethical Standards

Conflict of Interest

Author Xiaohong Wang declares that he has no conflict of interest. Author Na Zhao declares that he has no conflict of interest. Author Jingjing Shi declares that he has no conflict of interest. Author Yuhua Wu declares that he has no conflict of interest. Author Jun Liu declares that he has no conflict of interest. Author Qiang Xiao declares that he has no conflict of interest. Author Jian Hu declares that he has no conflict of interest.

Ethical Approval

All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards.

This article does not contain any studies with animals performed by any of the authors.

Informed Consent

Informed consent was obtained from all individual participants included in the study.


  1. 1.
    Sui, J., Pearlson, G. D., Du, Y. et al., In search of multimodal neuroimaging biomarkers of cognitive deficits in schizophrenia. Biol Psychiatr. 78(11):794–804, 2015.CrossRefGoogle Scholar
  2. 2.
    Venkatrao, P. H., and Damodar, S. S., HWFusion: Holoentropy and SP-whale optimisation-based fusion model for magnetic resonance imaging multimodal image fusion. Iet Image Process. 12(4):572–581, 2018.CrossRefGoogle Scholar
  3. 3.
    Levinschwartz, Y., Calhoun, V. D., and Adalı, T., Quantifying the interaction and contribution of multiple datasets in fusion: Application to the detection of schizophrenia. IEEE Trans. Med. Imag. 99:1–1, 2017.Google Scholar
  4. 4.
    Zhao, Y. L., Xia, X., Liang, C. E., and Li, X. M., Pharmacokinetic changes induced by focused ultrasound in glioma-bearing rats using dynamiccontrast-enhanced MRI measurement. J. Biol. Regul. Homeost. Agents 32(3):655–661, 2018.PubMedGoogle Scholar
  5. 5.
    Fujiwara, H., Yassin, W., Murai, T. et al., Neuroimaging studies of social cognition in schizophrenia[J]. Psychiatr. Clin. Neurosci. 69(5):259–267, 2015.CrossRefGoogle Scholar
  6. 6.
    Shah, C., Zhang, W., Xiao, Y. et al., Common pattern of gray-matter abnormalities in drug-naive and medicated first-episode schizophrenia: A multimodal meta-analysis. Psychol. Med. 47(3):401–413, 2016.CrossRefGoogle Scholar
  7. 7.
    Cooper, D., Barker, V., Radua, J. et al., Multimodal voxel-based meta-analysis of structural and functional magnetic resonance imaging studies in those at elevated genetic risk of developing schizophrenia. Psychiatr. Res. 221(1):69–77, 2014.CrossRefGoogle Scholar
  8. 8.
    Regenbogen, C., Kellermann, T., Seubert, J. et al., Neural responses to dynamic multimodal stimuli and pathology-specific impairments of social cognition in schizophrenia and depression. Brit. J. Psychiatr. J. Mental Sci. 206(3):198, 2018.CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media, LLC, part of Springer Nature 2019

Authors and Affiliations

  • Xiaohong Wang
    • 1
  • Na Zhao
    • 1
  • Jingjing Shi
    • 2
  • Yuhua Wu
    • 2
  • Jun Liu
    • 2
  • Qiang Xiao
    • 3
  • Jian Hu
    • 1
    Email author
  1. 1.Department of PsychiatryThe First Affiliated Hospital of Harbin Medical UniversityHarbinChina
  2. 2.The First Specialized Hospital of HarbinHarbinChina
  3. 3.Department of RadiologyThe First Specialized Hospital of HarbinHarbinChina

Personalised recommendations