Advertisement

Symmetric Dual Adversarial Connectomic Domain Alignment for Predicting Isomorphic Brain Graph from a Baseline Graph

Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11767)

Abstract

Medical image synthesis techniques can circumvent the need for costly clinical scan acquisitions using different modalities such as functional Magnetic Resonance Imaging (MRI). Recently, deep learning frameworks were designed to predict a target medical modality from a source one (e.g., MRI from Computed Tomography (CT)). However, such methods which work well on images might fail when handling geometric brain data such as graphs (or connectomes). To the best of our knowledge, learning how to predict brain graph from a source graph based on geometric deep learning remains unexplored [1]. Given a set of isomorphic source and target brain graph (i.e., derived from the same parcellation brain template so their topology is similar), learning how to predict target brain graph from a source graph has two major challenges. The first one is that the source and target domains might have different distributions, which causes a domain fracture. The second challenge can be viewed as a limitation of existing image synthesis methods which address the domain fracture and multimodal data prediction independently. To address both limitations, we unprecedentedly propose a Symmetric Dual Adversarial Domain Alignment (SymDADA) framework for predicting target brain graph from a source graph. SymDADA aligns source and target domains by learning their shared embedding while alternating two regularization constraints: (i) adversarial regularization matching the distribution of the learned shared embedding with that of the source graphs using training and testing data, and (ii) adversarial regularization enforcing the embedded source distribution to match the distribution of the predicted target graphs using only the training samples. In this way, we are optimally adapting the source to the target space as we are jointly predicting the target graph when learning the graph embedding. Our proposed SymDADA framework outperformed its variants for predicting a target brain graph from a source graph in healthy and autistic subjects.

References

  1. 1.
    Soussia, M., Rekik, I.: A review on image-and network-based brain data analysis techniques for Alzheimer’s Disease diagnosis reveals a gap in developing predictive methods for prognosis. arXiv preprint arXiv:1808.01951 (2018)
  2. 2.
    Olut, S., Sahin, Y.H., Demir, U., Unal, G.: Generative adversarial training for MRA image synthesis using multi-contrast MRI. arXiv preprint arXiv:1804.04366 (2018)
  3. 3.
    Goodfellow, I., Pouget-Abadie, J., et al.: Generative adversarial nets. In: Advances in Neural Information Processing Systems, pp. 2672–2680 (2014)Google Scholar
  4. 4.
    Ben-Cohen, A., et al.: Cross-modality synthesis from CT to PET using FCN and GAN networks for improved automated lesion detection. Eng. Appl. Artif. Intell. 78, 186–194 (2019)CrossRefGoogle Scholar
  5. 5.
    Ktena, S.I., et al.: Distance metric learning using graph convolutional networks: application to functional brain networks. In: Descoteaux, M., Maier-Hein, L., Franz, A., Jannin, P., Collins, D.L., Duchesne, S. (eds.) MICCAI 2017. LNCS, vol. 10433, pp. 469–477. Springer, Cham (2017).  https://doi.org/10.1007/978-3-319-66182-7_54CrossRefGoogle Scholar
  6. 6.
    Parisot, S., et al.: Spectral graph convolutions for population-based disease prediction. In: Descoteaux, M., Maier-Hein, L., Franz, A., Jannin, P., Collins, D.L., Duchesne, S. (eds.) MICCAI 2017. LNCS, vol. 10435, pp. 177–185. Springer, Cham (2017).  https://doi.org/10.1007/978-3-319-66179-7_21CrossRefGoogle Scholar
  7. 7.
    Moreno-Torres, J.G., Raeder, T., Alaiz-RodríGuez, R., Chawla, N.V., Herrera, F.: A unifying view on dataset shift in classification. Pattern Recogn. 45, 521–530 (2012)CrossRefGoogle Scholar
  8. 8.
    Pan, Y., Liu, M., Lian, C., Zhou, T., Xia, Y., Shen, D.: Synthesizing missing PET from MRI with cycle-consistent generative adversarial networks for Alzheimer’s disease diagnosis. In: Frangi, A.F., Schnabel, J.A., Davatzikos, C., Alberola-López, C., Fichtinger, G. (eds.) MICCAI 2018. LNCS, vol. 11072, pp. 455–463. Springer, Cham (2018).  https://doi.org/10.1007/978-3-030-00931-1_52CrossRefGoogle Scholar
  9. 9.
    Yi, X., Walia, E., Babyn, P.: Generative adversarial network in medical imaging: a review. arXiv preprint arXiv:1809.07294 (2018)
  10. 10.
    Pan, S., Hu, R., Long, G., Jiang, J., Yao, L., Zhang, C.: Adversarially regularized graph autoencoder. arXiv preprint arXiv:1802.04407 (2018)
  11. 11.
    Kipf, T.N., Welling, M.: Semi-supervised classification with graph convolutional networks. arXiv preprint arXiv:1609.02907 (2016)
  12. 12.
    Wang, B., Ramazzotti, D., De Sano, L., Zhu, J., Pierson, E., Batzoglou, S.: SIMLR: a tool for large-scale single-cell analysis by multi-kernel learning. bioRxiv (2017) 118901Google Scholar
  13. 13.
    Mahjoub, I., Mahjoub, M.A., Rekik, I.: Brain multiplexes reveal morphological connectional biomarkers fingerprinting late brain dementia states. Sci. Rep. 8, 4103 (2018)CrossRefGoogle Scholar
  14. 14.
    Soussia, M., Rekik, I.: Unsupervised manifold learning using high-order morphological brain networks derived from T1-w MRI for autism diagnosis. Front. Neuroinform. 12 (2018) Google Scholar
  15. 15.
    Dhifallah, S., Rekik, I., Initiative, A.D.N., et al.: Clustering-based multi-view network fusion for estimating brain network atlases of healthy and disordered populations. J. Neurosci. Methods 311, 426–435 (2019)CrossRefGoogle Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  1. 1.LATIS Lab, ISITCOMUniversity of SousseSousseTunisia
  2. 2.BASIRA Lab, Faculty of Computer and InformaticsIstanbul Technical UniversityIstanbulTurkey

Personalised recommendations