Graph-Based Deep Learning for Prediction of Longitudinal Infant Diffusion MRI Data

  • Jaeil Kim
  • Yoonmi Hong
  • Geng Chen
  • Weili Lin
  • Pew-Thian Yap
  • Dinggang ShenEmail author
Conference paper
Part of the Mathematics and Visualization book series (MATHVISUAL)


Diffusion MRI affords great value for studying brain development, owing to its capability in assessing brain microstructure in association with myelination. With longitudinally acquired pediatric diffusion MRI data, one can chart the temporal evolution of microstructure and white matter connectivity. However, due to subject dropouts and unsuccessful scans, longitudinal datasets are often incomplete. In this work, we introduce a graph-based deep learning approach to predict diffusion MRI data. The relationships between sampling points in spatial domain (x-space) and diffusion wave-vector domain (q-space) are harnessed jointly (x-q space) in the form of a graph. We then implement a residual learning architecture with graph convolution filtering to learn longitudinal changes of diffusion MRI data along time. We evaluate the effectiveness of the spatial and angular components in data prediction. We also investigate the longitudinal trajectories in terms of diffusion scalars computed based on the predicted datasets.


Brain development Longitudinal prediction Diffusion MRI Graph representation Graph convolution Residual graph neural network 



This work was supported in part by NIH grants (NS093842, EB022880, EB006733, EB009634, AG041721, MH100217, and AA012388), an NSFC grant (11671022, China), and Institute for Information & communications Technology Promotion (IITP) grant (MSIT, 2018-2-00861, Intelligent SW Technology Development for Medical Data Analysis, South Korea).


  1. 1.
    Qiu, A., Mori, S., Miller, M.I.: Diffusion tensor imaging for understanding brain development in early life. Ann. Rev. Psychol. 66(1), 853–876 (2015)CrossRefGoogle Scholar
  2. 2.
    Niethammer, M., Huang, Y., Vialard, F.X.: Geodesic regression for image time-series. In: Medical Image Computing and Computer-Assisted Intervention–MICCAI 2011, pp. 655–662 (2011)Google Scholar
  3. 3.
    Rekik, I., Li, G., Wu, G., Lin, W., Shen, D.: Prediction of infant MRI appearance and anatomical structure evolution using sparse patch-based metamorphosis learning framework. In: Patch-Based Techniques in Medical Imaging, pp. 197–204, October 2015CrossRefGoogle Scholar
  4. 4.
    Isola, P., Zhu, J.Y., Zhou, T., Efros, A.A.: Image-to-image translation with conditional adversarial networks (2016)Google Scholar
  5. 5.
    Chen, G., Dong, B., Zhang, Y., Shen, D., Yap, P.T.: Neighborhood matching for curved domains with application to denoising in diffusion MRI. In: Medical Image Computing and Computer Assisted Intervention – MIC-CAI, pp. 629–637. Springer, Cham (2017)CrossRefGoogle Scholar
  6. 6.
    Defferrard, M., Bresson, X., Vandergheynst, P.: Convolutional neural networks on graphs with fast localized spectral filtering, pp. 3844–3852 (2016)Google Scholar
  7. 7.
    Bronstein, M.M., Bruna, J., LeCun, Y., Szlam, A., Vandergheynst, P.: Geometric deep learning: going beyond euclidean data. IEEE Signal Process. Mag. 34(4), 18–42 (2017)CrossRefGoogle Scholar
  8. 8.
    Cao, J., Pang, Y., Li, X., Liang, J.: Randomly translational activation inspired by the input distributions of ReLU. Neurocomputing 275, 859–868 (2018)CrossRefGoogle Scholar
  9. 9.
    Wu, Y., He, K.: Group Normalization (2018)CrossRefGoogle Scholar
  10. 10.
    Huber, P.J.: Robust estimation of a location parameter. Ann. Math. Stat. 35(1), 73–101 (1964)MathSciNetCrossRefGoogle Scholar
  11. 11.
    Jenkinson, M., Beckmann, C.F., Behrens, T.E.J., Woolrich, M.W., Smith, S.M.: FSL. NeuroImage 62(2), 782–790 (2012)CrossRefGoogle Scholar
  12. 12.
    Kim, J., Chen, G., Lin, W., Yap, P.T., Shen, D.: Graph-constrained sparse construction of longitudinal diffusion-weighted infant atlases. Medical Image Computing and Computer-Assisted Intervention, pp. 49–56. Springer, Cham (2017)Google Scholar
  13. 13.
    Chen, G., Zhang, P., Li, K., Wee, C.Y., Wu, Y., Shen, D., Yap, P.T.: Improving estimation of fiber orientations in diffusion MRI using inter-subject information sharing. Sci. Rep. 6, 37847 (2016)CrossRefGoogle Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  • Jaeil Kim
    • 1
    • 2
  • Yoonmi Hong
    • 2
  • Geng Chen
    • 2
  • Weili Lin
    • 2
  • Pew-Thian Yap
    • 2
  • Dinggang Shen
    • 2
    Email author
  1. 1.School of Computer Science and Engineering, Kyungpook National UniversityDaeguSouth Korea
  2. 2.Department of Radiology and BRIC, University of North Carolina at Chapel HillChapel HillUSA

Personalised recommendations