A Hybrid Multishape Learning Framework for Longitudinal Prediction of Cortical Surfaces and Fiber Tracts Using Neonatal Data

Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9900)


Dramatic changes of the human brain during the first year of postnatal development are poorly understood due to their multifold complexity. In this paper, we present the first attempt to jointly predict, using neonatal data, the dynamic growth pattern of brain cortical surfaces (collection of 3D triangular faces) and fiber tracts (collection of 3D lines). These two entities are modeled jointly as a multishape (a set of interlinked shapes). We propose a hybrid learning-based multishape prediction framework that captures both the diffeomorphic evolution of the cortical surfaces and the non-diffeomorphic growth of fiber tracts. In particular, we learn a set of geometric and dynamic cortical features and fiber connectivity features that characterize the relationships between cortical surfaces and fibers at different timepoints (0, 3, 6, and 9 months of age). Given a new neonatal multishape at 0 month of age, we hierarchically predict, at 3, 6 and 9 months, the postnatal cortical surfaces vertex-by-vertex along with fibers connected to adjacent faces to these vertices. This is achieved using a new fiber-to-face metric that quantifies the similarity between multishapes. For validation, we propose several evaluation metrics to thoroughly assess the performance of our framework. The results confirm that our framework yields good prediction accuracy of complex neonatal multishape development within a few seconds.


Ground Truth Cortical Surface Fiber Tract Posterior Cingulate Cortex Connectivity Feature 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. 1.
    Li, G., Liu, T., Ni, D., Lin, W., Gilmore, J., Shen, D.: Spatiotemporal patterns of cortical fiber density in developing infants, and their relationship with cortical thickness. Hum. Brain Mapp. 36, 5183–5195 (2015)CrossRefGoogle Scholar
  2. 2.
    Durrleman, S., Prastawa, M., Charon, N., Korenberg, J., Joshi, S., Gerig, G., Trouvé, A.: Morphometry of anatomical shape complexes with dense deformations and sparse parameters. NeuroImage 101, 35–49 (2014)CrossRefGoogle Scholar
  3. 3.
    Gori, P., Colliot, O., Worbe, Y., Marrakchi-Kacem, L., Lecomte, S., Poupon, C., Hartmann, A., Ayache, N., Durrleman, S.: Bayesian atlas estimation for the variability analysis of shape complexes. Med. Image Comput. Comput. Assist. Interv. 16, 267–274 (2013)Google Scholar
  4. 4.
    Gori, P., Colliot, O., Marrakchi-Kacem, L., Worbe, Y., Routier, A., Poupon, C., Hartmann, A., Ayache, N., Durrleman, S.: Joint morphometry of fiber tracts and gray matter structures using double diffeomorphisms. Inf. Process. Med. Imaging 24, 275–287 (2015)Google Scholar
  5. 5.
    Rekik, I., Li, G., Lin, W., Shen, D.: Predicting infant cortical surface development using a 4D varifold-based learning framework and local topography-based shape morphing. Med. Image Anal. 28, 1–12 (2015)CrossRefGoogle Scholar
  6. 6.
    Rekik, I., Li, G., Lin, W., Shen, D.: Multidirectional and topography-based dynamic-scale varifold representations with application to matching developing cortical surfaces. NeuroImage 135, 152–162 (2016)CrossRefGoogle Scholar
  7. 7.
    Stieltjes, B., Kaufmann, W., Zijl, P.V., Fredericksen, K., Pearlson, G., Solaiyappan, M., Mori, S.: Diffusion tensor imaging and axonal tracking in the human brainstem. NeuroImage 14, 723–735 (2001)CrossRefGoogle Scholar

Copyright information

© Springer International Publishing AG 2016

Authors and Affiliations

  1. 1.Department of Radiology and BRICUniversity of North Carolina at Chapel HillChapel HillUSA

Personalised recommendations