Journal of Mathematical Imaging and Vision

, Volume 55, Issue 2, pp 179–198 | Cite as

A Unified Variational Volume Registration Method Based on Automatically Learned Brain Structures

  • Carl LedermanEmail author
  • Anand Joshi
  • Ivo Dinov
  • John Darrell Van Horn
  • Luminita Vese
  • Arthur Toga


We introduce a new volumetric registration technique that effectively combines active surfaces with the finite element method. The method simultaneously aligns multi-label automatic structural segmentation results, which can be obtained by the application of existing segmentation software, to produce an anatomically accurate 3D registration. This registration is obtained by the minimization of a single energy functional. Just like registering raw images, obtaining a 3D registration this way still requires solving a fundamentally ill-posed problem. We explain through academic examples as well as an MRI dataset with manual anatomical labels, which are hidden from the registration method, how the quality of a registration method can be measured and the advantages our approach offers.


Image registration Active surfaces Finite elements 


  1. 1.
    Pohl, P., Van Genderen, J.L.: Review article multisensor image fusion in remote sensing: concepts, methods and applications. Int. J. Remote Sens. 19(5), 823–854 (1998)CrossRefGoogle Scholar
  2. 2.
    Dhond, U.R., Aggarwal, J.K.: Structure from stereo–a review. IEEE Trans. Syst. Man Cybern. 19(6), 1489–1510 (1989)MathSciNetCrossRefGoogle Scholar
  3. 3.
    Christensen, G.E., Rabbitt, R.D., Miller, M.I.: Deformable templates using large deformation kinematics. IEEE Trans. Image Process. 5, 1435–1447 (1996)CrossRefGoogle Scholar
  4. 4.
    Thompson, P.M., Giedd, J.N., Woods, R.P., et al.: Growth patterns in the developing brain detected by using continuum mechanical tensor maps. Nature 404, 190–193 (2000)CrossRefGoogle Scholar
  5. 5.
    Yanovsky, I., Osher, S., Thompson, P., et al.: Log-unbiased large deformation image registration. In: VISAPP, pp. 272–279 (2007)Google Scholar
  6. 6.
    Klein, A., Andersson, J., Ardekani, B.A., et al.: Evaluation of 14 nonlinear deformation algorithms applied to human brain MRI registration. Neuroimage 46, 786–802 (2009)CrossRefGoogle Scholar
  7. 7.
    Modersitzki, J.: Numerical Methods for Image Registration. Oxford University Press, Oxford (2004)zbMATHGoogle Scholar
  8. 8.
    Le Guyader, C., Vese, L.: A Combined Segmentation and Registration Framework with a Nonlinear Elasticity Smoother. UCLA CAM Report pp. 08–16 (2008)Google Scholar
  9. 9.
    Unal, G., Slabaugh, G.: Coupled PDEs for non-rigid registration and segmentation. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition (2005)Google Scholar
  10. 10.
    Yezzi, A.: A variational framework for integrating segmentation and registration through active contours. Med. Image Anal. 7, 171–185 (2003)CrossRefGoogle Scholar
  11. 11.
    Chan, T., Vese, L.: Active contours without edges. IEEE Trans. Image Process. 10(2), 266–277 (2001)CrossRefzbMATHGoogle Scholar
  12. 12.
    Lie, J., Lysaker, M., Tai, X.: A piecewise constant level set framework. Int. J. Numer. Anal. Model. 2, 422–438 (2005)MathSciNetzbMATHGoogle Scholar
  13. 13.
    Tu, Z., Narr, K.L., Dollar, P., et al.: Brain anatomical structure segmentation by hybrid discriminative/generative models. IEEE Trans. Med. Imaging 27(4), 495–508 (2008)CrossRefGoogle Scholar
  14. 14.
    Joshi, A.A., Shattuck, D.W., Thompson, P.M., et al.: Surface-constrained volumetric brain registration using harmonic mappings. IEEE Trans. Med. Imaging 26(12), 1657–1669 (2007)CrossRefGoogle Scholar
  15. 15.
    Postelnicu, G., Zöllei, L., Fischl, B.: Combined volumetric and surface registration. In: IEEE Transactions on Medical Imaging, pp. 508–522 (2009)Google Scholar
  16. 16.
    Hughes, T.J.R.: The Finite Element Method: Linear Static and Dynamic Finite Element Analysis. Dover Publications, New York (2000)zbMATHGoogle Scholar
  17. 17.
    Gosz, M.: The Finite Element Method: Applications in Solids, Structures, and Heat Transfer. Taylor & Francis, London (2006)zbMATHGoogle Scholar
  18. 18.
    Teran, J., Sifakis, E., Irving, G.: Robust quasistatic finite elements and flesh simulation. In: Symposium on Computer Animation, pp. 181–190 (2005)Google Scholar
  19. 19.
    Ferrant, M., Warfield, S., Guttmann, C., et al.: 3D Image matching using a finite element based elastic deformation model. In: Lecture Notes in Computer Science, pp. 202–209 (1999)Google Scholar
  20. 20.
    Ferrant, M., Warfield, S., Nabavi, A., et al.: Registration of 3D intraoperative MR images of the brain using a finite element biomechanical model. In: MICCAI 2000, pp. 10 (2000)Google Scholar
  21. 21.
    Schnabel, J.: Validation of nonrigid image registration using finite-element methods: application to breast MR. IEEE Trans. Med. Imaging 22, 238 (2003)CrossRefGoogle Scholar
  22. 22.
    Brock, K.K., Sharpe, M.B., Dawson, L.A., et al.: Accuracy of finite element model-based multi-organ deformable image registration. Med. Phys. 32, 1647 (2005)CrossRefGoogle Scholar
  23. 23.
    Jung, M., Chung, G., Sundaramoorthi, G., et al.: Sobolev gradients and joint variational image segmentation, denoising and deblurring. In: SPIE Electronic Imaging Conference Proceedings, vol. 7246 (2009)Google Scholar
  24. 24.
    Renka, R.: Constructing fair curves and surfaces with a Sobolev gradient method. Comput. Aided Geom. Des. 21, 137–149 (2004)MathSciNetCrossRefzbMATHGoogle Scholar
  25. 25.
    Dale, A.M., Fischl, B., Sereno, M.I.: Cortical surface-based analysis. I. Segmentation and surface reconstruction. Neuroimage 9(2), 179–194 (1999)CrossRefGoogle Scholar
  26. 26.
    Lederman, C., Joshi, A., Dinov, I., et al.: The generation of tetrahedral mesh models for neuroanatomical MRI. NeuroImage 55, 153–164 (2011)CrossRefGoogle Scholar
  27. 27.
    Tarantola, A.: Inverse Problem Theory. Society for Industrial and Applied Mathematics (2004)Google Scholar
  28. 28.
    Pedegral, P.: Variational Methods in Nonlinear Elasticity. Society for Industrial Mathematics (SIAM), Philadelphia (2000)Google Scholar
  29. 29.
    Irving, G., Teran, J., Fedkiw, R.: Invertible finite elements for robust simulation of large deformations. In: Proceedings of the 2004 ACM SIGGRAPH/Eurographics symposium on Computer animation, pp. 131–140 (2004)Google Scholar
  30. 30.
    Lin, T., Dinov, I., Toga, A., Vese, L.: Nonlinear elasticity registration and sobolev gradients biomedical image registration. In: Lecture Notes in Computer Science, vol. 6204, pp. 269–280 (2010)Google Scholar
  31. 31.
    Yanovsky, I., Le Guyader, C., Leow, A., et al.: Nonlinear elastic registration with unbiased regularization in three dimensions. In: MICCAI (2008)Google Scholar
  32. 32.
    Dinov, I.D., Van Horn, J.D., Lozev, K.M., et al.: fficient, distributed and interactive neuroimaging data analysis using the LONI pipeline. Front. Neuroinformatics 3, 22 (2009)CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media New York 2015

Authors and Affiliations

  • Carl Lederman
    • 1
    Email author
  • Anand Joshi
    • 2
  • Ivo Dinov
    • 3
    • 4
  • John Darrell Van Horn
    • 2
  • Luminita Vese
    • 1
  • Arthur Toga
    • 2
  1. 1.Department of MathematicsUniversity of California Los AngelesLos AngelesUSA
  2. 2.Institute for Data Science, School of NursingUniversity of MichiganAnn ArborUSA
  3. 3.Statistics Online Computational Resource, Michigan Institute for Data Science, School of NursingUniversity of MichiganAnn ArborUSA
  4. 4.Department of Statistics, Center for Computational BiologyUniversity of California, Los Angeles (UCLA)Los AngelesUSA

Personalised recommendations