mlVIRNET: Multilevel Variational Image Registration Network

  • Alessa HeringEmail author
  • Bram van Ginneken
  • Stefan Heldmann
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11769)


We present a novel multilevel approach for deep learning based image registration. Recently published deep learning based registration methods have shown promising results for a wide range of tasks. However, these algorithms are still limited to relatively small deformations. Our method addresses this shortcoming by introducing a multilevel framework, which computes deformation fields on different scales, similar to conventional methods. Thereby, a coarse-level alignment is obtained first, which is subsequently improved on finer levels. We demonstrate our method on the complex task of inhale-to-exhale lung registration. We show that the use of a deep learning multilevel approach leads to significantly better registration results.


Image registration Multilevel Deep learning Thoracic CT 



We gratefully acknowledge the COPDGene Study for providing the data used. COPDGene is funded by Award Number U01 HL089897 and Award Number U01 HL089856 from the National Heart, Lung, and Blood Institute. The COPDGene project is also supported by the COPD Foundation through contributions made to an Industry Advisory Board comprised of AstraZeneca, Boehringer Ingelheim, GlaxoSmithKline, Novartis, Pfizer, Siemens and Sunovion.


  1. 1.
    Bajcsy, R., Kovačič, S.: Multiresolution elastic matching. Comput. Vis. Graph. Image Process. 46(1), 1–21 (1989)CrossRefGoogle Scholar
  2. 2.
    Balakrishnan, G., Zhao, A., Sabuncu, M.R., Guttag, J., Dalca, A.V.: VoxelMorph: a learning framework for deformable medical image registration. IEEE TMI (2019)Google Scholar
  3. 3.
    Castillo, R., et al.: A reference dataset for deformable image registration spatial accuracy evaluation using the copdgene study archive. Phys. Med. Biol. 58(9), 2861 (2013)CrossRefGoogle Scholar
  4. 4.
    Eppenhof, K.A., Lafarge, M.W., Pluim, J.P.: Progressively growing convolutional networks for end-to-end deformable image registration. In: Medical Imaging 2019: Image Processing, vol. 10949, p. 109491C. International Society for Optics and Photonics (2019)Google Scholar
  5. 5.
    Glorot, X., Bengio, Y.: Understanding the difficulty of training deep feedforward neural networks. In: Proceedings of the Thirteenth International Conference on Artificial Intelligence and Statistics, pp. 249–256 (2010)Google Scholar
  6. 6.
    Hering, A., Heldmann, S.: Unsupervised learning for large motion thoracic CT follow-up registration. In: SPIE Medical Imaging: Image Processing, vol. 10949, p. 109491B (2019)Google Scholar
  7. 7.
    Hering, A., Kuckertz, S., Heldmann, S., Heinrich, M.P.: Enhancing label-driven deep deformable image registration with local distance metrics for state-of-the-art cardiac motion tracking. In: Handels, H., Deserno, T., Maier, A., Maier-Hein, K., Palm, C., Tolxdorff, T. (eds.) Bildverarbeitung für die Medizin 2019. I, pp. 309–314. Springer, Wiesbaden (2019). Scholar
  8. 8.
    Hu, Y., et al.: Label-driven weakly-supervised learning for multimodal deformable image registration. In: Proceedings of ISBI 2018, pp. 1070–1074. IEEE (2018)Google Scholar
  9. 9.
    Kabus, S., Lorenz, C.: Fast elastic image registration. Med. Image Anal. Clinic: A Grand Challenge, 81–89 (2010)Google Scholar
  10. 10.
    Modersitzki, J.: FAIR: Flexible Algorithms for Image Registration. SIAM (2009)Google Scholar
  11. 11.
    Modersitzki, J., Haber, E.: COFIR: coarse and fine image registration, chap. 14. In: Computational Science & Engineering: Real-Time PDE-Constrained Optimization, pp. 277–288. SIAM (2007)Google Scholar
  12. 12.
    Regan, E.A., et al.: Genetic epidemiology of COPD (COPDGene) study design. COPD: J. Chronic Obstructive Pulm. Dis. 7(1), 32–43 (2011)CrossRefGoogle Scholar
  13. 13.
    Rohé, M.-M., Datar, M., Heimann, T., Sermesant, M., Pennec, X.: SVF-Net: learning deformable image registration using shape matching. In: Descoteaux, M., Maier-Hein, L., Franz, A., Jannin, P., Collins, D.L., Duchesne, S. (eds.) MICCAI 2017. LNCS, vol. 10433, pp. 266–274. Springer, Cham (2017). Scholar
  14. 14.
    Rühaak, J., et al.: Estimation of large motion in lung CT by integrating regularized keypoint correspondences into dense deformable registration. IEEE TMI 36(8), 1746–1757 (2017)Google Scholar
  15. 15.
    Schnabel, J.A., et al.: A generic framework for non-rigid registration based on non-uniform multi-level free-form deformations. In: Niessen, W.J., Viergever, M.A. (eds.) MICCAI 2001. LNCS, vol. 2208, pp. 573–581. Springer, Heidelberg (2001). Scholar
  16. 16.
    de Vos, B.D., Berendsen, F.F., Viergever, M.A., Sokooti, H., Staring, M., Išgum, I.: A deep learning framework for unsupervised affine and deformable image registration. Med. Image Anal. 52, 128–143 (2019)CrossRefGoogle Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  • Alessa Hering
    • 1
    • 2
    Email author
  • Bram van Ginneken
    • 2
  • Stefan Heldmann
    • 1
  1. 1.Fraunhofer MEVISLübeckGermany
  2. 2.Diagnostic Image Analyse GroupRadboudumcNijmegenThe Netherlands

Personalised recommendations