Skip to main content

mlVIRNET: Multilevel Variational Image Registration Network

Part of the Lecture Notes in Computer Science book series (LNIP,volume 11769)

Abstract

We present a novel multilevel approach for deep learning based image registration. Recently published deep learning based registration methods have shown promising results for a wide range of tasks. However, these algorithms are still limited to relatively small deformations. Our method addresses this shortcoming by introducing a multilevel framework, which computes deformation fields on different scales, similar to conventional methods. Thereby, a coarse-level alignment is obtained first, which is subsequently improved on finer levels. We demonstrate our method on the complex task of inhale-to-exhale lung registration. We show that the use of a deep learning multilevel approach leads to significantly better registration results.

Keywords

  • Image registration
  • Multilevel
  • Deep learning
  • Thoracic CT

This is a preview of subscription content, access via your institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • DOI: 10.1007/978-3-030-32226-7_29
  • Chapter length: 9 pages
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
eBook
USD   99.00
Price excludes VAT (USA)
  • ISBN: 978-3-030-32226-7
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
Softcover Book
USD   129.99
Price excludes VAT (USA)
Fig. 1.
Fig. 2.

References

  1. Bajcsy, R., Kovačič, S.: Multiresolution elastic matching. Comput. Vis. Graph. Image Process. 46(1), 1–21 (1989)

    CrossRef  Google Scholar 

  2. Balakrishnan, G., Zhao, A., Sabuncu, M.R., Guttag, J., Dalca, A.V.: VoxelMorph: a learning framework for deformable medical image registration. IEEE TMI (2019)

    Google Scholar 

  3. Castillo, R., et al.: A reference dataset for deformable image registration spatial accuracy evaluation using the copdgene study archive. Phys. Med. Biol. 58(9), 2861 (2013)

    CrossRef  Google Scholar 

  4. Eppenhof, K.A., Lafarge, M.W., Pluim, J.P.: Progressively growing convolutional networks for end-to-end deformable image registration. In: Medical Imaging 2019: Image Processing, vol. 10949, p. 109491C. International Society for Optics and Photonics (2019)

    Google Scholar 

  5. Glorot, X., Bengio, Y.: Understanding the difficulty of training deep feedforward neural networks. In: Proceedings of the Thirteenth International Conference on Artificial Intelligence and Statistics, pp. 249–256 (2010)

    Google Scholar 

  6. Hering, A., Heldmann, S.: Unsupervised learning for large motion thoracic CT follow-up registration. In: SPIE Medical Imaging: Image Processing, vol. 10949, p. 109491B (2019)

    Google Scholar 

  7. Hering, A., Kuckertz, S., Heldmann, S., Heinrich, M.P.: Enhancing label-driven deep deformable image registration with local distance metrics for state-of-the-art cardiac motion tracking. In: Handels, H., Deserno, T., Maier, A., Maier-Hein, K., Palm, C., Tolxdorff, T. (eds.) Bildverarbeitung für die Medizin 2019. I, pp. 309–314. Springer, Wiesbaden (2019). https://doi.org/10.1007/978-3-658-25326-4_69

    CrossRef  Google Scholar 

  8. Hu, Y., et al.: Label-driven weakly-supervised learning for multimodal deformable image registration. In: Proceedings of ISBI 2018, pp. 1070–1074. IEEE (2018)

    Google Scholar 

  9. Kabus, S., Lorenz, C.: Fast elastic image registration. Med. Image Anal. Clinic: A Grand Challenge, 81–89 (2010)

    Google Scholar 

  10. Modersitzki, J.: FAIR: Flexible Algorithms for Image Registration. SIAM (2009)

    Google Scholar 

  11. Modersitzki, J., Haber, E.: COFIR: coarse and fine image registration, chap. 14. In: Computational Science & Engineering: Real-Time PDE-Constrained Optimization, pp. 277–288. SIAM (2007)

    Google Scholar 

  12. Regan, E.A., et al.: Genetic epidemiology of COPD (COPDGene) study design. COPD: J. Chronic Obstructive Pulm. Dis. 7(1), 32–43 (2011)

    CrossRef  Google Scholar 

  13. Rohé, M.-M., Datar, M., Heimann, T., Sermesant, M., Pennec, X.: SVF-Net: learning deformable image registration using shape matching. In: Descoteaux, M., Maier-Hein, L., Franz, A., Jannin, P., Collins, D.L., Duchesne, S. (eds.) MICCAI 2017. LNCS, vol. 10433, pp. 266–274. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-66182-7_31

    CrossRef  Google Scholar 

  14. Rühaak, J., et al.: Estimation of large motion in lung CT by integrating regularized keypoint correspondences into dense deformable registration. IEEE TMI 36(8), 1746–1757 (2017)

    Google Scholar 

  15. Schnabel, J.A., et al.: A generic framework for non-rigid registration based on non-uniform multi-level free-form deformations. In: Niessen, W.J., Viergever, M.A. (eds.) MICCAI 2001. LNCS, vol. 2208, pp. 573–581. Springer, Heidelberg (2001). https://doi.org/10.1007/3-540-45468-3_69

    CrossRef  Google Scholar 

  16. de Vos, B.D., Berendsen, F.F., Viergever, M.A., Sokooti, H., Staring, M., Išgum, I.: A deep learning framework for unsupervised affine and deformable image registration. Med. Image Anal. 52, 128–143 (2019)

    CrossRef  Google Scholar 

Download references

Acknowledgements

We gratefully acknowledge the COPDGene Study for providing the data used. COPDGene is funded by Award Number U01 HL089897 and Award Number U01 HL089856 from the National Heart, Lung, and Blood Institute. The COPDGene project is also supported by the COPD Foundation through contributions made to an Industry Advisory Board comprised of AstraZeneca, Boehringer Ingelheim, GlaxoSmithKline, Novartis, Pfizer, Siemens and Sunovion.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Alessa Hering .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and Permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this paper

Verify currency and authenticity via CrossMark

Cite this paper

Hering, A., van Ginneken, B., Heldmann, S. (2019). mlVIRNET: Multilevel Variational Image Registration Network. In: , et al. Medical Image Computing and Computer Assisted Intervention – MICCAI 2019. MICCAI 2019. Lecture Notes in Computer Science(), vol 11769. Springer, Cham. https://doi.org/10.1007/978-3-030-32226-7_29

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-32226-7_29

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-32225-0

  • Online ISBN: 978-3-030-32226-7

  • eBook Packages: Computer ScienceComputer Science (R0)