Linear and Deformable Image Registration with 3D Convolutional Neural Networks

  • Christodoulidis StergiosEmail author
  • Sahasrabudhe Mihir
  • Vakalopoulou Maria
  • Chassagnon Guillaume
  • Revel Marie-Pierre
  • Mougiakakou Stavroula
  • Paragios Nikos
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11040)


Image registration and in particular deformable registration methods are pillars of medical imaging. Inspired by the recent advances in deep learning, we propose in this paper, a novel convolutional neural network architecture that couples linear and deformable registration within a unified architecture endowed with near real-time performance. Our framework is modular with respect to the global transformation component, as well as with respect to the similarity function while it guarantees smooth displacement fields. We evaluate the performance of our network on the challenging problem of MRI lung registration, and demonstrate superior performance with respect to state of the art elastic registration methods. The proposed deformation (between inspiration & expiration) was considered within a clinically relevant task of interstitial lung disease (ILD) classification and showed promising results.


Convolutional neural networks Deformable registration Unsupervised learning Lungs Breathing MRI Interstitial lung disease 


  1. 1.
    Anthimopoulos, M., Christodoulidis, S., Ebner, L., Geiser, T., Christe, A., Mougiakakou, S.: Semantic segmentation of pathological lung tissue with dilated fully convolutional networks. arXiv preprint arXiv:1803.06167 (2018)
  2. 2.
    Avants, B., Epstein, C., Grossman, M., Gee, J.: Symmetric diffeomorphic image registration with cross-correlation: evaluating automated labeling of elderly and neurodegenerative brain. Med. Image Anal. 12, 26–41 (2008)CrossRefGoogle Scholar
  3. 3.
    Avants, B.B., Tustison, N.J., Song, G., Cook, P.A., Klein, A., Gee, J.C.: A reproducible evaluation of ants similarity metric performance in brain image registration. NeuroImage 54, 2033–2044 (2011)CrossRefGoogle Scholar
  4. 4.
    Chandra, S., Usunier, N., Kokkinos, I.: Dense and low-rank Gaussian CRFs using deep embeddings. In: 2017 IEEE International Conference on Computer Vision (ICCV) (2017)Google Scholar
  5. 5.
    Cheng, X., Zhang, L., Zheng, Y.: Deep similarity learning for multimodal medical images (2016)Google Scholar
  6. 6.
    Ferrante, E., Dokania, P.K., Marini, R., Paragios, N.: Deformable registration through learning of context-specific metric aggregation. In: Wang, Q., Shi, Y., Suk, H.-I., Suzuki, K. (eds.) MLMI 2017. LNCS, vol. 10541, pp. 256–265. Springer, Cham (2017). Scholar
  7. 7.
    Glocker, B., Sotiras, A., Komodakis, N., Paragios, N.: Deformable medical image registration: setting the state of the art with discrete methods. Ann. Rev. Biomed. Eng. 13, 219–244 (2011)CrossRefGoogle Scholar
  8. 8.
    Hu, J., Shen, L., Sun, G.: Squeeze-and-excitation networks. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2018)Google Scholar
  9. 9.
    Hui, T.W., Tang, X., Loy, C.C.: Liteflownet: A lightweight convolutional neural network for optical flow estimation. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2018)Google Scholar
  10. 10.
    Jaderberg, M., Simonyan, K., Zisserman, A., et al.: Spatial transformer networks. In: Advances in Neural Information Processing Systems, pp. 2017–2025 (2015)Google Scholar
  11. 11.
    Kingma, D.P., Ba, J.: Adam: a method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014)
  12. 12.
    Riza, A., Neverova, N., Kokkinos, I.: DensePose: dense human pose estimation in the wild. arXiv (2018)Google Scholar
  13. 13.
    Shu, Z., Sahasrabudhe, M., Güler, R.A., Samaras, D., Paragios, N., Kokkinos, I.: Deforming autoencoders: unsupervised disentangling of shape and appearance. In: 2018 IEEE European Conference on Computer Vision (ECCV) (2018)Google Scholar
  14. 14.
    Simonovsky, M., Gutiérrez-Becker, B., Mateus, D., Navab, N., Komodakis, N.: A deep metric for multimodal registration. In: Ourselin, S., Joskowicz, L., Sabuncu, M.R., Unal, G., Wells, W. (eds.) MICCAI 2016. LNCS, vol. 9902, pp. 10–18. Springer, Cham (2016). Scholar
  15. 15.
    Sotiras, A., Davatzikos, C., Paragios, N.: Deformable medical image registration: a survey. IEEE Trans. Med. Imaging 32, 1153–1190 (2013)CrossRefGoogle Scholar
  16. 16.
    Yan, P., Xu, S., Rastinehad, A.R., Wood, B.J.: Adversarial image registration with application for MR and TRUS image fusion (2018).

Copyright information

© Springer Nature Switzerland AG 2018

Authors and Affiliations

  • Christodoulidis Stergios
    • 1
    Email author
  • Sahasrabudhe Mihir
    • 2
  • Vakalopoulou Maria
    • 2
  • Chassagnon Guillaume
    • 2
    • 3
  • Revel Marie-Pierre
    • 3
  • Mougiakakou Stavroula
    • 1
  • Paragios Nikos
    • 4
  1. 1.ARTORG CenterUniversity of BernBernSwitzerland
  2. 2.CVN, CentraleSupélec, Université Paris-SaclayGif-sur-YvetteFrance
  3. 3.Groupe Hospitalier Cochin-Hôtel Dieu, Université Paris DescartesParisFrance
  4. 4.TheraPanaceaParisFrance

Personalised recommendations