On the Adaptability of Unsupervised CNN-Based Deformable Image Registration to Unseen Image Domains

  • Enzo FerranteEmail author
  • Ozan Oktay
  • Ben Glocker
  • Diego H. Milone
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11046)


Deformable image registration is a fundamental problem in medical image analysis. During the last years, several methods based on deep convolutional neural networks (CNN) proved to be highly accurate to perform this task. These models achieved state-of-the-art accuracy while drastically reducing the required computational time, but mainly focusing on images of specific organs and modalities. To date, no work has reported on how these models adapt across different domains. In this work, we ask the question: can we use CNN-based registration models to spatially align images coming from a domain different than the one/s used at training time? We explore the adaptability of CNN-based image registration to different organs/modalities. We employ a fully convolutional architecture trained following an unsupervised approach. We consider a simple transfer learning strategy to study the generalisation of such model to unseen target domains, and devise a one-shot learning scheme taking advantage of the unsupervised nature of the proposed method. Evaluation on two publicly available datasets of X-Ray lung images and cardiac cine magnetic resonance sequences is provided. Our experiments suggest that models learned in different domains can be transferred at the expense of a decrease in performance, and that one-shot learning in the context of unsupervised CNN-based registration is a valid alternative to achieve consistent registration performance when only a pair of images from the target domain is available.



EF is beneficiary of an AXA Research Grant. We thank NVIDIA Corporation for the donation of the Titan X GPU used for this project.


  1. 1.
    Balakrishnan, G., et al.: An unsupervised learning model for deformable medical image registration. Accepted at CVPR 2018 (2018)Google Scholar
  2. 2.
    Ganin, Y., Lempitsky, V.: Unsupervised domain adaptation by backpropagation. ICML (2015)Google Scholar
  3. 3.
    Guerrero, R., et al.: White matter hyperintensity and stroke lesion segmentation and differentiation using cnns. NeuroImage: Clin. 17, 918–934 (2018)Google Scholar
  4. 4.
    Jaderberg, M., et al.: Spatial transformer networks. In: NIPS, pp. 2017–2025 (2015)Google Scholar
  5. 5.
    Kawaguchi, T., Harada, Y., Nagata, R., Miyake, H.: Image registration methods for contralateral subtraction of chest radiographs. In: IEE BMEI (2010)Google Scholar
  6. 6.
    Klein, S., Staring, M., Murphy, K., Viergever, M.A., Pluim, J.P.: Elastix: a toolbox for intensity-based medical image registration. IEEE TMI 29(1), 196–205 (2010)Google Scholar
  7. 7.
    Li, H., Fan, Y.: Non-rigid image registration using self-supervised fully convolutional networks without training data. Accepted at ISBI 2018 (2018)Google Scholar
  8. 8.
    Paragios, N.: (hyper)-graphical models in biomedical image analysis. Med. Image Anal. 33, 102–106 (2016)CrossRefGoogle Scholar
  9. 9.
    Phatak, N.S.: Strain measurement in the left ventricle during systole with deformable image registration. Med. Image Anal. 13(2), 354–361 (2009)CrossRefGoogle Scholar
  10. 10.
    Radau, P., Lu, Y., Connelly, K., Paul, G., et al.: Evaluation framework for algorithms segmenting short axis cardiac MRI. MIDAS J. 49 (2009)Google Scholar
  11. 11.
    Ronneberger, O., Fischer, P., Brox, T.: U-net: convolutional networks for biomedical image segmentation. In: MICCAI, pp. 234–241. Springer, Cham (2015)Google Scholar
  12. 12.
    Salakhutdinov, R., Tenenbaum, J., Torralba, A.: One-shot learning with a hierarchical nonparametric Bayesian model. In: ICML Workshop Proceedings (2012)Google Scholar
  13. 13.
    Shiraishi, J.: Development of a digital image database for chest radiographs with and without a lung nodule: receiver operating characteristic analysis of radiologists’ detection of pulmonary nodules. Am. J. Roentgenol. 174(1), 71–74 (2000)CrossRefGoogle Scholar
  14. 14.
    Sokooti, Hessam, de Vos, Bob, Berendsen, Floris, Lelieveldt, Boudewijn P.F., Išgum, Ivana, Staring, Marius: Nonrigid Image Registration Using Multi-scale 3D Convolutional Neural Networks. In: Descoteaux, Maxime, Maier-Hein, Lena, Franz, Alfred, Jannin, Pierre, Collins, D.Louis, Duchesne, Simon (eds.) MICCAI 2017. LNCS, vol. 10433, pp. 232–239. Springer, Cham (2017). Scholar
  15. 15.
    Thirion, J.P.: Image matching as a diffusion process: an analogy with Maxwell’s demons. Med. Image Anal. 2(3), 243–260 (1998)CrossRefGoogle Scholar
  16. 16.
    de Vos, Bob D., Berendsen, Floris F., Viergever, Max A., Staring, Marius, Išgum, Ivana: End-to-End Unsupervised Deformable Image Registration with a Convolutional Neural Network. In: Cardoso, M.Jorge, Arbel, Tal, Carneiro, Gustavo, Syeda-Mahmood, Tanveer, Tavares, João Manuel R.S., Moradi, Mehdi, Bradley, Andrew, Greenspan, Hayit, Papa, João Paulo, Madabhushi, Anant, Nascimento, Jacinto C., Cardoso, Jaime S., Belagiannis, Vasileios, Lu, Zhi (eds.) DLMIA/ML-CDS -2017. LNCS, vol. 10553, pp. 204–212. Springer, Cham (2017). Scholar

Copyright information

© Springer Nature Switzerland AG 2018

Authors and Affiliations

  • Enzo Ferrante
    • 1
    Email author
  • Ozan Oktay
    • 2
  • Ben Glocker
    • 2
  • Diego H. Milone
    • 1
  1. 1.Research Institute for Signals, Systems and Computational Intelligence, Sinc(i), FICH-UNL/CONICETSanta FeArgentina
  2. 2.Biomedical Image Analysis GroupImperial College LondonLondonUK

Personalised recommendations