Unsupervised Deep Feature Learning for Deformable Registration of MR Brain Images

Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8150)


Establishing accurate anatomical correspondences is critical for medical image registration. Although many hand-engineered features have been proposed for correspondence detection in various registration applications, no features are general enough to work well for all image data. Although many learning-based methods have been developed to help selection of best features for guiding correspondence detection across subjects with large anatomical variations, they are often limited by requiring the known correspondences (often presumably estimated by certain registration methods) as the ground truth for training. To address this limitation, we propose using an unsupervised deep learning approach to directly learn the basis filters that can effectively represent all observed image patches. Then, the coefficients by these learnt basis filters in representing the particular image patch can be regarded as the morphological signature for correspondence detection during image registration. Specifically, a stacked two-layer convolutional network is constructed to seek for the hierarchical representations for each image patch, where the high-level features are inferred from the responses of the low-level network. By replacing the hand-engineered features with our learnt data-adaptive features for image registration, we achieve promising registration results, which demonstrates that a general approach can be built to improve image registration by using data-adaptive features through unsupervised deep learning.


Image Registration Image Patch Gabor Filter Registration Method Deformable Image Registration 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. 1.
    Zitová, B., Flusser, J.: Image registration methods: A survey. Image and Vision Computing 21(11), 977–1000 (2003)CrossRefGoogle Scholar
  2. 2.
    Vercauteren, T., et al.: Diffeomorphic demons: efficient non-parametric image registration. NeuroImage 45(1, suppl. 1), S61–S72 (2009)Google Scholar
  3. 3.
    Liu, J., Vermuri, B.C., Marroquin, J.L.: Local frequency representations for robust multimodal image registration. IEEE Trans. Med. Imaging 21(5), 462–469 (2002)CrossRefGoogle Scholar
  4. 4.
    Ou, Y., et al.: DRAMMS: Deformable registration via attribute matching and mutual-saliency weighting. Med. Image Anal. 15(4), 622–639 (2011)CrossRefGoogle Scholar
  5. 5.
    Wu, G., Qi, F., Shen, D.: Learning-based deformable registration of MR brain images. IEEE Trans. Med. Imaging, 25(9), 1145–1157 (2006)CrossRefGoogle Scholar
  6. 6.
    Wu, G., Qi, F., Shen, D.: Learning best features and deformation statistics for hierarchical registration of MR brain images. In: Karssemeijer, N., Lelieveldt, B. (eds.) IPMI 2007. LNCS, vol. 4584, pp. 160–171. Springer, Heidelberg (2007)CrossRefGoogle Scholar
  7. 7.
    Le, Q.V., et al.: Learning hierarchical invariant spatio-temporal features for action recognition with independent subspace analysis. In: IEEE Conference on Computer Vision and Pattern Recognition, CVPR (2011)Google Scholar
  8. 8.
    Hyvarinen, A., Hoyer, P.: Emergence of phase- and shift-invariant features by decomposition of natural images into independent feature subspaces. Neural Comput. 12(7), 1705–1720 (2000)CrossRefGoogle Scholar
  9. 9.
    LeCun, Y., Bengio, Y.: Convolutional network for images, speech, and time series. In: The Handbook of Brain Theory and Neural Networks (1995)Google Scholar
  10. 10.
    Peyrat, J., et al.: Registration of 4D cardiac CT sequences under trajectory constraints with multichannel diffeomorphic demons. IEEE Trans. Med. Imaging 29(7), 1351–1368 (2010)CrossRefGoogle Scholar
  11. 11.
    Shen, D.G.: Image registration by local histogram matching. Pattern Recognition 40(4), 1161–1172 (2007)CrossRefzbMATHGoogle Scholar
  12. 12.
    Peyrat, J.-M., Delingette, H., Sermesant, M., Pennec, X., Xu, C., Ayache, N.: Registration of 4D time-series of cardiac images with multichannel Diffeomorphic Demons. In: Metaxas, D., Axel, L., Fichtinger, G., Székely, G. (eds.) MICCAI 2008, Part II. LNCS, vol. 5242, pp. 972–979. Springer, Heidelberg (2008)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2013

Authors and Affiliations

  1. 1.Department of Radiology and BRICUniversity of North Carolina at Chapel HillUSA

Personalised recommendations