Groupwise Multimodal Image Registration Using Joint Total Variation

Conference paper
Part of the Communications in Computer and Information Science book series (CCIS, volume 1248)


In medical imaging it is common practice to acquire a wide range of modalities (MRI, CT, PET, etc.), to highlight different structures or pathologies. As patient movement between scans or scanning session is unavoidable, registration is often an essential step before any subsequent image analysis. In this paper, we introduce a cost function based on joint total variation for such multimodal image registration. This cost function has the advantage of enabling principled, groupwise alignment of multiple images, whilst being insensitive to strong intensity non-uniformities. We evaluate our algorithm on rigidly aligning both simulated and real 3D brain scans. This validation shows robustness to strong intensity non-uniformities and low registration errors for CT/PET to MRI alignment. Our implementation is publicly available at



MB was funded by the EPSRC-funded UCL Centre for Doctoral Training in Medical Imaging (EP/L016478/1) and the Department of Health’s NIHR-funded Biomedical Research Centre at University College London Hospitals. YB was funded by the MRC and Spinal Research Charity through the ERA-NET Neuron joint call (MR/R000050/1). MB and JA were funded by the EU Human Brain Project’s Grant Agreement No 785907 (SGA2).


  1. 1.
    Gerlot-Chiron, P., Bizais, Y.: Registration of multimodality medical images using a region overlap criterion. Graph. Models Image Process. 54(5), 396–406 (1992)CrossRefGoogle Scholar
  2. 2.
    Ashburner, J., Neelin, P., Collins, D., Evans, A., Friston, K.: Incorporating prior knowledge into image registration. NeuroImage 6(4), 344–352 (1997)CrossRefGoogle Scholar
  3. 3.
    Hill, D.L., Batchelor, P.G., Holden, M., Hawkes, D.J.: Medical image registration. Phys. Med. Biol. 46(3), R1 (2001)CrossRefGoogle Scholar
  4. 4.
    Oliveira, F.P., Tavares, J.M.R.: Medical image registration: a review. Comput. Meth. Biomech. Biomed. Eng. 17(2), 73–93 (2014)CrossRefGoogle Scholar
  5. 5.
    Lewis, J.P.: Fast template matching. Vis. Interface 95, 15–19 (1995)Google Scholar
  6. 6.
    Cideciyan, A.V.: Registration of ocular fundus images: an algorithm using cross-correlation of triple invariant image descriptors. IEEE Eng. Med. Biol. Mag. 14(1), 52–58 (1995)CrossRefGoogle Scholar
  7. 7.
    Roche, A., Malandain, G., Pennec, X., Ayache, N.: The correlation ratio as a new similarity measure for multimodal image registration. In: Wells, W.M., Colchester, A., Delp, S. (eds.) MICCAI 1998. LNCS, vol. 1496, pp. 1115–1124. Springer, Heidelberg (1998). Scholar
  8. 8.
    Hajnal, J.V., Saeed, N., Oatridge, A., Williams, E.J., Young, I.R., Bydder, G.M.: Detection of subtle brain changes using subvoxel registration and subtraction of serial MR images. J. Comput. Assist. Tomogr. 19(5), 677–691 (1995)CrossRefGoogle Scholar
  9. 9.
    Woods, R.P., Grafton, S.T., Holmes, C.J., Cherry, S.R., Mazziotta, J.C.: Automated image registration: I. general methods and intrasubject, intramodality validation. J. Comput. Assist. Tomogr. 22(1), 139–152 (1998)CrossRefGoogle Scholar
  10. 10.
    Myronenko, A., Song, X.: Intensity-based image registration by minimizing residual complexity. IEEE Trans. Med. Imag. 29(11), 1882–1891 (2010)CrossRefGoogle Scholar
  11. 11.
    Collignon, A., Maes, F., Delaere, D., Vandermeulen, D., Suetens, P., Marchal, G.: Automated multi-modality image registration based on information theory. IPMI 3, 263–274 (1995)Google Scholar
  12. 12.
    Viola, P., Wells III, W.M.: Alignment by maximization of mutual information. Int. J. Comput. Vis. 24(2), 137–154 (1997)CrossRefGoogle Scholar
  13. 13.
    Wells III, W.M., Viola, P., Atsumi, H., Nakajima, S., Kikinis, R.: Multi-modal volume registration by maximization of mutual information. Med. Image Anal. 1(1), 35–51 (1996)CrossRefGoogle Scholar
  14. 14.
    Orchard, J., Mann, R.: Registering a multisensor ensemble of images. IEEE Trans. Image Process. 19(5), 1236–1247 (2009)MathSciNetCrossRefGoogle Scholar
  15. 15.
    Studholme, C., Hill, D.L., Hawkes, D.J.: An overlap invariant entropy measure of 3d medical image alignment. Pattern Recogn. 32(1), 71–86 (1999)CrossRefGoogle Scholar
  16. 16.
    Pluim, J.P., Maintz, J.A., Viergever, M.A.: Mutual-information-based registration of medical images: a survey. IEEE Trans. Med. Imag. 22(8), 986–1004 (2003)CrossRefGoogle Scholar
  17. 17.
    Saad, Z.S., Glen, D.R., Chen, G., Beauchamp, M.S., Desai, R., Cox, R.W.: A new method for improving functional-to-structural MRI alignment using local Pearson correlation. Neuroimage 44(3), 839–848 (2009)CrossRefGoogle Scholar
  18. 18.
    Greve, D.N., Fischl, B.: Accurate and robust brain image alignment using boundary-based registration. Neuroimage 48(1), 63–72 (2009)CrossRefGoogle Scholar
  19. 19.
    Maintz, J.B.A., van den Elsen, P.A., Viergever, M.A.: Comparison of edge-based and ridge-based registration of CT and MR brain images. Med. Image Anal. 1(2), 151–161 (1996)CrossRefGoogle Scholar
  20. 20.
    Orchard, J.: Globally optimal multimodal rigid registration: an analytic solution using edge information. In: IEEE International Conference on Image Processing, vol. 1, pp. 1–485. IEEE (2007)Google Scholar
  21. 21.
    Haber, E., Modersitzki, J.: Intensity gradient based registration and fusion of multi-modal images. In: Larsen, R., Nielsen, M., Sporring, J. (eds.) MICCAI 2006. LNCS, vol. 4191, pp. 726–733. Springer, Heidelberg (2006). Scholar
  22. 22.
    Snape, P., Pszczolkowski, S., Zafeiriou, S., Tzimiropoulos, G., Ledig, C., Rueckert, D.: A robust similarity measure for volumetric image registration with outliers. Image Vis. Comput. 52, 97–113 (2016)CrossRefGoogle Scholar
  23. 23.
    Wachinger, C., Wein, W., Navab, N.: Three-dimensional ultrasound mosaicing. In: Ayache, N., Ourselin, S., Maeder, A. (eds.) MICCAI 2007. LNCS, vol. 4792, pp. 327–335. Springer, Heidelberg (2007). Scholar
  24. 24.
    Spiclin, Ž., Likar, B., Pernus, F.: Groupwise registration of multimodal images by an efficient joint entropy minimization scheme. IEEE Trans. Image Process. 21(5), 2546–2558 (2012)MathSciNetCrossRefGoogle Scholar
  25. 25.
    Polfliet, M., Klein, S., Huizinga, W., Paulides, M.M., Niessen, W.J., Vandemeulebroucke, J.: Intrasubject multimodal groupwise registration with the conditional template entropy. Med. Image Anal. 46, 15–25 (2018)CrossRefGoogle Scholar
  26. 26.
    Bresson, X., Chan, T.F.: Fast dual minimization of the vectorial total variation norm and applications to color image processing. Inverse Prob. Imag. 2(4), 455–484 (2008)MathSciNetCrossRefGoogle Scholar
  27. 27.
    Wu, C., Tai, X.-C.: Augmented Lagrangian method, dual methods, and split Bregman iteration for ROF, vectorial TV, and high order models. SIAM J. Imag. Sci. 3(3), 300–339 (2010)MathSciNetCrossRefGoogle Scholar
  28. 28.
    Huang, J., Chen, C., Axel, L.: Fast multi-contrast MRI reconstruction. Magn. Reson. Imag. 32(10), 1344–1352 (2014)CrossRefGoogle Scholar
  29. 29.
    Brudfors, M., Balbastre, Y., Nachev, P., Ashburner, J.: MRI super-resolution using multi-channel total variation. In: Nixon, M., Mahmoodi, S., Zwiggelaar, R. (eds.) MIUA 2018. CCIS, vol. 894, pp. 217–228. Springer, Cham (2018). Scholar
  30. 30.
    Blomgren, P., Chan, T.F.: Color tv: total variation methods for restoration of vector-valued images. IEEE Trans. Image Process. 7(3), 304–309 (1998)CrossRefGoogle Scholar
  31. 31.
    Sapiro, G., Ringach, D.L.: Anisotropic diffusion of multivalued images with applications to color filtering. IEEE Trans. Image Process. 5(11), 1582–1586 (1996)CrossRefGoogle Scholar
  32. 32.
    Woods, R.P.: Characterizing volume and surface deformations in an atlas framework: theory, applications, and implementation. NeuroImage 18(3), 769–788 (2003)CrossRefGoogle Scholar
  33. 33.
    Press, W.H., Teukolsky, S.A., Vetterling, W.T., Flannery, B.P.: Numerical Recipes 3rd Edition: The Art of Scientific Computing. Cambridge University Press, Cambridge (2007)zbMATHGoogle Scholar
  34. 34.
    Unser, M., Thévenaz, P.: Stochastic sampling for computing the mutual information of two images. In: Proceedings of the 5th International Workshop on Sampling Theory and Applications (SampTA 2003), pp. 102–109 (2003)Google Scholar
  35. 35.
    Cocosco, C.A., Kollokian, V., Kwan, R.K.-S., Pike, G.B., Evans, A.C.: BrainWeb: online interface to a 3D MRI simulated brain database. In: NeuroImage, Citeseer (1997)Google Scholar
  36. 36.
    Maes, F., Collignon, A., Vandermeulen, D., Marchal, G., Suetens, P.: Multimodality image registration by maximization of mutual information. IEEE Trans. Med. Imag. 16(2), 187–198 (1997)CrossRefGoogle Scholar
  37. 37.
    West, J.B., Woods, R.P.: Comparison and evaluation of retrospective intermodality image registration techniques. In: Medical Imaging 1996: Image Processing, vol. 2710, pp. 332–348. SPIE (1996)Google Scholar

Copyright information

© Springer Nature Switzerland AG 2020

Authors and Affiliations

  1. 1.The Wellcome Centre for Human Neuroimaging, UCLLondonUK

Personalised recommendations