Abstract
Medical scans are today routinely acquired using multiple sequences or contrast settings, resulting in multispectral data. For the automatic analysis of this data, the evaluation of multispectral similarity is essential. So far, few concepts have been proposed to deal in a principled way with images containing multiple channels. Here, we present a new approach based on a well known statistical technique: canonical correlation analysis (CCA). CCA finds a mapping of two multidimensional variables into two new bases, which best represent the true underlying relations of the signals. In contrast to previously used metrics, it is therefore able to find new correlations based on linear combinations of multiple channels. We extend this concept to efficiently model local canonical correlation (LCCA) between image patches. This novel, more general similarity metric can be applied to images with an arbitrary number of channels. The most important property of LCCA is its invariance to affine transformations of variables. When used on local histograms, LCCA can also deal with multimodal similarity. We demonstrate the performance of our concept on challenging clinical multispectral datasets.
Chapter PDF
Similar content being viewed by others
References
Peyrat, J.M., Delingette, H., Sermesant, M., Xu, C., Ayache, N.: Registration of 4D cardiac CT sequences under trajectory constraints with multichannel diffeomorphic demons. IEEE Transactions on Medical Imaging 29(7), 1351–1368 (2010)
Rohde, G., Pajevic, S., Pierpaoli, C., Basser, P.: A comprehensive approach for multi-channel image registration. In: Gee, J.C., Maintz, J.B.A., Vannier, M.W. (eds.) WBIR 2003. LNCS, vol. 2717, pp. 214–223. Springer, Heidelberg (2003)
Avants, B.B., Epstein, C.L., Grossman, M., Gee, J.C.: Symmetric diffeomorphic image registration with cross-correlation: evaluating automated labeling of elderly and neurodegenerative brain. Med. Imag. Anal. 12(1), 26–41 (2008)
Ruiz-Alzola, J., Westin, C., Warfield, S., Alberola, C., Maier, S., Kikinis, R.: Nonrigid registration of 3D tensor medical data. Med. Imag. Anal. 6(2), 143–161 (2002)
Taquet, M., Macq, B., Warfield, S.K.: A generalized correlation coefficient: Application to DTI and multi-fiber DTI. In: MMBIA 2012, pp. 9–14. IEEE (2012)
Wein, W., Brunke, S., Khamene, A., Callstrom, M.R., Navab, N.: Automatic CT-ultrasound registration for diagnostic imaging and image-guided intervention. Med. Imag. Anal. 12(5), 577–585 (2008)
Iglesias, J.E., Konukoglu, E., Zikic, D., Glocker, B., Van Leemput, K., Fischl, B.: Is synthesizing MRI contrast useful for inter-modality analysis? In: Mori, K., Sakuma, I., Sato, Y., Barillot, C., Navab, N. (eds.) MICCAI 2013, Part I. LNCS, vol. 8149, pp. 631–638. Springer, Heidelberg (2013)
Guimond, A., Roche, A., Ayache, N., Meunier, J.: Three-dimensional multimodal brain warping using the demons algorithm and adaptive intensity corrections. IEEE Transactions on Medical Imaging 20(1), 58–69 (2001)
Li, Y., Verma, R.: Multichannel image registration by feature-based information fusion. IEEE Transactions on Medical Imaging 30(3), 707–720 (2011)
Hotelling, H.: Relations between two sets of variates. Biometrika 28(3-4), 321–377 (1936)
Friman, O., Cedefamn, J., Lundberg, P., Borga, M., Knutsson, H.: Detection of neural activity in functional MRI using canonical correlation analysis. Magnetic Resonance in Medicine 45(2), 323–330 (2001)
Suarez, R.O., Commowick, O., Prabhu, S.P., Warfield, S.K.: Automated delineation of white matter fiber tracts with a multiple region-of-interest approach. NeuroImage 59(4), 3690–3700 (2012)
He, K., Sun, J., Tang, X.: Guided image filtering. IEEE Transactions on Pattern Analysis and Machine Intelligence 35(6), 1397–1409 (2013)
Heinrich, M.P., Papież, B.W., Schnabel, J.A., Handels, H.: Non-parametric discrete registration with convex optimisation. In: Ourselin, S., Modat, M. (eds.) WBIR 2014. LNCS, vol. 8545, pp. 51–61. Springer, Heidelberg (2014)
Mendrik, A.: Evaluation framework for MR brain image segmentation. In: MICCAI Grand Challenge (2013), http://mrbrains13.isi.uu.nl
Landman, B., Warfield, S.: Segmentation: Algorithms, theory and applications. In: MICCAI SATA (2013), https://masi.vuse.vanderbilt.edu/workshop2013
Ourselin, S., Roche, A., Prima, S., Ayache, N.: Block matching: A general framework to improve robustness of rigid registration of medical images. In: Delp, S.L., DiGoia, A.M., Jaramaz, B. (eds.) MICCAI 2000. LNCS, vol. 1935, pp. 557–566. Springer, Heidelberg (2000)
Heinrich, M.P., Jenkinson, M., Papież, B.W., Brady, S.M., Schnabel, J.A.: Towards realtime multimodal fusion for image-guided interventions using self-similarities. In: Mori, K., Sakuma, I., Sato, Y., Barillot, C., Navab, N. (eds.) MICCAI 2013, Part I. LNCS, vol. 8149, pp. 187–194. Springer, Heidelberg (2013)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
Heinrich, M.P., Papież, B.W., Schnabel, J.A., Handels, H. (2014). Multispectral Image Registration Based on Local Canonical Correlation Analysis. In: Golland, P., Hata, N., Barillot, C., Hornegger, J., Howe, R. (eds) Medical Image Computing and Computer-Assisted Intervention – MICCAI 2014. MICCAI 2014. Lecture Notes in Computer Science, vol 8673. Springer, Cham. https://doi.org/10.1007/978-3-319-10404-1_26
Download citation
DOI: https://doi.org/10.1007/978-3-319-10404-1_26
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-10403-4
Online ISBN: 978-3-319-10404-1
eBook Packages: Computer ScienceComputer Science (R0)