Self-Aligning Manifolds for Matching Disparate Medical Image Datasets
Manifold alignment can be used to reduce the dimensionality of multiple medical image datasets into a single globally consistent low-dimensional space. This may be desirable in a wide variety of problems, from fusion of different imaging modalities for Alzheimer’s disease classification to 4DMR reconstruction from 2D MR slices. Unfortunately, most existing manifold alignment techniques require either a set of prior correspondences or comparability between the datasets in high-dimensional space, which is often not possible. We propose a novel technique for the ‘self-alignment’ of manifolds (SAM) from multiple dissimilar imaging datasets without prior correspondences or inter-dataset image comparisons. We quantitatively evaluate the method on 4DMR reconstruction from realistic, synthetic sagittal 2D MR slices from 6 volunteers and real data from 4 volunteers. Additionally, we demonstrate the technique for the compounding of two free breathing 3D ultrasound views from one volunteer. The proposed method performs significantly better for 4DMR reconstruction than state-of-the-art image-based techniques.
KeywordsManifold Cross Correlation
This work was funded by EPSRC programme grant EP/H046410/1. This research was supported by the National Institute for Health Research (NIHR) Biomedical Research Centre at Guy’s and St. Thomas’ NHS Foundation Trust and King’s College London. The views expressed are those of the authors and not necessarily those of the NHS, the NIHR or the Department of Health.
- 5.Guerrero, R., Ledig, C., Rueckert, D.: Manifold alignment and transfer learning for classification of Alzheimer’s disease. In: Wu, G., Zhang, D., Zhou, L. (eds.) MLMI 2014. LNCS, vol. 8679, pp. 77–84. Springer, Heidelberg (2014) Google Scholar
- 12.Thielemans, K., Rathore, S., Engbrant, F., Razifar, P.: Device-less gating for PET/CT using PCA. In: Proceedings of the IEEE NSS/MIC, pp. 3904–3910. IEEE (2011)Google Scholar
- 15.Wang, C., Mahadevan, S.: Manifold alignment without correspondence. In: Proceedings of the IJCAI, pp. 1273–1278 (2009)Google Scholar