Summary
Clinical diagnosis, as well as therapy planning and evaluation, are increasingly supported by multimodal images. There are many instances desiring integration of the information obtained by various imaging devices. This paper describes a new approach to match images of different modalities. Differential operators are used in combination with Gaussian blurring to extract geometric features from the images that correspond to similar structures. The resulting ‘feature’ images may be used with existing matching techniques that minimize the distance between the features in the images to be matched. Our first application of this new approach concerns matching of MRI and CT brain images. The so-called Lυυ operator produces a ridge-like feature image from which in CT and MRI the center curve of the cranium is easily extracted. First results of this operator's performance in matching tasks are shown. Another promising operator is the ‘umbilicity’ operator, which is presented in combination with SPECT images.
Similar content being viewed by others
References
Borgefors, G. Hierarchical Chamfer matching: a parametric edge matching algorithm. IEEE Trans. PAMI, 1988, 10: 849–865.
Evans, A.C., Marret, S., Collins, L. and Peters, T.M. Anatomical-functional correlative analysis of the human brain using three dimensional systems. Proc. SPIE Medical Imaging III: Image Processing, 1989, 1092: 264–274.
Hawkes, D.J., Hill, D.L.G., Lehmann, E.D., Robinson, G.P., Maisey, M.N. and Colchester, A.C.F. Preliminary work on the interpretation of SPECT images with the aid of registered MR images and an MR derived 3D neuro-anatomical atlas. In: K.H. Höhne, H. Fuchs, S.M. Pizer (Eds.) 3D Imaging in Medicine. Springer, Berlin, 1990: 241–251.
Levin, D.N., Pelizarri, C.A., Chen, G.T.Y., Chen, C.T. and Cooper, M.D. Retrospective geometric correlation of MR, CT, and PET Images. Radiology, 1988, 169: 817–823.
Maguire Jr, G.Q., Noz, M.E., Lee, E.M. and Schimpf, J.H. Correlation methods for tomographic images using two and three dimensional techniques. In: S. Bacharach (Ed.) Information Processing in Medical Imaging. Martinus Nijhoff Publishers, Dordrecht, 1986: 266–279.
Peters, T.M., Clark, J.A., Pike, G.B., Henri, C., Collins, L., Leksell, D. and Jeppsson, O. Stereotactic neurosurgery planning on a personal-computer-based work station. J. Dig. Im., 1989, 2: 75–81.
Ter Haar Romeny, B.M., Florack, L.M.J., Koenderink, J.J. and Viergever, M.A. Scale space: its natural operators and differential invariants. In: A.C.F. Colchester, D.J. Hawkes (Eds.) Information Processing in Medical Imaging. Springer, Berlin, 1991, 239–255.
Ter Haar Romeny, B.M. and Florack, L.M.J. A multiscale geometric model of human vision. In: B. Hendee, P.N.T. Wells (Eds.) Perception of Visual Information. Springer-Verlag, Berlin, 1992 (in press).
Van den Elsen, P.A., Viergever, M.A., Van Huffelen, A.C., Van der Meij, W. and Wieneke, G.H. Accurate matching of electromagnetic dipole data with CT and MR images. Brain Topography, 1991a, 3: 425–432.
Van den Elsen, P.A. and Viergever, M.A. Marker-guided multimodality matching of the brain. Report 3DCV 91–26, Utrecht University, 1991b.
Van den Elsen, P.A., Pol, E.J.D. and Viergever, M.A. Medical image matching - A review with classification. IEEE Engineering in Medicine and Biology, 1992a (in press).
Van den Elsen, P.A., Maintz, J.B.A. Pol, E.J.D. and Viergever, M.A. Image fusion using geometrical features. In: Visualization in Biomedical Computing. Proc. SPIE. SPIE Press, Bellingham, 1992b (in press).
Viergever, M.A., Van den Elsen, P.A. and Stokking, R. Integrated presentation of multimodal brain images. Brain Topography, 1992, 5: 135–145.
Zhang, J., Levesque, M.F., Wilson, C.L., Harper, R.M., Engel, Jr., J., Lufkin, R. and Behnke, E.J. Multimodality imaging of brain structures for stereotactic surgery. Radiology, 1990, 175: 435–441.
Author information
Authors and Affiliations
Additional information
This research was supported in part by the Netherlands ministries of Education & Science and Economic Affairs through a SPIN grant, and by the industrial companies Agfa-Gevaert, Philips Medical Systems, and KEMA. The valuable discussions with E. J. D. Pol, B. M. ter Haar Romeny, and L. M. J. Florack are gratefully acknowledged.
Rights and permissions
About this article
Cite this article
van den Elsen, P.A., Antoine Maintz, J.B. & Viergever, M.A. Geometry driven multimodality matching of brain images. Brain Topogr 5, 153–157 (1992). https://doi.org/10.1007/BF01129043
Accepted:
Issue Date:
DOI: https://doi.org/10.1007/BF01129043