Abstract
As an aid to the interpretation of functional images, cross-modality coregistration of functional and anatomical images has grown rapidly. Various ways of easily interpreting and visualising coregistered images have previously been investigated; for their display, an intensity-weighted temporally alternating method is used. For brain images, geometric registration involves the automatic alignment method, using the head scalp boundary extracted from the sinogram of a PET emission scan and a surface-matching algorithm; images of the chest or abdomen are registered semi-automatically using a paired point matching algorithm. For the simultaneous display of geometrically registered images, rapid image switching is applied; both images are written with independent colour scales. The rapidly alternating display of two images, synchronised with monitor scanning, induces the fusion of images in the human visual perception system. The accuracy of registration of PET and MRI images is within 2 mm for two point sets. A resulting image is intensified by weighting the display time and/or controlling the intensity map of each image with the degree of interest. This method may be useful for the interpretation and visualisation of coregistered images.
Similar content being viewed by others
References
Besl, P. J., andMcKay, N. D. (1992): ‘A method for registration of 3-D shape’,IEEE Trans. Pattern Anal. Mach. Intell.,14, pp. 239–256
Borgefors, G. (1988): ‘Hierachical chamfer matching: a parametric edge matching algorithm’,IEEE Trans. Pattern. Anal. Mach. Intell.,10, pp. 849–865
Farrel, J. E. (1991): ‘Fitting physical screen parameters to the human eye’ in:Roufs, J. A. J. (Ed.) ‘Vision and visual dysfunction, 15, The man-machine interface’ (The Macmillan Press Ltd, Hampshire)
Grimson, W. E. L., Ettinger, G. J., White, S. J., Lozano-Pérez, T., Wells III, W. M., andKikinis, R. (1996): ‘An automatic registration method for frameless stereotaxy, image guided surgery, and enhanced reality visualization’,IEEE Trans. Med. Imag.,15, pp. 129–140
Hallett, P. E. (1991): ‘Some limitations to human peripheral vision’ in:Kulikowski, J. J., Walsh, V., andMurray, I. J. (Ed.) ‘Vision and visual dysfunction, 5, Limits of vision’ (The Macmillan Press Ltd, Hampshire)
Itti, L., Chang, L., Mangin, J-F., Darcourt, J., andErnst, T. (1997): ‘Robust multimodality registration for brain mapping’,Hum. Brain Mapping,5, pp. 3–17
Lee, J. S., Kwark, C., Lee, D. S., Chung, J-K., Lee, M. C., andPark, K. S. (1998): ‘Development of an automatic 3D coregistration technique of brain PET and MR images’,Korean J. Nucl. Med.,32, pp. 414–424
Levin, D. N., Hu, X., Tan, K. K., Galhotra, S., Pelizzari, C. A., Chen, G. T. Y., Beck, R. N., Chen, C-T., Cooper, M. D., Mullan, J. F., Hekmatpanah, J., andSpire, J-P. (1989): ‘The brain: integrated three-dimensional display of MR and PET images’,Radiology,172, pp. 783–789
Meltzer, C. C., Zubieta, J. K., Links, J. M., Brakeman, P., Stumpf, M. J., andFrost, J. J. (1996): ‘MR-based correction of brain PET measurements for heterogeneous gray matter radioactivity distribution’,J. Cereb. Blood Flow Metab.,16, pp. 650–658
Meyer, C. R., Leichtman, G. S., Brunberg, J. A., Wahl, R. L., andQuint, L. E. (1992): ‘Simultaneous usage of homologous points, lines, and planes for optimal, 3-D, linear registration of multimodality imaging data’,IEEE Trans. Med. Imag.,14, pp. 1–11
Molina, V., Montz, R., Martin-Loeches, M., Jiménez-Vicioso, A., Carreras, J. L., andRubia, F. J. (1995): ‘Drug therapy and cerebral perfusion in obsessive-compulsive disorder’,J. Nucl. Med.,36, pp. 2234–2238
Pelizzari, C. A., Chen, G. T. Y., Spelbring, D. R., Weichselbaum, R. R., andChen, C. (1989): ‘Accurate three-dimensional registration of CT, PET, and/or MR images of the brain’,J. Comput. Assist. Tomogr.,13, pp. 20–26
Peters, T., Munger, P., Comeau, R., Evans, A., andOlivier, A. (1996): ‘Three-dimensional multimodal image-guidance for neurosurgery’,IEEE Trans. Med. Imag.,15, pp. 121–128
Pietrzyk, U., Herholz, K., Fink, G., Jacobs, A., Mielke, R., Slansky, I., Würker, M., andHeiss, W-D. (1994): ‘An interactive technique for three-dimensional image registration: validation for PET, SPECT, MRI and CT brain studies’,J. Nucl. Med., 35, pp. 2011–2018
Rehm, K., Strother, S. C., Anderson, J. R., Schaper, K. A., andRottenberg, D. A. (1994): ‘Display of merged multimodality brain images using interleaved pixels with independent color scales’,J. Nucl. Med.,35, pp. 1815–1821
Taylor, R. H., Lavallee, S., Burdea, G. C., andMösges, R. (1996): ‘Computer-integrated surgery: technology and clinical application’ (MIT Press, Cambridge, Massachusetts), pp. 77–97
Wahl, R. L., Quint, L. E., Cieslak, R. D., Aisen, A. M., Koeppe, R. A., andMeyer, C. R. (1993): ‘Anatometabolic tumor imaging: fusion of FDG PET with CT or MRI to localize foci of increased activity’,J. Nucl. Med.,34, pp. 1190–1197
Wandell, B. A. (1995): ‘Foundations of vision’ (Sinauer Associates, Inc., Massachusetts)
Watson, A. B., Ahumada Jr, A. J., andFarrell, J. E. (1986): ‘Window of visibility: a psychophysical theory of fidelity in time-sampled visual motion display’,J. Opt. Soc. Am. A.,3, pp. 300–307
Zubal, I. G., Spencer, S. S., Imam, K., Seibyl, J., Smith, E. O., Wisniewski, G., andHoffer, P. B. (1995): ‘Difference images calculated from ictal and interictal Technetium-99m-HMPAO SPECT scans of epilepsy’,J. Nucl. Med.,36, pp. 684–689
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Lee, J.S., Kim, B., Chee, Y. et al. Fusion of coregistered cross-modality images using a temporally alternating display method. Med. Biol. Eng. Comput. 38, 127–132 (2000). https://doi.org/10.1007/BF02344766
Received:
Accepted:
Issue Date:
DOI: https://doi.org/10.1007/BF02344766