Multimodal Registration Using Patch Algorithm

  • P. Zhilkin
  • M. E. Alexander
  • C. D. Mansfield
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 2717)


Images of different modality are registered using a unimodal image registration program (“Patch Algorithm”). An affine model for the displacement field is considered. Prior to registration the images are convolved with a set of Gabor filter (quadrature) pairs tuned to certain orientations and scales, and a gradient of local phase (local frequency) is computed for the filtered images. Local frequency representation of an image is relatively insensitive to changes in illumination conditions, and may enable common features between images of different modality to be captured. To demonstrate the algorithm, a series of 2- dimensional T2-weighted magnetic resonance images of brain was registered against a T1-weighted reference image. Also, registration of a near infrared hyperspectral datacube was shown to improve recovery of localized skin chromophore features for facial imaging, demonstrating its potential to obtain high spatial resolution diagnostic information.


Mutual Information Image Registration Gabor Filter Local Phase Acne Lesion 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Viola, P., Wells, W.M.: Alignment by maximization of mutual information. International Journal of Computer Vision 24, 137–154 (1997)CrossRefGoogle Scholar
  2. 2.
    Fleet, D.J., Jepson, A.D.: Computation of component image velocity from local phase information. International Journal of Computer Vision 5, 77–104 (1990)CrossRefGoogle Scholar
  3. 3.
    Liu, J., Vemuri, B.C., Marroquin, J.L.: Local frequency representations for robust multimodal image registration. IEEE Trans. Medical Imaging 21, 462–469 (2002)CrossRefGoogle Scholar
  4. 4.
    Alexander, M.E.: Fast hierarchical noniterative registration algorithm. International Journal of Imaging Systems and Technology 10, 242–257 (1999)CrossRefGoogle Scholar
  5. 5.
    Zhilkin, P., Alexander, M.E.: 3D image registration using a fast noniterative algorithm. Magnetic Resonance Imaging 18, 1143–1150 (2000)CrossRefGoogle Scholar
  6. 6.
    Zhilkin, P., Alexander, M.E.: Nonlinear Registration of 3D Images Using Patch Algorithm. In: ISMRM, Honolulu, Hawaii, USA, May 18-24 (2002)Google Scholar
  7. 7.
    Liu, J., Vemuri, B.C., Bova, F.: Efficient multi-modal image registration using localfrequency maps. Machine Vision and Applications 13, 149–163 (2002)CrossRefGoogle Scholar
  8. 8.
    Thévenaz, P., Unser, M.: Optimization of Mutual Information for Multiresolution Image Registration. IEEE Trans. Image Processing 9, 2083–2099 (2000)zbMATHCrossRefGoogle Scholar
  9. 9.
  10. 10.
    Cocosco, C.A., Kollokian, V., Kwan, R.K.-S., Evans, A.C.: BrainWeb: Online Interface to a 3D MRI Simulated Brain Database. NeuroImage 5(4), part 2/4, S425, (1977); Proceedings of 3-rd International Conference on Functional Mapping of the Human Brain, Copenhagen (May 1997)Google Scholar
  11. 11.
    Stranc, M.F., Sowa, M.G., Abdulrf, B., Mantsch, H.H.: Assessment of tissue viability using near-infrared spectroscopy. Br. J. Plast. Surg. 51(3), 210–217 (1998)CrossRefGoogle Scholar
  12. 12.
    Kollias, N., Stamatas, G.N.: Optical non-invasive approaches to diagnosis of skin diseases. Journal of investigative dermatology, The Symposium proceedings the Society for Investigative Dermatology, Inc. and European Society for Dermatological Research 7(1), 64–75 (2002)Google Scholar
  13. 13.
    Mansfield, C.D., Alexander, M.E.: Registration of Thermal and Near Infrared Hyperspectral Datacubes for Recovery of Localized Thermal or Hemodynamic Features. manuscript submitted to IEEE Transactions on Medical Imaging (2003)Google Scholar
  14. 14.
    Alexander, M.E., Summers, A.R.: Fast Registration Algorithm Using a Variational Principle for Mutual Information. In: Proceedings of SPIE Medical Imaging Conference, San Diego, February 15-20 (2003) (to appear)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2003

Authors and Affiliations

  • P. Zhilkin
    • 1
  • M. E. Alexander
    • 1
  • C. D. Mansfield
    • 1
  1. 1.National Research Council of CanadaInstitute for BiodiagnosticsWinnipegCanada

Personalised recommendations