Journal of Digital Imaging

, Volume 23, Issue 3, pp 287–300 | Cite as

A Multistage Registration Method Using Texture Features

Article

Abstract

We present a novel, multistage registration method based on Laws’ texture features. In general, a large number of texture features may be extracted from the original intensity images. For each of the texture features, a criterion function that measures the similarity between the images may be derived. The proposed registration method consists of two major steps. In the first step, a dataset of images with the corresponding gold standard is used. In this step, the selection and ranking of the texture features for registration is made. The selection and ranking of the features is based on their robustness, accuracy, and capture range. The selected features are then entered in the second step, where the actual registration is performed using a sequence of registration stages. Our method is based on the selection of the most robust feature for the first registration stage and the selection of accurate feature(s) for the subsequent stages. The texture features are daisy-chained so that the accuracy of the previous feature is sufficient for the capture range of the next feature. We tested our method on 11 2D image pairs containing digital reconstructed radiographs and electron portal imaging modalities, which were difficult to register using intensity features alone. With our method, we have successfully registered 75% of the initial displacements, ranging from 5 to 7.5 mm, with the target-registration error below 3 mm, whereas the traditional intensity-based approach delivered only 15% successfully registered cases.

Key words

X-ray computed image registration digital image processing tomography texture-based registration digital reconstructed radiographs electron portal imaging 

References

  1. 1.
    Van den Elsen PA, Maintz BA, Pol EJD, Viergever MA: Automatic registration of CT and MR brain images using correlation of geometrical features. IEEE Trans Med Imaging 14(2):384–396, 1995CrossRefPubMedGoogle Scholar
  2. 2.
    Maintz A, Viergever MA: A survey of medical image registration. Med Image Anal 2(1):1–36, 1998CrossRefPubMedGoogle Scholar
  3. 3.
    Lester H, Arridge SR: A survey of hierarchical non-linear medical image registration. Pattern Recogn 32(1):129–149, 1999CrossRefGoogle Scholar
  4. 4.
    Hill DLG, Batchelor PG, Holden M, Hawkes DJ: Medical image registration. Phys Med Biol 46:1–45, 2001CrossRefGoogle Scholar
  5. 5.
    Pluim JP, Maintz BA, Viergever MA: Mutual information based registration of medical images: a survey. IEEE Trans Med Imaging 22(8):986–1004, 2003CrossRefPubMedGoogle Scholar
  6. 6.
    Zitova B, Flusser J: Image registration methods: a survey. Image Vision Comput 21(11):977–1000, 2003CrossRefGoogle Scholar
  7. 7.
    Gholipour A, Kehtarnavaz N, Briggs R, Devous M, Gopinath K: Brain functional localization: A survey of image registration techniques. IEEE Trans Med Imaging 26(4):427–451, 2007CrossRefPubMedGoogle Scholar
  8. 8.
    Jarc A, Rogelj P, Kovačič S: Texture feature based image registration. In Symposium proceedings Biomedical imaging: From Nano to Macro, IEEE ISBI, 17–20, 2007Google Scholar
  9. 9.
    Maurer CR, Aboutanos GB, Dawant BM, Maciunas RJ, Fitzpatrick JM: Registration of 3-D images using weighted geometrical features. IEEE Trans Med Imaging 15(6):836–850, 1996CrossRefPubMedGoogle Scholar
  10. 10.
    Likar B, Pernuš F: Automatic extraction of corresponding points for the registration of medical images. Med Phys 26(8):1678–1686, 1999CrossRefPubMedGoogle Scholar
  11. 11.
    Pennec X, Ayache N, Thirion JP: Landmark-based registration using features identified through differential geometry. Orlando: Academic Press, 2000Google Scholar
  12. 12.
    Viola P, Wells WM: Alignment by maximization of mutual information. Int J Comput Vision 24(2):137–154, 1997CrossRefGoogle Scholar
  13. 13.
    Rousseau F, Fablet R, Barillot C: Robust statistical registration of 3D ultrasound images using texture information. IEEE International Conference on Image Processing (ICIP) 1:581–584, 2003Google Scholar
  14. 14.
    Pratikakis I, Barillot C, Hellier P: Robust multiscale non-rigid registration of 3-D ultrasound images. In Int. Conf. on Scale-Space and Morphology in Computer Vision, Springer-Verlag, 389–397, 2001Google Scholar
  15. 15.
    Jarc A, Rogelj P, Kovačič S: Analysis of texture features for registration of DRR and EPI images. Int J Comput Assisted Radiol Surg 2(Supplement 1):116–118, 2007Google Scholar
  16. 16.
    Pluim JP, Maintz BA, Viergever MA: Image registration by maximization of combined mutual information and gradient information. IEEE Trans Med Imaging 19(8):809–814, 2000CrossRefPubMedGoogle Scholar
  17. 17.
    Maintz BA, Van den Elsen PA, Viergever MA: Comparison of edge-based and ridge-based registration of CT and MR brain images. Med Image Anal 1(2):151–161, 1996CrossRefPubMedGoogle Scholar
  18. 18.
    Hsu LY, Loew MH: Fully automatic 3-D feature-based registration of multi-modality medical images. Image Vision Comput 19(1):75–85, 2001CrossRefGoogle Scholar
  19. 19.
    Liu J, Vemuri BC, Marroquin JL: Local frequency representations for robust multimodal image registration. IEEE Trans Med Imaging 21(5):462–469, 2002CrossRefPubMedGoogle Scholar
  20. 20.
    Haber E, Modersitzki J: Intensity gradient based registration and fusion of multi-modal images. In Med Image Comput Comput-Assisted Intervention-MICCAI, Springer-Verlag:726–733, 2006Google Scholar
  21. 21.
    Liu J, Tian J: Registration of brain MRI/PET images based on adaptive combination of intensity and gradient mutual information. Int J Biomed Imaging 2007:1–10, 2007 (ID 93479)CrossRefGoogle Scholar
  22. 22.
    Škerl D, Likar B, Pernuš F: A protocol for evaluation of similarity measures for rigid registration. IEEE Trans Med Imaging 25(6):779–791, 2006CrossRefPubMedGoogle Scholar
  23. 23.
    Reinstein LE, Amols HI, Biggs PJ, Droege RT, Filimonov AB, Lutz WR, Shalev S: Radiotherapy portal imaging quality. Published for the American Association of Physicists in Medicine by the American Institute of Physics, Report of AAPM task group No. 28, 1987Google Scholar
  24. 24.
    Škerl D, Tomaževič D, Likar B, Pernuš F: Evaluation of similarity measures for reconstruction-based registration in image-guided radiotherapy and surgery. Int J Radiat Oncol Biol Phys 65(3):943–953, 2006PubMedGoogle Scholar
  25. 25.
    Škerl D, Likar B, Fitzpatrick JM, Pernuš F: Comparative evaluation of similarity measures for the rigid registration of multi-modal head images. Phys Med Biol 52:5587–5601, 2007CrossRefPubMedGoogle Scholar
  26. 26.
    Jarc A, Perš J, Rogelj P, Kovačič S: Efficient sampling for the evaluation protocol for 2-D rigid registration. Informacije MIDEM in press, 2009Google Scholar
  27. 27.
    Laws K: Rapid texture identification. SPIE Image Processing for Missile Guidance; Proceedings of the Seminar, San Diego, 376–380, 1980Google Scholar
  28. 28.
    Petrou M, Sevilla PG: Image Processing: Dealing with Texture. Hoboken: Willey, 2006Google Scholar
  29. 29.
    Press WH, Flannery BP, Teukolsky SA, Vetterling WT: Numerical Recipes in C: The Art of Scientific Computing, 2nd edition. Cambridge: Cambridge University Press, 1996Google Scholar
  30. 30.
    Dong L, Boyer A: An image correlation procedure for digitally reconstructed radiographs and electronic portal images. Int J Radiat Oncol Biol Phys 33(5):1053–1060, 1995PubMedGoogle Scholar
  31. 31.
    Matsopoulos G, Asvestas P, Delibasis K, Kouloulias V, Uzunoglu N, Karaiskos P, Sandilos P: Registration of electronic portal images for patient set-up verification. Phys Med Biol 49:3279–3289, 2004CrossRefPubMedGoogle Scholar
  32. 32.
    Bachman KA: Mutual information-based registration of digitally reconstructed radiographs and electronic portal images. Master’s thesis, Applied Mathematics, University of Colorado at Denver, 2005Google Scholar
  33. 33.
    Khamene A, Bloch P, Wein W, Svatos M, Sauer F: Automatic registration of portal images and volumetric CT for patient positioning in radiation therapy. Med Image Anal 10:96–112, 2006CrossRefPubMedGoogle Scholar
  34. 34.
    Ureten O, Erkal HS: Measurement of patient setup errors using digitally reconstructed radiographs and electronic portal images. Biomedical Engineering Days, Proceedings of the 1998 2nd International Conference 88–90, 1998Google Scholar

Copyright information

© Society for Imaging Informatics in Medicine 2009

Authors and Affiliations

  • Andreja Jarc
    • 1
    • 2
  • Janez Perš
    • 2
  • Stanislav Kovačič
    • 2
  1. 1.Sipronika d.o.o.LjubljanaSlovenia
  2. 2.Faculty of Electrical EngineeringUniversity of LjubljanaLjubljanaSlovenia

Personalised recommendations