Registration of 3D Angiographic and X-Ray Images Using Sequential Monte Carlo Sampling

  • Charles Florin
  • James Williams
  • Ali Khamene
  • Nikos Paragios
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3765)


Digital subtraction angiography (DSA) reconstructions and 3D Magnetic Resonance Angiography (MRA) are the modalities of choice for diagnosis of vascular diseases. However, when it comes to treatment through an endovascular intervention, only two dimensional lower resolution information such as angiograms or fluoroscopic images are usually available. Overlaying the pre-operative information from high resoluion acquisition onto the images acquired during intervention greatly helps physician in performing the operation. We propose to register pre-operative DSA or MRS with intra-operative images to bring the two data sets into a single coordinate frame. The method uses the vascular structure, which is present and visible from most of DSA, MRA and x-ray angiogram and fluoroscopic images, to determine the registration parameters. A robust multiple hypothesis framework is built to minimize a fitness measure between the 3D volume and the 2D projection. The measure is based on the distance map computed from the vascular segmentation. Particle Filters are used to resample the hypothesis, and direct them toward the feature space’s zones of maximum likelihood. Promising experimental results demonstrate the potentials of the method.


Magnetic Resonance Angiography Digital Subtraction Angiography Gradient Descent Particle Filter Portal Image 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Bansal, R., Staib, L.H., Chen, Z., Rangarajan, A., Knisely, J., Nath, R., Duncan, J.S.: Entropy-based, multiple -portal-to-3dct registration for prostate radiotherapy using iteratively estimated segmentation. In: Taylor, C., Colchester, A. (eds.) MICCAI 1999. LNCS, vol. 1679, pp. 567–578. Springer, Heidelberg (1999)CrossRefGoogle Scholar
  2. 2.
    Bates, D.M., Watts, D.G.: Nonlinear regression and its applications. Wiley, New York (1988)zbMATHCrossRefGoogle Scholar
  3. 3.
    Bijhold, J., van Herk, M., Vijlbrief, R., Lebesque, J.V.: Fast evaluation of patient set-up during radiotherapy by aligning features in portal and simulator images. Physics in Medicine and Biology 36(12), 1665–1679 (1991)CrossRefGoogle Scholar
  4. 4.
    Byrne, J.V., Colominas, C., Hipwell, J., Cox, T., Noble, J.A., Penney, G.P., Hawkes, D.J.: Assessment of a technique for 2d-3d registration of cerebral intra-arterial angiography. British Journal of Radiology 77, 123–128 (2004)CrossRefGoogle Scholar
  5. 5.
    Dong, L., Boyer, A.L.: An image correlation procedure for digitally reconstructed radiographs and electronic portal images. International Journal of Radiation Oncology Biology Physics 33(5), 1053–1060 (1995)CrossRefGoogle Scholar
  6. 6.
    Doucet, A., de Freitas, J., Gordon, N.: Sequential Monte Carlo Methods in Practice. Springer, New York (2001)zbMATHGoogle Scholar
  7. 7.
    Fearnhead, P., Clifford, P.: Online inference for well-log data. Journal of the Royal Statistical Society 65, 887–899 (2003)zbMATHCrossRefMathSciNetGoogle Scholar
  8. 8.
    Fitzgibbon, A.: Robust registration of 2d and 3d point sets. In: British Machine Vision Conference, vol. II, pp. 411–420 (September 2001)Google Scholar
  9. 9.
    Gordon, N.: Novel Approach to Nonlinear/Non-Gaussian Bayesian State Estimation. IEE Proceedings 140, 107–113 (1993)Google Scholar
  10. 10.
    Gordon, N.: On Sequential Monte Carlo Sampling Methods for Bayesian Filtering. Statistics and Computing 10, 197–208 (2000)CrossRefGoogle Scholar
  11. 11.
    Gordon, N.: A Tutorial on Particle Filters for On-line Non-linear/Non-Gaussian Bayesian Tracking. IEEE Transactions on Signal Processing 50, 174–188 (2002)CrossRefGoogle Scholar
  12. 12.
    Hristov, D.H., Fallone, B.G.: A grey-level image alignment algorithm for registration of portal images and digitally reconstructed radiographs. Medical physics 23(1), 75–84 (1996)CrossRefGoogle Scholar
  13. 13.
    Kita, Y., Wilson, D., Noble, J.A.: Real-time registration of 3d cerebral vessels to x-ray angiograms. In: Wells, W.M., Colchester, A.C.F., Delp, S.L. (eds.) MICCAI 1998. LNCS, vol. 1496, pp. 1125–1133. Springer, Heidelberg (1998)Google Scholar
  14. 14.
    LaRose, D.: Iterative X-ray/CT Registration Using Accelerated Volume Rendering. PhD thesis, Robotics Institute, Carnegie Mellon University, Pittsburgh, PA (May 2001)Google Scholar
  15. 15.
    Maintz, J., Viergever, M.: A Survey for Medical Image Registration. Medical Image Analysis 2, 1–36 (1998)CrossRefGoogle Scholar
  16. 16.
    McLauglin, R.A., Hipwell, J., Penney, G.P., Rhode, K., Chung, A., Noble, J.A., Hawkes, D.J.: Intensity-based registration versus feature-based registration for neurointerventions. In: Proc. Medical Image Understanding and Analysis (MIUA), pp. 69–72 (2001)Google Scholar
  17. 17.
    Penney, G.P., Weese, J., Little, J.A., Desmedt, P., Hill, D.L.G., Hawkes, D.J.: A comparison of similarity measures for use in 2d-3d medical image registration. IEEE Trans. Med. Imaging 17(4), 586–595 (1998)CrossRefGoogle Scholar
  18. 18.
    Plattard, D., Champleboux, G., Vassal, P., Troccaz, J., Bolla, M.: Epid for patient positioning in radiotherapy: calibration and image matching in the entropid system. In: Lemke, H. (ed.) Cars, pp. 265–269 (1999)Google Scholar
  19. 19.
    Roche, A., Malandain, G., Pennec, X., Ayache, N.: The correlation ratio as a new similarity measure for multimodal image registration. In: Wells, W.M., Colchester, A.C.F., Delp, S.L. (eds.) MICCAI 1998. LNCS, vol. 1496, p. 1115. Springer, Heidelberg (1998)Google Scholar
  20. 20.
    Rohlfing, T., Russakoff, D.B., Murphy, M.J., Maurer Jr., C.R.: Intensity-based registration algorithm for probabilistic images and its application for 2-D to 3-D image registration. In: Sonka, M., Fitzpatrick, J.M. (eds.) Proceedings of the SPIE. Medical Imaging: Image Processing, vol. 4684, pp. 581–591 (February 2002)Google Scholar
  21. 21.
    Stewart, C.V., Tsai, C.-L., Roysam, B.: The dual bootstrap iterative closest point algorithm with application to retinal image registration. IEEE Trans. Med. Imaging 22(11), 1379–1394 (2003)CrossRefGoogle Scholar
  22. 22.
    Tomazevic, D., Likar, B., Slivnik, T., Pernus, F.: 3-d/2-d registration of ct and mr to x-ray images. IEEE Trans. Med. Imaging 22(11), 1407–1416 (2003)CrossRefGoogle Scholar
  23. 23.
    Viola, P., Wells, W.: Aligment by Maximization of Mutual Information. In: ICCV, pp. 16–23 (1995)Google Scholar
  24. 24.
    West, W.: Modelling with mixtures. In: Bernardo, J., Berger, J., Dawid, A., Smith, A. (eds.) Bayesian Statistics. Clarendon Press, Oxford (1993)Google Scholar
  25. 25.
    Wilson, D.L., Royston, D.D., Noble, J.A., Byrne, J.V.: Automatic determination of optimal x-ray projections for use during endovascular treatments of intracranial aneurysms. IEEE Transactions on Medical Imaging 18(10), 973–980 (1999)CrossRefGoogle Scholar
  26. 26.
    Zöllei, L., Grimson, W.E.L., Norbash, A., III Weiis, W.M.: 2d-3d rigid registration of x-ray fluoroscopy and ct images using mutual information and sparsely sampled histogram estimators. In: CVPR (2), pp. 696–703 (2001)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2005

Authors and Affiliations

  • Charles Florin
    • 2
  • James Williams
    • 2
  • Ali Khamene
    • 2
  • Nikos Paragios
    • 1
  1. 1.Ecole Nationale des Ponts et ChausseesFrance
  2. 2.Imaging & Visualization DepartmentSiemens Corporate ResearchPrincetonUSA

Personalised recommendations