Feature-Driven Direct Non-Rigid Image Registration
- 478 Downloads
The direct registration problem for images of a deforming surface has been well studied. Parametric flexible warps based, for instance, on the Free-Form Deformation or a Radial Basis Function such as the Thin-Plate Spline, are often estimated using additive Gauss-Newton-like algorithms. The recently proposed compositional framework has been shown to be more efficient, but cannot be directly applied to such non-groupwise warps.
Our main contribution in this paper is the Feature-Driven framework. It makes possible the use of compositional algorithms for most parametric warps such as those above mentioned. Two algorithms are proposed to demonstrate the relevance of our Feature-Driven framework: the Feature-Driven Inverse Compositional and the Feature-Driven Learning-based algorithms. As another contribution, a detailed derivation of the Feature-Driven warp parameterization is given for the Thin-Plate Spline and the Free-Form Deformation. We experimentally show that these two types of warps have a similar representational power. Experimental results show that our Feature-Driven registration algorithms are more efficient in terms of computational cost, without loss of accuracy, compared to existing methods.
KeywordsDirect registration Inverse compositional image alignment Deformable model
Unable to display preview. Download preview PDF.
- Agarwal, A., & Triggs, B. (2006). Recovering 3D human pose from monocular images. IEEE Transactions on Pattern Analysis and Machine Intelligence 28(1). Google Scholar
- Bartoli, A., & Zisserman, A. (2004). Direct estimation of non-rigid registrations. In Proceedings of the British machine vision conference. Google Scholar
- Benhimane, S., & Malis, E. (2004). Real-time image-based tracking of planes using efficient second-order minimization. In Proceedings of the international conference on intelligent robots and systems. Google Scholar
- Bregler, C., Hertzmann, A., & Biermann, H. (2000). Recovering non-rigid 3D shape from image streams. In: Proceedings of the international conference on computer vision and pattern recognition Google Scholar
- Charpiat, G., Faugeras, O., & Keriven, R. (2005). Image statistics based on diffeomorphic matching. In Proceedings of the international conference on computer vision. Google Scholar
- Cootes, T. F., Edwards, G. J., & Taylor, C. J. (1998). Active appearance models. In Proceedings of the European conference on computer vision. Google Scholar
- Cootes, T. F., Marsland, S., Twining, C. J., Smith, K., & Taylor, C. J. (2004). Groupwise diffeomorphic non-rigid registration for automatic model building. In Proceedings of the European conference on computer vision. Google Scholar
- Fornefett, M., Rohr, K., & Stiehl, H. (1999). Elastic registration of medical images using radial basis functions with compact support. In Proceedings of the international conference on computer vision and pattern recognition. Google Scholar
- Gay-Bellile, V., Perriollat, M., Bartoli, A., & Sayd, P. (2006). Image registration by combining thin-plate splines with a 3D morphable model. In Proceedings of the international conference on image processing. Google Scholar
- Gay-Bellile, Bartoli A. V, & Sayd, P. (2007). Feature-driven direct non-rigid image registration. In Proceedings of the British machine vision conference. Google Scholar
- Georgel, P., Benhimane, S., & Nassir, N. (2008). A unified approach combining photometric and geometric information for pose estimation. In Proceedings of the British machine vision conference. Google Scholar
- Haber, E., & Modersitzki, J. (2006). Intensity gradient based registration and fusion of multi-modal images. In S. Berlin (Ed.), Lecture notes in computer science: Vol. 4191. Proceedings of the medical image computing and computer-assisted intervention (pp. 726–733). Google Scholar
- Lim, J., & Yang, M. H. (2005). A direct method for non-rigid motion with thin-plate spline. In Proceedings of the international conference on computer vision and pattern recognition. Google Scholar
- Meyer, C. R., Boes, J. L., Kim, B., Bland, P. H., Zasadny, K. R., Kison, P. V., Koral, K., Frey, K. A., & Wahl, R. L. (1997). Demonstration of accuracy and clinical versatility of mutual information for automatic multimodality image fusion using affine and thin-plate spline warped geometric deformations. Medical Image Analysis, 1(3), 195–206. CrossRefGoogle Scholar
- Pilet, J., Lepetit, V., & Fua, P. (2005). Real-time non-rigid surface detection. In Proceedings of the international conference on computer vision and pattern recognition. Google Scholar
- Pizarro, D., & Bartoli, A. (2007). Shadow resistant direct image registration. In Proceedings of the Scandinavian conference on image analysis (pp. 928–937). Google Scholar
- Romdhani, S., & Vetter, T. (2003). Efficient, robust and accurate fitting of a 3D morphable model. In Proceedings of the international conference on computer vision. Google Scholar
- Torr, P. H. S., & Zisserman, A. (1999). Feature based methods for structure and motion estimation. In Workshop on vision algorithms: theory and practice. Google Scholar