Generalized Thin-Plate Spline Warps
- 452 Downloads
The Thin-Plate Spline warp has been shown to be a very effective parameterized model of the optic flow field between images of various types of deformable surfaces, such as a paper sheet being bent. Recent work has also used such warps for images of a smooth and rigid surface. Standard Thin-Plate Spline warps are however not rigid, in the sense that they do not comply with the epipolar geometry. They are also intrinsically affine, in the sense of the affine camera model, since they are not able to simply model the effect of perspective projection.
We propose three types of warps based on the Thin-Plate Spline. The first one is a rigid flexible warp. It describes the optic flow field induced by a smooth and rigid surface, and satisfies the affine epipolar geometry constraint. The second and third proposed warps extend the standard Thin-Plate Spline warp and the proposed rigid flexible warp to the perspective camera model. The properties of these warps are studied in details and a hierarchy is defined. Experimental results on simulated and real data are reported.
KeywordsThin-plate spline Deformable surface Image warp Perspective projection Rigidity Fundamental matrix
Unable to display preview. Download preview PDF.
- Bartoli, A., & Zisserman, A. (2004). Direct estimation of non-rigid registrations. In British machine vision conference. Google Scholar
- Blanz, V., & Vetter, T. (2003). Face recognition based on fitting a 3D morphable model. IEEE Transactions on Pattern Analysis and Machine Intelligence, 25(9). Google Scholar
- Bregler, C., Hertzmann, A., & Biermann, H. (2000). Recovering non-rigid 3D shape from image streams. In International conference on computer vision and pattern recognition. Google Scholar
- Brunet, F., Bartoli, A., Malgouyres, R., & Navab, N. (2009). NURBS warps. In British machine vision conference. Google Scholar
- Cootes, T. F., Marsland, S., Twining, C. J., Smith, K., & Taylor, C. J. (2004). Groupwise diffeomorphic non-rigid registration for automatic model building. In European conference on computer vision. Google Scholar
- Donato, G., & Belongie, S. (2002). Approximate thin-plate spline mappings. In European conference on computer vision. Google Scholar
- Gay-Bellile, V., Bartoli, A., & Sayd, P. (2009). Direct estimation of non-rigid registrations with image-based self-occlusion reasoning. IEEE Transactions on Pattern Analysis and Machine Intelligence. To appear. Google Scholar
- Hartley, R. I., & Zisserman, A. (2003). Multiple view geometry in computer vision (2nd ed.). Cambridge: Cambridge University Press. Google Scholar
- Irani, M., Anandan, P., & Cohen, M. (1999). Direct recovery of planar-parallax from multiple frames. In Proceedings of the international workshop on vision algorithms: theory and practice. Google Scholar
- Lim, J., & Yang, M.-H. (2005). A direct method for non-rigid motion with thin-plate spline. In International conference on computer vision and pattern recognition. Google Scholar
- Masson, L., Dhome, M., & Jurie, F. (2005). Tracking 3D objects using flexible models. In British machine vision conference. Google Scholar
- Moreno, A., Delso, G., Camara, O., & Bloch, I. (2006). Non-linear registration between 3D images including rigid objects: Application to CT and PET lung images with tumors. In Workshop on image registration in deformable environments (DEFORM) at BMVC. Google Scholar
- Perriollat, M., & Bartoli, A. (2006). A single directrix quasi-minimal model for paper-like surfaces. In Workshop on image registration in deformable environments (DEFORM) at BMVC. Google Scholar
- Prasad, M., Zisserman, A., & Fitzgibbon, A. (2006). Single view reconstruction of curved surfaces. In International conference on computer vision and pattern recognition. Google Scholar
- Schaefer, S., McPhail, T., & Warren, J. (2006). Image deformation using moving least squares. In SIGGRAPH. Google Scholar
- Sederberg, T. W., & Parry, S. R. (1986). Free-form deformation of solid geometric models. In SIGGRAPH. Google Scholar
- Wills, J., & Belongie, S. (2004). A feature-based approach for determining dense long range correspondences. In European conference on computer vision. Google Scholar
- Yang, A. Y., Rao, S., Wagner, A., & Ma, Y. (2005). Segmentation of a piece-wise planar scene from perspective images. In International conference on computer vision and pattern recognition. Google Scholar