Structure Estimation and Surface Triangulation of Deformable Objects
A system is developed that from an image sequence of a deformable object automatically extracts features and tracks them through the sequence, estimates the non-rigid 3D structure and finally computes a surface triangulation. Also the camera motion is acquired. The object is supposed to deform according to a linear model, while the motion of the camera can be arbitrary. No domain specific prior of the object is required.
For the structure estimation a two-step approach is used, where we first obtain an initial estimate of the structure and motion, and then obtain an optimal solution via a non-linear optimization scheme. The triangulation is optimized to yield a non-rigid faceted surface that well approximates the true 3D surface.
- 1.H. Aanæs and F. Kahl. Estimation of deformable structure and motion. Workshop on Vision and Modelling of Dynamic Scenes, ECCV’02, Copenhagen, Denmark, 2002.Google Scholar
- 2.H. Aanæs and F. Kahl. Estimation of deformable structure and motion. Technical report, Centre for Mathematical Sciences, Lund University, January 2002.Google Scholar
- 4.C. Bregler, A. Hertzmann, and H. Biermann. Recovering non-rigid 3d shape from image streams. Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662), pages 690–6 vol.2, 2000.Google Scholar
- 6.J.D. Foley, A. van Dam, S.K. Feiner and J.F. Hughes Computer Graphics: Principles and Practice in C (2nd Edition). Addison-Wesley Pub Co., 1995.Google Scholar
- 8.M. Irani. Multi-frame optical flow estimation using subspace constraints. IEEE International Conference on Computer Vision (ICCV), Corfu, September 1999Google Scholar
- 9.A. Lanitis, C.J. Taylor and T.F. Cootes. Automatic interpretation of human faces and hand gestures using flexible models. In International Workshop on Automatic Face-and Gesture-Recognition, 1995Google Scholar
- 10.B. Lucas and T. Kanade An iterative image registration technique with an application to stereo vision. Proceedings 7th International Joint Conference on Artificial Intelligence, 1981Google Scholar
- 11.D.D. Morris and T. Kanade. Image-consistent surface triangulation. IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000, vol 1, pp 332–338, 2000.Google Scholar
- 12.H. Sidenbladh, M. J. Black, and D. J. Fleet. Stochastic tracking of 3d human figures using 2d image motion. In European Conf, Computer Vision’2000, volume 2, pages 702–718, 2000.Google Scholar
- 13.C.C. Slama, editor. Manual of Photogrammetry. American Society of Photogrammetry, Falls Church, VA, 4:th edition, 1984.Google Scholar
- 14.C. Sminchisescu and B. Triggs. Covariance scaled sampling for monocular 3d body tracking. In IEEE Conf. Computer Vision and Pattern Recognition’2001, volume I, pages 447–454, 2001.Google Scholar
- 16.L. Torresani, D.B. Yang, E.J. Alexander, and C. Bregler. Tracking and modeling non-rigid objects with rank constraints. Computer Vision and Pattern Recognition, 2001. CVPR 2001. Proceedings of the 2001 IEEE Computer Society Conference on, 1:493–500, 2001.Google Scholar