An efficient combination of 2D and 3D shape descriptions for contour based tracking of moving objects
Tracking the 2D contour of a moving object has widely been used in the past years. So called active contour models have been proven to be a promising approach to real-time tracking of deformable objects. Also tracking 2D contours, which are projections of rigid 3D objects, is reduced to tracking deformable 2D contours. There, the deformations of the contour are caused by the movement in 3D and the changing perspective to the camera.
In this paper a combination of 2D and 3D shape descriptions is presented, which can be applied to the prediction of changes in 2D contours, which are caused by movement in 3D. Only coarse 3D knowledge is provided, which is automatically acquired in a training step. Then, the reconstructed 3D model of the object is used to predict the shape of the 2D contour. Thus, limitations of the contour point search in the image is possible, which reduces the errors in the contour extraction caused by heterogenous background.
The experimental part shows, that the proposed combination of 2D and 3D shape descriptions is efficient and accurate with respect to real-time contour extraction and tracking.
KeywordsActive Contour Active Contour Model Contour Point Deformable Object Visual Hull
- 1.M. Berger. Tracking rigid and non polyhedral objects in an image sequence. In Scandinavian Conference on Image Analysis, pages 945–952, Tromso (Norway), 1993.Google Scholar
- 2.R. Beß. Objekterkennung mit dem Extended Gaussian Image. Technical report, Diploma thesis, Lehrstuhl für Mustererkennung (Informatik 5), Universität Erlangen-Nürnberg, Erlangen, 1993.Google Scholar
- 5.R. Curwen and A. Blake. Dynamic contours: Real-time active splines. In A. Blake and A. Yuille, editors, Active Vision, pages 39–58. MIT Press, Cambridge, 1992.Google Scholar
- 6.J. Denzler. Active Vision for Real-Time Object Tracking. Dissertation, Technische Fakultät, Universität Erlangen-Nürnberg, Erlangen, in preparation, 1997.Google Scholar
- 8.J. Denzler and H. Niemann. Real-time pedestrian tracking in natural scenes. In G. Sommer, K. Daniliidis, and J. Pauli, editors, Computer Analysis of Images and Patterns, CAIP'97, Kiel 1997, pages 42–49, Berlin, 1997. Lecture Notes in Computer Science.Google Scholar
- 10.C. Harris. Tracking with rigid models. In A. Blake and A. Yuille, editors, Active Vision, pages 59–74. MIT Press, Cambridge, 1992.Google Scholar
- 12.K.F. Lai and R.T. Chin. Deformable contours: Modelling and extraction. IEEE Transactions on Pattern Analysis and Machine Intelligence, 15(1): 1–20, 1996.Google Scholar
- 15.S. A. Nene, S. K. Nayar, and H. Murase. Columbia object image library (coil-20), 1996. http://www.cs.columbia.edu/CAVE/coil-20.html.Google Scholar
- 19.D. Terzopoulos and R. Szeliski. Tracking with Kalman snakes. In A. Blake and A. Yuille, editors, Active Vision, pages 3–20. MIT Press, Cambridge, 1992.Google Scholar