Abstract
We consider the problem of tracking a given set of point features over large sequences of image frames. A classic procedure for monitoring the tracking quality consists in requiring that the current features nicely warp towards their reference appearances. The procedure recommends focusing on features projected from planar 3D patches (planar features), by enforcing a conservative threshold on the residual of the difference between the warped current feature and the reference. However, in some important contexts, there are many features for which the planarity assumption is only partially satisfied, while the true planar features are not so abundant. This is especially true when the motion of the camera is mainly translational and parallel to the optical axis (such as when driving a car along straight sections of the road), which induces a permanent increase of the apparent feature size. Tracking features containing occluding boundaries then becomes an interesting goal, for which we propose a multi-scale monitoring solution striving to maximize the lifetime of the feature, while also detecting the tracking failures. The devised technique infers the parts of the reference which are not projected from the same 3D surface as the patch which has been consistently tracked until the present moment. The experiments on real sequences taken from cars driving through urban environments show that the technique is effective in increasing the average feature lifetimes, especially in sequences with occlusions and large photometric variations.
The presented work has been performed within the french national project Predit Mobivip, and within the project Robea Bodega. The authors would also like to acknowledge Prof. Axel Pinz for a helpful discussion on this subject.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Faugeras, O.D., Maybank, S.: Motion from point matches: multiplicity of solutions. Int. J. Comput. Vis. 4, 225–246 (1990)
Nistér, D., Naroditsky, O., Bergen, J.: Visual odometry. In: Proc. of CVPR, pp. 652–659. IEEE, Washington (2004)
Davison, A.: Real-time simultaneous localisation and mapping with a single camera. In: Proc. of ICCV, Nice, France, pp. 1403–1410 (2003)
Malis, E., Chaumette, F., Boudet, S.: 2 1/2 D visual servoing. IEEE Trans. RA 15, 234–246 (1999)
Shi, J., Tomasi, C.: Good features to track. In: Proc. of CVPR, pp. 593–600 (1994)
Jin, H., Favaro, P., Soatto, S.: Real-time feature tracking and outlier rejection with changes in illumination. In: Proc. of ICCV, vol. 1, pp. 684–689 (2001)
Ma, Y., Soatto, S., Košecká, J., Sastry, S.: An Invitation to 3-D Vision: From Images to Geometric Models. Springer, New York (2004)
Baker, S., Matthews, I.: Lucas-Kanade 20 years on: A unifying framework. Int. J. Comput. Vis. 56, 221–255 (2004)
Kenney, C., Manjunath, B., Zuliani, M., Hewer, G., van Nevel, A.: A condition number for point matching with application to registration and postregistration error estimation. IEEE Trans. PAMI 25, 1437–1454 (2003)
Odobez, J.M., Bouthemy, P.: Robust multiresolution estimation of parametric motion models. J. Vis. Commun. Image R 6, 348–365 (1995)
Arnaud, E., Mémin, E., Cernuschi-Frias, B.: Conditional filters for image sequence based tracking - application to point tracking. IEEE Trans. IP 14, 63–79 (2005)
Matthews, I., Ishikawa, T., Baker, S.: The template update problem. In: Proc. of British Machine Vision Conference (2003)
Nguyen, H.T., Smeulders, A.W.M.: Fast occluded object tracking by a robust appearance filter. IEEE Trans. PAMI 26, 1099–1104 (2004)
Darrell, T., Covell, M.: Correspondence with cumulative similarity transforms. IEEE Trans. PAMI 23, 222–227 (2001)
Loutas, E., Diamantaras, K., Pitas, I.: Occlusion resistant object tracking. In: Proc. of ICIP, pp. II:65–68 (2001)
Stauffer, C., Grimson, W.: Adaptive background mixture models for real-time tracking. In: Proc. of CVPR, pp. II:246–252. IEEE, Los Alamitos (1999)
Fusiello, A., Trucco, E., Tommasini, T., Roberto, V.: Improving feature tracking with robust statistics. Pattern Anal. Appl. 2, 312–320 (1999)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Šegvić, S., Remazeilles, A., Chaumette, F. (2006). Enhancing the Point Feature Tracker by Adaptive Modelling of the Feature Support. In: Leonardis, A., Bischof, H., Pinz, A. (eds) Computer Vision – ECCV 2006. ECCV 2006. Lecture Notes in Computer Science, vol 3952. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11744047_9
Download citation
DOI: https://doi.org/10.1007/11744047_9
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-33834-5
Online ISBN: 978-3-540-33835-2
eBook Packages: Computer ScienceComputer Science (R0)