Abstract
The fundamental task of visual tracking is considered in this work as a direct image registration problem. Direct methods refer to those that exploit the pixel intensities without intermediate steps, e.g., no extraction of image features. This article proposes new photogeometric transformation models and nonlinear optimization methods for directly registering central omnidirectional images. The proposed models ensure robustness to arbitrary illumination changes, as well as encompass all classes of projective deformations of planar objects within those images. Experimental results show that visual tracking can indeed be highly robust and accurate even for this type of vision systems.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Bagnato, L., Frossard, P., Vandergheynst, P.: A variational framework for structure from motion in omnidirectional image sequences. J. Math. Imaging Vis. (2011)
Baker, S., Nayar, K.: A theory of single-viewpoint catadioptric image formation. Int. J. Comput. Vis. 35(2), 1–22 (1999)
Barreto, J., Araujo, H.: Issues on the geometry of central catadioptric image formation. In: IEEE Computer Vision and Pattern Recognition, pp. 422–427 (2001)
Demonceaux, C., Vasseur, P.: Omnidirectional image processing using geodesic metric. In: Proc. of the International Conference on Image Processing (2009)
Gasparini, S., Sturm, P., Barreto, J.: Plane-based calibration of central catadioptric cameras. In: Proc. of the International Conference on Computer Vision (2009)
Geyer, C., Daniilidis, K.: A unifying theory for central panoramic systems and practical applications. In: Proc. of the European Conference on Computer Vision, pp. 445–461 (2000)
Hadj-Abdelkader, H., Mezouar, Y., Andreff, N., Martinet, P.: 2 1/2 D visual servoing with central catadioptric cameras. In: Proc. of the IEEE/RSJ Int. Conf. on Intell. Robot and Systems (2005)
Horst, R., Pardalos, P.M. (eds.): Handbook of Global Optimization. Kluwer, Dordrecht (1995)
Huber, P.J.: Robust Statistics. Wiley, New York (1981)
Maintz, J.B., Viergever, M.A.: A survey of medical image registration. Med. Image Anal. 2(1), 1–36 (1998)
Mei, C., Benhimane, S., Malis, E., Rives, P.: Efficient homography-based tracking and 3-D reconstruction for single-viewpoint sensors. IEEE Trans. Robot. 24(6), 1352–1364 (2008)
Mei, C., Rives, P.: Single view point omnidirectional camera calibration from planar grids. In: Proc. of the IEEE International Conference on Robotics and Automation (2007)
Puig, L., Sturm, P., Guerrero, J.J.: Hybrid homographies and fundamental matrices mixing uncalibrated omnidirectional and conventional cameras. Mach. Vis. Appl. (2012)
Salazar-Garibay, A., Malis, E., Mei, C.: Visual tracking of planes with an uncalibrated central catadioptric camera. In: Proc. of the IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 2999–3004 (2009)
Silveira, G., Malis, E.: Unified direct visual tracking of rigid and deformable surfaces under generic illumination changes in grayscale and color images. Int. J. Comput. Vis. 89(1), 84–105 (2010)
Warner, F.W.: Foundations of Differential Manifolds and Lie Groups. Springer, Berlin (1987)
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Silveira, G. Photogeometric Direct Visual Tracking for Central Omnidirectional Cameras. J Math Imaging Vis 48, 72–82 (2014). https://doi.org/10.1007/s10851-012-0393-4
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10851-012-0393-4