Abstract
We developped a fully automated algorithmic chain for the tracking of polyhedral objects with no manual intervention. It uses a multi-cameras calibrated system and the 3D model of the observed object.
The initial phase of the tracking is done according to an automatic location process using graph theoretical methods. The originality of the approach resides mainly in the fact that compound structures (triple junction and planar faces with four vertices) are used to construct the graphs describing scene and model. The association graph construction and the search of maximal cliques are greatly simplified in this way. The final solution is selected among the maximal cliques by a predictionverification scheme.
During the tracking process, it is noticeable that our model based approach does not use triangulation although the basis of the multi-ocular system is available. The knowledge of calibration parameters (extrinsic as well as intrinsic) of the cameras enables to express the various equations related to each images shot in one common reference system. The aim of this paper is to prove that model based methods are not bound to monocular schemes but can be used in various multi-ocular situations in which they can improve the overall robustness.
Chapter PDF
Similar content being viewed by others
Keywords
References
M. Anderson and P. Nordlund. A model based system for localization and tracking. In Workshop on Computer Vision for Space Applications, pages 251–260, September 1993.
N. Ayache. Vision stéréoscopique et perception multisensorielle. InterEditions, Science Informatique, 1989.
S.T. Barnard. Choosing a basis for perceptual space. Computer Vision Graphics and Image Processing, 29(1):87–99, 1985.
P. Braud, M. Dhome, and J.-T. Lapresté. Reconnaissance d'objets polyédriques par vision multi-oculaire. In 10ème Congrès Reconnaissance des Formes et Intelligence Artificielle, Rennes, France, January 1996.
P. Braud, M. Dhome, J.T. Lapresté, and N. Daucher. Modelled object pose estimation and tracking by a multi-cameras system. In Int. Conf., on Computer Vision and Pattern Recognition, pages 976–979, Seattle, Washington, June 1994.
P. Braud. Reconnaissance, localisation et suivi d'objets polyédriques modélisés par vision multi-oculaire. PhD thesis, Université Blaise Pascal de Clermont-Ferrand, France, January 1996.
R.T. Chin and C.R. Dyer. Model-based recognition in robot vision. ACM Computing Surveys, 18(1):67–108, March 1986.
R. Deriche and T. Blaszka. Recovering and characterizing image features using an efficient model based approach. In Int. Conf. on Computer Vision and Pattern Recognition, pages 530–535, New-York, June 1993.
N. Daucher, M. Dhome, J.T. Lapresté, and G. Rives. Modelled object pose estimation and tracking by monocular vision. In British Machine Vision Conference, volume 1, pages 249–258, October 1993.
M. Dhome, M. Richetin, J.T. Lapresté, and G. Rives. Determination of the attitude of 3d objets from a single perspective image. IEEE Trans. on Pattern Analysis and Machine Intelligence, 11(12):1265–1278, December 1989.
O.D. Faugeras. Three Dimensional Computer Vision: A Geometric View-Point, chapter 12. MIT Press, Boston, 1993.
M.A. Fischler and R.C. Bolles. Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography. Com. of the ACM, 24(6):381–395, June 1981.
D.B. Gennery. Tracking of known three-dimensional objects. International Journal of Computer Vision, 7(3):243–270, April 1992.
W.E.L. Grimson. On the recognition of parameterized 2d objects. International Journal of Computer Vision, 2(4):353–372, 1989.
R. Horaud, B. Conio, O. Leboulleux, and B. Lacoll. An analytic solution for the perspective 4 points problem. In Computer Vision Graphics and Image Processing, 1989.
R. Horaud. New methods for matching 3-d objects with single perspective view. IEEE Trans. on Pattern Analysis and Machine Intelligence, 9(3):401–412, May 1987.
C.G. Harris and M. Stephens. A combined corner and edge detector. In Fourth Alvey Vision Conference, pages 189–192, Manchester, United Kingdom, August 1988.
D.P. Huttenlocher and S. Ullman. Recognizing solid objects by alignment with an image. International Journal of Computer Vision, 5(2): 195–212, 1990.
T. Kanade. Recovery of the three dimensional shape of an object from a single view. Artificial Intelligence, Special Volume on Computer Vision, 17(1–3), August 1981.
D.G. Lowe. Perceptual Organization and Visual Recognition, chapter 7. Kluwer Academic Publishers, Boston, 1985.
C.F. Olson. Time and space efficient pose clustering. In Int. Conf. on Computer Vision and Pattern Recognition, pages 251–258, Seattle, Washington, June 1994.
S.B. Pollard, J. Porrill, J. Mayhew, and J. Frisby. Matching geometrical descriptions in three space. Image and Vision Computing, 5(2):73–78, 1987.
P. Rives, P. Bouthemy, B. Prasada, and E. Dubois. Recovering the orientation and position of a rigid body in space from a single view. Technical report, INRS-Télécommunications, 3, place du commerce, Ile-des-soeurs, Verdun, H3E 1H6, Quebec, Canada, 1981.
P. Reis. Vision Monoculaire pour la Navigation d'un Robot Mobile dans un Univers Partiellement Modélisé. PhD thesis, Université Blaise Pascal de Clermont-Ferrand, March 1991.
T. Shakunaga and H. Kaneko. Perspective angle transform and its application to 3-d configuration recovery. In Int. Conf. on Computer Vision and Pattern Recognition, pages 594–601, Miami Beach, Florida, June 1986.
T. Skordas. Mise en correspondance et reconstruction stéréo utilisant une description structurelle des images. PhD thesis, Institut National Polytechnique de Grenoble, October 1988.
Z. Zhang, R. Deriche, O. Faugeras, and Q.-T. Luong. A robust technique for matching two uncalibrated images through the recovery of the unknown epipolar geometry. Technical Report 2273, INRIA Sophia-Antipolis, France, May 1994.
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 1996 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Braud, P., Lapresté, J.T., Dhome, M. (1996). Recognition, pose and tracking of modelled polyhedral objects by multi-ocular vision. In: Buxton, B., Cipolla, R. (eds) Computer Vision — ECCV '96. ECCV 1996. Lecture Notes in Computer Science, vol 1065. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-61123-1_160
Download citation
DOI: https://doi.org/10.1007/3-540-61123-1_160
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-61123-3
Online ISBN: 978-3-540-49950-3
eBook Packages: Springer Book Archive