Abstract
Corresponding image points of a rigid object in a discrete sequence of images fulfil the so-called multilinear constraint. In this paper the continuous time analogue of this constraint, for a continuous stream of images, is introduced and studied. The constraint links the Taylor series expansion of the motion of the image points with the Taylor series expansion of the relative motion and orientation between the object and the camera. The analysis is done both for calibrated and uncalibrated cameras. Two simplifications are also presented for the uncalibrated camera case. One simplification is made using an affine reduction and the so-called kinetic depths. The second simplification is based upon a projective reduction with respect to the image of a planar configuration. The analysis shows that the constraint involving second-order derivatives are needed to determine camera motion. Experiments with real and simulated data are also presented.
Similar content being viewed by others
References
Åström, K. 1993. Automatic mapmaking. In Selected Papers from the 1st IFAC International Workshop on Intelligent Autonomous Vehicles, D. Charnley (Ed.), Pergamon Press: Southampton, UK, pp. 181-186.
Åström, K., Cipolla, R., and Giblin, P.J. 1996. Generalised epipolar constraints. In Proc. 4th European Conf. on Computer Vision, Cambridge, UK, pp. 97-108.
Åström, K. and Heyden, A. 1996. Multilinear forms in the velocity case. In Proc. Computer Vision and Pattern Recognition, San Fransisco, CA, USA, pp. 833-838.
Blom, J. 1992. Topological and geometrical aspects of image structure. Ph.D. thesis, Department of Medical and Physiological Physics, University of Utrecht, Utrecht, The Netherlands.
Faugeras, O.D. 1992. What can be seen in three dimensions with an uncalibrated stereo rig? In Proc. 2nd European Conf. on Computer Vision, G. Sandini (Ed.), Springer: Verlag, Santa Margherita Ligure, Italy, pp. 563-578.
Faugeras, O. 1993. Three-Dimensional Computer Vision.MIT Press: Cambridge, MA.
Faugeras, O. and Mourrain, B. 1995. On the geometry and algebra of the point and line correspon between n imagesdences. In Proc. 5th Int. Conf. on Computer Vision, MIT: Boston, MA, pp. 951- 956.
Heyden, A. 1995. Reconstruction from image sequences by means of relative depths. In Proc. 5th Int. Conf. on Computer Vision, MIT: Boston, MA, pp. 1058-1063.
Heyden, A. and Åström, K. 1995. A canonical framework for sequences of images. In Proc. IEEE workshop on Representation of Visual Scenes, MIT: Cambridge, MA, USA, pp. 45- 52.
Heyden, A. and Åström, K. 1997. Simplifications of multilinear forms for sequences of images. Image and Vision Computing, 15:749-757.
Longuet-Higgins, H.C. 1981. A computer algorithm for reconstructing a scene from two projections. Nature, 293:133-135.
Luong, Q. and Vieville, T. 1994. Canonic representations for the geometries of multiple projective views. In Proc. 3rd European Conf. on Computer Vision, Stockholm, Sweden, pp. 589- 599.
Shashua, A. and Navab, N. 1996. Relative affine structure: Canonical model for 3D from 2D geometry and applications. IEEE Trans. Pattern Anal. Machine Intell., 18(9):873-883.
Sparr, G. 1994. A common framework for kinetic depth, reconstruction and motion for deformable objects. In Proc. 3rd European Conf. on Computer Vision, Stockholm, Sweden, pp. 471-482.
Stefanovic, P. 1973. Relative orientation: Anewappraoch. ITC Journal, 3:417-448.
Triggs, B. 1995. Matching constraints and the joint image. In Proc. 5th Int. Conf. on Computer Vision, MIT: Boston, MA, pp. 338- 343.
Vieville, T. and Faugeras, O.D. 1995. Motion analysis with a camera with unknown and possibly varying intrinsic parameters. In Proc. 5th Int. Conf. on Computer Vision, MIT: Boston, MA, pp. 750-756.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Åström, K., Heyden, A. Continuous Time Matching Constraints for Image Streams. International Journal of Computer Vision 28, 85–96 (1998). https://doi.org/10.1023/A:1008006815607
Issue Date:
DOI: https://doi.org/10.1023/A:1008006815607