Structure from Motion Using Rigidly Coupled Cameras without Overlapping Views

  • Sandro Esquivel
  • Reinhard Koch
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8142)


Structure from Motion can be improved by using multi-camera systems without overlapping views to provide a large combined field of view. The extrinsic calibration of such camera systems can be computed from local reconstructions using hand-eye calibration techniques. Nevertheless these approaches demand that motion constraints resulting from the rigid coupling of the cameras are satisfied which is in general not the case for decoupled pose estimation. This paper presents an extension to Structure from Motion using multiple rigidly coupled cameras that integrates rigid motion constraints already into the local pose estimation step, based on dual quaternions for pose representation. It is shown in experiments with synthetic and real data that the overall quality of the reconstruction process is improved and pose error accumulation is counteracted, leading to more accurate extrinsic calibration.


Augmented Reality Bundle Adjustment Unit Quaternion Structure From Motion Motion Constraint 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Caspi, Y., Irani, M.: Alignment of non-overlapping sequences. International Journal of Computer Vision 48(1), 39–51 (2002)CrossRefMATHGoogle Scholar
  2. 2.
    Chen, H.H.: A screw motion approach to uniqueness analysis of head-eye geometry. In: Computer Vision and Pattern Recognition, CVPR 1991, pp. 145–151 (1991)Google Scholar
  3. 3.
    Daniilidis, K.: Hand-eye calibration using dual quaternions. International Journal of Robotics Research 18, 286–298 (1999)CrossRefGoogle Scholar
  4. 4.
    Dornaika, F., Chung, C.K.R.: Stereo geometry from 3d ego-motion streams. IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics 33(2), 308–323 (2003)Google Scholar
  5. 5.
    Esquivel, S., Woelk, F., Koch, R.: Calibration of a multi-camera rig from non-overlapping views. In: Hamprecht, F.A., Schnörr, C., Jähne, B. (eds.) DAGM 2007. LNCS, vol. 4713, pp. 82–91. Springer, Heidelberg (2007)CrossRefGoogle Scholar
  6. 6.
    Hartley, R.I., Zisserman, A.: Multiple View Geometry in Computer Vision, 2nd edn. Cambridge University Press (2004)Google Scholar
  7. 7.
    Kim, J.H., Li, H., Hartley, R.I.: Motion estimation for nonoverlapping multicamera rigs: Linear algebraic and l  ∞  geometric solutions. IEEE Transactions on Pattern Analysis and Machine Intelligence 32(6), 1044–1059 (2010)Google Scholar
  8. 8.
    Kim, J.H., Chung, M.J.: Absolute motion and structure from stereo image sequences without stereo correspondence and analysis of degenerate cases. Pattern Recognition 39(9), 1649–1661 (2006)Google Scholar
  9. 9.
    Klein, G., Murray, D.: Parallel tracking and mapping for small AR workspaces. In: 6th IEEE and ACM International Symposium on Mixed and Augmented Reality, ISMAR 2007 (2007)Google Scholar
  10. 10.
    Kuipers, J.B.: Quaternions and rotation sequences. In: International Conference on Geometry. In: International Conference on Geometry, Integrability and Quantization, GEOM 1999, pp. 127–143 (1999)Google Scholar
  11. 11.
    Lébraly, P., Royer, E., Ait-Aider, O., Deymier, C., Dhome, M.: Fast calibration of embedded non-overlapping cameras. In: IEEE International Conference on Robotics and Automation, Shanghai, China, pp. 221–227 (May 2011)Google Scholar
  12. 12.
    Luong, Q.T., Faugeras, O.: Self-calibration of a stereo rig from unknown camera motions and point correspondences (1993)Google Scholar
  13. 13.
    Moré, J.J.: The Levenberg-Marquardt algorithm: Implementation and theory. Numerical Analysis 630, 105–116 (1978)CrossRefGoogle Scholar
  14. 14.
    Schmidt, J., Niemann, H.: Using quaternions for parametrizing 3-d rotations in unconstrained nonlinear optimization. In: Vision, Modeling, and Visualization, VMV 2001, Stuttgart, Germany, pp. 399–406 (2001)Google Scholar
  15. 15.
    Shao, L., Walker, M.W.: Estimating 3-d location parameters using dual number quaternions. In: Computer Vision, Graphics, and Image Processing (CVGIP): Image Understanding, vol. 54 (3), pp. 358–367 (1991)Google Scholar
  16. 16.
    Tomasi, C., Kanade, T.: Detection and tracking of point features. Tech. Rep. CMU-CS-91-132, Carnegie Mellon University (1991)Google Scholar
  17. 17.
    Tsai, R.Y., Lenz, R.K.: A new technique for fully autonomous and efficient 3d robotics hand/eye calibration. IEEE Transactions on Robotics and Automation 5(3), 345–358 (1989)CrossRefGoogle Scholar
  18. 18.
    Weng, J., Huang, T.S.: Complete structure and motion from two monocular sequences without stereo correspondence. In: International Conference on Pattern Recognition, ICPR 1992, pp. 651–654 (1992)Google Scholar
  19. 19.
    Zisserman, A., Beardsley, P.A., Reid, I.D.: Metric calibration of a stereo rig. In: IEEE Workshop on Representations of Visual Scenes, pp. 16–23 (1995)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2013

Authors and Affiliations

  • Sandro Esquivel
    • 1
  • Reinhard Koch
    • 1
  1. 1.Christian-Albrechts-UniversityKielGermany

Personalised recommendations