Advertisement

Camera Pose Estimation Using Images of Planar Mirror Reflections

  • Rui Rodrigues
  • João P. Barreto
  • Urbano Nunes
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6314)

Abstract

The image of a planar mirror reflection (IPMR) can be interpreted as a virtual view of the scene, acquired by a camera with a pose symmetric to the pose of the real camera with respect to the mirror plane. The epipolar geometry of virtual views associated with different IPMRs is well understood, and it is possible to recover the camera motion and perform 3D scene reconstruction by applying standard structure-from-motion methods that use image correspondences as input. In this article we address the problem of estimating the pose of the real camera, as well as the positions of the mirror plane, by assuming that the rigid motion between N virtual views induced by planar mirror reflections is known. The solution of this problem enables the registration of objects lying outside the camera field-of-view, which can have important applications in domains like non-overlapping camera network calibration and robot vision. We show that the positions of the mirror planes can be uniquely determined by solving a system of linear equations. This enables to estimate the pose of the real camera in a straightforward closed-form manner using a minimum of N = 3 virtual views. Both synthetic tests and real experiments show the superiority of our approach with respect to current state-of-the-art methods.

Keywords

Planar Motion Planar Mirror Rigid Transformation Virtual View Static Camera 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

References

  1. 1.
    Baker, S., Nayar, S.K.: A theory of single-viewpoint catadioptric image formation. Int. Journal of Computer Vision 35(2), 175–196 (1999)CrossRefGoogle Scholar
  2. 2.
    Goshtasby, A., Gruver, W.: Design of a single-lens stereo camera system. Pattern Recognition (1993)Google Scholar
  3. 3.
    Inaba, M., Hara, T., Inoue, H.: A stereo viewer based on a single camera with view-controlmechanisms. In: Intelligent Robots and Systems (1993)Google Scholar
  4. 4.
    Ramsgaard, B., Balslev, I., Arnspang, J.: Mirror-based trinocular systems in robot-vision. Pattern Recognition 4, 499–502 (2000)Google Scholar
  5. 5.
    Gluckman, J., Nayar, S.: Catadioptric stereo using planar mirrors. IJCV (2001)Google Scholar
  6. 6.
    Hartley, R., Zisserman, A.: Multiple View Geometry in Computer Vision. Cambridge University Press, New York (2003)Google Scholar
  7. 7.
    Ma, Y., Soatto, S., Kosecka, J., Sastry, S.S.: An Invitation to 3-D Vision: From Images to Geometric Models. Springer, Heidelberg (2003)Google Scholar
  8. 8.
    Hesch, J., Mourikis, A., Roumeliotis, S.: Determining the camera to robot-body transformation from planar mirror reflections. In: IROS (2008)Google Scholar
  9. 9.
    Mariottini, G., Scheggi, S., Morbidi, F.: Planar catadioptric stereo: Single and multi-view geometry for calibration and localization. In: ICRA (2009)Google Scholar
  10. 10.
    Sturm, P., Bonfort, T.: How to compute the pose of an object without a direct view? In: ACCV, vol. II, pp. 21–31 (2006)Google Scholar
  11. 11.
    Kumar, R., Ilie, A., Frahm, J.M., Pollefeys, M.: Simple calibration of non-overlapping cameras with a mirror. In: CVPR, pp. 1–7 (2008)Google Scholar
  12. 12.
    Murray, R.M., Sastry, S.S., Zexiang, L.: A Mathematical Introduction to Robotic Manipulation. CRC Press, Inc, Boca Raton (1994)zbMATHGoogle Scholar
  13. 13.
    Golub, G.H., Van Loan, C.F.: Matrix computations, 3rd edn. Johns Hopkins Univ. Press, Baltimore (1996)zbMATHGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2010

Authors and Affiliations

  • Rui Rodrigues
    • 1
  • João P. Barreto
    • 1
  • Urbano Nunes
    • 1
  1. 1.Institute of Systems and Robotics, Dept. of Electrical and Computer EngineeringUniversity of CoimbraCoimbraPortugal

Personalised recommendations