Extrinsic Camera Calibration Using Multiple Reflections

  • Joel A. Hesch
  • Anastasios I. Mourikis
  • Stergios I. Roumeliotis
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6314)


This paper presents a method for determining the six-degree-of-freedom (DOF) transformation between a camera and a base frame of interest, while concurrently estimating the 3D base-frame coordinates of unknown point features in the scene. The camera observes the reflections of fiducial points, whose base-frame coordinates are known, and reconstruction points, whose base-frame coordinates are unknown. In this paper, we examine the case in which, due to visibility constraints, none of the points are directly viewed by the camera, but instead are seen via reflection in multiple planar mirrors. Exploiting these measurements, we analytically compute the camera-to-base transformation and the 3D base-frame coordinates of the unknown reconstruction points, without a priori knowledge of the mirror sizes, motions, or placements with respect to the camera. Subsequently, we refine the analytical solution using a maximum-likelihood estimator (MLE), to obtain high-accuracy estimates of the camera-to-base transformation, the mirror configurations for each image, and the 3D coordinates of the reconstruction points in the base frame. We validate the accuracy and correctness of our method with simulations and real-world experiments.


Mobile Robot Maximum Likelihood Estimator Base Frame Camera Frame Pixel Noise 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. 1.
    Merritt, E.L.: Explicitly three-point resection in space. Photogrammetric Engineering XV, 649–655 (1949)Google Scholar
  2. 2.
    Fischler, M.A., Bolles, R.C.: Random sample consensus: A paradigm for model fitting with applicatlons to image analysis and automated cartography. Communications of the ACM 24, 381–395 (1981)CrossRefMathSciNetGoogle Scholar
  3. 3.
    Haralick, R.M., Lee, C.N., Ottenberg, K., Nölle, M.: Review and analysis of solutions of the three point perspective pose estimation problem. Int. Journal of Computer Vision 13, 331–356 (1994)CrossRefGoogle Scholar
  4. 4.
    Gluckman, J., Nayar, S.K.: Planar catadioptric stereo: Geometry and calibration. In: Proc. of the IEEE Conf. on Computer Vision and Pattern Recognition, Ft. Collins, CO, pp. 22–28 (1999)Google Scholar
  5. 5.
    Jang, G., Kim, S., Kweon, I.: Single camera catadioptic stereo system. In: Proc. of the Workshop on Omnidirectional Vision, Camera Networks and Non-classical Cameras, Beijing, China (2005)Google Scholar
  6. 6.
    Ramsgaard, B.K., Balslev, I., Arnspang, J.: Mirror-based trinocular systems in robot-vision. In: Proc. of the IEEE Conf. on Computer Vision and Pattern Recognition, Barcelona, Spain, pp. 499–502 (2000)Google Scholar
  7. 7.
    Nayar, S.K.: Sphereo: Determining depth using two specular spheres and a single camera. In: Proc. of the SPIE Conf. on Optics, Illumination, and Image Sensing for Machine Vision, pp. 245–254 (1988)Google Scholar
  8. 8.
    Jang, K.H., Lee, D.H., Jung, S.K.: A moving planar mirror based approach for cultural reconstruction. Computer Animation and Virtual Worlds 15, 415–423 (2004)CrossRefGoogle Scholar
  9. 9.
    Kumar, R.K., Ilie, A., Frahm, J.M., Pollefeys, M.: Simple calibration of non-overlapping cameras with a mirror. In: Proc. of the IEEE Conf. on Computer Vision and Pattern Recognition, Anchorage, AK (2008)Google Scholar
  10. 10.
    Hesch, J.A., Mourikis, A.I., Roumeliotis, S.I.: Mirror-based extrinsic camera calibration. In: Proc. of the Int. Workshop on the Algorithmic Foundations of Robotics, Guanajuato, Mexico, pp. 285–299 (2008)Google Scholar
  11. 11.
    Hesch, J.A., Mourikis, A.I., Roumeliotis, S.I.: Determining the camera to robot-body transformation from planar mirror reflections. In: Proc. of the IEEE/RSJ Int. Conf. on Intelligent Robots and Systems, Nice, France, pp. 3865–3871 (2008)Google Scholar
  12. 12.
    Bouguet, J.Y.: Camera calibration toolbox for matlab (2006)Google Scholar
  13. 13.
    Shi, J., Tomasi, C.: Good features to track. In: Proc. of the IEEE Conf. on Computer Vision and Pattern Recognition, Washington, DC, pp. 593–600 (1994)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2010

Authors and Affiliations

  • Joel A. Hesch
    • 1
  • Anastasios I. Mourikis
    • 2
  • Stergios I. Roumeliotis
    • 1
  1. 1.University of MinnesotaMinneapolisUSA
  2. 2.University of CaliforniaRiversideUSA

Personalised recommendations