Full Self-calibration of a Hand-Mounted Projector Using Structured Light

  • Christian S. Wieghardt
  • Bernardo Wagner
Conference paper
Part of the Lecture Notes in Electrical Engineering book series (LNEE, volume 370)


This paper describes two methods to determine the homogeneous transformation of a projector with respect to the robot hand. Since the projector itself has no exteroceptive capabilities, a camera is rigidly attached to the robot base or placed in the environment to detect the projected pattern. The camera’s extrinsic calibration parameters can be simultaneously solved, which is shown by the second method. Self-calibration implies that any kind of calibration tool may be omitted. For calibration, the robot hand has to make at least two movements around nonparallel rotational axes. At each robot configuration, correspondences between the camera and the projector are established to recover the transformation between them, up to an unknown scale factor. The system is described by the common known formulations \(\mathbf{AX }=\mathbf{XB }\) and \(\mathbf{AX }=\mathbf{ZB }\). Both can be arranged in a linear form with respect to the unknown extrinsic parameters and scale factors, and solved in least square sense. Further optimization allows to refine all intrinsic and extrinsic parameters.


Self-calibration Pattern projection Structured light system Motion estimation 


  1. 1.
    Andreff, N., Horaud, R., Espiau, B.: Robot hand-eye calibration using structure-from-motion. Int. J. Robot. Res. 20(3), 228–248 (2001)CrossRefGoogle Scholar
  2. 2.
    Brewer, J.W.: Kronecker products and matrix calculus in system theory. IEEE Trans. Circ. Syst., CAS-25(9), 772–781 (1978)Google Scholar
  3. 3.
    De Tommaso, D., Calinon, S., Caldwell, D.: Using compliant robots as projective interfaces in dynamic environments. Lect. Notes Comput. Sci. 7621, 338–347 (2012)CrossRefGoogle Scholar
  4. 4.
    Dornaika, F., Horaud, R.: Simultaneous robot-world and hand-eye calibration. IEEE Trans. Robot. Autom. 14(4), 617–622 (1998)CrossRefGoogle Scholar
  5. 5.
    Gavaghan, K., Peterhans, M., Oliveira-Santos, T., Weber, S.: A portable image overlay projection device for computer-aided open liver surgery. IEEE Trans. Biomed. Eng. 58(6), 1855–1864 (2011)CrossRefGoogle Scholar
  6. 6.
    Hartley, R.: In defense of the eight-point algorithm. IEEE Trans. Pattern Anal. Mach. Intell. 19(6), 580–593 (1997)CrossRefGoogle Scholar
  7. 7.
    Hartley, R., Zisserman, A.: Multiple View Geometry in Computer Vision (2000)Google Scholar
  8. 8.
    Lourakis, M.: levmar: Levenberg-marquardt nonlinear least squares algorithms in C/C++. (2004)
  9. 9.
    Moreno, D., Taubin, G.: Simple, accurate, and robust projector-camera calibration. In: Second International Conference on 3D Imaging, Modeling, Processing, Visualization and Transmission (3DIMPVT), pp. 464–471 (2012)Google Scholar
  10. 10.
    Reinhart, G., Vogl, W., Kresse, I.: A projection- based user interface for industrial robots. In: Proceedings of the 2007 IEEE International Conference on Virtual Environments Human-Computer Interfaces, and Measurement Systems, VECIMS 2007 (2007)Google Scholar
  11. 11.
    Salvi, J., Pags, J., Batlle, J.: Pattern codification strategies in structured light systems. Pattern Recogn. 37(4), 827–849 (2004)CrossRefzbMATHGoogle Scholar
  12. 12.
    Shiu, Y.C., Ahmad, S.: Calibration of wrist-mounted robotic sensors by solving homogeneous transform equations of the form ax = xb. IEEE Trans. Robot. Autom. 5(1), 16–29 (1989)CrossRefGoogle Scholar
  13. 13.
    Tsai, R.Y., Lenz, R.K.: New technique for fully autonomous and efficient 3d robotics hand/eye calibration. IEEE Trans. Robot. Autom. 5(3), 345–358 (1989)CrossRefGoogle Scholar
  14. 14.
    Zhang, S., Huang, P.: Novel method for structured light system calibration. Opt. Eng. 45(8) (2006)Google Scholar
  15. 15.
    Zhang, Z.: A flexible new technique for camera calibration. IEEE Trans. Pattern Anal. Mach. Intell. 22(11), 1330–1334 (2000)CrossRefGoogle Scholar
  16. 16.
    Zhuang, H., Roth, Z.S., Sudhakar, R.: Simultaneous robot/world and tool/flange calibration by solving homogeneous transformation equations of the form ax=yb. IEEE Trans. Robot. Autom. 10(4), 549–554 (1994)CrossRefGoogle Scholar

Copyright information

© Springer International Publishing Switzerland 2016

Authors and Affiliations

  1. 1.Institute for Systems Engineering, Real Time Systems GroupLeibniz Universität HannoverHannoverGermany

Personalised recommendations