Advertisement

International Journal of Computer Vision

, Volume 68, Issue 3, pp 219–237 | Cite as

Automated Alignment of Robotic Pan-Tilt Camera Units Using Vision

  • Joss Knight
  • Ian Reid
Article

Abstract

In this paper we show how to carry out an automatic alignment of a pan-tilt camera platform with its natural coordinate frame, using only images obtained from the cameras during controlled motion of the unit. An active camera in aligned orientation represents the zero position for each axis, and allows axis odometry to be referred to a fixed reference frame; such referral is otherwise only possible using mechanical means, such as end-stops, which cannot take account of the unknown relationship between the camera coordinate frame and its mounting. The algorithms presented involve the calculation of two-view transformations (homographies or epipolar geometry) between pairs of images related by controlled rotation about individual head axes. From these relationships, which can be calculated linearly or optimised iteratively, an invariant line to the motion can be extracted which represents an aligned viewing direction. We present methods for general and degenerate motion (translating or non-translating), and general and degenerate scenes (non-planar and planar, but otherwise unknown), which do not require knowledge of the camera calibration, and are resistant to lens distortion non-linearity.Detailed experimentation in simulation, and in real scenes, demonstrate the speed, accuracy, and robustness of the methods, with the advantages of applicability to a wide range circumstances and no need to involve calibration objects or complex motions. Accuracy of within half a degree can be achieved with a single motion, and we also show how to improve on this by incorporating images from further motions, using a natural extension of the basic algorithm.

Keywords

alignment active vision calibration 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Armstrong, M.N. 1996. Self-calibration from Image Sequences. Ph.D. thesis, University of Oxford.Google Scholar
  2. Beardsley, P.A. and Zisserman, A. 1995. Affine Calibration of Mobile Vehicles. In R. Mohr and W. Chengke (Eds.): Proc. Joint Europe-China Workshop on Geometrical Modelling and Invariants for Computer Vision, Xi’an, China.Google Scholar
  3. Davison, A. 1998. Mobile robot navigation using active vision. Ph.D. thesis, Robotics Research Group, Oxford University Department of Engineering Science.Google Scholar
  4. DeSouza, G.N., Jones, A.J., and Kak, A.C. 2002. A world independent approach for the calibration of mobile robotics active stereo heads. In Proc. IEEE Int’l Conf. on Robotics and Automation, vol. 4. Washington, pp. 3336–3341.Google Scholar
  5. Harris, C.G. and Stephens, M. 1988. A combined corner and edge detector. In Proc. 4th Alvey Vision Conf., Manchester. pp. 147–151.Google Scholar
  6. Hartley, R.I. and Zisserman, A. 2000. Multiple View Geometry in Computer Vision. Cambridge University Press.Google Scholar
  7. Hayman, E., Knight, J., and Murray, D.W. 2000. Self-alignment of an active head from observations of rotation matrices. In Proc. 15th IEEE Int’l Conf. on Pattern Recognition, vol. 1. Barcelona, pp. 80–84.Google Scholar
  8. Horaud, R. and Csurka, G. 1998. Self-calibration and euclidean reconstruction using motions of a stereo rig. In Proc. 6th Int’l Conf. on Computer Vision, Bombay. pp. 96–103.Google Scholar
  9. Knight, J. 2002. Towards fully autonomous mobile robot navigation. Ph.D. thesis, Robotics Research Group, Oxford University Department of Engineering Science.Google Scholar
  10. Knight, J. and Reid, I. 2000a. Active visual alignment of a mobile stereo camera platform. In Proc. IEEE Int’l Conf. on Robotics and Automation, Vol.4. San Francisco, pp. 3203–3208.Google Scholar
  11. Knight, J. and Reid, I. 2000b. Binocular self-alignment and calibration from planar scenes. In Vernon, D. Ed.): Proc. 6th European Conference on Computer Vision, Dublin. pp. II:462–476.Google Scholar
  12. Knight, J., Zisserman, A., and Reid, I. 2003. Linear auto-calibration for ground plane motion. In Proc. IEEE Conf. on Computer vision and Pattern Recognition, Madison, Wisconsin.18–20 June, pp. I:503–510.Google Scholar
  13. Li, M. 1998. Kinematic calibration of an active head-eye system. IEEE Transactions on Robotics and Automation 14(1):153–157.CrossRefGoogle Scholar
  14. Ma, S.D. 1996. A self-calibration technique for active vision systems. IEEE Trans. Robotics and Automation 12(1):114–120.CrossRefGoogle Scholar
  15. Maybank, S.J. 1993. Theory of Reconstruction from Image Motion. Springer-Verlag Berlin.Google Scholar
  16. McLauchlan, P.F. and Murray, D.W. 1996. Active camera calibration for a head-eye platform using the variable state-dimension filter. IEEE Transactions on Pattern Analysis and Machine Intelligence 18(1):15–21.CrossRefGoogle Scholar
  17. Murray, D.W., Reid, I.D., and Davison, A.J. 1996. Steering and navigation behaviours using fixation. In Proc. 7th British Machine Vision Conf., pp. Edinburgh. 635–644.Google Scholar
  18. Murray, D.W., Reid, I.D., and Davison, A.J. 1997. Steering without representation using active fixation. Perception 26(12):1519–1528.Google Scholar
  19. Reid, I.D. and Beardsley, P.A. 1996. Self-alignment of a binocular head. Image and Vision Computing 14(8):635–640.CrossRefGoogle Scholar
  20. Sampson, P.D. 1982. Fitting conic sections to ‘very scattered’ data: An iterative refinement of the Bookstein algorithm. Computer Vision, Graphics, and Image Processing 18:97–108.CrossRefGoogle Scholar
  21. Sharkey, P.M., Murray, D.W., Vandevelde, S., Reid, I.D., and McLauchlan, P.F. 1993. A modular head/eye platform for real-time reactive vision. Mechatronics 3(4):517–535.CrossRefGoogle Scholar
  22. Tordoff, B. and Murray, D.W. 2000. Violating rotating camera geometry: The effect of radial distortion on self-calibration. In Proc. 15th IEEE Int’l Conf. on Pattern Recognition, vol. 1. Barcelona, pp. 423–427.Google Scholar
  23. Torr, P.H.S. and Zisserman, A. 2000. MLESAC: A new robust estimator with application to estimating image geometry. Computer Vision and Image Understanding 78(1), 138–156.CrossRefGoogle Scholar
  24. Viéville, T. and Lingrand, D. 1996. Using singular displacements for uncalibrated monocular vision systems. In Proc. 4th European Conf. on Computer Vision, Cambridge. pp. II:207–216.Google Scholar
  25. Zisserman, A., Beardsley, P.A., and Reid, I.D. 1995. Metric Calibration of a stereo rig. In Proc. IEEE Workshop on Representations of Visual Scenes, in conjunction with ICCV’95, Cambridge, MA. pp. 93–100.Google Scholar

Copyright information

© Springer Science + Business Media, LLC 2006

Authors and Affiliations

  1. 1.Active Vision Lab, Robotics Research Group, Department of Engineering ScienceUniversity of OxfordOxfordUK

Personalised recommendations