Article

Autonomous Robots

, Volume 34, Issue 1, pp 35-45

Real-time visuomotor update of an active binocular head

  • Michael SapienzaAffiliated withDepartment of Systems and Control Engineering, University of Malta Email author 
  • , Miles HansardAffiliated withSchool of Electronic Engineering and Computer Science, Queen Mary, University of London
  • , Radu HoraudAffiliated withINRIA Grenoble Rhône-Alpes

Rent the article at a discount

Rent now

* Final gross prices may vary according to local VAT.

Get Access

Abstract

In order for a binocular head to perform optimal 3D tracking, it should be able to verge its cameras actively, while maintaining geometric calibration. In this work we introduce a calibration update procedure, which allows a robotic head to simultaneously fixate, track, and reconstruct a moving object in real-time. The update method is based on a mapping from motor-based to image-based estimates of the camera orientations, estimated in an offline stage. Following this, a fast online procedure is presented to update the calibration of an active binocular camera pair. The proposed approach is ideal for active vision applications because no image-processing is needed at runtime for the scope of calibrating the system or for maintaining the calibration parameters during camera vergence. We show that this homography-based technique allows an active binocular robot to fixate and track an object, whilst performing 3D reconstruction concurrently in real-time.

Keywords

Real-time vision Active binocular vision Visual tracking 3D reconstruction