Autonomous Robots

, Volume 34, Issue 1–2, pp 47–71

How to localize humanoids with a single camera?

  • Pablo F. Alcantarilla
  • Olivier Stasse
  • Sebastien Druon
  • Luis M. Bergasa
  • Frank Dellaert


In this paper, we propose a real-time vision-based localization approach for humanoid robots using a single camera as the only sensor. In order to obtain an accurate localization of the robot, we first build an accurate 3D map of the environment. In the map computation process, we use stereo visual SLAM techniques based on non-linear least squares optimization methods (bundle adjustment). Once we have computed a 3D reconstruction of the environment, which comprises of a set of camera poses (keyframes) and a list of 3D points, we learn the visibility of the 3D points by exploiting all the geometric relationships between the camera poses and 3D map points involved in the reconstruction. Finally, we use the prior 3D map and the learned visibility prediction for monocular vision-based localization. Our algorithm is very efficient, easy to implement and more robust and accurate than existing approaches. By means of visibility prediction we predict for a query pose only the highly visible 3D points, thus, speeding up tremendously the data association between 3D map points and perceived 2D features in the image. In this way, we can solve very efficiently the Perspective-n-Point (PnP) problem providing robust and fast vision-based localization. We demonstrate the robustness and accuracy of our approach by showing several vision-based localization experiments with the HRP-2 humanoid robot.


Vision-based localization Visibility prediction Humanoid robots Locally weighted learning Bundle adjustment 

Supplementary material

(MPG 35.3 MB)

(MPG 5.1 MB)

(MPG 10.0 MB)

(MPG 9.8 MB)

(MPG 37.2 MB)

(MPG 35.6 MB)

(MPG 18.9 MB)

(MPG 11.0 MB)

(MPG 21.1 MB)

(MPG 9.3 MB)

(MPG 4.7 MB)

10514_2012_9312_MOESM12_ESM.ppt (869 kb)
(PPT 869 kB)

Copyright information

© Springer Science+Business Media, LLC 2012

Authors and Affiliations

  • Pablo F. Alcantarilla
    • 1
  • Olivier Stasse
    • 2
  • Sebastien Druon
    • 3
  • Luis M. Bergasa
    • 4
  • Frank Dellaert
    • 5
  1. 1.ISIT-UMR 6284 CNRSUniversité d’AuvergneClermont FerrandFrance
  2. 2.LAASCNRSToulouseFrance
  3. 3.LIRMMUniversity Montpellier IIMontpellierFrance
  4. 4.Department of ElectronicsUniversity of AlcaláMadridSpain
  5. 5.School of Interactive ComputingGeorgia Institute of TechnologyAtlantaUSA

Personalised recommendations