Markerless Visual Control of a Quad-Rotor Micro Aerial Vehicle by Means of On-Board Stereo Processing

  • Konstantin Schauwecker
  • Nan Rosemary Ke
  • Sebastian Andreas Scherer
  • Andreas Zell
Conference paper
Part of the Informatik aktuell book series (INFORMAT)


We present a quad-rotor micro aerial vehicle (MAV) that is capable to fly and navigate autonomously in an unknown environment. The only sensory input used by the MAV are the imagery from two cameras in a stereo configuration, and data from an inertial measurement unit. We apply a fast sparse stereo matching algorithm in combination with a visual odometry method based on PTAM to estimate the current MAV pose, which we require for autonomous control. All processing is performed on a single board computer on-board the MAV. To our knowledge, this is the first MAV that uses stereo vision for navigation, and does not rely on visual markers or off-board processing. In a flight experiment, the MAV was capable to hover autonomously, and it was able to estimate its current position at a rate of 29 Hz and with an average error of only 2.8 cm.


Inertial Measurement Unit Stereo Vision Stereo Match Visual Odometry Micro Aerial Vehicle 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. Achtelik, M., Weiss, S., Siegwart, R.: Onboard IMU and monocular vision based control for MAVs in unknown in-and outdoor environments. In: IEEE International Conference on Robotics and Automation (ICRA), pp. 3056–3063 (2011)Google Scholar
  2. Achtelik, M., Zhang, T., Kuhnlenz, K., Buss, M.: Visual tracking and control of a quadcopter using a stereo camera system and inertial sensors. In: IEEE International Conference on Mechatronics and Automation (ICMA), pp. 2863–2869 (2009)Google Scholar
  3. Brown, D.C.: Decentering distortion of lenses. Photogram. Eng. 7, 444–462 (1966)Google Scholar
  4. Carrillo, L.R.G., López, A.E.D., Lozano, R., Pégard, C.: Combining stereo vision and inertial navigation system for a quad-rotor UAV. J. Intell. Rob. Syst. 65(1), 373–387 (2012)CrossRefGoogle Scholar
  5. Heng, L., Meier, L., Tanskanen, P., Fraundorfer, V., Pollefeys, M.: Autonomous obstacle avoidance and maneuvering on a vision-guided MAV using on-board processing. In: IEEE International Conference on Robotics and Automation (ICRA), pp. 2472–2477 (2011)Google Scholar
  6. Klein, G., Murray, D.: Parallel tracking and mapping for small AR workspaces. In: IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR), pp. 1–10 (2007)Google Scholar
  7. Meier, L., Tanskanen, P., Heng, L., Lee, G., Fraundorfer, F., Pollefeys, M.: PIXHAWK: A micro aerial vehicle design for autonomous flight using onboard computer vision. Auton. Robots. pp. 1–19 (2012)Google Scholar
  8. Pebrianti, D., Kendoul, F., Azrad, S., Wang, W., Nonami, K.: Autonomous hovering and landing of a quad-rotor micro aerial vehicle by means of on ground stereo vision system. J. Syst. Des. Dyn. 4(2), 269–284 (2010)Google Scholar
  9. Scherer, S.A., Dube, D., Zell, A.: Using depth in visual simultaneous localisation and mapping. IEEE International Conference on Robotics and Automation (ICRA), Forthcoming, In (2012)Google Scholar
  10. Schauwecker, K., Klette, R., Zell, A.: A new feature detector and stereo matching method for accurate high-performance sparse stereo matching. IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Submitted, In (2012)Google Scholar
  11. Schauwecker, K., Zell, A.: Faster FAST corners by using SIMD instructions. European Conference on Computer Vision (ECCV), Submitted, In (2012)Google Scholar
  12. Tournier, G.P., Valenti, M., How, J.P., Feron, E.: Estimation and control of a quadrotor vehicle using monocular vision and moiré patterns. In: AIAA Guidance, Navigation and Control Conference, pp. 2006–6711 (2006)Google Scholar
  13. Wenzel, K.E., Zell, A.: Low-Cost visual tracking of a landing place and hovering flight control with a microcontroller. In: Kimon, P. Valavanis. (eds.) International Symposium on Unmanned Aerial Vehicles (UAV), pp. 1–15 (2009)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2012

Authors and Affiliations

  • Konstantin Schauwecker
    • 1
  • Nan Rosemary Ke
    • 1
  • Sebastian Andreas Scherer
    • 1
  • Andreas Zell
    • 1
  1. 1.University of TübingenTübingenGermany

Personalised recommendations