Skip to main content

Stereo Vision Based Obstacle Avoidance on Flapping Wing MAVs

  • Conference paper
Advances in Aerospace Guidance, Navigation and Control

Abstract

One of the major challenges in robotics is to develop a fly-like robot that can autonomously fly around in unknown environments. State-of-the-art research on autonomous flight of light-weight flapping wing MAVs uses information such as optic flow and appearance variation extracted from a single camera, and has met with limited success. This paper presents the first study of stereo vision for onboard obstacle detection. Stereo vision provides instantaneous distance estimates making the method less dependent than single camera methods on the camera motions resulting from the flapping. After hardware modifications specifically tuned to use on a flapping wing MAV, the computationally efficient Semi-Global Matching (SGM) algorithm in combination with off-board processing allows for accurate real-time distance estimation. Closed-loop indoor experiments with the flapping wing MAV DelFly II demonstrate the advantage of this technique over the use of optic flow measurements.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 259.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 329.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 329.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Griffiths, S., Saunders, J., et al.: Obstacle and Terrain Avoidance for Miniature Aerial Vehicles. In: Advances in Unmanned Aerial Vehicles (2007), doi:10.1007/978-1-4020-6114-1_7

    Google Scholar 

  2. Kownacki, C.: Guidance and obstacle avoidance of MAV in uncertain urban environment (2009), http://www.emav2009.org/EMAV_final_papers/EMAV2009_papers.html (cited October 1, 2012)

  3. Hines, L., Arabagi, V., Sitti, M.: Free flight simulations and pitch and roll control experiments of a sub-gram flapping-flight micro aerial vehicle. In: IEEE ICRA, pp. 1–7 (2011)

    Google Scholar 

  4. Lin, S., Hsiao, F., et al.: Altitude control of flapping-wing mav using vision-based navigation. In: IEEE ICRA, pp. 3644–3650 (2009)

    Google Scholar 

  5. Duhamel, P.E., Perez-Arancibia, N., et al.: Altitude feedback control of a flapping-wing microrobot using an on-board biologically inspired optical flow sensor. In: IEEE ICRA, pp. 4228–4235 (2012)

    Google Scholar 

  6. Beak, S., Fearing, R.: Flight forces and altitude regulation of 12 gram i-bird. In: IEEE RAS and EMBS Int. Conf. on Biomedical Robotics and Biomechatronics (BioRob), pp. 454–460 (2010)

    Google Scholar 

  7. Beak, S., Garcia Bermudez, F., Fearing, R.: Flight control for target seeking by 13 gram ornithopter. In: IEEE/RSJ Int. Conf. on Intelligent Robots and Systems (2011)

    Google Scholar 

  8. Garcia Bermudez, F., Fearing, R.: Optical flow on a flapping wing robot (Tech. Rep.) (2009), http://www.eecs.berkeley.edu/~fgb/pubs.shtml (cited October 1, 2012)

  9. Tedrake, R., Jackowski, Z., et al.: Learning to fly like a bird (Tech. Rep.) (2006), http://groups.csail.mit.edu/robotics-center/public_papers/Tedrake09.pdf (cited October 1, 2012)

  10. de Croon, G., de Clerq, K., et al.: Design, aerodynamics, and vision-based control of the Delfly. The Int. J. on MAVs 1(2), 71–97 (2009)

    Google Scholar 

  11. de Croon, G., de Weerdt, E., et al.: The appearance variation cue for obstacle avoidance. IEEE Transactions on Robotics 28(2), 529–534 (2012)

    Article  Google Scholar 

  12. de Croon, G., Groen, M., et al.: Design, aerodynamics, and autonomy of the Delfly. Bioinspiration and Biomimetics 7(2) (2012)

    Google Scholar 

  13. Scharstein, D., Szeliski, R.: A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms. International Journal for Computer Vision 47(1-3), 7–42 (2002)

    Article  MATH  Google Scholar 

  14. Tombari, F., Mattoccia, S., Di Stefano, L.: Classification and evaluation of cost aggregation methods for stereo correspondence. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–8 (2008)

    Google Scholar 

  15. Christian, B., Hesselbarth, S., Flatt, H., Blume, H., Pirsch, P.: Real-Time Stereo Vision System using Semi-Global Matching Disparity Estimation: Architecture and FPGA-Implementation. In: International Conference on Embedded Computer Systems, pp. 93–101 (2010)

    Google Scholar 

  16. Gehrig, S.K., Everli, F., Meyer, T.: Real-Time Semi-Global Matching on the CPU. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, pp. 85–92 (2010)

    Google Scholar 

  17. Chen, B., Chen, H.: A realization of semi-global matching stereo algorithm on GPU for real-time application. In: MIPPR 2011: Pattern Recognition and Computer Vision (2011)

    Google Scholar 

  18. Hirschmüller, H.: Stereo processing by Semi-Global matching and mutual information. IEEE Trans. Pattern Anal. Machine Intell. 30(2), 328–341 (2008)

    Article  Google Scholar 

  19. Barnich, O., van Droogenbroeck, M.: Vibe: A universal background subtraction algorithm for video sequences. IEEE Transactions on Image Processing 20(6), 1709–1724 (2011)

    Article  MathSciNet  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Sjoerd Tijmons .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2013 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Tijmons, S. et al. (2013). Stereo Vision Based Obstacle Avoidance on Flapping Wing MAVs. In: Chu, Q., Mulder, B., Choukroun, D., van Kampen, EJ., de Visser, C., Looye, G. (eds) Advances in Aerospace Guidance, Navigation and Control. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-38253-6_28

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-38253-6_28

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-38252-9

  • Online ISBN: 978-3-642-38253-6

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics