Skip to main content

Quadruped robot trotting over irregular terrain assisted by stereo-vision

Intelligent Service Robotics volume 7, pages 67–77 (2014)Cite this article

Abstract

Legged robots have the potential to navigate in challenging terrain, and thus to exceed the mobility of wheeled vehicles. However, their control is more difficult as legged robots need to deal with foothold computation, leg trajectories and posture control in order to achieve successful navigation. In this paper, we present a new framework for the hydraulic quadruped robot HyQ, which performs goal-oriented navigation on unknown rough terrain using inertial measurement data and stereo-vision. This work uses our previously presented reactive controller framework with balancing control and extends it with visual feedback to enable closed-loop gait adjustment. On one hand, the camera images are used to keep the robot walking towards a visual target by correcting its heading angle if the robot deviates from it. On the other hand, the stereo camera is used to estimate the size of the obstacles on the ground plane and thus the terrain roughness. The locomotion controller then adjusts the step height and the velocity according to the size of the obstacles. This results in a robust and autonomous goal-oriented navigation over difficult terrain while subject to disturbances from the ground irregularities or external forces. Indoor and outdoor experiments with our quadruped robot show the effectiveness of this framework.

This is a preview of subscription content, access via your institution.

Access options

Buy single article

Instant access to the full article PDF.

USD 39.95

Price includes VAT (USA)
Tax calculation will be finalised during checkout.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16

References

  1. Artner NM (2008) A comparison of mean shift tracking methods. In: 12th Central European Seminar on computer graphics, pp 197–204

  2. Bajracharya M, Ma J, Malchano M, Perkins A, Rizzi A, Matthies L (2013) High fidelity day/night stereo mapping with vegetation and negative obstacle detection for vision-in-the-loop walking. In: Proceedings of the IEEE/RSJ International Conference on intelligent robots and systems (IROS), pp 3663–3670

  3. Barasuol V, Buchli J, Semini C, Frigerio M, De Pieri ER, Caldwell DG (2013) A reactive controller framework for quadrupedal locomotion on challenging terrain. In: 2013 IEEE International Conference on robotics and automation (ICRA)

  4. Bazeille S, Barasuol V, Focchi M, Havoutis I, Frigerio M, Buchli J, Semini C, Caldwell DG (2013) Vision enhanced reactive locomotion control for trotting on rough terrain. In: IEEE International Conference on technologies for practical robot applications (TePRA)

  5. Boaventura T, Semini C, Buchli J, Frigerio M, Focchi M, Caldwell DG (2012) Dynamic torque control of a hydraulic quadruped robot. In: Proceedings of the IEEE Int. Conference on robotics and automation (ICRA)

  6. Bradski G (1998) Computer video face tracking for use in a perceptual user interface. Intel Technol J 1:1–15

    Google Scholar 

  7. Chilian A, Hirschmuller H (2009) Stereo camera based navigation of mobile robots on rough terrain. In: Intelligent robots and systems (IROS) IEEE/RSJ International Conference on, pp 4571–4576

  8. Filitchkin P, Byl K (2012) Feature-based terrain classification for littledog. In: Intelligent robots and systems (IROS), 2012 IEEE/RSJ International Conference on, pp 1387–1392

  9. Focchi M, Barasuol V, Havoutis I, Buchli J, Semini C, Caldwell DG (2013) Local reflex generation for obstacle negotiation in quadrupedal locomotion. In: Int. Conf. on climbing and walking robots (CLAWAR)

  10. Fujita M, Kitano H (1998) Development of an autonomous quadruped robot for robot entertainment. Auton Robots 5(1):7–18

    Article  Google Scholar 

  11. Hartley R, Zisserman A (2000) Multiple view geometry in computer vision, vol 2. Cambridge Univ Press, Cambridge

    Google Scholar 

  12. Havoutis I, Semini C, Buchli J, Caldwell DG (2013) Quadrupedal trotting with active compliance. IEEE International Conference on mechatronics (ICM)

  13. Howard A (2008) Real-time stereo visual odometry for autonomous ground vehicles. In: Proceedings of the 2008 IEEE/RSJ International Conference on intelligent robots and systems (IROS), pp 3946–3952

  14. Ijspeert AJ (2008) 2008 special issue: central pattern generators for locomotion control in animals and robots: a review. Neural Netw 21(4):642–653

    Article  Google Scholar 

  15. Kalakrishnan M, Buchli J, Pastor P, Mistry M, Schaal S (2011) Learning, planning, and control for quadruped locomotion over challenging terrain. Int J Robot Res 30(2):236–258

    Article  Google Scholar 

  16. Kolter JZ, Youngjun K, Ng AY (2009) Stereo vision and terrain modeling for quadruped robots. In: IEEE International Conference robotics and automation (ICRA) on, pp 1557–1564

  17. Lowe DG (2004) Distinctive image features from scale-invariant keypoints. Int J Computer Vis 60(2):91–110

    Article  Google Scholar 

  18. Mühlmann K, Maier D, Hesser J, Männer R (2002) Calculating dense disparity maps from color stereo images, an efficient implementation. Int J Computer Vis 47(1–3):79–88

    Article  MATH  Google Scholar 

  19. Murray D, Little JJ (2000) Using real-time stereo vision for mobile robot navigation. Auton Robots 8(2):161–171

    Article  Google Scholar 

  20. Pippine J, Hackett D, Watson A (2011) An overview of the defense advanced research projects agency’s learning locomotion program. Int J Robot Res 30:141–144

    Article  Google Scholar 

  21. Semini C (2010) HyQ—design and development of a hydraulically actuated quadruped robot. Ph.D. thesis, Italian Institute of Technology and University of Genoa

  22. Semini C, Tsagarakis NG, Guglielmino E, Focchi M, Cannella F, Caldwell DG (2011) Design of HyQ—a hydraulically and electrically actuated quadruped robot. J Syst Control Eng 225(6):831–849

    Google Scholar 

  23. Semini C, Khan H, Frigerio M, Boaventura T, Focchi M, Buchli J, Caldwell DG (2012) Design and scaling of versatile quadruped robots. In: Int. Conf. on climbing and walking robots (CLAWAR)

  24. Semini C, Barasuol V, Boaventura T, Frigerio M, Buchli J (2013) Is active impedance the key to a breakthrough for legged robots? In: International Symposium on robotics research (ISRR)

  25. Shao X, Yang Y, Wang W (2012) Obstacle crossing with stereo vision for a quadruped robot. In: Mechatronics and automation (ICMA), 2012 International Conference on, pp 1738–1743

  26. Zhou H, Yuan Y, Shi C (2009) Object tracking using sift features and mean shift. Computer Vis Image Underst 113(3):345–352

    Article  Google Scholar 

Download references

Acknowledgments

This work is an extended version of a previously published paper at the TEPRA conference [4]. The research has been funded by the Fondazione Istituto Italiano di Tecnologia. Jonas Buchli is supported by a Swiss National Science Foundation professorship. Successful experiments on HyQ are the fruit of many people’s contributions during the last years. For a full list of lab members please visit www.iit.it/hyq.

Author information

Authors and Affiliations

  1. Department of Advanced Robotics, Istituto Italiano di Tecnologia (IIT), via Morego, 30, 16163 , Genova, Italy

    Stéphane Bazeille, Victor Barasuol, Michele Focchi, Ioannis Havoutis, Marco Frigerio, Darwin G. Caldwell & Claudio Semini

  2. Agile and Dexterous Robotics Lab, ETH Zurich, Tannenstr. 3, 8092 , Zurich, Switzerland

    Jonas Buchli

Authors
  1. Stéphane Bazeille
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Victor Barasuol
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Michele Focchi
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Ioannis Havoutis
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Marco Frigerio
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Jonas Buchli
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Darwin G. Caldwell
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Claudio Semini
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Stéphane Bazeille.

Rights and permissions

Reprints and Permissions

About this article

Cite this article

Bazeille, S., Barasuol, V., Focchi, M. et al. Quadruped robot trotting over irregular terrain assisted by stereo-vision. Intel Serv Robotics 7, 67–77 (2014). https://doi.org/10.1007/s11370-014-0147-9

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11370-014-0147-9

Keywords

  • Reactive walking
  • Active impedance
  • Goal-oriented navigation
  • Visual servoing
  • Quadruped robot