Skip to main content
SpringerLink
Log in

On the design and development of attitude stabilization, vision-based navigation, and aerial gripping for a low-cost quadrotor

  • Published:
Autonomous Robots Aims and scope Submit manuscript

Abstract

This paper presents the design and development of autonomous attitude stabilization, navigation in unstructured, GPS-denied environments, aggressive landing on inclined surfaces, and aerial gripping using onboard sensors on a low-cost, custom-built quadrotor. The development of a multi-functional micro air vehicle (MAV) that utilizes inexpensive off-the-shelf components presents multiple challenges due to noise and sensor accuracy, and there are control challenges involved with achieving various capabilities beyond navigation. This paper addresses these issues by developing a complete system from the ground up, addressing the attitude stabilization problem using extensive filtering and an attitude estimation filter recently developed in the literature. Navigation in both indoor and outdoor environments is achieved using a visual Simultaneous Localization and Mapping (SLAM) algorithm that relies on an onboard monocular camera. The system utilizes nested controllers for attitude stabilization, vision-based navigation, and guidance, with the navigation controller implemented using a nonlinear controller based on the sigmoid function. The efficacy of the approach is demonstrated by maintaining a stable hover even in the presence of wind gusts and when manually hitting and pulling on the quadrotor. Precision landing on inclined surfaces is demonstrated as an example of an aggressive maneuver, and is performed using only onboard sensing. Aerial gripping is accomplished with the addition of a secondary camera, capable of detecting infrared light sources, which is used to estimate the 3D location of an object, while an under-actuated and passively compliant manipulator is designed for effective gripping under uncertainty.

The quadrotor is therefore able to autonomously navigate inside and outside, in the presence of disturbances, and perform tasks such as aggressively landing on inclined surfaces and locating and grasping an object, using only inexpensive, onboard sensors.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19
Fig. 20
Fig. 21
Fig. 22
Fig. 23
Fig. 24
Fig. 25
Fig. 26
Fig. 27

Similar content being viewed by others

Notes

  1. Camera I2C interfacing are discussed by Kako on his website (http://www.kako.com).

References

  • Achtelik, M., Bachrach, A., He, R., Prentice, S., & Roy, N. (2009). Stereo vision and laser odometry for autonomous helicopters in GPS-denied indoor environments. In Proceedings of the International Society for Optical Engineering (SPIE).

    Google Scholar 

  • Ahn, K., & Thanh, T. (2005). Nonlinear pid control to improve the control performance of the pneumatic artificial muscle manipulator using neural network. Journal of Mechanical Science and Technology, 19, 106–115.

    Article  Google Scholar 

  • Altuğ, E., Ostrowski, J. P., & Taylor, C. J. (2005). Control of a quadrotor helicopter using dual camera visual feedback. The International Journal of Robotics Research, 24, 329–341.

    Article  Google Scholar 

  • Amidi, O., Kanade, T., & Miller, J. R. (1998). Vision-based autonomous helicopter research at Carnegie Mellon Robotics Institute 1991–1997. In American helicopter society international conference.

    Google Scholar 

  • Bayraktar, S., & Feron, E. (2008). Experiments with small helicopter automated landings at unusual attitudes. arXiv:0709.1744.

  • Blösch, M., Weiss, S., Scaramuzza, D., & Siegwart, R. (2010). Vision based MAV navigation in unknown and unstructured environments. In Proceedings of the IEEE international conference on robotics and automation (ICRA) (pp. 21–28).

    Google Scholar 

  • Bouabdallah, S., & Siegwart, R. (2007). Full control of a quadrotor. In Proceedings of the IEEE/RSJ international conference on intelligent robots and systems (IROS) (pp. 153–158).

    Google Scholar 

  • Bouabdallah, S., Noth, A., & Siegwart, R. (2004). PID vs. LQ control techniques applied to an indoor micro quadrotor. In Proceedings of the IEEE/RSJ international conference on intelligent robots and systems (IROS) (pp. 2451–2456).

    Google Scholar 

  • Bouguet, J. Y. (1999). Pyramidal implementation of the Lucas Kanade feature tracker (Tech. Rep.), Intel Corp.

  • Bourquardez, O., Mahony, R., Guenard, N., Chaumette, F., Hamel, T., & Eck, L. (2009). Image-based visual servo control of the translation kinematics of a quadrotor aerial vehicle. IEEE Transactions on Robotics, 25(3), 743–749.

    Article  Google Scholar 

  • Castillo, P., Lozano, R., & Dzul, A. (2005). Stabilization of a mini rotorcraft with four rotors. IEEE Control Systems Magazine, 25(6), 45–55.

    Article  MathSciNet  Google Scholar 

  • Celik, K., Chung, S. J., Clausman, M., & Somani, A. (2009). Monocular vision SLAM for indoor aerial vehicles. In Proceedings of the IEEE/RSJ international conference on intelligent robots and systems (IROS) (pp. 1566–1573).

    Google Scholar 

  • Cory, R. E. (2010). Supermaneuverable perching. PhD thesis, Massachusetts Institute of Technology, Cambridge, MA.

  • Davison, A., Reid, I., Molton, N., & Stasse, O. (2007). MonoSLAM: Real-time single camera SLAM. IEEE Transactions on Pattern Analysis and Machine Intelligence, 29(6), 1052–1067.

    Article  Google Scholar 

  • Desbiens, AL, Asbeck, A. T., & Cutkosky, M. R. (2011). Landing, perching and taking off from vertical surfaces. The International Journal of Robotics Research, 30(3), 355–370.

    Article  Google Scholar 

  • Dollar, A., & Howe, R. (2006). A robust compliant grasper via shape deposition manufacturing. IEEE/ASME Transactions on Mechatronics, 11(2), 154–161.

    Article  Google Scholar 

  • Fowers, S., Lee, D., Tippetts, B., Lillywhite, K., Dennis, A., & Archibald, J. (2007). Vision aided stabilization and the development of a quad-rotor micro UAV. In Proceedings of the IEEE international symposium on computational intelligence in robotics and automation (CIRA) (pp. 143–148).

    Chapter  Google Scholar 

  • Gentili, L., Naldi, R., & Marconi, L. (2008). Modeling and control of VTOL UAVs interacting with the environment. In Proceedings of the IEEE conference on decision and control (CDC) (pp. 1231–1236).

    Google Scholar 

  • Grzonka, S., Grisetti, G., & Burgard, W. (2009). Towards a navigation system for autonomous indoor flying. In Proceedings of the IEEE international conference on robotics and automation (ICRA) (pp. 2878–2883).

    Google Scholar 

  • Guenard, N., Hamel, T., & Moreau, V. (2005). Dynamic modeling and intuitive control strategy for an “x4-flyer”. In Proceedings of the IEEE international conference on robotics and automation (ICRA) (pp. 141–146).

    Google Scholar 

  • Guenard, N., Hamel, T., & Mahony, R. (2008). A practical visual servo control for an unmanned aerial vehicle. IEEE Transactions on Robotics, 24(2), 331–340.

    Article  Google Scholar 

  • Gurdan, D., Stumpf, J., Achtelik, M., Doth, K., Hirzinger, G., & Rus, D. (2007). Energy-efficient autonomous four-rotor flying robot controlled at 1 kHz. In Proceedings of the IEEE international conference on robotics and automation (ICRA) (pp. 361–366).

    Chapter  Google Scholar 

  • He, R., Prentice, S., & Roy, N. (2008). Planning in information space for a quadrotor helicopter in a GPS-denied environment. In Proceedings of the IEEE international conference on robotics and automation (ICRA) (pp. 1814–1820).

    Google Scholar 

  • Hoffmann, G. M., Huang, H., Waslander, S. L., & Tomlin, C. J. (2007). Quadrotor helicopter flight dynamics and control: Theory and experiment. In Proceedings of the AIAA guidance, navigation, and control conference (GNC).

    Google Scholar 

  • Huang, H., Hoffmann, G., Waslander, S., & Tomlin, C. (2009). Aerodynamics and control of autonomous quadrotor helicopters in aggressive maneuvering. In Proceedings of the IEEE international conference on robotics and automation (ICRA) (pp. 3277–3282).

    Google Scholar 

  • Kendoul, F., Nonami, K., Fantoni, I., & Lozano, R. (2009). An adaptive vision-based autopilot for mini flying machines guidance, navigation and control. Autonomous Robots, 27, 165–188.

    Article  Google Scholar 

  • Klein, G., & Murray, D. (2007). Parallel tracking and mapping for small AR workspaces. In Proceedings of the IEEE and ACM international symposium on mixed and augmented reality (ISMAR) (pp. 1–10).

    Chapter  Google Scholar 

  • Klein, G., & Murray, D. (2008). Improving the agility of keyframe-based SLAM. In Proceedings of the European conference on computer vision (ECCV) (pp. 802–815).

    Google Scholar 

  • Kuntz, N. R., & Oh, P. Y. (2008). Development of autonomous cargo transport for an unmanned aerial vehicle using visual servoing. In: Proceedings of the ASME dynamic systems and control conference (DSCC), 2008 (pp. 731–738).

    Chapter  Google Scholar 

  • Lindsey, Q., Mellinger, D., & Kumar, V. (2011). Construction of cubic structures with quadrotor teams. In Proceedings of the robotics: science and systems conference (RSS), Los Angeles, CA, USA.

    Google Scholar 

  • Lourakis, MIA, & Argyros, A. A. (2009). SBA: A software package for generic sparse bundle adjustment. ACM Transactions on Mathematical Software, 36(2), 1–30.

    Article  MathSciNet  Google Scholar 

  • Lowe, D. G. (2004). Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision, 60(2), 91–110.

    Article  Google Scholar 

  • Mahony, R., Hamel, T., & Pflimlin, J. (2008). Nonlinear complementary filters on the special orthogonal group. IEEE Transactions on Automatic Control, 53(5), 1203–1218.

    Article  MathSciNet  Google Scholar 

  • Mellinger, D., Michael, N., & Kumar, V. (2010). Trajectory generation and control for precise aggressive maneuvers with quadrotors. In Proceedings of the IFRR international symposium on experimental robotics (ISER).

    Google Scholar 

  • Michael, N., Fink, J., & Kumar, V. (2009). Cooperative manipulation and transportation with aerial robots. In Proceedings of the robotics: science and systems conference (RSS).

    Google Scholar 

  • Montemerlo, M., Thrun, S., Koller, D., & Wegbreit, B. (2003). FastSLAM 2.0: An improved particle filtering algorithm for simultaneous localization and mapping that provably converges. In Proceedings of the international conference on artificial intelligence (IJCAI) (pp. 1151–1156).

    Google Scholar 

  • Moore, J., & Tedrake, R. (2009). Powerline perching with a fixed-wing UAV. In Proceedings of the AIAA infotech@aerospace conference.

    Google Scholar 

  • Moore, J. M. (1994). A system for landing an autonomous radio controlled helicopter on sloped terrain. Master’s thesis, Massachusetts Institute of Technology, Cambridge, Massachusetts.

  • Oh, S. R., Pathak, K., Agrawal, S., Pota, H., & Garratt, M. (2006). Approaches for a tether-guided landing of an autonomous helicopter. IEEE Transactions on Robotics, 22(3), 536–544.

    Article  Google Scholar 

  • Parrot, S. A. (2011) AR.Drone. http://ardrone.parrot.com.

  • Pounds, P., & Dollar, A. (2010a). Aerial grasping from a helicopter UAV platform. In Proceedings of the IFRR international symposium on experimental robotics (ISER)

    Google Scholar 

  • Pounds, P., & Dollar, A. (2010b). Hovering stability of helicopters with elastic constraints. In Proceedings of the ASME dynamic systems and control conference (DSCC).

    Google Scholar 

  • Pounds, P., Mahony, R., & Corke, P. (2010). Modelling and control of a large quadrotor robot. Control Engineering Practice, 18(7), 691–699. Special Issue on Aerial Robotics.

    Article  Google Scholar 

  • Pounds, P.E.I., Bersak, D.R., & Dollar, A.M. (2011). Grasping from the air: Hovering capture and load stability. In Proceedings of the IEEE international conference on robotics and automation (ICRA).

    Google Scholar 

  • Romero, H., Benosman, R., & Lozano, R. (2006). Stabilization and location of a four rotor helicopter applying vision. In Proceedings of the AACC american control conference (ACC).

    Google Scholar 

  • Romero, H., Salazar, S., & Lozano, R. (2009). Real-time stabilization of an eight-rotor UAV using optical flow. IEEE Transactions on Robotics, 25(4), 809–817.

    Article  Google Scholar 

  • Rudol, P., Wzorek, M., & Doherty, P. (2010). Vision-based pose estimation for autonomous indoor navigation of micro-scale unmanned aircraft systems. In Proceedings of the IEEE international conference on robotics and automation (ICRA) (pp. 1913–1920).

    Google Scholar 

  • Soundararaj, S., Sujeeth, A., & Saxena, A. (2009). Autonomous indoor helicopter flight using a single onboard camera. In Proceedings of the IEEE/RSJ international conference on intelligent robots and systems (IROS) (pp. 5307–5314).

    Google Scholar 

  • Strasdat, H., Montiel, J., & Davison, A. (2010). Real-time monocular SLAM: Why filter? In Proceedings of the IEEE international conference on robotics and automation (ICRA) (pp. 2657–2664).

    Google Scholar 

  • Tournier, G. P., Valenti, M., & How, J. P. (2006). Estimation and control of a quadrotor vehicle using monocular vision and Moiré patterns. In Proceedings of the AIAA guidance, navigation, and control conference (GNC) (pp. 2247–2252).

    Google Scholar 

  • Valenti, M., Bethke, B., Fiore, G., & How, J. P. (2006). Indoor multi-vehicle flight testbed for fault detection, isolation, and recovery. In Proceedings of the AIAA guidance, navigation, and control conference (GNC).

    Google Scholar 

  • Vicon (2011) Vicon MX Systems. http://www.vicon.com/products/viconmx.html.

Download references

Author information

Authors and Affiliations

  1. Department of Electrical Engineering, University of California, Riverside, Riverside, CA, 92521, USA

    Vaibhav Ghadiok & Wei Ren

  2. Electronic Systems Center, Hanscom Air Force Base, Bedford, MA, 01731, USA

    Jeremy Goldin

Authors
  1. Vaibhav Ghadiok
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jeremy Goldin
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Wei Ren
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Vaibhav Ghadiok.

Additional information

This research was supported by the National Science Foundation under CAREER Award ECCS-0748287.

Electronic Supplementary Material

Below is the link to the electronic supplementary material.

(MP4 38.4 MB)

Rights and permissions

Reprints and permissions

About this article

Cite this article

Ghadiok, V., Goldin, J. & Ren, W. On the design and development of attitude stabilization, vision-based navigation, and aerial gripping for a low-cost quadrotor. Auton Robot 33, 41–68 (2012). https://doi.org/10.1007/s10514-012-9286-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10514-012-9286-z

Keywords

Search

Navigation