Abstract
The growth of civil and military use has recently promoted the development of unmanned miniature aerial vehicles dedicated to surveillance tasks. These flying vehicles are often capable of carrying only a few dozen grammes of payload. To achieve autonomy for this kind of aircraft novel sensors are required, which need to cope with strictly limited onboard processing power. One of the key aspects in autonomous behaviour is target tracking. Our visual tracking approach differs from other methods by not using expensive cameras but a Wii remote camera, i.e. commodity consumer hardware. The system works without stationary sensors and all processing is done with an onboard microcontroller. The only assumptions are a good roll and pitch attitude estimation, provided by an inertial measurement unit and a stationary pattern of four infrared spots on the target or the landing spot. This paper details experiments for hovering above a landing place, but tracking a slowly moving target is also possible.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Bouabdallah, S., Murrieri, P., Siegwart, R.: Design and control of an indoor micro quadrotor. In: IEEE International Conference on Robotics and Automation (ICRA) (2004)
Bouabdallah, S., Noth, A., Siegwart, R.: PID vs LQ control techniques applied to an indoor micro quadrotor. In: IEEE International Conference on Intelligent Robots and Systems (IROS), pp. 2451–2456 (2004)
Frew, E., Mcgee, T., Kim, Z., Xiao, X., Jackson, S., Morimoto, M., Rathinam, S., Padial, J., Sengupta, R.: Vision-based road-following using a small autonomous aircraft. In: IEEE Aerospace Conference, vol. 5, pp. 3006–3015 (2004)
Guenard, N., Hamel, T.: A practical visual servo control for an unmanned aerial vehicle. In: IEEE International Conference on Robotics and Automation (ICRA), pp. 1342–1348 (2007)
Gurdan, D., Stumpf, J., Achtelik, M., Doth, K.M., Hirzinger, G., Rus, D.: Energy-efficient autonomous four-rotor flying robot controlled at 1 kHz. In: IEEE International Conference on Robotics and Automation (ICRA), pp. 361–366. Roma, Italy (2007)
Hay, S., Newman, J., Harle, R.: Optical tracking using commodity hardware. In: 7th IEEE/ACM International Symposium on Mixed and Augmented Reality (ISMAR), pp. 159–160 (2008)
Herisse, B., Russotto, F.X., Hamel, T., Mahony, R.E.: Hovering flight and vertical landing control of a VTOL unmanned aerial vehicle using optical flow. In: IEEE International Conference on Intelligent Robots and Systems (IROS), pp. 801–806 (2008)
Hrabar, S.: 3D path planning and stereo-based obstacle avoidance for rotorcraft UAVs. In: IEEE International Conference on Intelligent Robots and Systems (IROS), pp. 807–814 (2008)
Kemp, C.: Visual control of a miniature quad-rotor helicopter. Ph.D. thesis, Churchill College, University of Cambridge (2006)
Mak, L.C., Furukawa, T.: A 6 DoF visual tracking system for a miniature helicopter. In: 2nd International Conference on Sensing Technology (ICST), pp. 32–37 (2007)
Nordberg, K., Doherty, P., Farnebäck, G., Forssén, P.E., Granlund, G., Moe, A., Wiklund, J.: Vision for a UAV helicopter. In: International Conference on Intelligent Robots and Systems (IROS), workshop on aerial robotics. Lausanne, Switzerland (2002)
Roberts, J., Corke, P., Buskey, G.: Low-cost flight control system for a small autonomous helicopter. In: IEEE International Conference on Robotics and Automation (ICRA), pp. 546–551. Taipai, Taiwan (2003)
Saripalli, S., Montgomery, J.F., Sukhatme, G.S.: Vision-based autonomous landing of an unmanned aerial vehicle. In: IEEE International Conference on Robotics and Automation (ICRA), pp. 2799–2804. Washington, DC, USA (2002)
Schou, T., Gardner, H.J.: A Wii remote, a game engine, five sensor bars and a virtual reality theatre. In: OZCHI ’07: Proceedings of the 2007 conference of the computer-human interaction special interest group (CHISIG) of Australia on Computer-human interaction: design, activities, artifacts and environments, pp. 231–234. ACM, New York (2007)
Shakernia, O., Ma, Y., John, T., Sastry, K.S.: Landing an unmanned air vehicle: Vision based motion estimation and nonlinear control. Asian J. Control 1, 128–145 (1999)
Sharp, C.S., Shakernia, O., Sastry, S.S.: A vision system for landing an unmanned aerial vehicle. In: IEEE International Conference on Robotics and Automation (ICRA), Seoul, Korea, pp. 1720–1727 (2001)
Sreedharan, S., Zurita, E.S., Plimmer, B.: 3d input for 3d worlds. In: OZCHI ’07: Proceedings of the 2007 conference of the computer-human interaction special interest group (CHISIG) of Australia on Computer-human interaction: design, activities, artifacts and environments, pp. 227–230. ACM, New York (2007)
Valavanis, K.P. (ed.): Advances in Unmanned Aerial Vehicles. State of the Art and the Road to Autonomy. Springer, New York (2007)
Watanabe, K., Iwatani, Y., Nonaka, K., Hashimoto, K.: A visual-servo-based assistant system for unmanned helicopter control. In: IEEE International Conference on Intelligent Robots and Systems (IROS), pp. 822–827 (2008)
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Wenzel, K.E., Rosset, P. & Zell, A. Low-Cost Visual Tracking of a Landing Place and Hovering Flight Control with a Microcontroller. J Intell Robot Syst 57, 297–311 (2010). https://doi.org/10.1007/s10846-009-9355-5
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10846-009-9355-5