Nonlinear Visual Servoing Control for VTOL UAVs with Field of View Constraint

  • Henry de PlinvalEmail author
  • Laurent Burlion


This paper proposes a new nonlinear visual servoing control law for Vertical Take-Off and Landing (VTOL) Unmanned Aerial Vehicles (UAVs) which forces the observed target to be maintained inside the videocamera field of view. The considered vehicles are underactuated -there are less control inputs than degrees of freedom- and the control task is performed in a minimal sensors configuration, where only images from a videocamera, inertial and linear velocity measurements are available. An input saturation technique is applied to a recently defined nonlinear control design for vision based UAV stabilization, which forces the target to remain in view of the UAV during the flight, instead of assuming that this property will be true, as most existing approaches do. A stability analysis of the obtained closed-loop is presented. Simulation results show the relevance of the proposed approach.


Unmanned Aerial Vehicle Model Predictive Control Body Frame Input Saturation Output Constraint 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Hua, M.D., Hamel, T., Morin, P., Samson, C.: A control approach for thrust-propelled underactuated vehicles and its application to VTOL drones. IEEE Trans. on Automatic Control 54, 1837–1853 (2009)CrossRefMathSciNetGoogle Scholar
  2. 2.
    Weiss, L.E., Sanderson, A.C., Neuman, C.P.: Dynamic sensor-based control of robots with visual feedback. IEEE Journal of Robotics and Automation (1987)Google Scholar
  3. 3.
    Burlion, L., de Plinval, H., Mouyon, P.: Backstepping based visual servoing for transport aircraft automatic landing. In: Proc. of the IEEE Conference on Control Applications, Antibes, pp. 1461–1466 (2014)Google Scholar
  4. 4.
    Fang, Y., Dawson, D.M., Dixon, W.E., de Queiroz, M.S.: Homography-based visual servoing of wheeled mobile robots. In: CDC (2002)Google Scholar
  5. 5.
    Isidori, A., Marconi, L., Serrani, A.: Robust autonomous guidance: an internal model approach. Advances in industrial control. Springer (2003)Google Scholar
  6. 6.
    Hauser, J., Sastry, S., Meyer, G.: Nonlinear control design for slightly non-minimum phase systems: Application to V/STOL. Automatica 28, 651–670 (1992)CrossRefMathSciNetGoogle Scholar
  7. 7.
    Teel, A.R.: Global stabilization and restricted tracking for multiple integrators with bounded controls. SCL 18, 165–171 (1992)zbMATHMathSciNetGoogle Scholar
  8. 8.
    Metni, N., Hamel, T., Derkx, F.: A UAV for Bridges Inspection: Visual Servoing Control Law with Orientation Limits. In: 5th Symposium on Intelligent Autonomous Vehicles, IAV 2004 (2004)Google Scholar
  9. 9.
    Shakernia, O., Ma, Y., Koo, T., Sastry, S.: Landing an Unmanned Air Vehicle: Vision based motion estimation and nonlinear control. Asian Journal of Control 1, 128–145 (1999)CrossRefGoogle Scholar
  10. 10.
    Bernstein, D.S., Michel, A.N.: A chronological bibliography on saturating actuators. International Journal of Robust and Nonlinear Control 5, 375–380 (1995)CrossRefzbMATHMathSciNetGoogle Scholar
  11. 11.
    Hu, T.: Nonlinear feedback laws for practical stabilization of systems with input and state constraints. In: Proc. of the 47th Conference on Decision and Control, Cancun, Mexico, pp. 3481–3486 (2008)Google Scholar
  12. 12.
    Turner, M.C., Postlethwaite, I.: Output violation compensation for systems with output constraints. IEEE Transactions on Automatic Control 47(9), 1540–1546 (2002)CrossRefMathSciNetGoogle Scholar
  13. 13.
    Gilbert, E.G., Tan, K.T.: Linear systems with state and control constraints: the theory and application of maximal output admissible sets. IEEE Transactions on Automatic Control 36(9), 1008–1020 (1991)CrossRefzbMATHMathSciNetGoogle Scholar
  14. 14.
    Rojas, O.J., Goodwin, G.C.: A simple anti-windup strategy for state constrained linear control. In: Proc. of the 15th IFAC World Congress, Barcelona, Spain (2002)Google Scholar
  15. 15.
    Burlion, L.: A new Saturation function to convert an output constraint into an input constraint. In: 20th Mediterranean Conference on Control and Automation, pp. 1217–1222 (2012)Google Scholar
  16. 16.
    Allgöwer, F., Zheng, A.Z.: Nonlinear model predictive control: assessment and future directions for research. Progress in Systems and control Series. Birkhäuser Verlag, Basel (2000)CrossRefGoogle Scholar
  17. 17.
    Ngo, K.B., Mahony, R., Zhong-Ping, J.: Integrator backstepping using barrier functions for systems with multiple state constraints. In: Proc. of the 44th Conference on Decision and Control, Seville, Spain, pp. 8306–8312 (2005)Google Scholar
  18. 18.
    Tee, K.P., Ge, S.S., Tay, E.H.: Barrier Lyapunov functions for the control of output-constrained nonlinear systems. Automatica 45(4), 918–927 (2009)CrossRefzbMATHMathSciNetGoogle Scholar
  19. 19.
    Bürger, M., Guay, M.: Robust Constraint Satisfaction for Continuous-time Nonlinear Systems in Strict Feedback Form. IEEE Transactions on Automatic Control 55(11), 2597–2601 (2010)CrossRefGoogle Scholar
  20. 20.
    Burlion, L., de Plinval, H.: Keeping a Ground Point in the Camera Field of View of a Landing UAV. In: Proceedings of the 2013 IEEE International Conference on Robotics and Automation (ICRA), pp. 5763–5768 (2013)Google Scholar
  21. 21.
    Lopez-Nicolas, G., Bhattacharya, S., Guerrero, J.J., Sagues, C., Hutchinson, S.: Switched Homography-Based Visual Control of Differential Drive Vehicles with Field-of-View Constraints. In: IEEE International Conference on Robotics and Automation (2007)Google Scholar
  22. 22.
    Cunha, R., Silvestre, C., Hespanha, J.P., Aguiar, A.P.: Vision-based control for rigid body stabilization. Automatica, 1020–1027 (2011)Google Scholar
  23. 23.
    Zhang, Z., Hanson, A.R.: 3D Reconstruction Based on Homography Mapping. In: ARPA Image Understanding Workshop, pp. 0249–6399 (1996)Google Scholar
  24. 24.
    Benhimane, S., Malis, E., Rives, P., Azinheira, J.R.: Vision-based Control for Car Platooning using Homography Decomposition. In: IEEE Conference on Robotics and Automation, pp. 2161–2166 (2005)Google Scholar
  25. 25.
    Guerrero, J.J., Martinez-Cantin, R., Sagués, C.: Visual map-less navigation based on homographies, Journal of Robotic Systems, 569–581 (2005)Google Scholar
  26. 26.
    Vargas, M., Malis, E.: Visual servoing based on an analytical homography decomposition. In: IEEE Conference on Decision and Control and European Control Conference, pp. 5379–5384 (2005)Google Scholar
  27. 27.
    Malis, E., Vargas, M.: Deeper understanding of the homography decomposition for vision-based control, INRIA technical report (2007)Google Scholar
  28. 28.
    Simond, N., Laurgeau, C.: Vehicle Trajectory from an Uncalibrated Stereo-Rig with Super-Homography. In: IEEE International Conference on Robotics and Systems, pp. 4768–4773 (2006)Google Scholar
  29. 29.
    Benhimane, S., Malis, E.: Homography-based 2D Visual Tracking and Servoing. International Journal of Robotic Research, 661–676 (2007)Google Scholar
  30. 30.
    Benhimane, S., Malis, E.: Homography-based 2D visual tracking and servoing. The International Journal of Robotics Research, 661–676 (2007)Google Scholar
  31. 31.
    de Plinval, H., Morin, P., Mouyon, P.: Nonlinear control of underactuated vehicles with uncertain position measurements and application to visual servoing. In: Proc. of the American Control Conference, Montreal, Canada (2012)Google Scholar
  32. 32.
    de Plinval, H., Morin, P., Mouyon, P., Hamel, T.: Visual servoing for underactuated VTOL UAVs: A linear, Homography-Based Approach. In: IEEE International Conference on Robotics and Automation (2011)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2015

Authors and Affiliations

  1. 1.The French Aerospace Lab.OneraToulouseFrance

Personalised recommendations