A Nonlinear Adaptive Model-Predictive Approach for Visual Servoing of Unmanned Aerial Vehicles

  • Sina Sajjadi
  • Mehran MehrandezhEmail author
  • Farrokh Janabi-Sharifi
Conference paper
Part of the Springer Proceedings in Physics book series (SPPHY, volume 233)


Aerial vehicles, due to the nature of their operations, are subject to many uncertainties. In particular, their positioning control problem is aggravated in GPS-denied environments. As a result, vision-based control (or visual servoing) solutions are sought to address their navigation control issue. In this work, visual servoing is formulated as a nonlinear optimization problem in the image plane. The proposed approach is based on a class of nonlinear model-predictive control that takes constraints into consideration. A 2-DOF model helicopter is considered for initial formulations and verification of the approach. The considered model helicopter has a coupled nonlinear pitch/yaw dynamics. It is also capable of a pitch over (i.e., hover at a non-zero pitch angle) around its pivotal axis of rotation due to the offset between the center of mass (CoM) of its fuselage and the rotation axis. This further makes the linearized model (calculated around any pitch angle). A linear parameter varying (LPV) system for an adaptive control is formulated under a model-predictive visual servoing framework. In this paper, a design guideline is provided under a model-predictive visual servoing paradigm that considers field of view (FOV) constraints, the constraint on the pitch angle, and also the maximum voltages that can be applied to independently controlled pitch/yaw motors. The control space is parameterized via Laguerre basis network functions that make the optimization scheme computationally less expensive, thus suitable for real-time applications.


  1. 1.
    G.-R. Yu, H.-T. Liu, Sliding mode control of a two-degree-of-freedom helicopter via linear quadratic regulator, in 2005 IEEE International Conference on Systems, Man and CyberneticsGoogle Scholar
  2. 2.
    M. Lopez-Martinez, J. Diaz, M. Ortega, F. Rubio, Control of a laboratory helicopter using switched 2-step feedback linearization, in Proceedings of the 2004 American Control Conference (2004)Google Scholar
  3. 3.
    K. Kunz, S.M. Huck, T.H. Summers, Fast model predictive control of miniature helicopters, in 2013 European Control Conference (ECC) (2013)Google Scholar
  4. 4.
    A. Dutka, A. Ordys, M. Grimble, Non-linear predictive control of 2 DOF helicopter model, in 42nd IEEE International Conference on Decision and Control (IEEE Cat. No. 03CH37475)Google Scholar
  5. 5.
    H. Xie, G. Fink, A.F. Lynch, M. Jagersand, Adaptive visual servoing of UAVs using a virtual camera. IEEE Trans. Aerosp. Electron. Syst. 52(5), 2529–2538 (2016)ADSCrossRefGoogle Scholar
  6. 6.
    O. Shakernia, Y. Ma, T.J. Koo, S. Sastry, Landing an unmanned air vehicle: vision based motion estimation and nonlinear control. Asian J. Control 1(3), 128–145 (2008)CrossRefGoogle Scholar
  7. 7.
    M. Alizadeh, C. Ratanasawanya, M. Mehrandezh, R. Paranjape, Optimal error-clamping design for position-based visual servoing of a 2-DOF model helicopter, in Volume 3: 2011 ASME/IEEE International Conference on Mechatronic and Embedded Systems and Applications, Parts A and B (2011)Google Scholar
  8. 8. (last viewed on 6 August 2018)
  9. 9.
    S. Qin, T.A. Badgwell, A survey of industrial model predictive control technology. Control Eng. Pract. 11(7), 733–764 (2003)CrossRefGoogle Scholar
  10. 10.
    M. Muehlebach, C. Sferrazza, R. Dandrea, Implementation of a parametrized infinite-horizon model predictive control scheme with stability guarantees, in 2017 IEEE International Conference on Robotics and Automation (ICRA) (2017)Google Scholar

Copyright information

© Springer Nature Singapore Pte Ltd. 2019

Authors and Affiliations

  • Sina Sajjadi
    • 1
  • Mehran Mehrandezh
    • 1
    Email author
  • Farrokh Janabi-Sharifi
    • 2
  1. 1.Faculty of Engineering and Applied ScienceUniversity of ReginaReginaCanada
  2. 2.Department of Mechanical and Industrial EngineeringRyerson UniversityTorontoCanada

Personalised recommendations