EKF Based Attitude Estimation and Stabilization of a Quadrotor UAV Using Vanishing Points in Catadioptric Images

  • Metin Tarhan
  • Erdinç AltuğEmail author


In recent years, Unmanned Air Vehicles (UAVs) have become more and more important. These vehicles are employed in many applications from military operations to civilian tasks. Under situations where global positioning system (GPS) and inertial navigation system (INS) do not function, or as an additional sensor, computer vision can be used. Having 360° view, catadioptric cameras might be very useful as they can be used as measurement units, obstacle avoidance sensors or navigation planners. Although many innovative research has been done about this camera, employment of such cameras in UAVs is very new. In this paper, we present the use of catadioptric systems in UAVs to estimate vehicle attitude using parallel lines that exist on many structures in an urban environment. After explanation of the algorithm, the UAV modeling and control will be presented. In order to increase the estimation and control speed an Extended Kalman Filter (EKF) and multi-threading are used and speeds up to 40 fps are obtained. Various simulations have been done to present the effectiveness of the estimation algorithms as well as the UAV controllers. A custom test stand has been designed to perform successful experiments on the UAV. Finally, we will present the experiments and the results of the estimation and control algorithms on a real model helicopter. EKF based attitude estimation and stabilization using catadioptric images has found to be a reliable alternative to other sensor usage.


UAV EKF Catadioptric vision Attitude estimation Quadrotor control 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Castillo, P., Lozano, R., Dzul, A.E.: Modelling and Control of Mini-Flying Machines. Springer, London (2005)Google Scholar
  2. 2.
    Winters, N., Gaspar, J., Lacey, G., Santos-Victor, J.: Omni-directional vision for robot navigation. In: Proc. of IEEE Workshop on Omnidirectional Vision. Hilton Head Island, SC (2000)Google Scholar
  3. 3.
    Fiala, M., Basu A.: Robot navigation using panoramic tracking. Pattern Recogn. 37, 2195–2215 (2004)CrossRefGoogle Scholar
  4. 4.
    Gava, C.C., Vassallo, R.F., Roberti, F., Carelli, C., Bastos-Filho, T.F.: Nonlinear control techniques and omnidirectional vision for team formation on cooperative robotics. In: IEEE International Conference on Robotics and Automation, pp. 2409–2414. Roma, Italy (2007)Google Scholar
  5. 5.
    Sun, Y., Cao, Q., Chen, W.: An object tracking and global localization method using omnidirectional vision system. In: Proceedings of the 5th World Congress on Intelligent Control and Automation, pp. 4730–4735. Hangzhou, People’s Republic of China (2004)Google Scholar
  6. 6.
    Jamzad, M., Hadjkhodabakhshi, A.R., Mirrokni, V.S.: Object detection and localization using omnidirectional vision in the robocup environment. Sci. Iran. 14(6), 599–611 (2007)Google Scholar
  7. 7.
    Chen, Z., Chen, Y., Wang, Y.: Image-based control of an autonomous robot with omnidirectional vision. In: IEEE International Symposium on Industrial Embedded Systems. Lisbon (2007)Google Scholar
  8. 8.
    Hrabar, S., Sukhatme, G.S.: Omnidirectional vision for an autonomous helicopter. IEEE Int. Conf. Robot. Autom. 1, 558–563 (2003)Google Scholar
  9. 9.
    Hrabar, S., Sukhatme, G.S.: A comparison of two camera configurations for optic-flow based navigation of a UAV through urban canyons. In: Proceedings of the International Conference on Intelligent Robots and Systems, pp. 2673–2680 (2004)Google Scholar
  10. 10.
    Demonceaux, C., Vasseur, P., Pégard, C.: Robust attitude estimation with catadioptric vision. In: Proceedings of the International Conference on Intelligent Robots and Systems, pp. 3448–3453. Beijing, China (2006)Google Scholar
  11. 11.
    Demonceaux, C., Vasseur, P., Pégard, C.: Omnidirectional vision on UAV for attitude computation. In: Proceedings 2006 IEEE International Conference on Robotics and Automation, pp. 2842–2847 (2006)Google Scholar
  12. 12.
    Bazin, J.C., Kweon, I.S., Demonceaux, C., Vasseur, P.: UAV attitude estimation by combining horizon-based and homography-based approaches for catadioptric image. In: 6th IFAC/EURON Intelligent Autonomous Vehicles. Toulouse, France (2007)Google Scholar
  13. 13.
    Demonceaux, C., Vasseur, P., Pégard, C.: UAV attitude computation by omnidirectional vision in urban environment. IEEE Int. Conf. Robot. Autom. doi: 10.1109/ROBOT.2007.363618 (2007)Google Scholar
  14. 14.
    Bazin, J.C., Kweon, I., Demonceaux, C., Vasseur, P.: UAV attitude estimation by vanishing points in catadioptric images. In: IEEE International Conference on Robotics and Automation, pp. 2743–2749. Pasadena, CA (2008)Google Scholar
  15. 15.
    Barreto, J.P., Araujo, H.: Geometric properties of central catadioptric line images and their application in calibration. IEEE Trans. Pattern Anal. Mach. Intell. 27(8), 1327–1333 (2005)CrossRefGoogle Scholar
  16. 16.
    Horn, B.: closed-form solution of absolute orientation using unit quaternions. J. Opt. Soc. Am. A 4(4), 629–642 (1987)MathSciNetCrossRefGoogle Scholar
  17. 17.
    Dam, E.B., Koch, M., Lillholm, M.: Quaternions, interpolation and animation. Technical report DIKU-TR-98/5. Copenhagen, Denmark (1998)Google Scholar
  18. 18.
    Altuğ, E., Ostrowski, J., Taylor, C.J.: Control of a quadrotor helicopter using dual camera visual feedback. Int. J. Rob. Res. 24(5), 329–341 (2005)CrossRefGoogle Scholar
  19. 19.
    Bouabdallah, S., Siegwart, R.: Design and control of a miniature. In: Advances In Unmanned Aerial Vehicles, pp. 171–210. Springer (2007)Google Scholar
  20. 20.
  21. 21.

Copyright information

© Springer Science+Business Media B.V. 2010

Authors and Affiliations

  1. 1.System Dynamics and Control Graduate ProgramIstanbul Technical UniversityIstanbulTurkey
  2. 2.Department of Mechanical EngineeringIstanbul Technical UniversityIstanbulTurkey

Personalised recommendations