A Novel Flight Controller Interface for Vision-Guided Autonomous Drone

  • R. SenthilnathanEmail author
  • Niket Ahuja
  • G. Vyomkesh Bhargav
  • Devansh Ahuja
  • Adish Bagi
Conference paper
Part of the Lecture Notes in Computational Vision and Biomechanics book series (LNCVB, volume 30)


Aerial vehicles are rapidly exploring places in a variety of applications in the service sector such as transport assistance and other logistics involved sectors. Most applications require local perception for the aerial vehicles wherein vision system is the most powerful information. Such local perception may be designed based on landmarks on the ground below. This paper details the work where a computer vision system is aiding in landmark identification, namely, a line strip on the ground below. The vision system is implemented in a real-time controller, and a novel and simple interface solution is presented to interface the vision controller to the flight controller. The aerial vehicle under consideration is quadrotor type. The paper presents the details of the image processing algorithm along with the hardware details of the flight control interface. The vision system is developed to identify line strips which share sufficient contrast with the background under daylight condition. The image analysis is performed to continuously extract the lateral position and yaw error. Such an interface would serve as a computationally cheap and easy solution over traditional programmable flight control interface solutions such as MAVLINK.


Flight controller Vision guidance Autonomous drones Secondary controller 


  1. 1.
    Puri A (2005) A survey of unmanned aerial vehicles (UAV) for traffic surveillance. Department of Computer Science and Engineering, University of South FloridaGoogle Scholar
  2. 2.
    How Jonathan P (2008) Real-time indoor autonomous vehicle test environment. Control Syst IEEE 28(2):51–64MathSciNetCrossRefGoogle Scholar
  3. 3.
    Bi Y, Duan H (2013) Implementation of autonomous visual tracking and landing for a low-cost quadrotor. Optik-Int J Light Electron Opt 124(18):3296–3300CrossRefGoogle Scholar
  4. 4.
    Meier L, Tanskanen P, Heng L, Lee GH, Fraundorfer F, Pollefeys M (2011) PIXHAWK: a system for autonomous flight using onboard computer vision. In: 2011 IEEE international conference on Robotics and automation (ICRA). IEEEGoogle Scholar
  5. 5.
    Chae H, Park J, Song H, Kim Y, Jeong H (2015) The IoT based automate landing system of a drone for the round-the-clock surveillance solution. In: IEEE international conference on advanced intelligent mechatronics (AIM). IEEEGoogle Scholar
  6. 6.
    Pattersona T, McCleana S, Morrowa P, Parra G, Luob C (2014) Timely autonomous identification of UAV safe landing zones. Image Vis Comput 32(9):568–578CrossRefGoogle Scholar
  7. 7.
    Blösch M (2010) Vision based MAV navigation in unknown and unstructured environments. In: 2010 IEEE international conference on robotics and automation (ICRA). IEEEGoogle Scholar
  8. 8.
    Roberts PJ, Walker RA, O’Shea P (2005) Fixed wing UAV navigation and control through integrated GNSS and vision. In: AIAA guidance, navigation, and control conference and exhibitGoogle Scholar
  9. 9.
    Dusha D, Boles WW, Walker R (2007) Fixed-wing attitude estimation using computer vision based horizon detection, pp 1–19Google Scholar
  10. 10.
    Calise AJ (2003) Applications of adaptive neural-network control to unmanned aerial vehicles. In: AIAA/ICAS international air and space symposium and exposition: the next, vol 100Google Scholar
  11. 11.
    Senthilnathan R, Nikhil S, Sasikala R, Maruvada A (2017) Model based design of vision guided vertical landing system for quadrotor. Int J Control Theor Appl 10(9):803–819Google Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  • R. Senthilnathan
    • 1
    Email author
  • Niket Ahuja
    • 1
  • G. Vyomkesh Bhargav
    • 1
  • Devansh Ahuja
    • 1
  • Adish Bagi
    • 1
  1. 1.SRM Institute of Science and TechnologyKattankulathurIndia

Personalised recommendations