Springer Nature is making SARS-CoV-2 and COVID-19 research free. View research | View latest news | Sign up for updates

A binocular vision-based UAVs autonomous aerial refueling platform

Abstract

Unmanned aerial vehicles (UAVs) are highly focused and widely used in various domains, and the capability of autonomous aerial refueling (AAR) becomes increasingly important. Most of the research in this area concerns the verification of the algorithms while the experiments are conducted on the ground. In this work, in order to verify the vision system designed for boom approach AAR, an integrated platform is built and tested. The platform consists of a tanker UAV, a receiver UAV and a ground station. The pictures of the marker on the receiver UAV are captured by the binocular vision system on the tanker UAV and then used for flight control and boom control. Performance and feasibility of the platform are demonstrated by the real out-door flight tests, and the experimental results verified the feasibility and effectiveness of our developed binocular vision-based UAVs AAR.

摘要

无人机 (Unmanned aerial vehicles, UAVs) 在工程领域受到高度关注和广泛应用, 在这种情况下, 自动空中加油技术 (autonomous aerial refueling, AAR) 的实现则变得越来越重要。 当前, 该领域的研究重点关注算法的实现, 实际验证则多为地面验证。 为了测试硬管加油的视觉系统, 我们设计并开发了一个完整的实验平台。 该平台由一架加油无人机, 一架受油无人机和地面站组成。加油机上搭载的双目视觉系统采集受油机上的标志点图像,将其用于飞行控制和加油杆控制。实际飞行测试的结果验证了该平台的表现和稳定性。文中展示的结果数据证明视觉系统和控制系统可支持硬式自动空中加油技术的实现。

This is a preview of subscription content, log in to check access.

References

  1. 1

    Tsai W T, Bai X Y, Huang Y. Software-as-a-service (SaaS): perspectives and challenges. Sci China Inf Sci, 2014, 57: 051101

  2. 2

    Dai W Q, Jin H, Zou D Q, et al. TEE: a virtual DRTM based execution environment for secure cloudend computing. Future Gener Comput Syst, 2015; 49: 47–57

  3. 3

    Dai WQ, Paul P T, Jin H, et al. Enhancing data trustworthiness via assured digital signing. IEEE Trans Depend Secure Comput (TDSC), 2012; 9: 838–851

  4. 4

    Shi L, Zou D Q, Jin H. Xen Virtualization Technology (in Chinese). Wuhan: Huazhong University of Science and Technology Press, 2009

  5. 5

    Jin H. The Virtualization of Computing System Principles and Applications (in Chinese). Beijing: Tsinghua University Press, 2008

  6. 6

    Zou D Q, Qiang WZ, Jin H. The Principles and Application of Trusted Computing Technology (in Chinese). Beijing: Science Press, 2011

  7. 7

    Chen G, Jin H, Zou D Q, et al. A framework for practical dynamic software updating. IEEE Trans Parallel Distrib Syst, 2016; 27: 941–950

  8. 8

    Liu K, Zou D Q, Jin H. UaaS: software update as a service for the IaaS cloud. In: Proceedings of IEEE International Conference on Services Computing, Chicago, 2015. 483–490

  9. 1

    Tanner H G. Switched UAV-UGV cooperation scheme for target detection. In: Proceedings of IEEE International Conference on Robotics and Automation, Roma, 2007. 3457–3462

  10. 2

    Wang X H, Duan H B. Biologically adaptive robust mean shift algorithm with cauchy predator-prey BBO and space variant resolution for unmanned helicopter formation. Sci China Inf Sci, 2014, 57: 112202

  11. 3

    Jakob M, Semsch E, Pavlícek D, et al. Occlusion-aware multi-UAV surveillance of multiple urban areas. In: Proceedigns of the 6th Workshop on Agents in Traffic and Transportation, Toronto, 2010. 59–66

  12. 4

    Duan H B, Qiu H X, Fan Y M. Unmanned aerial vehicle close formation cooperative control based on predatory escaping pigeon-inspired optimization (in Chinese). Sci Sin Tech, 2015; 45: 559–572

  13. 5

    Baba Y, Takano H, Miyamoto S, et al. Air combat guidance law for an UCAV. In: Proceedings of the 1st Technical Conference and Workshop on Unmanned Aerospace Vehicles, Portsmouth, 2002. 1–11

  14. 6

    Nalepka J P, Hinchman J L. Automated aerial refueling: extending the effectiveness of unmanned air vehicles. In: Proceedings of Modeling and Simulation Technologies Conference and Exhibit, San Francisco, 2005. 15–18

  15. 7

    Valasek J, Gunnam K, Kimmett J, et al. Vision-based sensor and navigation system for autonomous air refueling. J Guid Control Dyna, 2005; 28: 979–989

  16. 8

    Chen C I, Stettner R. Drogue tracking using 3D flash lidar for autonomous aerial refueling. Proc SPIE Laser Radar Technology and Applications XVI, 2011. 80370Q

  17. 9

    Yin Y, Xu D,Wang X, et al. Detection and tracking strategies for autonomous aerial refueling tasks based on monocular vision. Int J Advanced Robot Syst, 2014; 11: 1–12

  18. 10

    Wilson D B, Goktogan A H, Sukkarieh S. Experimental validation of a drogue estimation algorithm for autonomous aerial refueling. In: Proceedings of IEEE International Conference on Robotics and Automation (ICRA), Seattle, 2015. 5318–5323

  19. 11

    Campa G, Fravolini M L, Ficola A, et al. Autonomous aerial refueling for UAVs using a combined GPS-machine vision guidance. In: Proceedings of Guidance, Navigation, and Control Conference and Exhibit, Providence, 2004. 1–11

  20. 12

    Doebbler J, Spaeth T, Valasek J, et al. Boom and receptacle autonomous air refueling using visual snake optical sensor. J Guid Control Dynam, 2007; 30: 1753–1769

  21. 13

    Zhang S J, Cao X B, Zhang F, et al. Monocular vision-based iterative pose estimation algorithm from corresponding feature points. Sci China Inf Sci, 2010; 53: 1682–1696

  22. 14

    Lei T, Wang Y, Fan Y Y, et al. Vector morphological operators in HSV color space. Sci China Inf Sci, 2013; 56: 1–12

  23. 15

    Zhang W L, Liu L B, Yin S Y, et al. An efficient VLSI architecture of speeded-up robust feature extraction for high resolution and high frame rate video. Sci China Inf Sci, 2013; 56: 1–14

  24. 16

    Duan H B, Zhang Q F, Deng Y M, et al. Biologically eagle-eye-based autonomous aerial refueling for unmanned aerial vehicles. Chinese J Sci Instrum, 2014; 35: 1450–1458

  25. 17

    Kimmett J, Valasek J, Junkins J L. Autonomous aerial refueling utilizing a vision based navigation system. In: Proceedings of the Guidance, Navigation and Control Conference and Exhibit, Monterey, 2002. 1–11

  26. 18

    Lu C P, Hager G D, Mjolsness E. Fast and globally convergent pose estimation from video images. IEEE Trans Pattern Anal Mach Intell, 2000; 22: 610–622

  27. 19

    Chen S Z, Xu H, Liu D K, et al. A vision of IoT: applications, challenges and opportunities, with China perspective. IEEE Int Things J, 2014; 1: 349–359

  28. 20

    Bouabdallah S, Siegwart R. Full control of a quadrotor. In: Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems, San Diego, 2007. 153–158

  29. 21

    Bouabdallah S, Murrieri P, Siegwart R. Design and control of an indoor micro quadrotor. In: Proceedings of IEEE International Conference on Robotics and Automation (ICRA’04), New Orleans, 2004; 5: 4393–4398

  30. 22

    Khatib O. Real-time obstacle avoidance for manipulators and mobile robots. Int J Robot Res, 1986; 5: 90–98

Download references

Author information

Correspondence to Haibin Duan.

Electronic supplementary material

Rights and permissions

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Duan, H., Li, H., Luo, Q. et al. A binocular vision-based UAVs autonomous aerial refueling platform. Sci. China Inf. Sci. 59, 053201 (2016). https://doi.org/10.1007/s11432-016-5553-5

Download citation

Keywords

  • unmanned aerial vehicles (UAVs)
  • autonomous aerial refueling (AAR)
  • boom approach
  • binocular vision
  • visual measurement

关键词

  • 无人机
  • 自动空中加油
  • 硬式加油
  • 双目视觉
  • 视觉测量