Experimental evaluation of a real-time GPU-based pose estimation system for autonomous landing of rotary wings UAVs
This paper proposes a real-time system for pose estimation of an unmanned aerial vehicle (UAV) using parallel image processing and a fiducial marker. The system exploits the capabilities of a high-performance CPU/GPU embedded system in order to provide on-board high-frequency pose estimation enabling autonomous takeoff and landing. The system is evaluated extensively with lab and field tests using a custom quadrotor. The autonomous landing is successfully demonstrated, through experimental tests, using the proposed algorithm. The results show that the system is able to provide precise pose estimation with a framerate of at least 30 fps and an image resolution of 640×480 pixels. The main advantage of the proposed approach is in the use of the GPU for image filtering and marker detection. The GPU provides an upper bound on the required computation time regardless of the complexity of the image thereby allowing for robust marker detection even in cluttered environments.
KeywordsUAV Vision GPU Kalman filter
Unable to display preview. Download preview PDF.
- C. Bu, Y. Ai, H. Du. Vision-based autonomous landing for rotorcraft unmanned aerial vehicle. IEEE International Conference on Vehicular Electronics and Safety (ICVES), Beijing: IEEE, 2016: 1–6. DOI 10.1109/ICVES.2016.7548174.Google Scholar
- A. Gautam, P. B. Sujit, S. Saripalli. A survey of autonomous landing techniques for UAVs. International Conference on Unmanned Aircraft Systems (ICUAS), Orlando: IEEE, 2014: 1210–1218. DOI 10.1109/ICUAS.2014.6842377.Google Scholar
- M. F. R. Lee, S. F. Su, J. W. E. Yeah, et al. Autonomous landing system for aerial mobile robot cooperation. The Joint 7th International Conference on Soft Computing and Intelligent Systems (SCIS) and 15th International Symposium on Advanced Intelligent Systems (ISIS), Kitakyushu: IEEE, 2014: 1306–1311. DOI 10.1109/SCIS-ISIS.2014.7044826.Google Scholar
- X. Guan, H. Bai. A GPU accelerated real-time self-contained visual navigation system for UAVs. IEEE International Conference on Information and Automation, Shenyang: IEEE, 2012: 578–581. DOI 10.1109/ICInfA.2012.6246879.Google Scholar
- G. Klein, D. Murray. Parallel tracking and mapping for small AR workspaces. The 6th IEEE and ACM International Symposium on Mixed and Augmented Reality, Nara: IEEE, 2007: 225–234. DOI 10.1109/ISMAR.2007.4538852.Google Scholar
- F. Cocchioni, A. Mancini, S. Longhi. Autonomous navigation, landing and recharge of a quadrotor using artificial vision. International Conference on Unmanned Aircraft Systems (ICUAS), Orlando: IEEE, 2014: 418–429. DOI 10.1109/ICUAS.2014. 6842282.Google Scholar
- Y. Jung, D. Lee, H. Bang. Study on ellipse fitting problem for vision-based autonomous landing of an UAV. The 14th International Conference on Control, Automation and Systems (ICCAS), Seoul: IEEE, 2014: 1631–1634. DOI 10.1109/ICCAS.2014.6987819Google Scholar
- H. Cheng, Y. Chen, X. Li, et al. Autonomous takeoff, tracking and landing of a UAV on a moving UGV using onboard monocular vision. Proceedings of the 32nd Chinese Control Conference, Xi’an: IEEE, 2013: 5895–5901.Google Scholar
- S. Lange, N. Sunderhauf, P. Protzel. A vision based onboard approach for landing and position control of an autonomous multirotor UAV in GPS-denied environments. International Conference on Advanced Robotics, Munich, 2009: 1–6.Google Scholar
- K. H. Hsia, S. F. Lien, J. P. Su. Height estimation via stereo vision system for unmanned helicopter autonomous landing. International Symposium on Computer, Communication, Control and Automation (3CA), Tainan: IEEE, 2010: 257–260. DOI 10.1109/3CA.2010.5533535.Google Scholar
- L. Calvet, P. Gurdjos, V. Charvillat. Camera tracking using concentric circle markers: Paradigms and algorithms. The 19th IEEE International Conference on Image Processing, Orlando: IEEE, 2012: 1361–1364. DOI 10.1109/ICIP.2012.6467121.Google Scholar
- A. Benini, M. J. Rutherford, K. P. Valavanis. Real-time, GPUbased pose estimation of a UAV for autonomous takeoff and landing. IEEE International Conference on Robotics and Automation (ICRA), Stockholm: IEEE, 2016: 3463–3470. DOI 10.1109/ICRA.2016.7487525.Google Scholar
- S. A. Conyers, N. I. Vitzilaios, M. J. Rutherford, et al. A mobile self-leveling landing platform for VTOL UAVs. IEEE International Conference on Robotics and Automation (ICRA), Seattle: IEEE, 2015: 815–822. DOI 10.1109/ICRA.2015.7139272.Google Scholar
- CUDA Programming Guide: http://docs.nvidia.com/cuda/cuda-cprogramming-guide.