Abstract
Unmanned Aerial Vehicles (UAVs) can be further optimized as tools on-board ships with the development of lacking infrastructure, like their recovery at sea. Current technologies focus on vision-based systems with little consideration for ship motion. A novel autonomous landing technique is tested experimentally, featuring acoustic positioning to allow for landings in a wider breadth of conditions and to reduce the reliance on specially designed landing targets. A potential fields path planner is used to adapt for ship motion and provide obstacle avoidance and natural biasing away from the heaving ship deck. A sea state predictor is used to compensate for harsher sea conditions and ship motion, allowing the UAV to look for appropriate landing windows in higher sea states. Autonomous landings are demonstrated in a lab setting for sea conditions up to, and including, sea state 5. The ship motions are defined using real sea trials data from the decommissioned HMCS Nipigon.
Similar content being viewed by others
Code Availability
All software used is open source and available on github.
References
Gautam, A., Sujit, P., Saripalli, S.: A survey of autonomous landing techniques for UAVs. In: International Conference on Unmanned Aircraft Systems, pp. 1210–1218 (2014)
Kong, W., Zhou, D., Zhang, D., et al.: Vision-based autonomous landing system for unmanned aerial vehicle: A survey. In: International Conference on Multisensor Fusion and Information Integrationfor Intelligent Systems (MFI), pp. 1–8 (2014)
Shakernia, O, Ma, Y, koo, T, et al.: Landing an unmanned air vehicle: Vision based motion estimation and nonlinear control. Asian Journal of Control 1, 128–145 (1999)
Saripalli, S, Montgomery, J, Sukhatme, G.: Vision-based autonomous landing of an unmanned aerial vehicle. IEEE International Conference on Robotics and Automation 3, 2799–2804 (2002)
Sharp, C, Shakernia, O, Sastry, S.: A vision system for landing an unmanned aerial vehicle. IEEE International Conference on Robotics and Automation 2, 1720–1727 (2001)
Shakernia, O, Vidal, R, Sharp, C, et al.: Multiple view motion estimation and control for landing an unmanned aerial vehicle. IEEE International Conference on Robotics and Automation 3, 2793–2798 (2002)
Mebarki, R., Lippiello, V., Siciliano, B.: Autonomous landing of rotary-wing aerial vehicles by image-based visual servoing in GPS-denied environments. In: IEEE International Symposium on Safety, Security, and Rescue Robotics (2015)
Sanchez-Lopez, J, Pestana, J.: An approach toward visual autonomous ship board landing of a VTOL UAV. J. Intell. Robotic Syst. 74, 113–127 (2014)
Shuo, Y., Jiahang, Y., Lu, Y., et al.: Precise quadrotor autonomous landing with SRUKF vision perception. In: IEEE International Conference on Robotics and Automation, pp. 2196–2201 (2015)
Bi, Y, Duan, H.: Implementation of autonomous visual tracking and landing for a low-cost quadrotor. Optik - International Journal for Light and Electron Optics 124, 3296–3300 (2013)
Lange, S., Sunderhauf, N., Protzel, P.: Autonomous landing for a multirotor UAV using vision. In: International Conference on Simulation, Modeling and Programming for Autonomous Robots, pp. 482–491 (2008)
Lange, S., Sunderhauf, N., Protzel, P.: A vision based onboard approach for landing and position control of an autonomous multirotor UAV in GPS-denied environments. In: International Conference on Advanced Robotics, pp. 1–6 (2009)
Lin, S, Garratt, M, Lambert, A.: Monocular vision-based real-time target recognition and tracking for autonomously landing an UAV in a cluttered shipboard environment. Auton. Robot. 41, 881–901 (2017)
Qui, L, Song, Z, Shen, W.: Computer vision scheme used for the automate landing of unmanned helicopter on ship deck. Acta Aeronautica Et Astronautica Sinica 24, 351–354 (2003)
Xu, C., Qiu, L., Liu, M., et al.: Stereo vision based relative pose and motion estimation for unmanned helicopter landing. In: IEEE Internation conference on Information Aquisition, pp. 31–36 (2006)
Hsia, K, Lien, S, Su, J.: Height estimation via stereo vision system for unmanned helicopter autonomous landing. International Symposium on Computer Communication Control and Automation 2, 257–260 (2010)
Sereewatana, M., Ruchanurucks, M., Siddhichai, S.: Depth estimation of markers for UAV automatic landing control using stereo vision with a single camera. ICICTES, pp. 29–34 (2014)
Yakimenko, O, Kaminer, I, Lentz, W, et al.: Unmanned aircraft navigation for shipboard landing using infrared vision. IEEE Trans. Aerosp. Electron. Syst. 38, 1181–1200 (2002)
Wenzel, K., Rosset, P., Zell, A.: Automatic take off, hovering and landing control for miniature helicopters with low-cost onboard hardware. In: . In: Proceedings of the AMS’09, Autonome Mobile Systeme, vol. 2009, pp 73–80 (2009)
Wenzel, K, Rosset, P, Zell, A.: Low-cost visual tracking of a landing place and hovering flight control with a microcontroller. J. Intell. Robotic Syst. 57, 297–311 (2010)
Gui, Y, Guo, P, Zhang, H, et al.: Airborne vision-based navigation method for UAV accuracy landing using infrared lamps. J. Intell. Robotic Syst. 72, 197–218 (2013)
Pebrianti, D, Kendoul, F, Azrad, S, et al.: Autonomous hovering and landing of a quad-rotor micro aerial vehicle by means of on ground stereo vision system. Journal of System Design and Dynamics 4, 269–284 (2010)
Martinez, C, Mondragon, I, Olivares-Mendez, M, et al.: On-board and ground visual pose estimation techniques for UAV control. J. Intell. Robotic Syst. 61, 301–320 (2011)
Kim, M, Kim, Y.: Multiple UAVs nonlinear guidance laws for stationary target observation with waypoint incidence angle constraint. International Journal of Aeronautical and Space Sciences 14, 67–74 (2013)
Min, B, Tahk, M J, Shim, D, et al.: Guidance law for visionbased automatic landing of UAV. KSAS International Journal 8, 46–53 (2007)
Saripalli, S., Sukhatme, G.: Landing on a moving target using an autonomous helicopter. In: IEEE International Conference on Robotics and Automation (2007)
Saripalli, S.: Vision-based autonomous landing of an helicopter on a moving target. In: AIAA Guidance, Navigation and Control Conference (2009)
Wu, C, Qi, J, Song, D, et al.: LP Based path planning for autonomous landing of an unmanned helicopter on a moving platform. The Journal of Unmanned System Technology 1 (2013)
Yoon, S., Kim, Y.: Pursuit guidance law and adaptive backstepping controller design for vision-based net-recovery UAV. In: AIAA Guidance, Navigation and Control COnference and Exhibit (2008)
Yoon, S, Kim, H, Kim, Y.: Spiral landing trajectory and pursuit guidance law design for vision-based net-recovery UAV. AIAA Guidance, Navigation, and Control Conference 30, 600–605 (2009)
Yoon, S, Kim, H, Kim, Y.: Spiral landing guidance law design for unmanned aerial vehicle net-recovery. J. Aerosp. Eng. 224, 1081–1096 (2010)
Huh, S, Shim, D.: A vision-based landing system for small unmanned aerial vehicles using an airbag. Control. Eng. Pract. 18(18), 812–823 (2010)
Huh, S, Shim, D.: A vision-based automatic landing method for fixed-wing UAVs. Journal of Intellegent Robotic Systems 57, 217–231 (2010)
Ferrier, B, Ernst, R.: Fire scout launch and recovery considerations in unexpected ship roll motion conditions. Nav. Eng. J 129, 87–98 (2017)
Moriarty, P., Sheehy, R., Doody, P.: Autonomous landing of a UAV on a moving platform using model predictive control. 2017 28th Irish Signals and Systems Conference (ISSC) (2017)
Abujoub, S., McPhee, J., Westin, C., et al.: Unmanned aerial vehicle landing on maritime vessels using signal prediction of the ship motion. OCEANS 2018 MTS/IEEE Charleston (2018)
Erginer, B., Altug, E.: Modeling and PD control of a quadrotor VTOL vehicle. IEEE Intellegent Vehicles Symposium, pp. 894–899 (2007)
Hervas, J., Reyhanoglu, M., Tang, H.: Automatic landing control of unmanned aerial vehicles on moving platforms. In: 2014 IEEE 23rd International Symposium on Industrial Electronics (ISIE) (2014)
Zhang, X., Fang, Y., et al.: A novel geometric hierarchical approach for dynamic visual servoing of quadrotors. IEEE Transactions on Industrial Electronics 67(5), 3840–3849 (2020)
Ross, J., Seto, M., Johnston, C.: Zero visibility autonomous landing of quadrotors on underway ships in a sea state. In: Proceedings of the 13th IEEE International Symposium on Robotic and Sensors Environments (2019)
Ross, J., Lindsay, J., Gregson, E., et al.: Collaboration of multi- domain marine robots towards above and below-water characterization of floating targets. In: Proceedings of the 13th IEEE International Symposium on Robotic and Sensors Environments (2019)
Ross, J., Seto, M., Johnston, C.: Autonomous zero visibility landing of quadrotors on underway ships in a sea state. In: Proceedings of the 2019 OCEANS Conference & Exposition (2019)
McAdams, T.: Slope limits. Aircraft Owners and Pilots Association 2012
Funding
Funding for the project was provided by The Marine Environmental Observation, Prediction and Response Network (MEOPAR), the Irving Shipbuilding Research Chair on Marine Engineering and Autonomous Systems and the NSERC chair in Design Engineering.
Author information
Authors and Affiliations
Contributions
MS and CJ conceived and presented the idea. MS and CJ secured the funding and built the project time line. JR developed the theory, designed the code and experimental platform, performed the experiments and analysed the data with the support of MS and CJ. JR, MS and CJ wrote the paper.
Corresponding author
Additional information
Availability of data and material
This work uses data made available by DRDC. This information is not in the public domain.
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Ross, J., Seto, M. & Johnston, C. Autonomous Landing of Rotary Wing Unmanned Aerial Vehicles on Underway Ships in a Sea State. J Intell Robot Syst 104, 1 (2022). https://doi.org/10.1007/s10846-021-01515-x
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s10846-021-01515-x