Skip to main content
Log in

Adaptive neural network control for visual servoing of underwater vehicles with pose estimation

  • Original article
  • Published:
Journal of Marine Science and Technology Aims and scope Submit manuscript

Abstract

In this paper, the visual servo control of fully actuated underwater vehicles is investigated by employing a position-based approach. Firstly, the global coordinates and Euler angles of the underwater vehicle with respect to a stationary visual target are estimated by an unscented Kalman filter with the visual measurements of point features, whose coordinates in the global frame attached to the stationary target are precisely known. Then, the adaptive neural network controller is designed for underwater vehicles to track the desired trajectory with estimated global pose information. The convergence of tracking errors is ensured by using a single-hidden-layer neural network, in conjunction with a sliding mode controller, to compensate for dynamic uncertainties and external disturbances. Simulation experiments with an underwater vehicle to track a time-varying trajectory and hold its position at a desired point are provided to demonstrate the performances of the proposed vision-based controller.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Similar content being viewed by others

References

  1. Fossen TI (2002) Marine control systems: guidance, navigation and control of ships, rigs and underwater vehicles. Marine Cybernetics, Trondheim

    Google Scholar 

  2. Antonelli G (2014) Underwater Robots, 3rd edn. Springer, Berlin

    Book  Google Scholar 

  3. Chaumette F, Hutchinson S (2006) Visual servo control. I. Basic approaches. IEEE Robot Autom Mag 13(4):82–90

    Article  Google Scholar 

  4. Chaumette F, Hutchinson S (2007) Visual servo control. II. Advanced approaches. IEEE Robot Autom Mag 14(1):109–118

    Article  Google Scholar 

  5. Shi H, Li X, Hwang KS, Pan W, Xu G (2016) Decoupled visual servoing with fuzzy Q-learning. IEEE Trans Industr Inform. doi:10.1109/TII.2016.2617464

    Google Scholar 

  6. Lots JF, Lane DM, Trucco E (2000) Application of 2 1/2 D visual servoing to underwater vehicle station-keeping. In: Proceedings of the MTS/IEEE OCEANS conference, pp 1257–1264

  7. Lots JF, Lane DM, Trucco E, Chaumette F (2001) A 2-D visual servoing for underwater vehicle station keeping. In: Proceedings of the IEEE international conference on robotics and automation, pp 2767–2772

  8. Silpa-Anan C, Brinsmead T, Abdallah S, Zelinsky A (2001) Preliminary experiments in visual servo control for autonomous underwater vehicle. In: Proceedings of the IEEE/RSJ international conference on intelligent robots and systems, pp 1824–1829

  9. Bechlioulis CP, Karras GC, Nagappa S, Palomeras N, Kyriakopoulos KJ, Carreras M (2013) A robust visual servo control scheme with prescribed performance for an autonomous underwater vehicle. In: Proceedings of the IEEE/RSJ international conference on intelligent robots and systems, pp 3879–3884

  10. Heshmati-alamdari S, Eqtami A, Karras GC, Dimarogonas DV, Kyriakopoulos KJ (2014) A self-triggered visual servoing model predictive control scheme for under-actuated underwater robotic vehicles. In: Proceedings of the 2014 IEEE international conference on robotics and automation, pp 3826–3831

  11. Hua MD, Allibert G, Krupinski S, Hamel T (2014) Homography-based visual servoing for autonomous underwater vehicles. In: Proceedings of the 19th IFAC world congress, pp 5726–5733

  12. Li Y, Jiang Y, Cao J, Wang B, Li Y (2015) AUV docking experiments based on vision positioning using two cameras. Ocean Eng 110:163–173

    Article  Google Scholar 

  13. Palomeras N, Nagappa S, Ribas D, Gracias N, Carreras M (2013) Vision-based localization and mapping system for AUV intervention. In: Proceedings of the MTS/IEEE OCEANS conference, pp 1–7

  14. Palomeras N, Peñalver A, Massot-Campos M, Vallicrosa G, Negre PL, Fernández JJ, Ridao P, Sanz PJ, Oliver-Codina G, Palomer A (2014) I-AUV docking and intervention in a subsea panel. In: Proceedings of the IEEE/RSJ international conference on intelligent robots and systems, pp 2279–2285

  15. Gao J, Proctor AA, Bradley C (2015) Adaptive neural network visual servo control for dynamic positioning of underwater vehicles. Neurocomputing 167:604–613

    Article  Google Scholar 

  16. Gao J, Proctor AA, Shi Y, Bradley C (2016) Hierarchical model predictive image-based visual servoing of underwater vehicles with adaptive neural network dynamic control. IEEE Trans Cybern 46(10):2323–2334

    Article  Google Scholar 

  17. Wan EA, van der Merwe R (2000) The unscented Kalman filter for nonlinear estimation. In: Proceedings of the IEEE adaptive systems for signal processing, communications, and control symposium, pp 153–158

  18. Kandepu R, Foss B, Imsland L (2008) Applying the unscented Kalman filter for nonlinear state estimation. J Process Control 18(7–8):753–768

    Article  Google Scholar 

  19. Johnson EN, Kannan SK (2005) Adaptive trajectory control for autonomous helicopters. J Guid Control Dyn 28(3):524–538

    Article  Google Scholar 

  20. Zhang M, Chu Z (2012) Adaptive sliding mode control based on local recurrent neural networks for underwater robot. Ocean Eng 45:56–62

    Article  Google Scholar 

  21. Chu Z, Zhu D, Yang SX. Observer-Based Adaptive Neural network trajectory tracking control for remotely operated vehicle. IEEE Trans Neural Netw Learn Syst. doi:10.1109/TNNLS.2016.2544786.

  22. Silpa-Anan C (2001) Autonomous Underwater Robot: Vision and Control. Master’s thesis, Australian National University, Australia

  23. Fischer N, Hughes D, Walters P, Schwartz EM, Dixon WE (2014) Nonlinear RISE-based control of an autonomous underwater vehicle. IEEE Trans Rob 30(4):845–852

    Article  Google Scholar 

  24. Xu J, Wang M, Qiao L (2015) Dynamical sliding mode control for the trajectory tracking of underactuated unmanned underwater vehicles. Ocean Eng 105:54–63

    Article  Google Scholar 

  25. Chen Y, Zhang R, Zhao X, Gao J (2016) Tracking control of underwater vehicle subject to uncertainties using fuzzy inverse desired trajectory compensation technique. J Marine Sci Technol 21(4):624–650

    Article  Google Scholar 

Download references

Acknowledgement

This work is supported by the National Natural Science Foundation of China under Grant 51279164.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Jian Gao.

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Gao, J., Wu, P., Yang, B. et al. Adaptive neural network control for visual servoing of underwater vehicles with pose estimation. J Mar Sci Technol 22, 470–478 (2017). https://doi.org/10.1007/s00773-016-0426-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00773-016-0426-6

Keywords

Navigation