Abstract
Underwater cooperative robotics offers the possibility to perform challenging intervention applications, such as recovering archeological objects as within the context of the MERBOTS research project, or grasping, transporting and assembly of big objects, using more than one mobile manipulator, as faced by the TWINBOT project. In order to enhance safety during the intervention, it is reasonable to avoid the umbilical, also giving more mobility to the robots, and enabling a broader set of cooperative movements. Several solutions, based on acoustic, radiofrequency (RF) or Visual Light Communication (VLC) have been proposed for underwater communications in the literature. This paper presents the architecture of an underwater wireless communication framework for the control of multiple semi-autonomous robots in cooperative interventions. The proposed framework is composed of several modules as the virtual reality interface using UWSim, the Underwater Multi-robot Cooperative Intervention Remote Control Protocol (UMCI-RCP) and a Generic Link Layer (GLL). UMCI-RCP allows the control of an underwater robot over limited communication links. UMCI-RCP integrates a progressive compression algorithm that provides visual feedback at a constant rate and ensures image reception even in channels with loses. The Time Division Multiple Access (TDMA) medium access strategy minimizes the jitter of transmitted packets. The GLL has been designed in order to provide support for multimodal transmission (i.e. acoustic, RF and VLC) and also to interface with the UWSim-NET simulator so that facilitates the experimentation either with a real or with a simulated modem. The possibility of exchange real and simulated devices in the proposed framework are demonstrated by means of a teleoperation experiment with a BlueROV equipped with the S100 RF modems. Hardware-In-the-Loop (HIL) capabilities are demonstrated repeating the experiment with the real modems and modeling the BlueROV, and also modeling both the modems and the BlueROV.
Article PDF
Similar content being viewed by others
Avoid common mistakes on your manuscript.
References
Ayela, G., Coudeville, J.M.: Tiva: A long range, high baud rate image/data acoustic transmission system for underwater applications. In: Underwater defence technol conf. Paris, France (1991)
Bales, J.W., Chryssostomidis, C.: High-bandwidth, low-power, short-range optical communication underwater. In: 9th international symposium on unmanned untethered submersible technology, Durham, New Hampshire (1995)
Caiti, A., Grythe, K., Hovem, J.M., Jesus, S.M., Lie, A., Munafò, A, Reinen, T.A., Silva, A., Zabel, F.: Linking acoustic communications and network performance: Integration and experimentation of an underwater acoustic network. IEEE J. Ocean. Eng. 38(4), 758–771 (2013). https://doi.org/10.1109/JOE.2013.2279472
Centelles, D., Moscoso, E., Vallicrosa, G., Palomeras, N., Sales, J., Marti, J.V., Marin, R., Ridao, P., Sanz, P.J.: Wireless HROV control with compressed visual feedback over an acoustic link. In: OCEANS 2017 - Aberdeen, IEEE, pp. 1–7. https://doi.org/10.1109/OCEANSE.2017.8084979. http://ieeexplore.ieee.org/document/8084979/ (2017)
Centelles, D., Soriano-Asensi, A., Martí, J.V., Marín, R., Sanz, P.J.: Underwater wireless communications for cooperative robotics with uwsim-net. Appl. Sci. 9(17), 3526 (2019). https://doi.org/10.3390/app9173526. https://www.mdpi.com/2076-3417/9/17/3526
Che, X., Wells, I., Dickers, G., Kear, P., Gong, X.: Re-evaluation of rf electromagnetic communication in underwater sensor networks. IEEE Commun. Mag. 48(12), 143–151 (2010)
Cossu, G., Corsini, R., Khalid, A., Balestrino, S., Coppelli, A., Caiti, A., Ciaramella, E.: Experimental demonstration of high speed underwater visible light communications. In: 2013 2nd International Workshop on Optical Wireless Communications (IWOW), pp. 11–15. https://doi.org/10.1109/IWOW.2013.6777767 (2013)
Dea, J., Radosevic, D., Tran, N., Chavez, J., Neuner, I.I.I.B.: Land and undersea field testing of very low frequency rf antennas and loop transceivers. Tech. rep., SSC Pacific San Diego United States (2017)
Farr, N., Bowen, A., Ware, J., Pontbriand, C., Tivey, M.: An integrated, underwater optical /acoustic communications system. In: OCEANS 2010 IEEE - Sydney, pp 1–6. https://doi.org/10.1109/OCEANSSYD.2010.5603510 (2010)
Garrido-Jurado, S., Muñoz-Salinas, R., Madrid-Cuevas, F., Marín-Jiménez, M.: Automatic generation and detection of highly reliable fiducial markers under occlusion. Pattern Recogn. 47(6), 2280–2292 (2014). https://doi.org/10.1016/j.patcog.2014.01.005
IRSLab: MERBOTS Research Project (http://www.irs.uji.es/merbots/) (2015)
IRSLab: TWINBOT Research Project (http://www.irs.uji.es/twinbot/) (2018)
Kaushal, H., Kaddoum, G.: Underwater optical wireless communication. IEEE Access 4, 1518–1547 (2016)
Kebkal, O., Komar, M., Kebkal, K., Bannasch, R.: D-mac: Media access control architecture for underwater acoustic sensor networks. In: OCEANS 2011 IEEE - Spain, pp. 1–8 . https://doi.org/10.1109/Oceans-Spain.2011.6003586 (2011)
Meier, L., Tanskanen, P., Heng, L., Lee, G.H., Fraundorfer, F., Pollefeys, M.: Pixhawk: A micro aerial vehicle design for autonomous flight using onboard computer vision. Auton. Robot. 33(1-2), 21–39 (2012)
Merriam, S., Porta, D.: Dsp-based acoustic telemetry modems. In: Sea Technol (1993)
Pelekanakis, C., Stojanovic, M., Freitag, L.: High rate acoustic link for underwater video transmission. In: OCEANS 2003. Proceedings, vol. 2, pp. 1091–1097. https://doi.org/10.1109/OCEANS.2003.178494 (2003)
Prats, M., Pérez, J., Fernández, J., Sanz, P.: An open source tool for simulation and supervision of underwater intervention missions. In: 2012 IEEE/RSJ international conference on intelligent robots and systems (IROS), pp. 2577–2582. https://doi.org/10.1109/IROS.2012.6385788 (2012)
Quigley, M., Conley, K., Gerkey, B., Faust, J., Foote, T., Leibs, J., Wheeler, R., Ng, A.Y.: Ros: An open-source robot operating system. In: ICRA workshop on open source software, Kobe, Japan, pp. 5 (2009)
Ribas, D., Palomeras, N., Ridao, P., Carreras, M., Mallios, A.: Girona 500 AUV: From survey to intervention. IEEE/ASME Trans. Mechatron. 17(1), 46–53 (2012). https://doi.org/10.1109/TMECH.2011.2174065
Ribas, D., Ridao, P., Turetta, A., Melchiorri, C., Palli, G., Fernandez, J.J., Sanz, P.J.: I-AUV Mechatronics Integration for the TRIDENT FP7 Project. IEEE/ASME Trans. Mechatron. 20 (5), 2583–2592 (2015). https://doi.org/10.1109/TMECH.2015.2395413. http://ieeexplore.ieee.org/lpdocs/epic03/wrapper.htm?arnumber=7047908
Ribas, J., Sura, D., Stojanovic, M.: Underwater wireless video transmission for supervisory control and inspection using acoustic OFDM. In: OCEANS, vol. 2010, pp 1–9 (2010). https://doi.org/10.1109/OCEANS.2010.5663839
Romero-Ramirez, F.J., Muñoz-Salinas, R., Medina-Carnicer, R.: Speeded up detection of squared fiducial markers. Image Vis. Comput. 76, 38–47 (2018). https://doi.org/10.1016/j.imavis.2018.05.004. http://www.sciencedirect.com/science/article/pii/S0262885618300799
Rubino, E.M., Centelles, D., Sales, J., Marti, J.V., Marin, R., Sanz, P.J., Alvares, A.J.: Progressive image compression and transmission with region of interest in underwater robotics. In: OCEANS 2017 - Aberdeen, IEEE, pp 1–9. https://doi.org/10.1109/OCEANSE.2017.8084999. http://ieeexplore.ieee.org/document/8084999/ (2017)
Rubino, E.M., Centelles, D., Sales, J., Martí, J.V., Marín, R., Sanz, P.J., Álvares A.J.: Underwater radio frequency image sensor using progressive image compression and region of interest. Journal of the Brazilian Society of Mechanical Sciences and Engineering. https://doi.org/10.1007/s40430-017-0894-6 (2017)
Schneider, T., Schmidt, H.: Unified command and control for heterogeneous marine sensing networks. J. Field Robot. 27(6), 876–889 (2010). https://doi.org/10.1002/rob.20346.
Shaw, A., Al-Shamma’a, A., Wylie, S., Toal, D.: Experimental investigations of electromagnetic wave propagation in seawater. In: Microwave Conference, 2006. 36th European, pp. 572–575. https://doi.org/10.1109/EUMC.2006.281456 (2006)
Suzuki, M., Sasaki, T., Tsuchiya, T.: Digital acoustic image transmission system for deep-sea research submersible. In: OCEANS ’92. Mastering the oceans through technology. Proceedings, vol. 2, pp 567–570 (1992). https://doi.org/10.1109/OCEANS.1992.607839
Tuci, E., Alkilabi, M.H.M., Akanyeti, O.: Cooperative object transport in multi-robot systems: A review of the state-of-the-art. Front. Robot. AI 5, 59 (2018). https://doi.org/10.3389/frobt.2018.00059. https://www.frontiersin.org/article/10.3389/frobt.2018.00059/full
Wirz, R., Marin, R., Ferre, M., Barrio, J., Claver, J.M., Ortego, J.: Bidirectional transport protocol for teleoperated robots. IEEE Trans. Ind. Electron. 56(9), 3772–3781 (2009). https://doi.org/10.1109/TIE.2009.2025291
Acknowledgements
It has been partially funded by the Spanish Government under under grants BES-2015-073112, DPI2014-57746-C3 (MERBOTS), DPI2017-86372-C3 (TWINBOT), Generalitat Valenciana under Prometeo program, and Jaume I University under NEPTUNO project.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Centelles, D., Soriano, A., Marin, R. et al. Wireless HROV Control with Compressed Visual Feedback Using Acoustic and RF Links. J Intell Robot Syst 99, 713–728 (2020). https://doi.org/10.1007/s10846-020-01157-5
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10846-020-01157-5