Skip to main content

Advertisement

SpringerLink
Log in

Emperor Penguin Optimized Q Learning Method for Energy Efficient Opportunistic Routing in Underwater WSN

  • Published:
Wireless Personal Communications Aims and scope Submit manuscript

Abstract

Underwater Wireless Sensor Network (UWSN) is a popular technique for monitoring marine environments. It consists of several acoustic channels, sink nodes, sensor nodes and base stations. Source nodes are deployed at different depth levels of oceans for monitoring purposes. Acoustic channels communicate between a source node and a sink node. After that, the information from the sink node is delivered to the base station using an RF signal. Limited Bandwidth, Energy Consumption and propagation delay are major challenges faced by UWSN. Battery consumption of sensor nodes leads to a great impact on the performance of the underwater wireless network. Void-hole occurrence and duplication of packets from sensor nodes to sink nodes increases energy dissipation and reduces the lifespan of the UWSN. Hence energy-efficient opportunistic routing with emperor penguin optimized Q learning method (EPO-Q) for UWSN was introduced to avoid the void-hole problem and reduce energy dissipation. The proposed work was implemented in the MATLAB platform and improved performance in terms of end-to-end delay, network overhead, energy consumption, accumulated propagation distance, battery power, packet loss ratio, absorption loss, throughput, energy efficiency and packet delivery ratio.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19
Fig. 20
Fig. 21
Fig. 22
Fig. 23
Fig. 24
Fig. 25
Fig. 26
Fig. 27
Fig. 28
Fig. 29
Fig. 30
Fig. 31
Fig. 32
Fig. 33
Fig. 34
Fig. 35
Fig. 36
Fig. 37
Fig. 38
Fig. 39
Fig. 40
Fig. 41
Fig. 42
Fig. 43
Fig. 44
Fig. 45
Fig. 46
Fig. 47

Similar content being viewed by others

Data Availability

Data sharing not applicable to this article.

References

  1. Awan, K. M., Shah, P. A., Iqbal, K., Gillani, S., Ahmad, W., & Nam, Y. (2019). Underwater wireless sensor networks: a review of recent issues and challenges. Wireless Communications and Mobile Computing. https://doi.org/10.1155/2019/6470359

    Article  Google Scholar 

  2. Anuradha, D., & Srivatsa, S. K. (2019). Energy effectual reconfigurable routing protocol (E2R2P) for cluster based underwater wireless sensor networks. Journal of Ambient Intelligence and Humanized Computing, 1–8, 709.

    Google Scholar 

  3. Mateen, A., Awais, M., Javaid, N., Ishmanov, F., Afzal, M. K., & Kazmi, S. (2019). Geographic and opportunistic recovery with depth and power transmission adjustment for energy-efficiency and void hole alleviation in UWSNs. Sensors, 19(3), 709.

    Article  Google Scholar 

  4. Javaid, N., Ahmad, Z., Sher, A., Wadud, Z., Khan, Z. A., & Ahmed, S. H. (2019). Fair energy management with void hole avoidance in intelligent heterogeneous underwater WSNs. Journal of Ambient Intelligence and Humanized Computing, 10(11), 4225–4241.

    Article  Google Scholar 

  5. Lu, Y., He, R., Chen, X., Lin, B., & Yu, C. (2020). Energy-Efficient Depth-Based Opportunistic Routing with Q-Learning for Underwater Wireless Sensor Networks. Sensors, 20(4), 1025.

    Article  Google Scholar 

  6. Rahman, Z., Hashim, F., Rasid, M. F. A., & Othman, M. (2018). Totally opportunistic routing algorithm (TORA) for underwater wireless sensor network. PLoS ONE, 13(6), e0197087.

    Article  Google Scholar 

  7. Celik, A., Saeed, N., Shihada, B., Al-Naffouri, T.Y., and Alouini, M-S. (2020). Opportunistic Routing for Opto-Acoustic Internet of Underwater Things, arXiv preprint arXiv: 2002.08420.

  8. Hussain, T., Rehman, Z. U., Iqbal, A., Saeed, K., & Ali, I. (2020). Two hop verification for avoiding void hole in underwater wireless sensor network using SM-AHH-VBF and AVH-AHH-VBF routing protocols. Transactions on Emerging Telecommunications Technologies, 31(8), e3992.

    Article  Google Scholar 

  9. Awais, M., Ali, I., Alghamdi, T. A., Ramzan, M., Tahir, M., Akbar, M., & Javaid, N. (2020). Towards void hole alleviation: enhanced geographic and opportunistic routing protocols in harsh underwater WSNs. IEEE Access. https://doi.org/10.1109/ACCESS.2020.2996367

    Article  Google Scholar 

  10. Ahmad, B., Jian, W., Enam, R. N., & Abbas, A. (2019). Classification of DoS attacks in smart underwater wireless sensor network. Wireless Personal Communications, 1–15, 1055–1069.

    Google Scholar 

  11. Chithaluru, P., Tiwari, R., and Kumar, K. (2020). ARIOR: Adaptive Ranking Based Improved Opportunistic Routing in Wireless Sensor Networks. Wireless Personal Communications, 1–24

  12. Kumar, N., Singh, Y., and Singh, P.K. (2020). An energy efficient trust aware opportunistic routing protocol for wireless sensor network. In Sensor Technology: Concepts, Methodologies, Tools, and Applications, IGI Global, 628–643.

  13. Baranidharan, V., Sivaradje, G., Varadharajan, K., & Vignesh, S. (2020). Clustered geographic-opportunistic routing protocol for underwater wireless sensor networks. Journal of Applied Research and Technology, 18(2), 628–643.

    Google Scholar 

  14. Coutinho, R. W. L., Boukerche, A., & Loureiro, A. A. F. (2020). A novel opportunistic power controlled routing protocol for internet of underwater things. Computer Communications, 150, 72–82.

    Article  Google Scholar 

  15. Kim, S. (2018). A better-performing Q-learning game-theoretic distributed routing for underwater wireless sensor networks. International Journal of Distributed Sensor Networks, 14(1), 1550147718754728.

    Article  Google Scholar 

  16. Liu, G., Wang, X., Li, X., Hao, J., and Feng, Z. (2018). Esrq: An efficient secure routing method in wireless sensor networks based on q-learning. In 2018 17th IEEE International Conference on Trust, Security and Privacy in Computing and Communications/12th IEEE International Conference on Big Data Science and Engineering (TrustCom/BigDataSE), 149–155.

  17. Chang, H., Feng, J., & Duan, C. (2019). Reinforcement learning-based data forwarding in underwater wireless sensor networks with passive mobility. Sensors, 19(2), 256.

    Article  Google Scholar 

  18. Jin, Z., Ma, Y., Su, Y., Li, S., & Fu, X. (2017). A Q-learning-based delay-aware routing algorithm to extend the lifetime of underwater sensor networks. Sensors, 17(7), 1660.

    Article  Google Scholar 

  19. Chithaluru, P., Tiwari, R., & Kumar, K. (2019). AREOR–Adaptive ranking based energy efficient opportunistic routing scheme in Wireless Sensor Network. Computer Networks, 162, 106863.

    Article  Google Scholar 

  20. Coutinho, R.W.L., Boukerche, A., and Loureiro, A.A.F. (2018). PCR: A power control-based opportunistic routing for underwater sensor networks. In Proceedings of the 21st ACM International Conference on Modeling, Analysis and Simulation of Wireless and Mobile Systems, 173–180.

  21. Kamaruddin, A., Ngadi, M. A., Harun, H., & Haron, H. N. (2019). Energy Efficient Opportunistic Routing Protocol (EE-OR) for Underwater Wireless Sensor Network. In Journal of Physics Conference Series, 1174(1), 012010.

    Article  Google Scholar 

  22. Kaur, S., & Mahajan, R. (2018). Hybrid meta-heuristic optimization based energy efficient protocol for wireless sensor networks. Egyptian Informatics Journal, 19(3), 145–150.

    Article  Google Scholar 

  23. Fang, Z., Wang, J., Jiang, C., Zhang, B., Qin, C., and Ren, Y. (2020). QLACO: Q-learning Aided Ant Colony Routing Protocol for Underwater Acoustic Sensor Networks. In 2020 IEEE Wireless Communications and Networking Conference (WCNC). 1–6.

  24. Zhou, Y., Cao, T., and Xiang, W. (2020). Anypath Routing Protocol Design via Q-Learning for Underwater Sensor Networks. arXiv preprint arXiv:2002.09623.

  25. Zhang, Y., Zhang, Z., Chen, L., & Wang, X. (2021). Reinforcement learning-based opportunistic routing protocol for underwater acoustic sensor networks. IEEE Transactions on Vehicular Technology, 70(3), 2756–2770.

    Article  Google Scholar 

  26. Zhu, R., Jiang, Q., Huang, X., Li, D., & Yang, Q. (2022). a reinforcement-learning-based opportunistic routing protocol for energy-efficient and Void-Avoided UASNs. IEEE Sensors Journal. https://doi.org/10.1109/JSEN.2022.3175994

    Article  Google Scholar 

  27. Jin, Z., Zhao, Q., & Su, Y. (2019). RCAR: A reinforcement-learning-based routing protocol for congestion-avoided underwater acoustic sensor networks. IEEE sensors journal, 19(22), 10881–10891.

    Article  Google Scholar 

Download references

Funding

No funding is provided for the preparation of manuscript.

Author information

Authors and Affiliations

  1. Department of ECE, College of Engineering and Technology, SRM Institute of Science and Technology, SRM Nagar, Kattankulathur, Tamil Nadu, 603203, India

    B. Priyalakshmi & S. Murugaveni

Authors
  1. B. Priyalakshmi
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. S. Murugaveni
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

All authors have equal contributions in this work.

Corresponding author

Correspondence to B. Priyalakshmi.

Ethics declarations

Conflict of Interest

Authors declare that they have no conflict of interest

Consent to participate

All the authors involved have agreed to participate in this submitted article

Consent to Publish

All the authors involved in this manuscript give full consent for publication of this submitted article.

Ethical Approval

This article does not contain any studies with human participants or animals performed by any of the authors.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Priyalakshmi, B., Murugaveni, S. Emperor Penguin Optimized Q Learning Method for Energy Efficient Opportunistic Routing in Underwater WSN. Wireless Pers Commun 128, 2039–2072 (2023). https://doi.org/10.1007/s11277-022-10031-6

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11277-022-10031-6

Keywords

Search

Navigation