Skip to main content

Advertisement

SpringerLink
Log in

An efficient multicast multi-rate reinforcement learning based opportunistic routing algorithm

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Multicasting through device-to-device communication (MD2D) is a promising solution for handling the heavy load caused by the extraordinary high traffic in 5G cellular networks. One of the most important challenges of effective multicast in wireless networks is routing. Traditional multicast routing is not a good option in wireless environments due to the limited battery and energy of the users and users’ mobility, leading to entering and leaving multicast groups. Opportunistic Routing (OR) was introduced to meet these challenges in wireless networks. In OR, the forwarding nodes are selected along the way and in each hop from the packet receivers. Although multicast opportunistic routing solves these problems to some extent, it poses challenges such as suitable forwarder set selection, forwarder nodes’ coordination, and the crying baby problem. Multi-rate Multicast Reinforcement Learning based Opportunistic Routing (2MRLOR) is proposed in this paper to deal with these problems. In this algorithm, the transmission ranges of the nodes are altered by changing their transmission rate. Therefore, the neighboring nodes will also vary, and more candidates may be available for the packet forwarding. In 2MRLOR, we introduce a routing metric called EMD (Expected Multicast Delay) to determine the best forwarders along the packets’ way in a multi-rate condition. In this algorithm, the suitable transmission rate of each node is calculated based on the network conditions. Reinforcement learning is also used to reduce the amount of information exchanged between the nodes in the network. Furthermore, network coding is used to facilitate the forwarders’ transmission and eliminate the need for forwarders’ coordination. Based on the simulation results, the proposed algorithm leads to an increase in network throughput and a reduction in end-to-end delay in the network compared to the benchmark algorithms.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Algorithm 1
Fig. 1
Fig. 2
Fig. 3

Similar content being viewed by others

Data availability

Data sharing not applicable to this article as no datasets were generated or analyzed during the current study.

References

  1. Bhardwaj A, Agnihotri S (2015) A resource allocation scheme for device-to-device multicast in cellular networks. In 2015 IEEE 26th Annual International Symposium on Personal, Indoor, and Mobile Radio Communications (PIMRC), IEEE, pp 1498–1502

  2. Biswas S, Morris R (2005) ExOR: opportunistic multi-hop routing for wireless networks. Presented at the Proceedings of the 2005 conference on Applications, technologies, architectures, and protocols for computer communications, Philadelphia, Pennsylvania, USA. [Online]. Available: https://doi.org/10.1145/1080091.1080108

  3. Chachulski S, Jennings M, Katti S, Katabi D (2007) Trading structure for randomness in wireless opportunistic routing. ACM SIGCOMM Comput Commun Rev 37(4):169–180

    Article  Google Scholar 

  4. Chakchouk N (2015) A survey on opportunistic routing in wireless communication networks. IEEE Commun Surv Tutor 17(4):2214–2241

    Article  Google Scholar 

  5. Cheng L, Niu J, Cao J, Das SK, Gu Y (2013) QoS aware geographic opportunistic routing in wireless sensor networks. IEEE Trans Parallel Distrib Syst 25(7):1864–1875

    Article  Google Scholar 

  6. Choumas K, Syrigos I, Korakis T, Tassiulas L (2017) Video-aware multicast opportunistic routing over 802.11 two-hop mesh networks. IEEE Trans Veh Technol 66(9):8372–8384

    Article  Google Scholar 

  7. Feng L, Zhao P, Zhou F, Yin M, Yu P, Li W, Qiu X (2018) Resource allocation for 5G D2D multicast content sharing in social-aware cellular networks. IEEE Commun Mag 56(3):112–118

    Article  Google Scholar 

  8. Ganesan D, Govindan R, Shenker S, Estrin D (2001) Highly-resilient, energy-efficient multipath routing in wireless sensor networks. ACM SIGMOBILE Mobile Comput Commun Rev 5(4):11–25

    Article  Google Scholar 

  9. Hassouna AB, Koubaa H, Saidane LA (2018) A throughput-oriented reliable multicast in multi-rate wireless networks. Int J Ad Hoc Ubiquitous Comput 27(3):210–221

    Article  Google Scholar 

  10. https://www.isi.edu/nsnam/ns/ (accessed on 03/20/2022)

  11. Jain S, Das SR (2008) Exploiting path diversity in the link layer in wireless ad hoc networks. Ad Hoc Netw 6(5):805–825

    Article  Google Scholar 

  12. Koutsonikolas D, Hu YC, Wang C-C (2011) Pacifier: high-throughput, reliable multicast without “crying babies” in wireless mesh networks. IEEE/ACM Trans Netw 20(5):1375–1388

    Article  Google Scholar 

  13. Laneman JN, Wornell GW (2000) Exploiting distributed spatial diversity in wireless networks. In Proc. Allerton Conference on Communications, Control, and Computing

  14. Laufer R, Dubois-Ferrière H, Kleinrock L (2011) Polynomial-time algorithms for multirate anypath routing in wireless multihop networks. IEEE/ACM Trans Networking 20(3):742–755

    Article  Google Scholar 

  15. Le T, Liu Y (2010) Opportunistic overlay multicast in wireless networks. In 2010 IEEE Global Telecommunications Conference GLOBECOM 2010, IEEE pp 1–5

  16. Li P, Guo S, Yu S, Vasilakos AV (2012) CodePipe: an opportunistic feeding and routing protocol for reliable multicast with pipelined network coding. In 2012 Proceedings IEEE INFOCOM, IEEE, pp 100–108

  17. Li L, Wang X, Ma X (2022) Design of a location-based opportunistic geographic routing protocol. Comput Commun 181:357–364

    Article  Google Scholar 

  18. Li C, Xiong H, Zou J, Wu DO (2017) Joint dynamic rate control and transmission scheduling for scalable video multirate multicast over wireless networks. IEEE Trans Multimed 20(2):361–378

    Article  Google Scholar 

  19. Mammeri Z (2019) Reinforcement learning based routing in networks: review and classification of approaches. IEEE Access 7:55916–55950

    Article  Google Scholar 

  20. Qabajeh LK (2021) WINDMILL: a scalable multicast routing protocol for mobile ad-hoc networks [J]. Int J Electr Electron Eng Telecommun 10(5):341–354

    Google Scholar 

  21. Qin X, Huang G, Zhang B, Li C (2021) Energy efficient data correlation aware opportunistic routing protocol for wireless sensor networks. Peer-to-Peer Netw Appl pp 1–13

  22. Rozner E, Seshadri J, Mehta Y, Qiu L (2009) SOAR: simple opportunistic adaptive routing protocol for wireless mesh networks. IEEE Trans Mob Comput 8(12):1622–1635

    Article  Google Scholar 

  23. Singh D, Pattanayak BK (2020) Markovian model analysis for energy harvesting nodes in a modified opportunistic routing protocol. Int J Electron 107(12):1963–1984

    Article  Google Scholar 

  24. Sudhakar BS, Kumar A (2019) A study of opportunistic routing with energy efficiency in manet. JAC J Composition Theory 0731–6755

  25. Tang K, Li C, Xiong H, Zou J, Frossard P (2017) Reinforcement learning-based opportunistic routing for live video streaming over multi-hop wireless networks. In 2017 IEEE 19th International Workshop on Multimedia Signal Processing (MMSP), IEEE, pp 1–6

  26. WenZhong Y, ChuanHe H, Bo W, ZhenYu Z, Tong W (2010) A reliable multicast for MANETs based on opportunistic routing and network coding. In 2010 IEEE International Conference on Wireless Communications, Networking and Information Security, IEEE, pp 540–545

  27. Zeng G, Huang P, Mutka M, Xiao L, Torng E (2011) Efficient opportunistic multicast via tree backbone for wireless mesh networks. In 2011 IEEE Eighth International Conference on Mobile Ad-Hoc and Sensor Systems, JAC : A Journal Of Composition Theory, 2019 vol. ISSN : 0731–6755: IEEE, pp 600–609

  28. Zeng K, Lou W, Yang J, Brown DR (2007) On throughput efficiency of geographic opportunistic routing in multihop wireless networks. Mob Netw Appl 12(5–6):347–357

    Article  Google Scholar 

  29. Zhao J, Yang F, Zhang Q, Zhang Z, Zhang F (2006) LION: layered overlay multicast with network coding. IEEE Trans Multimed 8(5):1021–1032

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Computer Engineering, University of Isfahan, Isfahan, Iran

    Mahshid Hashemi & Neda Moghim

Authors
  1. Mahshid Hashemi
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Neda Moghim
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Neda Moghim.

Ethics declarations

Conflict of interest

Authors do not have any conflict of interest.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Hashemi, M., Moghim, N. An efficient multicast multi-rate reinforcement learning based opportunistic routing algorithm. Multimed Tools Appl 82, 26613–26630 (2023). https://doi.org/10.1007/s11042-023-14645-1

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-023-14645-1

Keywords

Search

Navigation