A Reinforcement Learning-Based Routing Protocol in VANETs

  • Yanglong Sun
  • Yiming Lin
  • Yuliang Tang
Conference paper
Part of the Lecture Notes in Electrical Engineering book series (LNEE, volume 463)


Vehicular ad hoc networks serves as an important enabling technology for assistant driving and intelligent transportation, it has aroused wide concern since it was proposed. However, due to the dynamic topology and poor link quality of wireless channel in VANETs caused by vehicle movement and obstacles, establishing a reliable multi-hop communication in VANETs is rather challenging. In this paper, we proposed a position-based reinforcement learning routing protocol. The protocol uses Q-learning to evaluate the quality of the neighbor nodes, and thus selects the next-hop node according to the quality of the neighbor nodes and the position of the destination node to maintain the stability and reliability of the links and routing. Through extensive simulation, the effectiveness of the proposed protocol is shown.


Vehicular ad hoc networks (VANETs) Reinforcement learning Routing protocol 


  1. 1.
    Toor, Y., Muhlethaler, P., Laouiti, A.: Vehicle ad hoc networks: applications and related technical issues. IEEE commun. Surv. Tutorials 10(3), 74–88 (2008)Google Scholar
  2. 2.
    Altayeb, M., Mahgoub, I.: A survey of vehicular ad hoc networks routing protocols. Int. J. Innov. Appl. Stud. 3(3), 829–846 (2013)Google Scholar
  3. 3.
    Perkins, C., Belding-Royer, E., Das, S.: Ad hoc on-demand distance vector (AODV) routing, No. RFC 3561 (2003)Google Scholar
  4. 4.
    Liu, J., Wan, J., Wang, Q., Deng, P., Zhou, K., Qiao, Y.: A survey on position-based routing for vehicular ad hoc networks. Telecommun. Syst. 62(1), 15–30 (2016)Google Scholar
  5. 5.
    Karp, B., Kung, H.T.: GPSR: greedy perimeter stateless routing for wireless networks. In: Proceedings of the 6th Annual International Conference on Mobile Computing and Networking, pp. 243–254. ACM (2000)Google Scholar
  6. 6.
    Watkins, C.J., Dayan, P.: Q-learning. Mach. Learn. 8(3–4), 279–292 (1992)Google Scholar
  7. 7.
    Parekh, A.K.: Selecting routers in ad-hoc wireless networks. In: Proceedings of the SBT/IEEE International Telecommunications Symposium, vol. 204 (1994)Google Scholar
  8. 8.
    Kuklinski, S., Wolny, G.: Density based clustering algorithm for vehicular ad-hoc networks. Int. J. Internet Protoc. Technol. 4(3), 149–157 (2009)Google Scholar

Copyright information

© Springer Nature Singapore Pte Ltd. 2019

Authors and Affiliations

  1. 1.Department of Communication EngineeringXiamen UniversityXiamenChina

Personalised recommendations