Skip to main content

Traffic Signal Switching Strategy Based on Reinforcement Learning Algorithm

  • Conference paper
  • First Online:
2021 6th International Conference on Intelligent Transportation Engineering (ICITE 2021) (ICITE 2021)

Part of the book series: Lecture Notes in Electrical Engineering ((LNEE,volume 901))

Included in the following conference series:

  • 1257 Accesses

Abstract

The abstract should summarize the contents of the paper in short terms, i.e. 150–250 words. With the development of modern urban traffic, intersection signal control has become a significant research problem to relieve vehicle congestion. The reinforcement learning algorithm is an essential means to solve complex decision-making problems. Applying reinforcement learning technology to intersection signal control is an insight solution. This paper takes Wuhan Optical Valley special roundabout as an example and presents a Markov decision model suitable for special roundabouts. The incentive mechanism of reinforcement learning is used to adjust the right of way. When the traffic congestion of the green phase is less than the average traffic congestion of the intersection, the green light time is shortened. Otherwise, the average queuing time of vehicles at the intersection will be increased. Simulation results show that this method is superior to the traditional signal switching strategy, and the effectiveness of the model is verified.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 349.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 449.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Thrun, S., Littman, M.L.: Reinforcement learning: an introduction. AI Mag. 21(1), 103 (2000)

    Google Scholar 

  2. Guo, M., Wang, P., Chan, C.Y., et al.: A reinforcement learning approach for intelligent traffic signal control at urban intersections. In: 2019 IEEE Intelligent Transportation Systems Conference (ITSC), pp. 4242–4247. IEEE (2019)

    Google Scholar 

  3. Yu, X.H., Recker, W.W.: Stochastic adaptive control model for traffic signal systems. Transp. Res. Part C Emerg. Technol. 14(4), 263–282 (2006)

    Article  Google Scholar 

  4. Abdulhai, B., Pringle, R., Karakoulas, G.J.: Reinforcement learning for true adaptive traffic signal control. J. Transp. Eng. 129(3), 278–285 (2003)

    Article  Google Scholar 

  5. Wiering, M.A.: Explorations in efficient reinforcement learning. University of Amsterdam (1999)

    Google Scholar 

  6. Steingrover, M., Schouten, R., Peelen, S., Nijhuis, E., Bakker, B.: Reinforcement learning of traffic light controllers adapting to traffic congestion. In: BNAIC, pp. 216–223 (2005)

    Google Scholar 

  7. Liang, X., Du, X., Wang, G., Han, Z.: A deep reinforcement learning network for traffic light cycle control. IEEE Trans. Veh. Technol. 68(2), 1243–1253 (2019)

    Article  Google Scholar 

  8. Zhao, X., Li, Z., Chen, Y.: Hybrid control of urban traffic lights based on Q-learning. J. Syst. Simul. 10, 2889–2894 (2006)

    Google Scholar 

  9. Huang, Y., Tang, J., Xu, L.: Urban road traffic signal control method based on agent. Highway Traffic Sci. Technol. 26(10), 126–129 (2009)

    Google Scholar 

  10. Watkins, C.J.C.H., Dayan, P.: Q-learning. Mach. Learn. 8(3–4), 279–292 (1992)

    Article  MATH  Google Scholar 

Download references

Acknowledgment

This research is supported by Major projects of Technological Innovation in Hubei Province, China (No. 2019ABA101).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Yue Niu .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Hu, L., Xu, S., Li, X., Niu, Y. (2022). Traffic Signal Switching Strategy Based on Reinforcement Learning Algorithm. In: Zhang, Z. (eds) 2021 6th International Conference on Intelligent Transportation Engineering (ICITE 2021). ICITE 2021. Lecture Notes in Electrical Engineering, vol 901. Springer, Singapore. https://doi.org/10.1007/978-981-19-2259-6_102

Download citation

Publish with us

Policies and ethics