Feedback Control of Traffic Signal Network of Less Traffic Sensors by Help of Machine Learning
As a way of resolving vehicle congestion, there is a feedback control approach which models a traffic network as a discrete dynamical system and derives feedback gain for controlling green light times of each junction. Since the input is the sensory observed traffic flow of each link, and since the state equation models both the topology and the parameters of the network, it is effective for adaptive control of a wide area traffic in real-time. One of the essential factors in a state equation is the vehicles’ turning ratio at each junction. However, in a normal traffic sensor layout, it is impossible to directly measure this value in real-time, and values from traffic census are used. This paper is to propose a method that predicts this value in real-time through machine learning and gives more appropriate feedback control. Out idea is to find the turning ratio through probabilistic search by Reinforcement Learning referring to the degree of improvement of the entire traffic flow. At this moment we have finished formulation of the scheme and the verification for the performance by a traffic simulator is on the way.
KeywordsReinforcement Learning Traffic light Control Feedback Control Discrete Dynamical System Split
Unable to display preview. Download preview PDF.
- 2.Wakasa, Y., Iwaoka, K., Hanaoka, K., Tanaka, K.: A Control Engineering Approach to Real-Time and Network-Wide Traffic Signal Control. Transactions of the Society of Instrument and Control Engineers 42(9), 1076–1082 (2006) (in Japanese)Google Scholar
- 3.Hunt, P.B., Robertson, D.I., Bretherton, R.D., Royle, M.C.: The SCOOT on-line Traffic Signal Optimisation Technique. Traffic Engineering and Control 23(4), 190–192 (1982)Google Scholar
- 4.Lowrie, P.R.: SCATS: The Sydney Co-ordinated Adaptive Traffic System – Principles, Methodology, Algorithms. In: Proceedings of the IEE International Conference on Road Traffic Signalling, pp. 67–70 (1982)Google Scholar
- 5.Sugiyama, Y.: Physics of Traffic Flow. Nagare: The Japan Society of Fluid Mechanics 22(2), 95–108 (2003) (in Japanese)Google Scholar
- 6.Sutton, R.S., Barto, A.G.: Reinforcement Learning: An Introduction. The MIT Press (1998)Google Scholar
- 9.Lämmer, S., Helbing, D.: Self-control of traffic lights and vehicle flows in urban road networks. Journal of Statistical Mechanics: Theory and Experiment 2008(4), P04019 (2008)Google Scholar
- 10.Mimura, S., Hisai, M.: Construction of Real-Time Control Logic for Signalized Network Under Over-Saturated Condition. Memoirs of the Faculty of Engineering Yamaguchi University 57(1), 15–19 (2006) (in Japanese)Google Scholar
- 11.Ishikawa, H., Shimizu, H., Sobata, Y., Kobayashi, M.: Congestion Length Control for a Traffic Network. IPSJ Journal 45(4), 1154–1162 (2004) (in Japanese)Google Scholar