Feedback Control of Traffic Signal Network of Less Traffic Sensors by Help of Machine Learning

Conference paper
Part of the Advances in Intelligent Systems and Computing book series (AISC, volume 194)


As a way of resolving vehicle congestion, there is a feedback control approach which models a traffic network as a discrete dynamical system and derives feedback gain for controlling green light times of each junction. Since the input is the sensory observed traffic flow of each link, and since the state equation models both the topology and the parameters of the network, it is effective for adaptive control of a wide area traffic in real-time. One of the essential factors in a state equation is the vehicles’ turning ratio at each junction. However, in a normal traffic sensor layout, it is impossible to directly measure this value in real-time, and values from traffic census are used. This paper is to propose a method that predicts this value in real-time through machine learning and gives more appropriate feedback control. Out idea is to find the turning ratio through probabilistic search by Reinforcement Learning referring to the degree of improvement of the entire traffic flow. At this moment we have finished formulation of the scheme and the verification for the performance by a traffic simulator is on the way.


Reinforcement Learning Traffic light Control Feedback Control Discrete Dynamical System Split 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Diakaki, C., Papageorgiou, M., Aboudolas, K.: A multivariable regulator approach to traffic-responsive network-wide signal control. Control Engineering Practice 10(2), 183–195 (2002)CrossRefGoogle Scholar
  2. 2.
    Wakasa, Y., Iwaoka, K., Hanaoka, K., Tanaka, K.: A Control Engineering Approach to Real-Time and Network-Wide Traffic Signal Control. Transactions of the Society of Instrument and Control Engineers 42(9), 1076–1082 (2006) (in Japanese)Google Scholar
  3. 3.
    Hunt, P.B., Robertson, D.I., Bretherton, R.D., Royle, M.C.: The SCOOT on-line Traffic Signal Optimisation Technique. Traffic Engineering and Control 23(4), 190–192 (1982)Google Scholar
  4. 4.
    Lowrie, P.R.: SCATS: The Sydney Co-ordinated Adaptive Traffic System – Principles, Methodology, Algorithms. In: Proceedings of the IEE International Conference on Road Traffic Signalling, pp. 67–70 (1982)Google Scholar
  5. 5.
    Sugiyama, Y.: Physics of Traffic Flow. Nagare: The Japan Society of Fluid Mechanics 22(2), 95–108 (2003) (in Japanese)Google Scholar
  6. 6.
    Sutton, R.S., Barto, A.G.: Reinforcement Learning: An Introduction. The MIT Press (1998)Google Scholar
  7. 7.
    Bando, M., Hasebe, K., Nakayama, A., Shibata, A., Sugiyama, Y.: Dynamical model of traffic congestion and numerical simulation. Physical Review E 51(2), 1035–1042 (1995)CrossRefGoogle Scholar
  8. 8.
    Bando, M., Hasebe, K., Nakanishi, K., Nakayama, A., Shibata, A., Sugiyama, Y.: Phenomenological Study of Dynamical Model of Traffic Flow. Journal de Physique I 5(11), 1389–1399 (1995)CrossRefGoogle Scholar
  9. 9.
    Lämmer, S., Helbing, D.: Self-control of traffic lights and vehicle flows in urban road networks. Journal of Statistical Mechanics: Theory and Experiment 2008(4), P04019 (2008)Google Scholar
  10. 10.
    Mimura, S., Hisai, M.: Construction of Real-Time Control Logic for Signalized Network Under Over-Saturated Condition. Memoirs of the Faculty of Engineering Yamaguchi University 57(1), 15–19 (2006) (in Japanese)Google Scholar
  11. 11.
    Ishikawa, H., Shimizu, H., Sobata, Y., Kobayashi, M.: Congestion Length Control for a Traffic Network. IPSJ Journal 45(4), 1154–1162 (2004) (in Japanese)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2013

Authors and Affiliations

  1. 1.Graduate School of System Information ScienceFuture University HakodateHakodateJapan
  2. 2.Depertment of Complex and Intelligent SystemsFuture University HakodateHakodateJapan

Personalised recommendations