Abstract
Traffic signal control plays a crucial role in traffic management and operation practices. In the past decade, adaptive signal control systems, capable of adjusting control schemes in response to traffic patterns, have shown the abilities to improve traffic mobility. On the other hand, the negative impacts on environments by increased vehicles attract increased attentions from traffic stakeholders and the general public. Most of the prevalent adaptive signal control systems do not address energy and environmental issues. The present paper proposes an adaptive signal control system capable of taking multi-criteria strategies into account. A general multi-agent framework is introduced for modeling signal control operations. The behavior of each cognitive agent is modeled by a Constrained Markov Decision Process (CMDP). Reinforcement learning algorithms are applied to solve the MDP problem. As a result, the signal controller makes intelligent timing decisions according to a pre-defined policy goal. A case study is carried out for the stage-based control scheme to investigate the effectiveness of the adaptive signal control system from two perspectives, traffic mobility and energy efficiency. The control approach can be further applied to a large network in a decentralized manner.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Abdulhai, B., Pringle, R., Karakoulas, G.J.: Reinforcement learning for true adaptive traffic signal control. J. Transp. Eng. 129(3), 278–285 (2003)
Barto, A.G.: Reinforcement Learning: An Introduction. MIT press, Cambridge (1998)
Khamis, M.A., Gomaa, W.: Adaptive multi-objective reinforcement learning with hybrid exploration for traffic signal control based on cooperative multi-agent framework. Eng. Appl. Artif. Intell. 29, 134–151 (2014)
Krajzewicz, D., Erdmann, J., Behrisch, M., Bieker, L.: Recent development and applications of SUMO-simulation of urban mobility. Int. J. Adv. Syst. Meas. 5(3–4), 128–138 (2012)
Krauss, S., Wagner, P., Gawron, C.: Metastable states in a microscopic model of traffic flow. Phys. Rev. E 55(5), 5597 (1997)
Ma, X., Jin, J., Lei, W.: Multi-criteria analysis of optimal signal plans using microscopic traffic models. Transp. Res. Part D Transp. Environ. 32, 1–14 (2014)
Puterman, M.L.: Markov Decision Processes: Discrete Stochastic Dynamic Programming. Wiley, New York (2014)
Scora, G., Barth, M.: Comprehensive modal emissions model (CMEM), version 3.01. User guide. Centre for Environmental Research and Technology, University of California, Riverside (2006)
Thorpe, T.L., Anderson, C.W.: Traffic light control using SARSA with three state representations. Technical report, Citeseer (1996)
Wiering, M.: Multi-agent reinforcement learning for traffic light control. In: ICML, pp. 1151–1158 (2000)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer International Publishing AG
About this paper
Cite this paper
Jin, J., Ma, X. (2018). A Multi-criteria Intelligent Control for Traffic Lights Using Reinforcement Learning. In: Żak, J., Hadas, Y., Rossi, R. (eds) Advanced Concepts, Methodologies and Technologies for Transportation and Logistics. EURO EWGT 2016 2016. Advances in Intelligent Systems and Computing, vol 572. Springer, Cham. https://doi.org/10.1007/978-3-319-57105-8_22
Download citation
DOI: https://doi.org/10.1007/978-3-319-57105-8_22
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-57104-1
Online ISBN: 978-3-319-57105-8
eBook Packages: EngineeringEngineering (R0)