A collaborative agent-based traffic signal system for highly dynamic traffic conditions
- 28 Downloads
In this paper we present DALI, a distributed, collaborative multi-agent traffic signal timing system (TST) for highly dynamic traffic conditions. In DALI, intersection controllers are augmented with software agents which collaboratively adapt signal timings by considering the feedback of all controller agents that may be affected by a change. The model is based on a real-world TST and will be deployed with minimal changes to the infrastructure. DALI has been validated by traffic engineers as well as through extensive simulation of the City of Richardson’s traffic network, comprising 128 signalized intersections. The experimental results show that, in highly dynamic scenarios, DALI outperforms the conventional traffic system used by the city as well as a state-of-the-art reinforcement learning-based TST.
KeywordsIntelligent transportation system Multi-agent systems Coordinated decision making
- 3.Al-Zinati, M., & Zalila-Wenkstern, R. (2015). Matisse 2.0: A large-scale multi-agent simulation system for agent-based its. In IEEE/WIC/ACM international conference on web intelligence and intelligent agent technology (WI-IAT), 2015 (vol. 2, pp. 328–335).Google Scholar
- 4.Balke, K, N., & Herrick, C. (2004). Potential measures of assessing signal timing performance using existing technologies. Technical Report FHWA/TX-04/0-4422-1, Texas A&M Transportation Institute, College Station, Texas 77843-3135.Google Scholar
- 8.Chao, K.-H., Lee, R.-H., & Wang, M.-H. (2008). An intelligent traffic light control based on extension neural network. In Knowledge-based intelligent information and engineering systems (pp. 17–24). Berlin: Springer.Google Scholar
- 10.Chin, Y. K., Lee, L. K., Bolong, N., Yang, S. S., & Teo, K. T. K. (2011). Exploring Q-learning optimization in traffic signal timing plan management. In 2011 third international conference on computational intelligence, communication systems and networks (pp. 269–274).Google Scholar
- 13.Dusparic, I., & Cahill, V. (2012). Autonomic multi-policy optimization in pervasive systems: Overview and evaluation. ACM Transactions on Autonomous and Adaptive Systems (TAAS), 7(1), 11.Google Scholar
- 14.Dusparic, I., Monteil, J., & Cahill, V. (2016). Towards autonomic urban traffic control with collaborative multi-policy reinforcement learning. In 2016 IEEE 19th international conference on intelligent transportation systems (ITSC) (pp. 2065–2070).Google Scholar
- 15.El-Tantawy, S., & Abdulhai, B. (2010). An agent-based learning towards decentralized and coordinated traffic signal control. In 2010 13th international IEEE conference on intelligent transportation systems (ITSC) (pp. 665–670).Google Scholar
- 16.El-Tantawy, S., Abdulhai, B., & Abdelgawad, H. (2013). Multiagent reinforcement learning for integrated network of adaptive traffic signal controllers (MARLIN-ATSC): Methodology and large-scale application on downtown toronto. IEEE Transactions on Intelligent Transportation Systems, 14(3), 1140–1150.CrossRefGoogle Scholar
- 17.France, J., & Ghorbani, A. A. (2003). A multiagent system for optimizing urban traffic. In Proceedings of the IEEE/WIC international conference on intelligent agent technology (pp. 411–414).Google Scholar
- 18.Gartner, N. H., Pooran, F. J., & Andrews, C. M. (2001). Implementation of the OPAC adaptive control strategy in a traffic signal network. In Proceedings. 2001 IEEE intelligent transportation systems, 2001 (pp. 195–200).Google Scholar
- 19.Goldstein, R., & Smith, S. F. (2018). Expressive real-time intersection scheduling. In Thirty-second AAAI conference on artificial intelligence.Google Scholar
- 21.Hu, H.-C., & Smith, S. F. (2018). Bi-directional information exchange in decentralized schedule-driven traffic control. In Proceedings of the 17th international conference on autonomous agents and multiagent systems. Bi-directional information exchange in decentralized schedule-driven traffic control (pp. 1962–1964).Google Scholar
- 22.Koonce, P., et al. (2008). Traffic signal timing manual. Technical report, United States. Federal Highway Administration.Google Scholar
- 23.Lu, S., Liu, X., & Dai, S. (2008). Incremental multistep Q-learning for adaptive traffic signal control based on delay minimization strategy. In 7th world congress on intelligent control and automation, WCICA (pp. 2854–2858). IEEE.Google Scholar
- 24.Mannion, P., Duggan, J., & Howley, E. (2015). Parallel reinforcement learning for traffic signal control (Vol. 52, pp. 956–961). Amsterdam: Elsevier.Google Scholar
- 27.Pham, T. T., Brys, T., Taylor, M. E., Brys, T., Drugan, M. M., Bosman, P. A., Cock, M.-D., Lazar, C., Demarchi, L., & Steenhoff, D., et al. (2013). Learning coordinated traffic light control. In Proceedings of the adaptive and learning agents workshop (at AAMAS-13) (vol. 10, pp. 1196–1201).Google Scholar
- 28.Prabuchandran, K. J., AN, H. K, & Bhatnagar, S. (2014). Multi-agent reinforcement learning for traffic signal control. In 2014 IEEE 17th international conference on intelligent transportation systems (ITSC) (pp. 2529–2534).Google Scholar
- 29.PTV Group. Ptv vissim. http://vision-traffic.ptvgroup.com/en-us/products/ptvvissim/. Accessed Oct 2018.
- 30.Richter, S. (2006). Learning traffic control-towards practical traffic control using policy gradients. Albert-Ludwigs-Universitat Freiburg, Tech. Rep.Google Scholar
- 31.Roads and Maritime Services. Scats: The benchmark in urban traffic control. http://www.scats.com.au/. Accessed Oct 2018.
- 33.Smith, S. F., Barlow, G. J., Xie, X.-F., & Rubinstein, Z. B. (2013). Smart urban signal networks: Initial application of the surtrac adaptive traffic signal control system. In Twenty-third international conference on automated planning and scheduling.Google Scholar
- 35.Torabi, B. (2017). A self-organizing traffic management system and its real-world implementation, Ph.D. proposal. Technical report, University of Texas at Dallas.Google Scholar
- 36.Torabi, Behnam, Al-Zinati, Mohammad, & Wenkstern, Rym Z. (2018). MATISSE 3.0: A Large-Scale Multi-agent Simulation System for Intelligent Transportation Systems. In Proceedings of the 16th international conference on practical applications of agents and multi-agent systems, PAAMS 18,Toledo, Spain (pp. 357–360).Google Scholar
- 37.Torabi, B., Wenkstern, R. Z., & Al-Zinati, M. (2018). An agent-based micro-simulator for ITS. In Proceedings of the 21st IEEE international conference on intelligent transportation systems, IEEE ITSC 2018, Maui, Hawaii, USA.Google Scholar
- 38.Torabi, B., Wenkstern, R. Z., & Saylor, R. (2018). A collaborative agent-based traffic signal system for highly dynamic traffic conditions. In Proceedings of the 21st IEEE international conference on intelligent transportation systems, IEEE ITSC 2018, Maui, Hawaii, USA.Google Scholar
- 39.Torabi, B., Wenkstern, R. Z., & Saylor, R. (2018). A multi-hop agent-based traffic signal timing system for the city of richardson. In Proceedings of the the sixteenth international conference on autonomous agent and multiagent systems, AAMAS, Stockholm, Sweden (pp. 2094–2096).Google Scholar
- 40.UK’s Transport Research Laboratory. Split cycle and offset optimisation technique. https://trlsoftware.co.uk/products/traffic_control/scoot. Accessed Oct 2018.
- 41.UK’s Transport Research Laboratory. Traffic network and isolated intersection study tool. https://trlsoftware.co.uk/products/junction_signal_design/transyt. Accessed Oct 2018.
- 42.Wen, K., Qu, S., & Zhang, Y. (2007). A stochastic adaptive control model for isolated intersections. In IEEE international conference on robotics and biomimetics, 2007. ROBIO (pp. 2256–2260).Google Scholar
- 43.Xie, X.-F., Smith, S. F., Chen, T.-W., & Barlow, G. J. (2014). Real-time traffic control for sustainable urban living. In 17th international IEEE conference on intelligent transportation systems (ITSC) (pp. 1863–1868).Google Scholar