Skip to main content

Can we Learn from Outliers? Unsupervised Optimization of Intelligent Vehicle Traffic Management Systems

  • Conference paper
  • First Online:
Machine Learning and Knowledge Discovery in Databases (ECML PKDD 2022)

Abstract

Vehicle traffic flow prediction is an essential task for several applications including city planning, traffic congestion management and smart traffic light control systems. However, recent solutions suffer in outlier situations where traffic flow becomes more challenging to predict. In this work, we address the problem of predicting traffic flow on different intersections in a traffic network under the realistic assumption of having outliers. Our framework, called OBIS, applies an existing LOF-based approach to detect outliers on each intersection in the network separately. Based on the spatio-temporal interdependencies of these outliers, we infer the correlations between intersections in the network. We use these outlier-based correlations then to improve the predictability of existing traffic flow prediction systems by selecting more relevant inputs for the prediction system. We show that our framework considerably improves the performance of LSTM-based models both under outlier scenarios and also under normal traffic. We test our framework under two real-life settings. In the first, we show how improving the predictability using our framework reduces the overall delays of vehicles on an intersection with a smart traffic light control system. In the second, we demonstrate how OBIS improves the predictability of a real dataset from four trajectories of intersections in the city of The Hague. We share the latter dataset together with an implementation of our framework.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 79.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 99.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Altché, F., de La Fortelle, A.: An LSTM network for highway trajectory prediction. In: ITSC, pp. 353–359 (2017)

    Google Scholar 

  2. Andersen, E., Chiarandini, M., Hassani, M., Jänicke, S., Tampakis, P., Zimek, A.: Evaluation of probability distribution distance metrics in traffic flow outlier detection. In: 23rd IEEE International Conference on Mobile Data Management, MDM, Paphos, Cyprus, 6–9 June 2022, pp. 64–69. IEEE (2022). https://doi.org/10.1109/MDM55031.2022.00030

  3. Angiulli, F., Pizzuti, C.: Outlier mining in large high-dimensional data sets. IEEE Trans. Knowl. Data Eng. 17(2), 203–215 (2005)

    Article  Google Scholar 

  4. Bhattacharyya, A.: On a measure of divergence between two multinomial populations. Sankhyā Indian J. Stat. (1933–1960) 7(4), 401–406 (1946)

    Google Scholar 

  5. Breunig, M., Kriegel, H., Ng, R., Sander, J.: LOF: identifying density-based local outliers. In: SIGMOD, Dallas, Texas (2000)

    Google Scholar 

  6. Campos, G.O., et al.: On the evaluation of unsupervised outlier detection: measures, datasets, and an empirical study. DMKD 30, 891–927 (2016)

    MathSciNet  Google Scholar 

  7. Fitters, W., Cuzzocrea, A., Hassani, M.: Enhancing LSTM prediction of vehicle traffic flow data via outlier correlations. In: COMPSAC, pp. 210–217 (2021)

    Google Scholar 

  8. Ghazal, B., et al.: Smart traffic light control system. In: EECEA, pp. 140–145 (2016)

    Google Scholar 

  9. Hautamäki, V., Kärkkäinen, I., Fränti, P.: Outlier detection using k-nearest neighbor graph. In: ICPR (2004)

    Google Scholar 

  10. Jin, W., Tung, A., Han, J., Wang, W.: Ranking outliers using symmetric neighborhood relationship. In: PAKDD (2006)

    Google Scholar 

  11. Li, Y., Yu, R., Shahabi, C., Lui, Y.: Diffusion convolutional recurrent neural network: data-driven traffic forecasting. In: ICLR, Vancouver (2018)

    Google Scholar 

  12. Ma, Y., Zhu, X., Zhang, S., Yang, R., Wang, W., Manocha, D.: Trafficpredict: trajectory prediction for heterogeneous traffic-agents. In: AAAI, vol. 33 (2019)

    Google Scholar 

  13. Pasquale, C., et al.: Two-class freeway traffic regulation to reduce congestion and emissions via nonlinear optimal control. Transp. Res. 55, 85–99 (2015)

    Google Scholar 

  14. Polson, N.G., Sokolov, V.O.: Deep learning for short-term traffic flow prediction. Transp. Res. Part C Emerg. Technol. 79, 1–17 (2017)

    Article  Google Scholar 

  15. Schrank, D., Eisele, B., Lomax, T., Bak, J.: Urban mobility scorecard. In: Texas A M Transportation Institute (2015)

    Google Scholar 

  16. Tanaguchi, E., Thompson, R.G., Yamada, T.: Modelling city logistics. Cairns, Queensland, Australia (1999)

    Google Scholar 

  17. Djenouri, Y., Zimek, A., Chiarandini, M.: Outlier detection in urban traffic data. In: ICDM, pp. 935–940 (2018)

    Google Scholar 

  18. Yuan, H., et al.: An effective joint prediction model for travel demands and traffic flows. In: ICDE, pp. 348–359 (2021)

    Google Scholar 

  19. Zhao, Z., Chen, W., Wu, X., Chen, P.C., Liu, J.: LSTM network: a deep learning approach for short-term traffic forecast. ITS 11(2), 68–75 (2017)

    Google Scholar 

  20. Zimek, A., Djenouri, Y.: Outlier detection in urban traffic data tutorial. In: 8th International Conference on Web Intelligence, Mining and Semantics (2018)

    Google Scholar 

Download references

Acknowledgment

The authors would like to thank Marco Hennipman and Siemens Mobility for the support with the data, the access to DIRECTOR and the domain expertise.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Marwan Hassani .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Mertens, T., Hassani, M. (2023). Can we Learn from Outliers? Unsupervised Optimization of Intelligent Vehicle Traffic Management Systems. In: Amini, MR., Canu, S., Fischer, A., Guns, T., Kralj Novak, P., Tsoumakas, G. (eds) Machine Learning and Knowledge Discovery in Databases. ECML PKDD 2022. Lecture Notes in Computer Science(), vol 13718. Springer, Cham. https://doi.org/10.1007/978-3-031-26422-1_32

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-26422-1_32

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-26421-4

  • Online ISBN: 978-3-031-26422-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics