Abstract
Short-term traffic flow prediction plays a critical role in Intelligent Transportation System (ITS), and has attracted continuous attention. Previous studies have focused on improving the prediction accuracy of mean traffic flow. Due to the dynamics and propagation of traffic system, reliable traffic control and induction measures have been considered to be dependent on prediction intervals of short-term traffic flows. The current parametric models used to quantify uncertainty in traffic flow prediction cannot well capture the nonlinear patterns of traffic flow series, and may not apply to situations without long-term continuous observations. This paper proposes a hybrid framework combining long short-term memory neural network (LSTM NN) and Bayesian neural network (BNN) for real-time traffic flow prediction and uncertainty quantification based on sequence data. Caltrans Performance Measurement System (PeMS) traffic flow data for 6 freeways in Sacramento city is aggregated at 15-min intervals to evaluate the proposed model. Compared to the SARIMA-GARCH model, the proposed LSTM-BNN model outperforms in predicting both the mean and interval of the traffic flow. Especially, the experiments show that the LSTM-BNN model is superior during the daytime and under non-seasonal traffic conditions. The proposed LSTM-BNN model can be utilized in ITS for making reliable management decisions.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Ahmed MS, Cook AR (1979) Analysis of freeway traffic time-series data by using Box-Jenkins techniques. Transportation Research Record 722:1–9
Blei DM, Kucukelbir A, McAuliffe JD (2017) Variational inference: A review for statisticians. Journal of the American Statistical Association 112(518):859–877, DOI: https://doi.org/10.1080/01621459.2017.1285773
Blundell C, Cornebise J, Kavukcuoglu K, Wierstra D (2015) Weight uncertainty in neural networks. In International Conference on Machine Learning 1613–1622, DOI: https://doi.org/10.48550/arXiv.1505.05424
Chan A, Alaa A, Qian Z, Schaar MVD (2020) Unlabelled data improves Bayesian uncertainty calibration under covariate shift. Proceedings of the 37th International Conference on Machine Learning, PMLR, 1392–1402, DOI: https://doi.org/10.48550/arXiv.2006.14988
Clark SD, Dougherty MS, Kirby HR (1993) The use of neural networks and time series models for short term traffic forecasting: A comparative study. In Transportation Planning Methods. Proceedings of Seminar D Held at the Ptrc European Transport, Highways and Planning 21st Summer Annual Meeting, 363
Du S, Li T, Gong X, Yang Y, Horng SJ (2017) Traffic flow forecasting based on hybrid deep learning framework. 2017 12th International Conference on Intelligent Systems and Knowledge Engineering (ISKE), IEEE, Nanjing, 1–6, DOI: https://doi.org/10.1109/ISKE.2017.8258813
Gers FA, Schmidhuber J (2000) Recurrent nets that time and count. Proceedings of the IEEE-INNS-ENNS International Joint Conference on Neural Networks. IJCNN 2000. Neural Computing: New Challenges and Perspectives for the New Millennium, IEEE, Como, Italy 3:189–194, DOI: https://doi.org/10.1109/IJCNN.2000.861302
Guo J, Huang W, Williams BM (2014) Adaptive Kalman filter approach for stochastic short-term traffic flow rate prediction and uncertainty quantification. Transportation Research Part C: Emerging Technologies 43:50–64, DOI: https://doi.org/10.1016/j.trc.2014.02.006
Guo S, Lin Y, Feng N, Song C, Wan H (2019) Attention based spatial-temporal graph convolutional networks for traffic flow forecasting. Proceedings of the AAAI Conference on Artificial Intelligence 33:922–929, DOI: https://doi.org/10.1609/aaai.v33i01.3301922
Hamed MM, Al-Masaeid HR, Said ZMB (1995) Short-term prediction of traffic volume in urban arterials. Journal of Transportation Engineering 121(3):249–254, DOI: https://doi.org/10.1061/(ASCE)0733-947X(1995)121:3(249)
Hochreiter S, Schmidhuber J (1997) Long short-term memory. Neural Computation 9(8):1735–1780, DOI: https://doi.org/10.1162/neco.1997.9.8.1735
Jia Y, Wu J, Xu M (2017) Traffic flow prediction with rainfall impact using a deep learning method. Journal of Advanced Transportation 2017: e6575947, DOI: https://doi.org/10.1155/2017/6575947
Jospin LV, Laga H, Boussaid F, Buntine W, Bennamoun M (2022) Hands-on Bayesian neural networks — a tutorial for deep learning. IEEE Computational Intelligence Magazine 17(2):29–48, DOI: https://doi.org/10.1109/MCI.2022.3155327
Kendall A, Gal Y (2017) What uncertainties do we need in Bayesian deep learning for computer vision. Advances in Neural Information Processing Systems, 30, DOI: https://doi.org/10.48550/arXiv.1703.04977
Kingma DP, Ba J (2014) Adam: A method for stochastic optimization. DOI: https://doi.org/10.48550/arXiv.1412.6980
Kingma DP, Welling M (2019) An introduction to variational autoencoders. Foundations and Trends in Machine Learning 12(4):307–392, DOI: https://doi.org/10.1561/2200000056
Kullback S, Leibler RA (1951) On information and sufficiency. The Annals of Mathematical Statistics 22(1):79–86, DOI: https://doi.org/10.1214/aoms/1177729694
Li Z, Jiang S, Li L, Li Y (2019) Building sparse models for traffic flow prediction: An empirical comparison between statistical heuristics and geometric heuristics for Bayesian network approaches. Transportmetrica B: Transport Dynamics 7(1):107–123, DOI: https://doi.org/10.1080/21680566.2017.1354737
Long J, Gao Z, Ren H, Lian A (2008) Urban traffic congestion propagation and bottleneck identification. Science in China Series F: Information Sciences 51(7):948–964, DOI: https://doi.org/10.1007/s11432-008-0038-9
Luo X, Niu L, Zhang S (2018) An algorithm for traffic flow prediction based on improved SARIMA and GA. KSCE Journal of Civil Engineering 22(10):4107–4115, DOI: https://doi.org/10.1007/s12205-018-0429-4
Lv Y, Duan Y, Kang W, Li Z, Wang F-Y (2015) Traffic flow prediction with big data: A deep learning approach. IEEE Transactions on Intelligent Transportation Systems 16(2):865–873, DOI: https://doi.org/10.1109/TITS.2014.2345663
Okutani I, Stephanedes YJ (1984) Dynamic prediction of traffic volume through Kalman filtering theory. Transportation Research Part B: Methodological 18(1):1–11, DOI: https://doi.org/10.1016/0191-2615(84)90002-X
Park B, Messer CJ, Urbanik T (1998) Short-term freeway traffic volume forecasting using radial basis function neural network. Transportation Research Record: Journal of the Transportation Research Board 1651(1):39–47, DOI: https://doi.org/10.3141/1651-06
Pavlyuk D (2019) Feature selection and extraction in spatiotemporal traffic forecasting: A systematic literature review. European Transport Research Review 11(1):6, DOI: https://doi.org/10.1186/s12544-019-0345-9
Razali NAM, Shamsaimon N, Ishak KK, Ramli S, Amran MFM, Sukardi S (2021) Gap, techniques and evaluation: Traffic flow prediction using machine learning and deep learning. Journal of Big Data 8(1):152, DOI: https://doi.org/10.1186/s40537-021-00542-7
Shao H, Soong BH (2016) Traffic flow prediction with long short-term memory networks (LSTMs). 2016 IEEE Region 10 Conference (TENCON), 2986–2989, DOI: https://doi.org/10.1109/TENCON.2016.7848593
Smith BL, Williams BM, Oswald RK (2002) Comparison of parametric and nonparametric models for traffic flow forecasting. Transportation Research Part C: Emerging Technologies 10(4):303–321, DOI: https://doi.org/10.1016/S0968-090X(02)00009-8
Tang J, Zeng J, Wang Y, Yuan H, Liu F, Huang H (2021) Traffic flow prediction on urban road network based on license plate recognition data: Combining attention-LSTM with genetic algorithm. Transportmetrica A: Transport Science 17(4):1217–1243, DOI: https://doi.org/10.1080/23249935.2020.1845250
Tedjopurnomo DA, Zheng B, Choudhury FM, Qin K (2020) A survey on modern deep neural network for traffic prediction: Trends, methods and challenges. IEEE Transactions on Knowledge and Data Engineering, DOI: https://doi.org/10.1109/TKDE.2020.3001195
Treiber M, Kesting A (2013) Traffic flow dynamics. Traffic Flow Dynamics: Data, Models and Simulation, Springer-Verlag Berlin Heidelberg 983–1000, DOI: https://doi.org/10.1007/978-3-642-32460-4
Vaswani A, Shazeer N, Parmar N, Uszkoreit J, Jones L, Gomez AN, Kaiser L, Polosukhin I (2017) Attention is all you need. Advances in Neural Information Processing Systems 30:6000–6010, DOI: https://doi.org/10.48550/arXiv.1706.03762
Williams BM (1999) Modeling and forecasting vehicular traffic flow as a seasonal stochastic time series process. PhD Thesis, University of Virginia, Charlottesville, USA
Williams BM, Hoel LA (2003) Modeling and forecasting vehicular traffic flow as a seasonal ARIMA process: Theoretical basis and empirical results. Journal of Transportation Engineering 129(6):664–672, DOI: https://doi.org/10.1061/(ASCE)0733-947X(2003)129:6(664)
Wu Y, Tan H (2016) Short-term traffic flow forecasting with spatial-temporal correlation in a hybrid deep learning framework. Computer Vision and Pattern Recognition, DOI: https://doi.org/10.48550/arXiv.1612.01022
Xia J, Nie Q, Huang W, Qian Z (2013) Reliable short-Term traffic flow forecasting for urban roads: Multivariate generalized autoregressive conditional heteroscedasticity approach. Transportation Research Record: Journal of the Transportation Research Board 2343(1):77–85, DOI: https://doi.org/10.3141/2343-10
Xu C, Liu P, Wang W, Jiang X (2013) Development of a crash risk index to identify real time crash risks on freeways. KSCE Journal of Civil Engineering 17(7):1788–1797, DOI: https://doi.org/10.1007/s12205-013-0353-6
Yao R, Zhang W, Long M (2022) DLW-Net model for traffic flow prediction under adverse weather. Transportmetrica B: Transport Dynamics 10(1):499–524, DOI: https://doi.org/10.1080/21680566.2021.2008280
Ye Z, Zhang Y, Middleton DR (2006) Unscented Kalman filter method for speed estimation using single loop detector data. Transportation Research Record: Journal of the Transportation Research Board 1968(1):117–125, DOI: https://doi.org/10.1177/0361198106196800114
Yu B, Yin H, Zhu Z (2018) Spatio-temporal graph convolutional networks: A deep learning framework for traffic forecasting. Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence, International Joint Conferences on Artificial Intelligence Organization, Stockholm, Sweden, 3634–3640, DOI: https://doi.org/10.48550/arXiv.1709.04875
Zeng J, Lesnikowski A, Alvarez JM (2018) The relevance of Bayesian layer positioning to model uncertainty in deep Bayesian active learning. Machine Learning, DOI: https://doi.org/10.48550/arXiv.1811.12535
Zhu L, Laptev N (2017) Deep and confident prediction for time series at Uber. 2017 IEEE International Conference on Data Mining Workshops (ICDMW), 103–110, DOI: https://doi.org/10.1109/ICDMW.2017.19
Acknowledgments
This study was funded by the National Natural Science Foundation of China (No. 71971060). The authors want to thank the anonymous reviewers for their useful comments and suggestions to improve the quality of this paper.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Wang, Y., Ke, S., An, C. et al. A Hybrid Framework Combining LSTM NN and BNN for Short-term Traffic Flow Prediction and Uncertainty Quantification. KSCE J Civ Eng 28, 363–374 (2024). https://doi.org/10.1007/s12205-023-2457-y
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12205-023-2457-y