Skip to main content
SpringerLink
Log in

Deep Learning Methods for Vehicle Trajectory Prediction: A Survey

  • Conference paper
  • First Online:
IoT Based Control Networks and Intelligent Systems (ICICNIS 2023)

Part of the book series: Lecture Notes in Networks and Systems ((LNNS,volume 789))

  • 397 Accesses

Abstract

Trajectory prediction in autonomous vehicles deals with the prediction of future states of other vehicles/traffic participants to avoid possible collisions and decide the best possible manager given the current state of the surrounding. As the commercial use of self-driving cars is increasing rapidly, the need for reliable and efficient trajectory prediction in autonomous vehicles has become eminent now more than ever. While techniques or approaches that rely on principles and laws of physics and traditional machine learning-based methods have laid the groundwork for trajectory prediction research, they have primarily been shown to be effective only in uncomplicated driving scenarios. Following the increasing computing power of machines, the said task has seen an increase in popularity of DL techniques, which have demonstrated high levels of reliability. Driven by this increased popularity of deep learning approaches, we provide a systematic review of the popular deep learning methods used for vehicle trajectory prediction. Firstly, we discuss the problem formulation. Then we classify the different methods based on 3 categories—the type of output they generate, whether or not they take social context into account, and the different types of deep learning techniques they use. Next, we compare the performances of some popular methods on a common dataset and finally, we also discuss potential research gaps and future directions.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 189.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 249.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Korbmacher R, Tordeux A (2022) Review of pedestrian trajectory prediction methods: comparing deep learning and knowledge-based approaches. IEEE Trans Intell Transp Syst

    Google Scholar 

  2. Huang Y et al (2022) A survey on trajectory-prediction methods for autonomous driving. IEEE Trans Intell Veh 7(3):652–674

    Article  MathSciNet  Google Scholar 

  3. Leon F, Gavrilescu M (2021) A review of tracking and trajectory prediction methods for autonomous driving. Mathematics 9(6):660

    Article  Google Scholar 

  4. Miglani A, Kumar N (2019) Deep learning models for traffic flow prediction in autonomous vehicles: a review, solutions, and challenges. Veh Commun 20:100184

    Google Scholar 

  5. Lefèvre S, Vasquez D, Laugier C (2014) A survey on motion prediction and risk assessment for intelligent vehicles. ROBOMECH J 1(1):1–14

    Article  Google Scholar 

  6. U.S. Department of Transportation Federal Highway Administration (2016) Next Generation Simulation (NGSIM) vehicle trajectories and supporting data [Dataset]. Provided by ITS DataHub through Data.transportation.gov. https://doi.org/10.21949/1504477. Accessed 24 Mar 2023

  7. Ramanathan M et al (2018) Intention-aware long horizon trajectory prediction of surrounding vehicles using dual LSTM networks. In: 2018 IEEE intelligent transportation systems conference (ITSC), pp 2695–2702

    Google Scholar 

  8. Park SH et al (2018) Sequence-to-sequence prediction of vehicle trajectory via LSTM encoder-decoder architecture. In: 2018 IEEE intelligent vehicles symposium (IV). IEEE

    Google Scholar 

  9. Zyner A et al (2017) Long short-term memory for driver intent prediction. In: 2017 IEEE intelligent vehicles symposium (IV). IEEE

    Google Scholar 

  10. He H et al (2019) A recurrent neural network solution for predicting driver intention at unsignalized intersection. In: 2019 IEEE intelligent transportation systems conference (ITSC), pp 4228–4233

    Google Scholar 

  11. Wiest MA, Montemerlo M, Thrun S (2018) Naturalistic driver intention and path prediction using recurrent neural networks. In: 2018 IEEE intelligent vehicles symposium (IV), pp 107–114

    Google Scholar 

  12. Zhao Y et al (2020) Generalizable intention prediction of human drivers at intersections. In: 2020 IEEE/CVF conference on computer vision and pattern recognition (CVPR), pp 3408–3417

    Google Scholar 

  13. Deo N, Trivedi MM (2019) Multi-modal trajectory prediction of surrounding vehicles with maneuver based LSTMs. In: 2018 IEEE intelligent vehicles symposium (IV). IEEE. arXiv preprint arXiv:1905.01787

  14. Huang Y, Sun Q, Chen X, Zhao H, Zhang C (2019) Modeling vehicle interactions via modified LSTM models for trajectory prediction. IEEE Trans Intell Transp Syst 20(3):1033–1043. https://doi.org/10.1109/TITS.2018.2821554

    Article  Google Scholar 

  15. Lee S et al (2019) Convolution neural network-based lane change intention prediction of surrounding vehicles for ACC. In: 2019 IEEE international conference on robotics and automation (ICRA), pp 3915–3921

    Google Scholar 

  16. Deo N, Trivedi MM (2018) Convolutional social pooling for vehicle trajectory prediction. In: 2018 IEEE intelligent vehicles symposium (IV), pp 616–623. https://doi.org/10.1109/IVS.2018.8500582

  17. Cui H et al (2019) Multimodal trajectory predictions for autonomous driving using deep convolutional networks. In: 2019 international conference on robotics and automation (ICRA). IEEE

    Google Scholar 

  18. Li X, Ying X, Chuah MC (2019) Grip: graph-based interaction-aware trajectory prediction. In: 2019 IEEE intelligent transportation systems conference (ITSC). IEEE

    Google Scholar 

  19. Diehl F et al (2019) Graph neural networks for modelling traffic participant interaction. In: 2019 IEEE intelligent vehicles symposium (IV). IEEE

    Google Scholar 

  20. Li X, Ying X, Chuah MC (2019) GRIP++: enhanced graph-based interaction-aware trajectory prediction for autonomous driving. arXiv preprint arXiv:1907.07792

  21. Azadani MN, Boukerche A (2023) STAG: a novel interaction-aware path prediction method based on spatio-temporal attention graphs for connected automated vehicles. Ad Hoc Netw 138:103021

    Article  Google Scholar 

  22. Choi S, Kim J, Yeo H (2019) Attention-based recurrent neural network for urban vehicle trajectory prediction. Procedia Comput Sci 151:327–334

    Article  Google Scholar 

  23. Mercat J et al (2020) Multi-head attention for multi-modal joint vehicle motion forecasting. In: 2020 IEEE international conference on robotics and automation (ICRA). IEEE

    Google Scholar 

  24. Bender A et al (2015) Predicting driver intent from models of naturalistic driving. In: 2015 IEEE 18th international conference on intelligent transportation systems. IEEE

    Google Scholar 

  25. Ding W, Chen J, Shen S (2019) Predicting vehicle behaviors over an extended horizon using behavior interaction network. In: 2019 international conference on robotics and automation (ICRA). IEEE

    Google Scholar 

  26. Lee AX et al (2017) DESIRE: distant future prediction in dynamic scenes with interacting agents. In: 2017 IEEE conference on computer vision and pattern recognition (CVPR), pp 336-345

    Google Scholar 

  27. Zhao Z et al (2020) GISNet: graph-based information sharing network for vehicle trajectory prediction. In: 2020 international joint conference on neural networks (IJCNN). IEEE

    Google Scholar 

  28. Chen G et al (2020) ST-LSTM: spatio-temporal graph based long short-term memory network for vehicle trajectory prediction. In: 2020 IEEE international conference on image processing (ICIP). IEEE

    Google Scholar 

  29. Mo X, Xing Y, Lv C (2020) ReCoG: a deep learning framework with heterogeneous graph for interaction-aware trajectory prediction. arXiv preprint arXiv:2012.05032

  30. Wang H et al (2021) SACS-LSTM: a vehicle trajectory prediction method based on self-attention mechanism. In: Proceedings of the 2021 5th international conference on electronic information technology and computer engineering

    Google Scholar 

  31. Mersch B et al (2021) Maneuver-based trajectory prediction for self-driving cars using spatio-temporal convolutional networks. In: 2021 IEEE/RSJ international conference on intelligent robots and systems (IROS). IEEE

    Google Scholar 

  32. Zhang K, Li L (2022) Explainable multimodal trajectory prediction using attention models. Transp Res Part C: Emerg Technol 143:103829

    Article  Google Scholar 

  33. Luo W, Yang B, Urtasun R (2018) Fast and furious: real time end-to-end 3D detection, tracking and motion forecasting with a single convolutional net. In: IEEE conference on computer vision and pattern recognition (CVPR), pp 3569–3577. https://doi.org/10.1109/CVPR.2018.00375

  34. Rhinehart N, Kitani KM (2018) IntentNet: learning to predict intention from raw sensor data. In: IEEE conference on computer vision and pattern recognition (CVPR), pp 511–520. https://doi.org/10.1109/CVPR.2018.00062

  35. Alahi A et al (2016) An LSTM network for highway trajectory prediction. In: 2016 IEEE conference on computer vision and pattern recognition (CVPR), pp 3514–3522

    Google Scholar 

  36. Khakzar M et al (2020) A dual learning model for vehicle trajectory prediction. IEEE Access 8:21897–21908

    Article  Google Scholar 

  37. Ding W, Shen S (2019) Online vehicle trajectory prediction using policy anticipation network and optimization-based context reasoning. In: 2019 international conference on robotics and automation (ICRA). IEEE

    Google Scholar 

  38. Ma Y et al (2019) TrafficPredict: trajectory prediction for heterogeneous traffic-agents. In: Proceedings of the AAAI conference on artificial intelligence, vol 33(01)

    Google Scholar 

  39. Zhao T et al (2019) Multi-agent tensor fusion for contextual trajectory prediction. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition

    Google Scholar 

  40. Djuric N et al (2020) Uncertainty-aware short-term motion prediction of traffic actors for autonomous driving. In: Proceedings of the IEEE/CVF winter conference on applications of computer vision

    Google Scholar 

  41. Ju C et al (2020) Interaction-aware Kalman neural networks for trajectory prediction. In: 2020 IEEE intelligent vehicles symposium (IV). IEEE

    Google Scholar 

  42. Wang Y et al (2020) Multi-vehicle collaborative learning for trajectory prediction with spatio-temporal tensor fusion. IEEE Trans Intell Transp Syst 23(1):236–248

    Article  Google Scholar 

  43. Meng Q et al (2021) Intelligent vehicles trajectory prediction with spatial and temporal attention mechanism. IFAC-PapersOnLine 54(10):454–459

    Article  Google Scholar 

  44. Liu S et al (2021) Lane change scheduling for autonomous vehicle: a prediction-and-search framework. In: Proceedings of the 27th ACM SIGKDD conference on knowledge discovery and data mining

    Google Scholar 

  45. Lin L et al (2021) Vehicle trajectory prediction using LSTMs with spatial-temporal attention mechanisms. IEEE Intell Transp Syst Mag 14(2):197–208

    Article  Google Scholar 

  46. Guo H et al (2023) Map-enhanced generative adversarial trajectory prediction method for automated vehicles. Inf Sci 622:1033–1049

    Article  Google Scholar 

  47. Chen L et al (2022) Spatial-temporal attention networks for vehicle trajectory prediction. In: Proceedings of the 8th international conference on computing and artificial intelligence

    Google Scholar 

  48. Guo H et al (2022) Vehicle trajectory prediction method coupled with ego vehicle motion trend under dual attention mechanism. IEEE Trans Instrum Meas 71:1–16

    Google Scholar 

  49. Wei C et al (2022) Fine-grained highway autonomous vehicle lane-changing trajectory prediction based on a heuristic attention-aided encoder-decoder model. Transp Res Part C: Emerg Technol 140:103706

    Article  Google Scholar 

  50. An J et al (2022) DGInet: dynamic graph and interaction-aware convolutional network for vehicle trajectory prediction. Neural Netw 151:336–348

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Delhi Technological University, Bawana Road, Rohini, New Delhi, India

    Shuvam Shiwakoti, Suryodaya Bikram Shahi & Priya Singh

Authors
  1. Shuvam Shiwakoti
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Suryodaya Bikram Shahi
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Priya Singh
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Priya Singh .

Editor information

Editors and Affiliations

  1. Department of Computer Science and Engineering, St. Joseph's College of Engineering and Technology, Palai, Kerala, India

    P. P. Joby

  2. Department of Communications Engineering, Federal University of Rio Grande do Norte (UFRN), Natal, Rio Grande do Norte, Brazil

    Marcelo S. Alencar

  3. Gdańsk University of Technology, Gdańsk, Poland

    Przemyslaw Falkowski-Gilski

Rights and permissions

Reprints and permissions

Copyright information

© 2024 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Shiwakoti, S., Bikram Shahi, S., Singh, P. (2024). Deep Learning Methods for Vehicle Trajectory Prediction: A Survey. In: Joby, P.P., Alencar, M.S., Falkowski-Gilski, P. (eds) IoT Based Control Networks and Intelligent Systems. ICICNIS 2023. Lecture Notes in Networks and Systems, vol 789. Springer, Singapore. https://doi.org/10.1007/978-981-99-6586-1_37

Download citation

  • DOI: https://doi.org/10.1007/978-981-99-6586-1_37

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-99-6585-4

  • Online ISBN: 978-981-99-6586-1

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics

Search

Navigation