Skip to main content

Simulating the Concept of Self-Driving Cars Using Deep-Q Learning

  • Conference paper
  • First Online:
Machine Learning for Predictive Analysis

Part of the book series: Lecture Notes in Networks and Systems ((LNNS,volume 141))

Abstract

Prior to the deployment of a critical software or functional hardware equipment, it is always suitable to test the working of the equipment in an environment that tests the capabilities of the functionality to the fullest. The equipment can be deployed in the real-world only on successful clearance granted to the test scenarios. Thus, an efficient foolproof simulated environment for any type of hardware is customary in a product development cycle. Thus, through this research, we aim at creating a suitable environment for a self-driving car which consists of simple test cases the agent will have to pass before it can be deployed in the real world. The outcome developed as the end-product of this research will help serve companies that are involved in the development of technologies for the purpose of building a full-fledged vehicle with autonomous capabilities. This product will not only help them to run the algorithms designed for technology but also help in designing suitable test case scenarios. The simulating agent can be visualized as a game-playing agent where an environment similar to that of a typical game comprises of the environment where the agent overcomes certain obstacles and challenges to complete a particular task.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 259.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 329.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 329.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. T. Hester, M. Vecerik, O. Pietquin, M. Lanctot, T. Schaul, B. Piot, D. Horgan, J. Quan, A. Sendonaris, I. Osband, G. Dulac-Arnold, J. Agapiou, J.Z. Leibo, Audrunas Gruslys; deep Q-learning from demonstrations; AAAI Publications, in Thirty-Second AAAI Conference on Artificial Intelligence

    Google Scholar 

  2. V. Mnih, K. Kavukcuoglu, D. Silver, A. Graves, I. Antonoglou, D. Wierstra, M. Riedmiller; Playing atari with deep reinforcement learning, arXiv:1312.5602

  3. H. Yi, Deep deterministic policy gradient for autonomous vehicle driving. Int’l Conf Artif. Intell. |ICAI’18|

    Google Scholar 

  4. M.C. Figueiredo, R.J.F. Rossetti, A.M. Rodrigo, R.A. Braga, L.P. Reis, An approach to simulate autonomous vehicles in Urban traffic scenarios

    Google Scholar 

  5. F. Grazioli, E. Kusmenko, A. Roth, B. Rumpe, M. von Wenckstern, Simulation framework for executing component and connector models of self-driving vehicles, Software Engineering, RWTH Aachen University, German

    Google Scholar 

  6. N. Lee, W. Choi, P. Vernaza, C.B. Choy, P.H.S. Torr, M. Chandraker, DESIRE: distant future prediction in dynamic scenes with interacting agents, arXiv:1704.04394

  7. S. Sachulter, P. Vernaza, W. Choi, S. Chandraker, Deep network flow for multi-object tracking, in Proceedings of IEEE CVPR 2017, Hawaii, USA

    Google Scholar 

  8. T. Cederborg, I. Grover, C. Isbell, A. Thomaz, Policy shaping with human teachers, in International Joint Conference on Artificial Intelligence (IJCAI 2015) (2015)

    Google Scholar 

  9. O. Toro, T. Becsi, S. Aradi, Design of a lane keeping algorithm of autonomous vehicle. Periodica Polytechnica Transportation Engineering (2015)

    Google Scholar 

  10. C.J. Watkins, P. Dayan. Q learning: technical note. Mach. Learning, 8 279–292, (1992)

    Google Scholar 

  11. D. Krajzewicz, J. Erdmann, M. Behrisch, L. Bieker, Recent development and applications of sumo-simulation of urban mobility. Int. J. Adv. Syst. Measure. 5(3, 4), 128–138 (2012)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Akhilesh P. Patil .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2021 The Editor(s) (if applicable) and The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Patil, A.P., Sunagar, P., Ganesan, K., Kumar, B., Sethi, K. (2021). Simulating the Concept of Self-Driving Cars Using Deep-Q Learning. In: Joshi, A., Khosravy, M., Gupta, N. (eds) Machine Learning for Predictive Analysis. Lecture Notes in Networks and Systems, vol 141. Springer, Singapore. https://doi.org/10.1007/978-981-15-7106-0_32

Download citation

Publish with us

Policies and ethics