Abstract
Prior to the deployment of a critical software or functional hardware equipment, it is always suitable to test the working of the equipment in an environment that tests the capabilities of the functionality to the fullest. The equipment can be deployed in the real-world only on successful clearance granted to the test scenarios. Thus, an efficient foolproof simulated environment for any type of hardware is customary in a product development cycle. Thus, through this research, we aim at creating a suitable environment for a self-driving car which consists of simple test cases the agent will have to pass before it can be deployed in the real world. The outcome developed as the end-product of this research will help serve companies that are involved in the development of technologies for the purpose of building a full-fledged vehicle with autonomous capabilities. This product will not only help them to run the algorithms designed for technology but also help in designing suitable test case scenarios. The simulating agent can be visualized as a game-playing agent where an environment similar to that of a typical game comprises of the environment where the agent overcomes certain obstacles and challenges to complete a particular task.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
T. Hester, M. Vecerik, O. Pietquin, M. Lanctot, T. Schaul, B. Piot, D. Horgan, J. Quan, A. Sendonaris, I. Osband, G. Dulac-Arnold, J. Agapiou, J.Z. Leibo, Audrunas Gruslys; deep Q-learning from demonstrations; AAAI Publications, in Thirty-Second AAAI Conference on Artificial Intelligence
V. Mnih, K. Kavukcuoglu, D. Silver, A. Graves, I. Antonoglou, D. Wierstra, M. Riedmiller; Playing atari with deep reinforcement learning, arXiv:1312.5602
H. Yi, Deep deterministic policy gradient for autonomous vehicle driving. Int’l Conf Artif. Intell. |ICAI’18|
M.C. Figueiredo, R.J.F. Rossetti, A.M. Rodrigo, R.A. Braga, L.P. Reis, An approach to simulate autonomous vehicles in Urban traffic scenarios
F. Grazioli, E. Kusmenko, A. Roth, B. Rumpe, M. von Wenckstern, Simulation framework for executing component and connector models of self-driving vehicles, Software Engineering, RWTH Aachen University, German
N. Lee, W. Choi, P. Vernaza, C.B. Choy, P.H.S. Torr, M. Chandraker, DESIRE: distant future prediction in dynamic scenes with interacting agents, arXiv:1704.04394
S. Sachulter, P. Vernaza, W. Choi, S. Chandraker, Deep network flow for multi-object tracking, in Proceedings of IEEE CVPR 2017, Hawaii, USA
T. Cederborg, I. Grover, C. Isbell, A. Thomaz, Policy shaping with human teachers, in International Joint Conference on Artificial Intelligence (IJCAI 2015) (2015)
O. Toro, T. Becsi, S. Aradi, Design of a lane keeping algorithm of autonomous vehicle. Periodica Polytechnica Transportation Engineering (2015)
C.J. Watkins, P. Dayan. Q learning: technical note. Mach. Learning, 8 279–292, (1992)
D. Krajzewicz, J. Erdmann, M. Behrisch, L. Bieker, Recent development and applications of sumo-simulation of urban mobility. Int. J. Adv. Syst. Measure. 5(3, 4), 128–138 (2012)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 The Editor(s) (if applicable) and The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Patil, A.P., Sunagar, P., Ganesan, K., Kumar, B., Sethi, K. (2021). Simulating the Concept of Self-Driving Cars Using Deep-Q Learning. In: Joshi, A., Khosravy, M., Gupta, N. (eds) Machine Learning for Predictive Analysis. Lecture Notes in Networks and Systems, vol 141. Springer, Singapore. https://doi.org/10.1007/978-981-15-7106-0_32
Download citation
DOI: https://doi.org/10.1007/978-981-15-7106-0_32
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-15-7105-3
Online ISBN: 978-981-15-7106-0
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)