Skip to main content

Building Machine Learning Bot with ML-Agents in Tank Battle

  • Conference paper
  • First Online:
International Conference on Information Systems and Intelligent Applications (ICISIA 2022)

Part of the book series: Lecture Notes in Networks and Systems ((LNNS,volume 550))

  • 421 Accesses

Abstract

In recent years, Deep Reinforcement Learning has made great progress in video games, including Atari, ViZDoom, StarCraft, Dota2, and so on. Those successes coupled with the release of the ML-Agents Toolkit, an open-source that helps users to create simulated environments, shows that Deep Reinforcement Learning can now be easily apply to video games. Therefore, stimulating the creativity of developers and researchers. This research aspires to develop a new video game and turn it into a simulation environment for training intelligent agents. Experienced it with tuning the hyperparameters to make the agent getting the best performance for a final commercial video game product.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 189.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 249.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Sutton RS, Barto AG, Williams RJ (1992) Reinforcement learning is direct adaptive optimal control. IEEE Control Syst Mag 12(2):19–22. https://doi.org/10.1109/37.126844

    Article  Google Scholar 

  2. Li Y (2017) Deep reinforcement learning: an overview. arXiv:1701.07274

  3. Hsu FH (2002) Behind deep blue: building the computer that defeated the world chess champion. Princeton University Press

    Google Scholar 

  4. Silver D, Hubert T, Schrittwieser J, Antonoglou I, Lai M, Guez A, Lanctot M, Sifre L, Kumaran D, Graepel T, Lillicrap T, Simonyan K, Hassabis D (2018) A general reinforcement learning algorithm that masters chess, shogi, and go through self-play. Science 362(6419):1140–1144

    Article  MathSciNet  Google Scholar 

  5. Open AI et al (2019) Dota 2 with large scale deep reinforcement learning. arXiv:1912.06680

  6. Schulman J, Wolski F, Dhariwal P, Radford A, Klimov O (2017) Proximal policy optimization algorithms. arXiv:1707.06347

  7. Xie J (2012) Research on key technologies base Unity3D game engine. In: Proceedings of the 7th International Conference on Computer Science & Education (ICCSE), pp 695–699. https://doi.org/10.1109/ICCSE.2012.6295169

  8. Juliani A et al (2020) Unity: a general platform for intelligent agents. arXiv:1809.02627

  9. Bengio Y, Louradour J, Collobert R, Weston J (2009) Curriculum learning. In: Proceedings of the 26th Annual International Conference on Machine Learning (ICML '09). Association for computing machinery, New York, NY, USA, pp 41–48. https://doi.org/10.1145/1553374.1553380

  10. Foerster J, Nardelli N, Farquhar G et al (2017) Stabilising experience replay for deep multi-agent reinforcement learning. In: Proceedings of the 34th International Conference on Machine Learning, vol. 70 (ICML'17). JMLR.org, pp 1146–1155

    Google Scholar 

  11. Hung PD, Giang DT (2021) Traffic light control at isolated intersections in case of heterogeneous traffic. In: Kreinovich V, Hoang Phuong N (eds) Soft computing for biomedical applications and related topics. Studies in computational intelligence, vol 899. Springer, Cham. https://doi.org/10.1007/978-3-030-49536-7_23

  12. Hung PD (2020) Early warning system for shock points on the road surface. In: Luo Y (eds) Cooperative design, visualization, and engineering. CDVE 2020. Lecture Notes in Computer Science, vol 12341. Springer, Cham. https://doi.org/10.1007/978-3-030-60816-3_33

  13. Su NT, Hung PD, Vinh BT, Diep VT (2022) Rice leaf disease classification using deep learning and target for mobile devices. In: Al-Emran M, Al-Sharafi MA, Al-Kabi MN, Shaalan, K (eds) Proceedings of International Conference on Emerging Technologies and Intelligent Systems. ICETIS 2021. Lecture Notes in Networks and Systems, vol 299. Springer, Cham. https://doi.org/10.1007/978-3-030-82616-1_13

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Van Duc Dung .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Dung, V.D., Hung, P.D. (2023). Building Machine Learning Bot with ML-Agents in Tank Battle. In: Al-Emran, M., Al-Sharafi, M.A., Shaalan, K. (eds) International Conference on Information Systems and Intelligent Applications. ICISIA 2022. Lecture Notes in Networks and Systems, vol 550. Springer, Cham. https://doi.org/10.1007/978-3-031-16865-9_10

Download citation

Publish with us

Policies and ethics