Skip to main content
SpringerLink
Log in

UT Austin Villa: RoboCup 2021 3D Simulation League Competition Champions

  • Conference paper
  • First Online:
RoboCup 2021: Robot World Cup XXIV (RoboCup 2021)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 13132))

Included in the following conference series:

Abstract

The UT Austin Villa team, from the University of Texas at Austin, won the 2021 RoboCup 3D Simulation League, winning all 19 games the team played. During the course of the competition the team scored 108 goals while conceding only 5. Additionally the team finished second in the overall RoboCup 3D Simulation League technical challenge by finishing second in both the fat proxy and scientific challenges. This paper details and analyzes the results of the 2021 competition, and also presents a new deep RL learning framework that was presented during the scientific challenge.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 64.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 84.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

Notes

  1. 1.

    Full tournament results can be found at http://www.cs.utexas.edu/~AustinVilla/?p=competitions/RoboCup21#3D.

  2. 2.

    Scientific challenge entry description available at https://www.cs.utexas.edu/~AustinVilla/sim/3dsimulation/AustinVilla3DSimulationFiles/2021/files/UTAustinVillaScientificChallenge2021.pdf.

  3. 3.

    All participating teams’ scientific challenge entry descriptions available at http://archive.robocup.info/Soccer/Simulation/3D/FCPs/RoboCup/2021/.

  4. 4.

    https://github.com/magmaOffenburg/magmaFatProxy.

  5. 5.

    https://github.com/magmaOffenburg/magmaRelease.

  6. 6.

    More information about the UT Austin Villa team, as well as video from the competition, released binaries, and team publications, can be found at the team’s website: http://www.cs.utexas.edu/~AustinVilla/sim/3dsimulation/#2021.

  7. 7.

    Code release at https://github.com/LARG/utaustinvilla3d.

References

  1. MacAlpine, P., et al.: UT Austin Villa 2011: a champion agent in the RoboCup 3D soccer simulation competition. In: Proceedings of 11th International Conference on Autonomous Agents and Multiagent Systems (AAMAS 2012) (2012)

    Google Scholar 

  2. MacAlpine, P., Collins, N., Lopez-Mobilia, A., Stone, P.: UT Austin Villa: RoboCup 2012 3D simulation league champion. In: Chen, X., Stone, P., Sucar, L.E., van der Zant, T. (eds.) RoboCup 2012. LNCS (LNAI), vol. 7500, pp. 77–88. Springer, Heidelberg (2013). https://doi.org/10.1007/978-3-642-39250-4_8

    Chapter  Google Scholar 

  3. MacAlpine, P., Depinet, M., Liang, J., Stone, P.: UT Austin Villa: RoboCup 2014 3D simulation league competition and technical challenge champions. In: Bianchi, R.A.C., Akin, H.L., Ramamoorthy, S., Sugiura, K. (eds.) RoboCup 2014. LNCS (LNAI), vol. 8992, pp. 33–46. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-18615-3_3

    Chapter  Google Scholar 

  4. MacAlpine, P., Hanna, J., Liang, J., Stone, P.: UT Austin Villa: RoboCup 2015 3D simulation league competition and technical challenges champions. In: Almeida, L., Ji, J., Steinbauer, G., Luke, S. (eds.) RoboCup 2015. LNCS (LNAI), vol. 9513, pp. 118–131. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-29339-4_10

    Chapter  Google Scholar 

  5. MacAlpine, P., Stone, P.: UT Austin Villa: RoboCup 2016 3D simulation league competition and technical challenges champions. In: Behnke, S., Sheh, R., Sarıel, S., Lee, D.D. (eds.) RoboCup 2016. LNCS (LNAI), vol. 9776, pp. 515–528. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-68792-6_43

    Chapter  Google Scholar 

  6. MacAlpine, P., Stone, P.: UT Austin Villa: RoboCup 2017 3D simulation league competition and technical challenges champions. In: Akiyama, H., Obst, O., Sammut, C., Tonidandel, F. (eds.) RoboCup 2017. LNCS (LNAI), vol. 11175, pp. 473–485. Springer, Cham (2018). https://doi.org/10.1007/978-3-030-00308-1_39

    Chapter  Google Scholar 

  7. MacAlpine, P., Torabi, F., Pavse, B., Sigmon, J., Stone, P.: UT Austin Villa: RoboCup 2018 3D simulation league champions. In: Holz, D., Genter, K., Saad, M., von Stryk, O. (eds.) RoboCup 2018. LNCS (LNAI), vol. 11374, pp. 462–475. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-27544-0_38

    Chapter  Google Scholar 

  8. MacAlpine, P., Torabi, F., Pavse, B., Stone, P.: UT Austin Villa: RoboCup 2019 3D simulation league competition and technical challenge champions. In: Chalup, S., Niemueller, T., Suthakorn, J., Williams, M.-A. (eds.) RoboCup 2019. LNCS (LNAI), vol. 11531, pp. 540–552. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-35699-6_44

    Chapter  Google Scholar 

  9. MacAlpine, P., et al.: UT Austin Villa 2011 3D simulation team report. Technical report AI11-10, The Univ. of Texas at Austin, Dept. of Computer Science, AI Laboratory (2011)

    Google Scholar 

  10. Obst, O., Rollmann, M.: Spark – a generic simulator for physical multi-agent simulations. In: Lindemann, G., Denzinger, J., Timm, I.J., Unland, R. (eds.) MATES 2004. LNCS (LNAI), vol. 3187, pp. 243–257. Springer, Heidelberg (2004). https://doi.org/10.1007/978-3-540-30082-3_18

    Chapter  Google Scholar 

  11. Xu, Y., Vatankhah, H.: SimSpark: an open source robot simulator developed by the RoboCup community. In: Behnke, S., Veloso, M., Visser, A., Xiong, R. (eds.) RoboCup 2013. LNCS (LNAI), vol. 8371, pp. 632–639. Springer, Heidelberg (2014). https://doi.org/10.1007/978-3-662-44468-9_59

    Chapter  Google Scholar 

  12. MacAlpine, P., Price, E., Stone, P.: SCRAM: scalable collision-avoiding role assignment with minimal-Makespan for formational positioning. In: Proceedings of the Twenty-Ninth AAAI Conference on Artificial Intelligence (AAAI-15) (2015)

    Google Scholar 

  13. MacAlpine, P., Stone, P.: Prioritized role assignment for marking. In: Behnke, S., Sheh, R., Sarıel, S., Lee, D.D. (eds.) RoboCup 2016. LNCS (LNAI), vol. 9776, pp. 306–318. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-68792-6_25

    Chapter  Google Scholar 

  14. MacAlpine, P., Stone, P.: Overlapping layered learning. Artif. Intell. 254, 21–43 (2018)

    Article  MathSciNet  Google Scholar 

  15. Abreu, M., Silva, T., Teixeira, H., Reis, L.P., Lau, N.: 6D localization and kicking for humanoid robotic soccer. J. Intell. Robot. Syst. 102(2), 1–25 (2021). https://doi.org/10.1007/s10846-021-01385-3

    Article  Google Scholar 

  16. MacAlpine, P., Depinet, M., Stone, P.: UT Austin Villa 2014: RoboCup 3D simulation league champion via overlapping layered learning. In: Proceedings of the Twenty-Ninth AAAI Conference on Artificial Intelligence (AAAI-15) (2015)

    Google Scholar 

  17. MacAlpine, P., Barrett, S., Urieli, D., Vu, V., Stone, P.: Design and optimization of an omnidirectional humanoid walk: a winning approach at the RoboCup 2011 3D simulation competition. In: Proceedings of the Twenty-Sixth AAAI Conference on Artificial Intelligence (AAAI-12) (2012)

    Google Scholar 

  18. Depinet, M., MacAlpine, P., Stone, P.: Keyframe sampling, optimization, and behavior integration: towards long-distance kicking in the robocup 3d simulation league. In: Bianchi, R.A.C., Akin, H.L., Ramamoorthy, S., Sugiura, K. (eds.) RoboCup 2014. LNCS (LNAI), vol. 8992, pp. 571–582. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-18615-3_47

    Chapter  Google Scholar 

  19. Abreu, M., Lau, N., Sousa, A., Reis, L.P.: Learning low level skills from scratch for humanoid robot soccer using deep reinforcement learning. In: 2019 IEEE International Conference on Autonomous Robot Systems and Competitions (ICARSC), pp. 1–8. IEEE (2019)

    Google Scholar 

  20. Abreu, M., Reis, L.P., Lau, N.: Learning to run faster in a humanoid robot soccer environment through reinforcement learning. In: Chalup, S., Niemueller, T., Suthakorn, J., Williams, M.-A. (eds.) RoboCup 2019. LNCS (LNAI), vol. 11531, pp. 3–15. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-35699-6_1

    Chapter  Google Scholar 

  21. Melo, L.C., Melo, D.C., Maximo, M.R.O.A.: Learning humanoid robot running motions with symmetry incentive through proximal policy optimization. J. Intell. Robot. Syst. 102(3), 1–15 (2021). https://doi.org/10.1007/s10846-021-01355-9

    Article  Google Scholar 

  22. Brockman, G., et al.: Openai gym. arXiv preprint arXiv:1606.01540 (2016)

  23. Schulman, J., Wolski, F., Dhariwal, P., Radford, A., Klimov, O.: Proximal policy optimization algorithms. ArXiv abs/1707.06347 (2017)

    Google Scholar 

  24. Haarnoja, T., Zhou, A., Abbeel, P., Levine, S.: Soft actor-critic: Off-policy maximum entropy deep reinforcement learning with a stochastic actor. In: Dy, J., Krause, A. (eds.) Proceedings of the 35th International Conference on Machine Learning. Volume 80 of Proceedings of Machine Learning Research, PMLR, pp. 1861–1870 (2018)

    Google Scholar 

  25. Weng, J., et al.: A highly modularized deep reinforcement learning library. arXiv preprint arXiv:2107.14171 (2021)

  26. MacAlpine, P., Stone, P.: UT Austin Villa RoboCup 3D simulation base code release. In: Behnke, S., Sheh, R., Sarıel, S., Lee, D.D. (eds.) RoboCup 2016. LNCS (LNAI), vol. 9776, pp. 135–143. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-68792-6_11

    Chapter  Google Scholar 

Download references

Acknowledgments

Thanks to members of the magmaOffenburg teams for creating the fat proxy for the fat proxy challenge.

This work has taken place in the Learning Agents Research Group (LARG) at the Artificial Intelligence Laboratory, The University of Texas at Austin. LARG research is supported in part by grants from the National Science Foundation (CPS-1739964, IIS-1724157, NRI-1925082, FAIN-2019844), the Office of Naval Research (N00014-18-2243), Future of Life Institute (RFP2-000), Army Research Office (W911NF-19-2-0333), DARPA, Lockheed Martin, General Motors, and Bosch. Peter Stone serves as the Executive Director of Sony AI America and receives financial compensation for this work. The terms of this arrangement have been reviewed and approved by the University of Texas at Austin in accordance with its policy on objectivity in research. Patrick MacAlpine is an employee of Sony AI America and is supported by Sony.

Author information

Authors and Affiliations

  1. Sony AI, Austin, USA

    Patrick MacAlpine & Peter Stone

  2. The University of Texas at Austin, Austin, USA

    Bo Liu, William Macke, Caroline Wang & Peter Stone

Authors
  1. Patrick MacAlpine
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Bo Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. William Macke
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Caroline Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Peter Stone
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Patrick MacAlpine .

Editor information

Editors and Affiliations

  1. LAAS-CNRS/ANITI, Toulouse, France

    Rachid Alami

  2. The University of Texas at Austin, Austin, TX, USA

    Joydeep Biswas

  3. University of Washington, Seattle, WA, USA

    Maya Cakmak

  4. Western Sydney University, Penrith, NSW, Australia

    Oliver Obst

Rights and permissions

Reprints and permissions

Copyright information

© 2022 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

MacAlpine, P., Liu, B., Macke, W., Wang, C., Stone, P. (2022). UT Austin Villa: RoboCup 2021 3D Simulation League Competition Champions. In: Alami, R., Biswas, J., Cakmak, M., Obst, O. (eds) RoboCup 2021: Robot World Cup XXIV. RoboCup 2021. Lecture Notes in Computer Science(), vol 13132. Springer, Cham. https://doi.org/10.1007/978-3-030-98682-7_26

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-98682-7_26

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-98681-0

  • Online ISBN: 978-3-030-98682-7

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation