WrightEagle and UT Austin Villa: RoboCup 2011 Simulation League Champions

  • Aijun Bai
  • Xiaoping Chen
  • Patrick MacAlpine
  • Daniel Urieli
  • Samuel Barrett
  • Peter Stone
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7416)

Abstract

The RoboCup simulation league is traditionally the league with the largest number of teams participating, both at the international competitions and worldwide. 2011 was no exception, with a total of 39 teams entering the 2D and 3D simulation competitions. This paper prese- nts the champions of the competitions, WrightEagle from the University of Science and Technology of China in the 2D competition, and UT Austin Villa from the University of Texas at Austin in the 3D competition.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Dellaert, F., Fox, D., Burgard, W., Thrun, S.: Monte carlo localization for mobile robots. In: Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C), vol. 2, pp. 1322–1328. IEEE (2001)Google Scholar
  2. 2.
    Dietterich, T.G.: Hierarchical reinforcement learning with the MAXQ value function decomposition. Journal of Machine Learning Research 13(1), 63 (1999)Google Scholar
  3. 3.
    Dietterich, T.G.: The MAXQ method for hierarchical reinforcement learning. In: Proceedings of the Fifteenth International Conference on Machine Learning, vol. 8(c), pp. 118–126. Morgan Kaufmann (1999)Google Scholar
  4. 4.
    Fan, C., Chen, X.: Bounded incremental real-time dynamic programming. In: Frontiers in the Convergence of Bioscience and Information Technologies, pp. 637–644 (2007)Google Scholar
  5. 5.
    Graf, C., Härtl, A., Röfer, T., Laue, T.: A robust closed-loop gait for the standard platform league humanoid. In: Proc. of the 4th Workshop on Humanoid Soccer Robots in Conjunction with the 2009 IEEE-RAS Int. Conf. on Humanoid Robots, pp. 30–37 (2009)Google Scholar
  6. 6.
    Hansen, N.: The CMA Evolution Strategy: A Tutorial (January 2009), http://www.lri.fr/~hansen/cmatutorial.pdf
  7. 7.
    Kaelbling, L.P., Littman, M.L., Cassandra, A.R.: Planning and acting in partially observable stochastic domains. Artificial Intelligence 101(1-2), 99–134 (1998)MathSciNetMATHCrossRefGoogle Scholar
  8. 8.
    MacAlpine, P., Urieli, D., Barrett, S., Kalyanakrishnan, S., Barrera, F., Lopez-Mobilia, A., Ştiurcă, N., Vu, V., Stone, P.: UT Austin Villa 2011: A champion agent in the RoboCup 3D soccer simulation competition. In: Proc. of 11th Int. Conf. on Autonomous Agents and Multiagent Systems (AAMAS 2012) (June 2012)Google Scholar
  9. 9.
    Puterman, M.L.: Markov Decision Processes: Discrete Stochastic Dynamic Programming. John Wiley & Sons, Inc. (1994)Google Scholar
  10. 10.
    Shi, K., Chen, X.: Action-driven markov decision process and the application in robocup. Journal of Chinese Computer Systems 32, 511–515 (2011)Google Scholar
  11. 11.
    Sutton, R.S., Precup, D., Singh, S.: Between mdps and semi-mdps: A framework for temporal abstraction in reinforcement learning. Artificial Intelligence 112(1-2), 181–211 (1999)MathSciNetMATHCrossRefGoogle Scholar
  12. 12.
    Urieli, D., MacAlpine, P., Kalyanakrishnan, S., Bentor, Y., Stone, P.: On optimizing interdependent skills: A case study in simulated 3D humanoid robot soccer. In: Proc. of the Tenth Int. Conf. on Autonomous Agents and Multiagent Systems (AAMAS 2011), May 2011, pp. 769–776 (2011)Google Scholar
  13. 13.
    Wu, F., Chen, X.: Solving Large-Scale and Sparse-Reward DEC-POMDPs with Correlation-MDPs. In: Visser, U., Ribeiro, F., Ohashi, T., Dellaert, F. (eds.) RoboCup 2007. LNCS (LNAI), vol. 5001, pp. 208–219. Springer, Heidelberg (2008)CrossRefGoogle Scholar
  14. 14.
    Wu, F., Zilberstein, S., Chen, X.: Online planning for multi-agent systems with bounded communication. Artificial Intelligence 175(2), 487–511 (2011)MathSciNetMATHCrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2012

Authors and Affiliations

  • Aijun Bai
    • 1
  • Xiaoping Chen
    • 1
  • Patrick MacAlpine
    • 2
  • Daniel Urieli
    • 2
  • Samuel Barrett
    • 2
  • Peter Stone
    • 2
  1. 1.Department of Computer ScienceUniversity of Science and Technology of ChinaChina
  2. 2.Department of Computer ScienceThe University of Texas at AustinUSA

Personalised recommendations