Abstract
This paper presents the latest progress of WrightEagle, the champion of RoboCup 2D simulation league. We introduce a decision-making framework, an extension of MAXQ-OP framework using multiple heuristic functions and a reachable state checking method. The experimental results show that our approach improves the quality of solutions in complex situations.
Chapter PDF
Similar content being viewed by others
References
Puterman, M.L.: Markov decision processes: discrete stochastic dynamic programming, vol. 414. Wiley. com (2009)
Dietterich, T.G.: The maxq method for hierarchical reinforcement learning. In: ICML, pp. 118–126. Citeseer (1998)
Bai, A., Wu, F., Chen, X.: Online planning for large mdps with maxq decomposition. In: Proceedings of the Autonomous Robots and Multirobot Systems Workshop, at AAMAS 2012 (June 2012)
Bai, A., Wu, F., Chen, X.: Towards a principled solution to simulated robot soccer. In: Chen, X., Stone, P., Sucar, L.E., van der Zant, T. (eds.) RoboCup 2012. LNCS (LNAI), vol. 7500, pp. 141–153. Springer, Heidelberg (2013)
Akiyama, H., Nakashima, T.: HELIOS2012: RoboCup 2012 Soccer Simulation 2D League Champion. In: Chen, X., Stone, P., Sucar, L.E., van der Zant, T. (eds.) RoboCup 2012. LNCS (LNAI), vol. 7500, pp. 13–19. Springer, Heidelberg (2013)
Akiyama, H., Nakashima, T., Yamashita, K.: HELIOS2013 Team Description Paper. In: RoboCup 2012: Robot Soccer World Cup XVI, pp. 1–6 (2012)
Burkhard, H.-D., Hannebauer, M., Wendler, J.: At humboldt development, practice and theory. In: Kitano, H. (ed.) RoboCup 1997. LNCS, vol. 1395, pp. 357–372. Springer, Heidelberg (1998)
Gabel, T., Riedmiller, M., Trost, F.: A case study on improving defense behavior in soccer simulation 2d: The neurohassle approach. In: Iocchi, L., Matsubara, H., Weitzenfeld, A., Zhou, C. (eds.) RoboCup 2008. LNCS (LNAI), vol. 5399, pp. 61–72. Springer, Heidelberg (2009)
Stone, P.: Layered learning in multiagent systems: A winning approach to robotic soccer. The MIT Press (2000)
Stone, P., Sutton, R.S., Kuhlmann, G.: Reinforcement learning for robocup soccer keepaway. Adaptive Behavior 13(3), 165–188 (2005)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Zhang, H., Chen, X. (2014). The Decision-Making Framework of WrightEagle, the RoboCup 2013 Soccer Simulation 2D League Champion Team. In: Behnke, S., Veloso, M., Visser, A., Xiong, R. (eds) RoboCup 2013: Robot World Cup XVII. RoboCup 2013. Lecture Notes in Computer Science(), vol 8371. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-662-44468-9_11
Download citation
DOI: https://doi.org/10.1007/978-3-662-44468-9_11
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-662-44467-2
Online ISBN: 978-3-662-44468-9
eBook Packages: Computer ScienceComputer Science (R0)