Development of an Augmented Environment and Autonomous Learning for Quadruped Robots
This paper describes an interactive experimental environment for autonomous soccer robots, which is a soccer field augmented by utilizing camera input and projector output. This environment, in a sense, plays an intermediate role between simulated environments and real environments. We can simulate some parts of real environments, e.g., real objects such as robots or a ball, and reflect simulated data into the real environments, e.g., to visualize the positions on the field, so as to create a situation that allows easy debugging of robot programs. As an application in the augmented environment, we address the learning of goalie strategies on real quadruped robots in penalty kicks. Our robots learn and acquire sophisticated strategies in a fully simulated environment, and then they autonomously adapt to real environments in the augmented environment.
- 4.Microsoft: Microsoft Robotics Studio (2007), http://msdn.microsoft.com/robotics/
- 5.Takeshita, K., Okuzumi, T., Kase, S., Hasegawa, Y., Mitsumoto, H., Ueda, R., Umeda, K., Osumi, H., Arai, T.: Technical Report of Team ARAIBO. Technical report, ARAIBO (2007), http://araibo.is-a-geek.com/
- 7.da Silva Guerra, R., Boedecker, J., Mayer, N., Yanagimachi, S., Hirosawa, Y., Yoshikawa, K., Namekawa, M., Asada, M.: CITIZEN Eco-Be! League: bringing new flexibility for research and education to RoboCup. In: Proceedings of the Meeting of Special Interest Group on AI Challenges, vol. 23, pp. 13–18 (2006)Google Scholar
- 8.Kobayashi, H., Osaki, T., Williams, E., Ishino, A., Shinohara, A.: Autonomous Learning of Ball Trapping in the Four-legged Robot League. In: Lakemeyer, G., Sklar, E., Sorrenti, D.G., Takahashi, T. (eds.) RoboCup 2006: Robot Soccer World Cup X. LNCS (LNAI), vol. 4434, pp. 86–97. Springer, Heidelberg (2007)CrossRefGoogle Scholar
- 9.Piccardi, M.: Background subtraction techniques: a review. In: IEEE International Conference on Systems, Man and Cybernetics 2004, vol. 4, pp. 3099–3104 (2004)Google Scholar
- 10.Sutton, R.S., Barto, A.G.: Reinforcement Learning: An Introduction. MIT Press, Cambridge (1998)Google Scholar