Simulation Based Selection of Actions for a Humanoid Soccer-Robot

Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9776)


This paper introduces a method for making fast decisions in a highly dynamic situation, based on forward simulation. This approach is inspired by the decision problem within the RoboCup domain. In this environment, selecting the right action is often a challenging task. The outcome of a particular action may depend on a wide variety of environmental factors, such as the robot’s position on the field or the location of obstacles. In addition, the perception is often heterogeneous, uncertain, and incomplete. In this context, we investigate forward simulation as a versatile and extensible yet simple mechanism for inference of decisions. The outcome of each possible action is simulated based on the estimated state of the situation. The simulation of a single action is split into a number of simple deterministic simulations – samples – based on the uncertainties of the estimated state and of the action model. Each of the samples is then evaluated separately, and the evaluations are combined and compared with those of other actions to inform the overall decision. This allows us to effectively combine heterogeneous perceptual data, calculate a stable decision, and reason about its uncertainty. This approach is implemented for the kick selection task in the RoboCup SPL environment and is actively used in competitions. We present analysis of real game data showing significant improvement over our previous methods.


RoboCup (RC15) Forward Simulation RoboCup Domain Opponent Goal German Performance (GO15) 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. 1.
    Ahmadi, M., Stone, P.: Instance-based action models for fast action planning. In: Visser, U., Ribeiro, F., Ohashi, T., Dellaert, F. (eds.) RoboCup 2007. LNCS (LNAI), vol. 5001, pp. 1–16. Springer, Heidelberg (2008). Scholar
  2. 2.
    Bordallo, A., Previtali, F., Nardelli, N., Ramamoorthy, S.: Counterfactual reasoning about intent for interactive navigation in dynamic environments. In: 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 2943–2950, September 2015Google Scholar
  3. 3.
    Dodds, R., Vallejos, P., Ruiz-del Solar, J.: Probabilistic kick selection in robot soccer. In: IEEE 3rd Latin American Robotics Symposium, LARS 2006, pp. 137–140, October 2006Google Scholar
  4. 4.
    Guerrero, P., Ruiz-del-Solar, J., Díaz, G.: Probabilistic decision making in robot soccer. In: Visser, U., Ribeiro, F., Ohashi, T., Dellaert, F. (eds.) RoboCup 2007. LNCS (LNAI), vol. 5001, pp. 29–40. Springer, Heidelberg (2008). Scholar
  5. 5.
    Kunze, L., Beetz, M.: Envisioning the qualitative effects of robot manipulation actions using simulation-based projections. Artif. Intell. (2015).
  6. 6.
    Winfield, A.F.T., Blum, C., Liu, W.: Towards an ethical robot: internal models, consequences and ethical action selection. In: Mistry, M., Leonardis, A., Witkowski, M., Melhuish, C. (eds.) TAROS 2014. LNCS (LNAI), vol. 8717, pp. 85–96. Springer, Cham (2014). Scholar

Copyright information

© Springer International Publishing AG 2017

Authors and Affiliations

  1. 1.Adaptive Systems Group, Department of Computer ScienceHumboldt-Universität zu BerlinBerlinGermany

Personalised recommendations