RoboCup@Home: Adaptive Benchmarking of Robot Bodies and Minds

  • Tijn van der Zant
  • Luca Iocchi
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7072)


RoboCup@Home is the largest benchmarking effort for domestic service robots. The benchmarking is in the form of a competition, with several yearly local competitions and an international one. Every year the tests become more complex, depending on the results of the previous years. In the past four years the focus has been on benchmarking physical aspects of the robots, such as manipulation, recognizing people and human-robot interaction. In 2010, for the first time, there is a test which is targeted at the mental cognitive capabilities of the robot. In order to guarantee scientific quality of the proposed solutions and effective integration in a fully working system, all the tests include different capabilities and change every year. This novel feature of RoboCup@Home benchmarking raises the question of: How can effective benchmark tests be defined and at the same time measure the progress over many years? In this paper we present the methodology applied in and results of RoboCup@Home for measuring the effectiveness of benchmarking service robots through competitions and present a new integrated test for benchmarking the cognitive abilities of a robot.


Speech Recognition Gesture Recognition Shopping Mall Service Robot Object Manipulation 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Doostdar, M., Schiffer, S., Lakemeyer, G.: A Robust Speech Recognition System for Service-robotics Applications. In: Iocchi, L., Matsubara, H., Weitzenfeld, A., Zhou, C. (eds.) RoboCup 2008. LNCS, vol. 5399, pp. 1–12. Springer, Heidelberg (2009)CrossRefGoogle Scholar
  2. 2.
    Feil-Seifer, D., Skinner, K., Mataric, M.J.: Benchmarks for evaluating socially assistive robotics. Interaction Studies 8(3), 423–439 (2007)CrossRefGoogle Scholar
  3. 3.
    Kitano, H., Asada, M., Kuniyoshi, Y., Noda, I., Osawa, E.: Robocup: The robot world cup initiative. In: AGENTS 1997: Proceedings of the First International Conference on Autonomous Agents, New York, NY, USA, pp. 340–347. ACM (1997)Google Scholar
  4. 4.
    Kitano, H., Asada, M., Kuniyoshi, Y., Noda, I., Osawa, E., Matsubara, H.: RoboCup: A Challenge Problem for AI. AI Magazine 18(1), 73–85 (1997)Google Scholar
  5. 5.
    van der Zant, T., Wisspeintner, T.: RoboCup X: A Proposal for a New League Where RoboCup Goes Real World. In: Bredenfeld, A., Jacoff, A., Noda, I., Takahashi, Y. (eds.) RoboCup 2005. LNCS, vol. 4020, pp. 166–172. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  6. 6.
    van der Zant, T., Wisspeintner, T.: RoboCup@Home: Creating and Benchmarking Tomorrows Service Robot Applications. In: Robotic Soccer, pp. 521–528. I-Tech Education and Publishing (2007)Google Scholar
  7. 7.
    Wilcox, T., Baillargeon, R.: Object individuation in infancy: The use of featural information in reasoning about occlusion events. Cognitive Psychology 37(2), 97–155 (1998)CrossRefGoogle Scholar
  8. 8.
    Wisspeintner, T., van der Zant, T., Iocchi, L., Schiffer, S.: Robocup@home: Scientific Competition and Benchmarking for Domestic Service Robots. Interaction Studies. Special Issue on Robots in the Wild 10(3), 392–426 (2009)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2011

Authors and Affiliations

  • Tijn van der Zant
    • 1
  • Luca Iocchi
    • 2
  1. 1.Cogitive Robotics Laboratory, A.I. dept, faculty of Natural SciencesUniversity of GroningenNetherlands
  2. 2.Department of Computer and Systems ScienceUniversity of Rome ”La Sapienza”Italy

Personalised recommendations