RoboCup@Home-Objects: Benchmarking Object Recognition for Home Robots

  • Nizar MassouhEmail author
  • Lorenzo Brigato
  • Luca Iocchi
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11531)


This paper presents a benchmark for object recognition inspired by RoboCup@Home competition and thus focusing on home robots. The benchmark includes a large-scale training set of 196K images labelled with classes derived from RoboCup@Home rulebooks, two medium-scale test sets (one taken with a Pepper robot) with different objects and different backgrounds with respect to the training set, a robot behavior for image acquisition, and several analysis of the results that are useful both for RoboCup@Home Technical Committee to define competition tests and for RoboCup@Home teams to implement effective object recognition components.


Object recognition Benchmarking Service robots 


  1. 1.
    Chatfield, K., Simonyan, K., Vedaldi, A., Zisserman, A.: Return of the devil in the details: delving deep into convolutional nets. In: Proceedings BMVC (2014)Google Scholar
  2. 2.
    Cheng, D.S., Setti, F., Zeni, N., Ferrario, R., Cristani, M.: Semantically-driven automatic creation of training sets for object recognition. Comput. Vis. Image Underst. 131, 56–71 (2015)CrossRefGoogle Scholar
  3. 3.
    Deng, J., Dong, W., Socher, R., Li, L.J., Li, K., Fei-Fei, L.: Imagenet: a large-scale hierarchical image database. In: Proceedings CVPR, pp. 248–255 (2009)Google Scholar
  4. 4.
    Divvala, S.K., Farhadi, A., Guestrin, C.: Learning everything about anything: webly-supervised visual concept learning. In: Proceedings CVPR, pp. 3270–3277 (2014)Google Scholar
  5. 5.
    Howard, A.G., et al.: Mobilenets: efficient convolutional neural networks for mobile vision applications. CoRR abs/1704.04861 (2017).
  6. 6.
    Iocchi, L., Holz, D., Ruiz-del-Solar, J., Sugiura, K., van der Zant, T.: RoboCup@Home: analysis and results of evolving competitions for domestic and service robots. Artif. Intell. 229, 258–281 (2015)MathSciNetCrossRefGoogle Scholar
  7. 7.
    Krizhevsky, A., Sutskever, I., Hinton, G.E.: Imagenet classification with deep convolutional neural networks. In: Proceedings NIPS (2012)Google Scholar
  8. 8.
    Massouh, N., Babiloni, F., Tommasi, T., Young, J., Hawes, N., Caputo, B.: Learning deep visual object models from noisy web data: how to make it work. In: 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS 2017, Vancouver, 24–28 September 2017, pp. 5564–5571 (2017).
  9. 9.
    Matamoros, M., Seib, V., Memmesheimer, R., Paulus, D.: RoboCup@Home; summarizing achievements in over eleven years of competition. CoRR abs/1902.00758 (2019).
  10. 10.
    Szegedy, C., et al.: Going deeper with convolutions. CoRR abs/1409.4842 (2014)Google Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  1. 1.Department of Computer Control and Management EngineeringSapienza University of RomeRomeItaly

Personalised recommendations