Give MEANinGS to Robots with Kitchen Clash: A VR Human Computation Serious Game for World Knowledge Accumulation

  • Johannes PfauEmail author
  • Robert Porzel
  • Mihai Pomarlan
  • Vanja Sophie Cangalovic
  • Supara Grudpan
  • Sebastian Höffner
  • John Bateman
  • Rainer Malaka
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11863)


In this paper, we introduce the framework of MEANinGS for the semi-autonomous accumulation of world knowledge for robots. Where manual aggregation is inefficient and prone to incompleteness and autonomous approaches suffer from underspecified information, we deploy the human computation game Kitchen Clash and give evidence of its efficiency, completeness and motivation potential.


Serious game Knowledge accumulation Framework 



This work was funded by the German Research Foundation (DFG) as part of Collaborative Research Center (SFB) 1320 EASE - Everyday Activity Science and Engineering, University of Bremen (, subprojects H2 and P1. We thank all participants.


  1. 1.
    Beetz, M., Bessler, D., Haidu, A., Pomarlan, M., Bozcuoglu, A.K., Bartels, G.: Know Rob 2.0 - a 2nd generation knowledge processing framework for cognition-enabled robotic agents. In: Proceedings - IEEE International Conference on Robotics and Automation, pp. 512–519 (2018).
  2. 2.
    Beetz, M., Mösenlechner, L., Tenorth, M.: CRAM–a cognitive robot abstract machine for everyday manipulation in human environments. In: 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 1012–1017. IEEE (2010)Google Scholar
  3. 3.
    Dang, H., Allen, P.K.: Robot learning of everyday object manipulations via human demonstration. In: 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 1284–1289. IEEE (2010)Google Scholar
  4. 4.
    Kunze, L., Tenorth, M., Beetz, M.: Putting people’s common sense into knowledge bases of household robots. In: Dillmann, R., Beyerer, J., Hanebeck, U.D., Schultz, T. (eds.) KI 2010. LNCS, vol. 6359, pp. 151–159. Springer, Heidelberg (2010). Scholar
  5. 5.
    Mascardi, V., Cordì, V., Rosso, P.: A comparison of upper ontologies (technical report disi-tr-06-21). Dipartimento di Informatica e Scienze dell’Informazione (DISI), Universitŕ degli Studi di Genova, Via Dodecaneso 35, 16146 (2008)Google Scholar
  6. 6.
    Masolo, C., Borgo, S., Gangemi, A., Guarino, N., Oltramari, A.: Wonderweb deliverable D18, ontology library (final). ICT Proj. 33052, 31 (2003)Google Scholar
  7. 7.
    McAuley, E., Duncan, T., Tammen, V.V.: Psychometric properties of the Intrinsic Motivation Inventory in a competitive sport setting: a confirmatory factor analysis. Res. Q. Exerc. Sport 60(1), 48–58 (1989)CrossRefGoogle Scholar
  8. 8.
    Mösenlechner, L., Beetz, M.: Fast temporal projection using accurate physics-based geometric reasoning. In: Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), pp. 1821–1827, Karlsruhe, Germany, 6–10 May 2013Google Scholar
  9. 9.
    Mossakowski, T.: The distributed ontology, model and specification language– DOL. In: James, P., Roggenbach, M. (eds.) WADT 2016. LNCS, vol. 10644, pp. 5–10. Springer, Cham (2017). Scholar
  10. 10.
    Narayanan, S.S.: KARMA: knowledge-based active representations for metaphor and aspect (1999)Google Scholar
  11. 11.
    Nielsen, R.D., et al.: A platform for human-robot dialog systems research. In: 2010 AAAI Fall Symposium Series (2010)Google Scholar
  12. 12.
    Nilsson, N.J.: Shakey the robot. Technical report, Sri International Menlo Park CA (1984)Google Scholar
  13. 13.
    Parde, N.P., Papakostas, M., Tsiakas, K., Dagioglou, M., Karkaletsis, V., Nielsen, R.D.: I Spy: an interactive game-based approach to multimodal robot learning. In: Workshops at the Twenty-Ninth AAAI Conference on Artificial Intelligence (2015)Google Scholar
  14. 14.
    Pfau, J., Smeddinck, J.D., Malaka, R.: Towards deep player behavior models in MMORPGs. In: Proceedings of the 2018 Annual Symposium on Computer-Human Interaction in Play, CHI PLAY 2018, pp. 381–392. ACM, New York (2018).
  15. 15.
    Schubert, T., Friedmann, F., Regenbrecht, H.: Embodied presence in virtual environments. In: Paton, R., Neilson, I. (eds.) Visual Representations and Interpretations, pp. 269–278. Springer, London (1999). Scholar
  16. 16.
    Steels, L.: Basics of fluid construction grammar. Constr. Frames 9(2), 178–225 (2017). Scholar
  17. 17.
    Stulp, F., Fedrizzi, A., Mösenlechner, L., Beetz, M.: Learning and reasoning with action-related places for robust mobile manipulation. J. Artif. Intell. Res. (JAIR) 43, 1–42 (2012)MathSciNetCrossRefGoogle Scholar
  18. 18.
    Walther-Franks, B., Smeddinck, J., Szmidt, P., Haidu, A., Beetz, M., Malaka, R.: Robots, pancakes, and computer games: designing serious games for robot imitation learning. In: Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, pp. 3623–3632. ACM (2015)Google Scholar
  19. 19.
    Winkler, J., Bozcuoğlu, A.K., Pomarlan, M., Beetz, M.: Task parametrization through multi-modal analysis of robot experiences. In: International Foundation for Autonomous Agents and Multiagent Systems, Proceedings of the 16th Conference on Autonomous Agents and MultiAgent Systems, AAMAS 2017, pp. 1754–1756, Richland, SC (2017).

Copyright information

© IFIP International Federation for Information Processing 2019

Authors and Affiliations

  • Johannes Pfau
    • 1
    Email author
  • Robert Porzel
    • 1
  • Mihai Pomarlan
    • 1
  • Vanja Sophie Cangalovic
    • 1
  • Supara Grudpan
    • 1
  • Sebastian Höffner
    • 1
  • John Bateman
    • 1
  • Rainer Malaka
    • 1
  1. 1.University of BremenBremenGermany

Personalised recommendations