The RoboCup Mixed Reality League – A Case Study

  • Reinhard GerndtEmail author
  • Matthias Bohnen
  • Rodrigo da Silva Guerra
  • Minoru Asada
Part of the Human-Computer Interaction Series book series (HCIS)


In typical mixed reality systems there is only a one-way interaction from real to virtual. A human user or the physics of a real object may influence the behavior of virtual objects, but real objects usually cannot be influenced by the virtual world. By introducing real robots into the mixed reality system, we allow a true two-way interaction between virtual and real worlds. Our system has been used since 2007 to implement the RoboCup mixed reality soccer games and other applications for research and edutainment. Our framework system is freely programmable to generate any virtual environment, which may then be further supplemented with virtual and real objects. The system allows for control of any real object based on differential drive robots. The robots may be adapted for different applications, e.g., with markers for identification or with covers to change shape and appearance. They may also be “equipped” with virtual tools. In this chapter we present the hardware and software architecture of our system and some applications. The authors believe this can be seen as a first implementation of Ivan Sutherland’s 1965 idea of the ultimate display: “The ultimate display would, of course, be a room within which the computer can control the existence of matter …” (Sutherland, 1965, Proceedings of IFIPS Congress 2:506–508).


Mixed systems Robotics RoboCup Physical control 


  1. 1.
    Sutherland I E (1965) The Ultimate Display. Proceedings of IFIPS Congress 2:506–508.Google Scholar
  2. 2.
    The RoboCup in the Internet:
  3. 3.
    Boedecker J, Guerra R da S, Mayer N M, Obst O, Asada A (2007) 3D2Real: Simulation League Finals in Real Robots. Lecture Notes in Computer Science 4020:25–34.Google Scholar
  4. 4.
    Boedecker J, Mayer N M, Ogino M, Guerra R da S, Kikuchi M, Asada M (2005) Getting Closer: How Simulation and Humanoid League Can Benefit from Each Other. Symposium on Autonomous Minirobots for Research and Edutainment 93–98.Google Scholar
  5. 5.
    Guerra R da S, Boedecker J, Mayer N M, Yanagimachi S, Hirosawa Y, Yoshikawa K, Namekawa K, Asada M (2008) Introducing Physical Visualization Sub-League. Lecture Notes in Computer Science.Google Scholar
  6. 6.
    Guerra R da S, Boedecker J, Yanagimachi S, Asada M (2007) Introducing a New Minirobotics Platform for Research and Edutainment. Symposium on Autonomous Minirobots for Research and Edutainment, Buenos Aires.Google Scholar
  7. 7.
    Guerra R da S, Boedecker J, Asada M (2007) Physical Visualization Sub-League: A New Platform for Research and Edutainment. SIG-CHALLENGE Workshop 24:15–20.Google Scholar
  8. 8.
    Guerra R da S, Boedecker J, Mayer N M, Yanagimachi S, Hirosawa Y, Yoshikawa K, Namekawa M, Asada M (2006) CITIZEN Eco-Be! League: Bringing New Flexibility for Research and Education to RoboCup. SIG-CHALLENGE Workshop 23:13–18.Google Scholar
  9. 9.
    Milgram P, Takemura H, Utsumi A, Kishina F (1994) Augmented Reality: A class of displays on the reality-virtuality continuum Paper presented at the SPIE, Telemanipulator and Telepresence Technologies, Boston.Google Scholar
  10. 10.
    Fitzmaurice G W (1996): Graspable User Interfaces. PhD at the University of Toronto.˜gf/papers/PhD%20-%20Graspable%20UIs/
  11. 11.
    Pangaro G, Maynes-Aminzade D, Ishii H (2002) The Actuated Workbench: Computer-Controlled Actuation in Tabbletop Tangible Interfaces. In Proceedings of UIST’02, ACM Press, NY, 181–190.Google Scholar
  12. 12.
    Guerra R da S, Boedecker J, Mayer N M, Yanagimachi S, Ishiguro H, Asada M (2007) A New Minirobotics System for Teaching and Researching. Agent-based Programming. Computers and Advanced Technology in Education, Beijing.Google Scholar
  13. 13.
    Guerra R da S, Boedecker J, Ishiguro H, Asada M (2007) Successful Teaching of Agent-Based Programming to Novice Undergrads in a Robotic Soccer Crash Course. SIG-CHALLENGE Workshop 24:21–26.Google Scholar
  14. 14.
    Dresner K, Stone P (2008) A Multiagent Approach to Autonomous Intersection Management. Journal of Artificial Intelligence Research, March 2008, 31:591–656.Google Scholar
  15. 15.
    Caprari G, Colot A, Siegwart R, Halloy J, Deneubourg J -L (2004) Building Mixed Societies of Animals and Robots. IEEE Robotics & Automation Magazine.Google Scholar
  16. 16.
    Open Dynamics Engine (ODE) in the Internet:
  17. 17.
    Guerra R da S, Boedecker J, Yamauchi K, Maekawa T, Asada M, Hirosawa T, Namekawa M, Yoshikawa K, Yanagimachi S, Masubuchi S, Nishimura K (2006) CITIZEN Eco-Be! and the RoboCup Physical Visualization League. Micromechatronics Lectures – The Horological Institute of Japan.Google Scholar
  18. 18.
    ARToolKit. In the Internet:

Copyright information

© Springer-Verlag London 2010

Authors and Affiliations

  • Reinhard Gerndt
    • 1
    Email author
  • Matthias Bohnen
    • 2
  • Rodrigo da Silva Guerra
    • 3
  • Minoru Asada
    • 3
  1. 1.University of Applied Sciences Braunschweig/WolfenbuettelWolfenbuettelGermany
  2. 2.University Koblenz-LandauKoblenzGermany
  3. 3.Graduate School of EngineeringOsaka UniversityOsakaJapan

Personalised recommendations