The RoboCup Mixed Reality League – A Case Study
In typical mixed reality systems there is only a one-way interaction from real to virtual. A human user or the physics of a real object may influence the behavior of virtual objects, but real objects usually cannot be influenced by the virtual world. By introducing real robots into the mixed reality system, we allow a true two-way interaction between virtual and real worlds. Our system has been used since 2007 to implement the RoboCup mixed reality soccer games and other applications for research and edutainment. Our framework system is freely programmable to generate any virtual environment, which may then be further supplemented with virtual and real objects. The system allows for control of any real object based on differential drive robots. The robots may be adapted for different applications, e.g., with markers for identification or with covers to change shape and appearance. They may also be “equipped” with virtual tools. In this chapter we present the hardware and software architecture of our system and some applications. The authors believe this can be seen as a first implementation of Ivan Sutherland’s 1965 idea of the ultimate display: “The ultimate display would, of course, be a room within which the computer can control the existence of matter …” (Sutherland, 1965, Proceedings of IFIPS Congress 2:506–508).
KeywordsMixed systems Robotics RoboCup Physical control
- 1.Sutherland I E (1965) The Ultimate Display. Proceedings of IFIPS Congress 2:506–508.Google Scholar
- 2.The RoboCup in the Internet: http://www.robocup.org
- 3.Boedecker J, Guerra R da S, Mayer N M, Obst O, Asada A (2007) 3D2Real: Simulation League Finals in Real Robots. Lecture Notes in Computer Science 4020:25–34.Google Scholar
- 4.Boedecker J, Mayer N M, Ogino M, Guerra R da S, Kikuchi M, Asada M (2005) Getting Closer: How Simulation and Humanoid League Can Benefit from Each Other. Symposium on Autonomous Minirobots for Research and Edutainment 93–98.Google Scholar
- 5.Guerra R da S, Boedecker J, Mayer N M, Yanagimachi S, Hirosawa Y, Yoshikawa K, Namekawa K, Asada M (2008) Introducing Physical Visualization Sub-League. Lecture Notes in Computer Science.Google Scholar
- 6.Guerra R da S, Boedecker J, Yanagimachi S, Asada M (2007) Introducing a New Minirobotics Platform for Research and Edutainment. Symposium on Autonomous Minirobots for Research and Edutainment, Buenos Aires.Google Scholar
- 7.Guerra R da S, Boedecker J, Asada M (2007) Physical Visualization Sub-League: A New Platform for Research and Edutainment. SIG-CHALLENGE Workshop 24:15–20.Google Scholar
- 8.Guerra R da S, Boedecker J, Mayer N M, Yanagimachi S, Hirosawa Y, Yoshikawa K, Namekawa M, Asada M (2006) CITIZEN Eco-Be! League: Bringing New Flexibility for Research and Education to RoboCup. SIG-CHALLENGE Workshop 23:13–18.Google Scholar
- 9.Milgram P, Takemura H, Utsumi A, Kishina F (1994) Augmented Reality: A class of displays on the reality-virtuality continuum Paper presented at the SPIE, Telemanipulator and Telepresence Technologies, Boston.Google Scholar
- 10.Fitzmaurice G W (1996): Graspable User Interfaces. PhD at the University of Toronto.http://www.dgp.toronto.edu/˜gf/papers/PhD%20-%20Graspable%20UIs/Thesis.gf.html.
- 11.Pangaro G, Maynes-Aminzade D, Ishii H (2002) The Actuated Workbench: Computer-Controlled Actuation in Tabbletop Tangible Interfaces. In Proceedings of UIST’02, ACM Press, NY, 181–190.Google Scholar
- 12.Guerra R da S, Boedecker J, Mayer N M, Yanagimachi S, Ishiguro H, Asada M (2007) A New Minirobotics System for Teaching and Researching. Agent-based Programming. Computers and Advanced Technology in Education, Beijing.Google Scholar
- 13.Guerra R da S, Boedecker J, Ishiguro H, Asada M (2007) Successful Teaching of Agent-Based Programming to Novice Undergrads in a Robotic Soccer Crash Course. SIG-CHALLENGE Workshop 24:21–26.Google Scholar
- 14.Dresner K, Stone P (2008) A Multiagent Approach to Autonomous Intersection Management. Journal of Artificial Intelligence Research, March 2008, 31:591–656.Google Scholar
- 15.Caprari G, Colot A, Siegwart R, Halloy J, Deneubourg J -L (2004) Building Mixed Societies of Animals and Robots. IEEE Robotics & Automation Magazine.Google Scholar
- 16.Open Dynamics Engine (ODE) in the Internet: http://www.ode.org.
- 17.Guerra R da S, Boedecker J, Yamauchi K, Maekawa T, Asada M, Hirosawa T, Namekawa M, Yoshikawa K, Yanagimachi S, Masubuchi S, Nishimura K (2006) CITIZEN Eco-Be! and the RoboCup Physical Visualization League. Micromechatronics Lectures – The Horological Institute of Japan.Google Scholar
- 18.ARToolKit. In the Internet: http://www.hitl.washington.edu/artoolkit.