Abstract
Increasingly, agent teams are used in realistic and complex multiagent environments. In such environments, dynamic and complex changes in the environment require appropriate adaptation of the teamwork (collaboration) among team-members. As RoboCup proposes to provide multi-agent researchers with a standard test-bed for evaluation of methodologies, it is only natural to use it for investigating this essential capability. During the RoboCup-98 workshop and competition a unique event took place: a comparative evaluation of the teamwork adaptation capabilities of 13 of the top competing teams. An evaluation attempt of this scale is a novel undertaking, and presents many novel challenges to researchers in the multi-agent community. This preliminary report describes the data-collection session, the experimental protocol, and some of the preliminary results from analysis of the data. Rather than proposing solutions and well understood results, it seeks to highlight key challenges in evaluation of multi-agent research in general, and of teamwork in particular..
We thank Kay Schroter and Prof. Hans-Dieter Burkhard for their help during data-collection phases.
Chapter PDF
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Andou, T. (1998). Andhill-98: A RoboCup Team which Reinforces Positioning Observability. RoboCup-98, Paris, France.
Andre, D. and A. Teller (1998). Evolving Team Darwin United. RoboCup-98, Paris, France.
Balch, T. (1998). Behavioral Diversity in Learning Robot Teams. Ph.D. thesis, Georgia Institute of Technology.
Burkhard, H.-D., M. Hannebauer, et al. (1998). AT Humboldt-Development, Practice, and Theory. RoboCup-97: Robot Soccer World Cup I. H. Kitano, Springer. LNAI 1395: 357–372.
Burkhard, H.-D., J. Wendler, et al. (1998). AT Humboldt in RoboCup-98. RoboCup-98, Paris, France
Corten, E. and E. Rondema (1998). Team Description of the Windmill Wanderers. RoboCup-98, Paris, France.
Gemini, 1998. A Competing entry in RoboCup-98. No team description or other reference was available for this team.
Goldberg, D. and Mataric, M. (1997). Interference as a tool for designing and evaluating multi-robot controllers. In Proceedings of the 14th National Conference on Artificial Intelligence (AAAI-97), pp. 637–642.
Johnson, W. L. and J. Rickel (1997). Steve: An Animated Pedagogical Agent for Procedural Training in Virtual Environments. SIGART Bulletin. 8: 16–21.
Kitano, H., M. Tambe, et al. (1997). The RoboCup Synthetic Agent Challenge’ 97. the International Joint Conference on Artificial Intelligence (IJCAI-97), Nagoya, Japan.
Lubbers, J. and R.R. Spaans (1998). The Priority/Confidence Model as a Framework for Soccer Agents, the Second RoboCup Workshop (RoboCup-98), Paris, France.
Maeda, K., A. Kohketsu, et al. (1998). Ball-Receiving Skill Dependent on Centering in Soccer Simulation Games. RoboCup-98, Paris, France.
Marsella, S.C, J. Adibi, et al. (1999). On Being a teammate: Experiences acquired in the design of RoboCup teams, the Third International Conference on Autonomous Agents (Agents-99), Seattle, WA, ACM Press.
Montesello, F. and E. Pagello (1998). PaSo-Team’98: Learning the’ when’ in RoboCup Competition. RoboCup-98, Paris, France.
Polani, D., S. Weber, et al. (1998). A Direct Approach to Robot Soccer Agents: Description for the Team MAINZ ROLLING BRAINS Simulation League of RoboCup’98. RoboCup-98, Paris, France.
Repository, (1998). The RoboCup Teamwork Evaluation Homepage. 1998. At: http://www.isi.edu/~galk/Eval/
Riekki, J. (1998). Reactive Task Execution of a Mobile Robot. Infotech Oulu and Department of Electrical Engineering. Oulu, Finland, University of Oulu. (Ph.D. Dissertation)
Stone, P. and M. Veloso (1998). The CMUnited-97 Simulator Team. RoboCup-97: Robot Soccer World Cup 1, LNAI 1395. H. Kitano, Springer: 389–397.
Tambe, M., W. L. Johnson, et al. (1995). “Intelligent Agents for Interactive Simulation Environments.” AI Magazine 16(1).
Tambe, M., G. A. Kaminka, et al. (1999). Two Fielded Teams and Two Expert Agents: A RoboCup Challenge Response from the Trenches. International Joint Conference on Artificial Intelligence (IJCAI-99), Stockholm, Sweden.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2000 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Kaminka, G.A. (2000). The RoboCup-98 Teamwork Evaluation Session: A Preliminary Report. In: Veloso, M., Pagello, E., Kitano, H. (eds) RoboCup-99: Robot Soccer World Cup III. RoboCup 1999. Lecture Notes in Computer Science(), vol 1856. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-45327-X_28
Download citation
DOI: https://doi.org/10.1007/3-540-45327-X_28
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-41043-0
Online ISBN: 978-3-540-45327-7
eBook Packages: Springer Book Archive