On the evaluation of MAS development tools

  • Emilia Garcia
  • Adriana Giret
  • Vicente Botti
Part of the IFIP – The International Federation for Information Processing book series (IFIPAICT, volume 276)


Recently a great number of methods and frameworks to develop multiagent systems have appeared. Nowadays there is no established framework to evaluate environments to develop multiagent systems (MAS) and choosing between one framework or another is a difficult task. The main contributions of this paper are: (1) a brief analysis of the state of the art in the evaluation of MAS engineering; (2) a complete list of criteria that helps in the evaluation of multiagent system development environments; (3) a quantitative evaluation technique; (4) an evaluation of the Ingenias methodology and its development environment using this evaluation framework.


Modeling Language Multiagent System Mobil Agent Mental Attitude Automatic Code Generation 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. 1.
    F. L. Bellifemine, G. Caire, and D. Greenwood. Developing Multi-Agent Systems with JADE (Wiley Series in Agent Technology). John Wiley & Sons, 2007.Google Scholar
  2. 2.
    E. Bitting, J. Carter, and A. A. Ghorbani. Multiagent System Development Kits: An Evaluation. In Proc. of the CNSR, pages 80-92, 2003.Google Scholar
  3. 3.
    L. Cernuzzi and G. Rossi. On the evaluation of agent oriented modeling methods. In In Proceedings of Agent Oriented Methodology Workshop, 2002.Google Scholar
  4. 4.
    T. Eiter and V. Mascardi. Comparing environments for developing software agents. AI Commun., 15(4):169-197, 2002.Google Scholar
  5. 5.
    A. Giret, V. Botti, and S. Valero. MAS Methodology for HMS, volume LNAI 3593, pages 39-49. Springer Verlag., 2005.Google Scholar
  6. 6.
    J. Gomez-Sanz and J. Pavon. Ingenias development kit (idk) manual, version 2.5. 2005.Google Scholar
  7. 7.
    J. Pavon, J. Gomez-Sanz, and R. Fuentes. The INGENIAS Methodology and Tools, volume chapter IX, page 236276. Henderson-Sellers, 2005.Google Scholar
  8. 8.
    M. P. Singh and M. N. Huhns. Service-Oriented Computing Semantics, Processes, Agents. John Wisley and Sons Ltd, 2005.Google Scholar
  9. 9.
    A. Sturm and O. Shehory. A framework for evaluating agent-oriented methodologies. In AOIS, volume 3030 of LNCS, pages 94-109. Springer, 2003.Google Scholar
  10. 10.
    J. Sudeikat, L. Braubach, A. Pokahr, and W. Lamersdorf. Evaluation of agent-oriented software methodologies examination of the gap between modeling and platform. AOSE-2004 at AAMAS04, 2004.Google Scholar
  11. 11.
    M. Wooldridge and P. Ciancarini. Agent-Oriented Software Engineering: The State of the Art. In AOSE01, volume 1957/2001 of LNCS, pages 55-82. Springer, 2001.Google Scholar

Copyright information

© International Federation for Information Processing 2008

Authors and Affiliations

  • Emilia Garcia
    • 1
  • Adriana Giret
    • 1
  • Vicente Botti
    • 1
  1. 1.Technical University of ValenciaSpain

Personalised recommendations