An Evaluation Method for Multi-Agent Systems
The growing employment of Multi-Agent Systems (MASs) in several domains of everyday life has provided the impetus for much research into new tools and methodologies for their design and implementation. But up to now, few works have focused on evaluation of these MASs, and none of these considered characteristics such as the rationality, the autonomy, the reactivity and the environment adaptability of the agents in the MAS. We believe these characteristics affect the whole performance of these systems and are connected to the complexity of the environment where the agents act. In this paper we propose an evaluation method for static multi-agent systems. The method, based on the Goal-Question-Metric approach, allows evaluation of these same MAS characteristics and combines two analysis perspectives of these systems: intra-agent and inter-agent. We also report the use of the defined approach to evaluate the GeCo_Automotive system’s MAS.
KeywordsMulti-Agent Systems Goal-Question-Metric MAS evaluation
Unable to display preview. Download preview PDF.
- 1.Jang, K.S., Nam, T.E., Wadhwa, B.: On measurement of Objects and Agents., http://www.comp.nus.edu.sg/~bimlesh/ametrics/index.htm
- 3.Król, D., Zelmozer, M.: Structural Performance Evaluation of Multi-Agent Systems. J. of Universal Computer Science 14, 1154–1178 (2008)Google Scholar
- 8.Basili, V., Caldiera, G., Rombach, H.: The Goal Question Metric Approach. In: Marciniak, J.J. (ed.) Encyclopedia of Soft. Eng., vol. 2, pp. 528–532. John Wiley & Sons, Inc., Chichester (1994)Google Scholar
- 12.Di Bitonto, P., Plantamura, V.L., Roselli, T., Rossano, V.: A taxonomy for cataloging LOs using IEEE educational metadata. In: 7th IEEE International Conference on Advanced Learning Technologies, pp. 139–141. IEEE Press, Los Alamitos (2007)Google Scholar