Abstract
This paper describes an approach to unit testing of plan based agent systems, with a focus on automated generation and execution of test cases. Design artefacts, supplemented with some additional data, provide the basis for specification of a comprehensive suite of test cases. Correctness of execution is evaluated against a design model, and a comprehensive report of errors and warnings is provided to the user. Given that it is impossible to design test suites which execute all possible traces of an agent program, it is extremely important to thoroughly test all units in as wide a variety of situations as possible to ensure acceptable behaviour. We provide details of the information required in design models or related data to enable the automated generation and execution of test cases. We also briefly describe the implemented tool which realises this approach.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Benfield, S.S., Hendrickson, J., Galanti, D.: Making a strong business case for multiagent technology. In: Proceedings of AAMAS 2006, pp. 10–15. ACM, New York (2006)
Padgham, L., Winikoff, M.: Developing Intelligent Agent Systems: A Practical Guide. John Wiley and Sons, Chichester (2004)
Zhang, Z., Thangarajah, J., Padgham, L.: Automated Unit Testing For Agent Systems. In: 2nd International Working Conference on Evaluation of Novel Approaches to Software Engineering (ENASE 2007), Spain, pp. 10–18 (July 2007)
Rao, A.S., Georgeff, M.P.: BDI Agents: From Theory to Practice. In: Lesser, V. (ed.) The First International Conference on Multi-Agent Systems, San Francisco, pp. 312–319 (1995)
Busetta, P., Rönnquist, R., Hodgson, A., Lucas, A.: JACK Intelligent Agents — Components for Intelligent Agents in Java. AgentLink News (2) (1999)
Poutakidis, D., Padgham, L., Winikoff, M.: An Exploration of Bugs and Debugging in Multi-agent Systems. In: Proceedings of AAMAS 2003, pp. 1100–1101. ACM, NY (2003)
Paton, N.W., DÃaz, O.: Active Database Systems. ACM Comput. Surv. 31(1), 63–103 (1999)
Burnstein, I.: Practical Software Testing. Springer, New York (2002)
Jorgensen, P.C.: Software Testing: A Craftsman’s Approach, 2nd edn. CRC Press, Boca Raton (2002)
Copeland, L.: A Practitioner’s Guide to Software Test Design. Artech House, Inc., Norwood (2003)
Myers, G.J., Sandler, C., Badgett, T., Thomas, T.M.: The Art of Software Testing, 2nd edn. Wiley, Chichester (2004)
Cohen, D.M., Dalal, S.R., Fredman, M.L., Patton, G.C.: The AETG system: An Approach to Testing Based on Combinatiorial Design. Software Engineering 23(7), 437–444 (1997)
Binder, R.V.: Testing Object-Oriented Systems: Models, Patterns, and Tools. Addison-Wesley Longman Publishing Co., Inc., Boston (1999)
Padgham, L., Winikoff, M.: Developing Intelligent Agent Systems: A practical guide. John Wiley and Sons, Chichester (2004)
Apfelbaum, L., Doyle, J.: Model Based Testing. In: The 10th International Software Quality Week Conference, CA, USA (1997)
Dalal, S.R., Jain, A., Karunanithi, N., Leaton, J.M., Lott, C.M., Bellcore, B.: Model-Based Testing in Practice. In: International Conference on Software Engineering (1999)
Bresciani, P., Perini, A., Giorgini, P., Giunchiglia, F., Mylopoulos, J.: Tropos: An Agent-Oriented Software Development Methodology. Autonomous Agents and Multi-Agent Systems 8(3), 203–236 (2004)
DeLoach, S.A.: Analysis and Design using MaSE and agentTool. In: Proceedings of the 12th Midwest Artificial Intelligence and Cognitive Science Conference, Oxford, Ohio (2001)
Nguyen, C.D., Perini, A., Tonella, P.: A goal-oriented software testing methodology. Technical report, ITC-irst (2006), http://sra.itc.it/images/sepapers/gost-techreport.pdf
Nguyen, C.D., Perini, A., Tonella, P.: Automated continuous testing of multi-agent systems (December 2007)
Nguyen, C.D., Perini, A., Tonella, P.: Experimental evaluation of ontology-based test generation for multi-agent systems, pp. 187–198 (2009)
Nguyen, C.D., Perini, A., Tonella, P.: Ontology-based Test Generation for Multi-agent Systems. In: Proceedings of AAMAS 2008, pp. 1315–1320 (2008)
Knublauch, H.: Extreme programming of multi-agent systems (2002)
Husted, T., Massol, V.: JUnit in Action. Manning Publications Co. (2003)
Coelho, R., Kulesza, U., von Staa, A., Lucena, C.: Unit Testing in Multi-Agent Systems using Mock Agents and Aspects. In: Proceedings of the 2006 International Workshop on Software Engineering for Large-Scale Multi-Agent Systems, pp. 83–90 (2006)
Bellifemine, F., Poggi, A., Rimassa, G.: JADE: a FIPA2000 Compliant Agent Development Environment. In: Proceedings of Agents Fifth International Conference on Autonomous Agents, pp. 216–217 (2001)
Tiryaki, A.M., Öztuna, S., Dikenelli, O., Erdur, R.C.: SUNIT: A unit testing framework for test driven development of multi-agent systems. In: Padgham, L., Zambonelli, F. (eds.) AOSE VII / AOSE 2006. LNCS, vol. 4405, pp. 156–173. Springer, Heidelberg (2007)
Dikenelli, O.: SEAGENT MAS Platform Development Environment. In: Proceedings of AAMAS 2008, pp. 1671–1672 (2008)
EI Fallah-Seghrouchni, A., Haddad, S., Mazouzi, H.: A formal study of interactions in multi-agent systems. In: Garijo, F.J., Boman, M. (eds.) MAAMAW 1999. LNCS, vol. 1647. Springer, Heidelberg (1999)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Zhang, Z., Thangarajah, J., Padgham, L. (2011). Automated Testing for Intelligent Agent Systems. In: Gleizes, MP., Gomez-Sanz, J.J. (eds) Agent-Oriented Software Engineering X. AOSE 2009. Lecture Notes in Computer Science, vol 6038. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-19208-1_5
Download citation
DOI: https://doi.org/10.1007/978-3-642-19208-1_5
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-19207-4
Online ISBN: 978-3-642-19208-1
eBook Packages: Computer ScienceComputer Science (R0)