Ant Colony Optimization for Automatic Design of Strategies in an Adversarial Model
Adversarial decision making is aimed at determining optimal strategies against an adversarial enemy who observes our actions and learns from them. The field is also known as decision making in the presence of adversaries. Given two agents or entities S and T (the adversary), both engage in a repeated conflicting situation in which agent T tries to learn how to predict the behaviour of S. One defense for S is to make decisions that are intended to confuse T, although this will affect the ability of getting a higher reward. It is difficult to define good decision strategies for S since they should contain certain amount of randomness. Ant-based techniques can help in this direction because the automatic design of good strategies for our adversarial model can be expressed as a combinatorial optimization problem that is suitable for Ant-based optimizers. We have applied the Ant System (AS) and the Max-Min Ant System (MMAS) algorithms to such problem and we have compared the results with those found by a Generational Genetic Algorithm in a previous work. We have also studied the structure of the solutions found by both search techniques. The results are encouraging because they confirm that our approach is valid and MMAS is a competitive technique for automatic design of strategies.
KeywordsAutomatic Design Combinatorial Optimization Problem Payoff Matrix Heuristic Information Payoff Matrice
Unable to display preview. Download preview PDF.
- 1.Amigoni, F., Gatti, N., Ippedico, A.: A game-theoretic approach to determining efficient patrolling strategies for mobile robots. In: Proceedings of the International Conference on Web Intelligence and Intelligent Agent Technology (IAT 2008), pp. 500–503 (2008)Google Scholar
- 4.Cordón, O., de Viana, I.F., Herrera, F., Moreno, L.: A new aco model integrating evolutionary computation concepts: The best-worst ant system. In: Proceedings of the Second International Workshop on Ant Algorithms, ANTS 2000, pp. 22–29 (2000)Google Scholar
- 5.Corne, D., Dorigo, M., Glover, F., Dasgupta, D., Moscato, P., Poli, R., Price, K.V. (eds.): New ideas in optimization. McGraw-Hill Ltd, UK (1999)Google Scholar
- 10.Dorigo, M., Maniezzo, V., Colorni, A.: The ant system: Optimization by a colony of cooperating agents. IEEE Trans. on Systems, Man and Cybernetics - Part B 26(1), 1–13 (1996)Google Scholar
- 11.Fidanova, S., Lirkov, I.: Ant colony system approach for protein solving. In: Proceedings of 2nd Int. Multiconf. on Computer Science and Information Technology, pp. 887–891 (2008)Google Scholar
- 13.Kott, A., Ownby, M.: Tools for real-time anticipation of enemy actions in tactical ground operations. In: Proceedings of the 10th International Command and Control Research and Technology Symposium (2005)Google Scholar
- 15.Maniezzo, V., Colorni, A., Dorigo, M.: The ant system applied to the quadratic assignment problem. Tech. Rep. 94/28, IRIDIA, Université Libre de Bruxelles, Belgium (1994)Google Scholar
- 18.Paruchuri, P., Pearce, J.P., Kraus, S.: Playing games for security: An efficient exact algorithm for solving bayesian stackelberg games. In: Proceedings of 7th Int. Conf. on Autonomous Agents and Multiagent Systems (AAMAS 2008), pp. 895–902 (2008)Google Scholar
- 23.Villacorta, P., Pelta, D.: Evolutionary design and statistical assessment of strategies in an adversarial domain. In: Proceedings of the IEEE Conference on Evolutionary Computation (CEC 2010), pp. 2250–2256 (2010)Google Scholar