Abstract
This paper presents MO-TRIBES, an adaptive multiobjective Particle Swarm Optimization (PSO) algorithm. Metaheuristics have the drawback of being very dependent on their parameter values. Then, performances are strongly related to the fitting of parameters. Usually, such tuning is a lengthy, time consuming and delicate process. The aim of this paper is to present and to evaluate MO-TRIBES, which is an adaptive algorithm, designed for multiobjective optimization, allowing to avoid the parameter fitting step. A global description of TRIBES and a comparison with other algorithms are provided. Using an adaptive algorithm means that adaptation rules must be defined. Swarm’s structure and strategies of displacement of the particles are modified during the process according to the tribes behaviors. The choice of the final solutions is made using the Pareto dominance criterion. Rules based on crowding distance have been incorporated in order to maintain diversity along the Pareto Front. Preliminary simulations are provided and compared with the best known algorithms. These results show that MO-TRIBES is a promising alternative to tackle multiobjective problems without the constraint of parameter fitting.
Similar content being viewed by others
References
Adra, S.F., Griffin, I.A., Fleming, P.J.: An adaptive memetic algorithm for enhanced diversity. In: Parmee, I.C. (ed.) Proceedings of the Seventh International Adaptive Computing in Design and Manufacture Conference, 2006, pp. 251–254. Springer, Berlin (2006)
Battiti, R.: Reactive search: toward self tuning heuristics. In: Modern Heuristic Search Methods, pp. 61–83. Wiley, Hoboken (1996)
Bird, S., Li, X.: Adaptively choosing niching parameters in a PSO. In: Keizer, M. (ed.) Genetic and Evolutionary Computation Conference (GECCO’2006), vol. 1, pp. 3–9. ACM Press, New York (2006)
Chen, L., Xu, X.H., Chen, Y.X.: An adaptive ant colony clustering algorithm. In: Proceedings of the 3rd Conference on Machine Learning and Cybernetics, pp. 1387–1392. IEEE Press, Piscataway (2004)
Clerc, M., Kennedy, J.: The particle swarm: explosion, stability, and convergence in multi-dimensional complex space. IEEE Trans. Evol. Comput. 6, 58–73 (2002)
Clerc, M.: Binary particle swarm optimisers: toolbox, derivations, and mathematical insights (2005). https://hal.archives-ouvertes.fr/hal-00122809
Clerc, M.: Particle Swarm Optimization. International Scientific and Technical Encyclopaedia. Wiley, Hoboken (2006)
Coello Coello, C.A., Salazar Lechuga, M.: MOPSO: a proposal for multiple objective particle swarm optimization. In: Proceedings of 2002 Congress on Evolutionary Computation (CEC’2002), pp. 1666–1670. IEEE Press, Piscataway (2002)
Coello Coello, C.A., Van Veldhuisen, D., Lamont, G.: Evolutionary Algorithms for Solving Multi-Objective Problems. Kluwer Academic, New York (2002)
Collette, Y., Siarry, P.: Multiobjective Optimization: Principles and Case Studies. Springer, Berlin (2003)
Corne, D.W., Knowles, J.D., Oates, M.J.: The Pareto envelope-based selection algorithm for multiobjective optimization. In: Proceedings of the Parallel Problem Solving from Nature VI Conference. LNCS, pp. 839–848. Springer, Berlin (2000)
Deb, K.: Multi-objective genetic algorithms: problem difficulties and construction of test problems. Evol. Comput. 7(3), 205–230 (1999)
Deb, K., Agrawal, S., Pratap, A., Meyarivan, T.: A fast elitist non-dominated sorting genetic algorithm for multiobjective optimization: NSGA II. In: Proceedings of the Parallel Problem Solving from Nature Conference, PPSN VI. LNCS, pp. 849–858. Springer, Berlin (2000). http://www.lania.mx/~ccoello/NSGAII.tar.gz
Devireddy, V., Reed, P.: Efficient and reliable evolutionary multiobjective optimization using epsilon-dominance archiving and adaptive population sizing. In: Deb, K. et al. (eds.) Genetic and Evolutionary Computation-GECCO 2004, Proceedings of the Genetic and Evolutionary Computation Conference, Part II. Lecture Notes in Computer Science, vol. 3103, pp. 390–391. Springer, Berlin (2004)
Di Caro, G.: Ant colony optimization and its application to adaptive routing in telecommunications networks. PhD thesis, Université Libre de Bruxelles (2004)
Dréo, J., Pétrowski, A., Siarry, P., Taillard, E.: Metaheuristics for Hard Optimization: Methods and Case Studies. Springer, Berlin (2006)
Fonseca, C.M., Flemming, P.J.: On the performance assessment and comparison of stochastic multiobjective optimizers. In: Proceedings of the Parallel Problem Solving from Nature IV Conference. Lecture Notes in Computer Science, pp. 584–593. Springer, Berlin (1996)
Förster, M., Bickel, B., Hardung, B., Kókai, G.: Self-adaptive ant colony optimisation applied to function allocation in vehicle networks. In: Proceedings of the 9th Annual Conference on Genetic and Evolutionary Computation, pp. 1991–1998. ACM Press, New York (2007)
Hu, X., Eberhart, R.C.: Multiobjective optimization using dynamic neighborhood particle swarm optimization. In: Proceedings of 2002 Congress on Evolutionary Computation (CEC’2002), pp. 1677–1681. IEEE Press, Piscataway (2002)
Hu, X., Eberhart, R.C.: Adaptive particle swarm optimization: detection and response to dynamic systems. In: Proceedings of 2002 Congress on Evolutionary Computation (CEC’2002), pp. 1666–1670. IEEE Press, Piscataway (2002)
Ingber, L.: Adaptive simulated annealing (ASA): lessons learned. Control Cybern. 25(1), 33–54 (1996)
Kennedy, J., Eberhart, R.C.: Particle swarm optimisation. In: Proceedings of the IEEE International Conference on Neural Networks, pp. 1942–1948. IEEE Press, Piscataway (1995)
Knowles, J., Corne, D.: Properties of an adaptive archiving algorithm for storing nondominated vectors. In: IEEE Trans. Evol. Comput. 7(2), 100–116 (2003)
Kukkonen, S., Deb, K.: Improved pruning of non-dominated solutions based on crowding distance for bi-objective optimization problems. In: Proceedings of the IEEE 2006 Congress on Evolutionary Computation (CEC’2006), pp. 1179–1186. IEEE Press, Piscataway (2006)
Kursawe, F.: A variant of evolution strategies for vector optimization. In: Proceedings of Parallel Problem Solving for Nature Conference. Lecture Notes in Computer Science, vol. 496, pp. 193–197. Springer, Berlin (1990)
Laumanns, M., Deb, K., Thiele, L., Zitzler, E.: Scalable test problems for evolutionary multi-objective optimization. Technical Report 112, Institut für Technische Informatik und Kommunikationsnetze, ETH Zürich, 8092 Zürich, July 2001
Mahfoud, M., Chen, M., Linkens, D.: Adaptive weighted particle swarm optimisation for multi-objective optimal design of alloy steels. In: Yao, X. et al. (eds.) Parallel Problem Solving from Nature, PPSN VIII. Lecture Notes in Computer Science, vol. 3242, pp. 762–771. Springer, Berlin (2004)
Murata, T., Ishibuchi, H.: MOGA: multi-objective genetic algorithms. In: Proceedings of the 2nd IEEE International Conference on Evolutionary Computation, pp. 289–294. IEEE Press, Piscataway (1995)
Murata, Y. et al.: Agent oriented self adaptive genetic algorithm. In: Proceedings of the IASTED Communications and Computer Networks, pp. 348–353. Acta Press, Calgary (2002)
Nakib, A., Cooren, Y., Oulhadj, H., Siarry, P.: Magnetic resonance image segmentation based on two-dimensional exponential entropy and a parameter free PSO. In: Proceedings of the 8th International Conference on Artificial Evolution. LNCS, pp. 50–61. Springer, Berlin (2007)
Nawrocki, M., Dohler, M., Aghvami, A.H.: Understanding UMTS radio network modelling. In: Theory and Practice. Wiley, Hoboken (2006)
Niu, B., Zhu, Y., He, X., Henry, W.: MCPSO: a multi-swarm cooperative particle swarm optimizer. Appl. Math. Comput. 185(2), 1050–1062 (2005)
Okabe, T., Jin, Y., Senhoff, B.: A critical survey of performances indices for multi-objective optimization. In: Proceedings of the 2003 IEEE Congress on Evolutionary Computation, pp. 878–885. IEEE Press, Piscataway (2003)
Onwubolu, G.C., Babu, B.V.: TRIBES application to the flow shop scheduling problem. In: New Optimization Techniques in Engineering, pp. 517–536. Springer, Berlin (2004), Chap. 21
Parmee, I.C.: Evolutionary and Adaptive Computing in Engineering Design. Springer, Berlin (2001)
Parsopoulos, K.E., Tasoulis, D.K., Vrahatis, M.N.: Multiobjective optimization using parallel vector evaluated particle swarm optimization. In: Proceedings of the IASTED International Conference on Artificial Intelligence and Applications, pp. 823–828. Acta Press, Calgary (2004)
Peer, E.S., Van den Bergh, F., Engelbrecht, A.P.: Using neighborhoods with the guaranteed convergence PSO. In: Proceedings of the IEEE Swarm Intelligence Symposium 2003 (SIS 2003), pp. 235–242. IEEE Press, Piscataway (2003)
Raquel, C.R., Naval, P.C.: An effective use of crowding distance in multiobjective particle swarm optimization. In: Proceedings of the Genetic and Evolutionary Computation Conference (GECCO 2005), pp. 257–264. ACM Press, New York (2005). www.engg.upd.edu.ph/~cvmig/mopsocd.html
Ray, T., Liew, K.M.: A swarm metaphor for multiobjective design optimization. Eng. Optim. 34(2), 141–153 (2002)
Reyes-Sierra, M., Coello Coello, A.: Multiobjective particle swarm optimizers: a survey of the state-of-the-art. Int. J. Comput. Intell. Res. 2(3), 287–308 (2006)
Sawai, H., Adachi, S.: Genetic algorithm inspired by gene duplication. In: Proceedings of the 1999 Congress on Evolutionary Computing, pp. 480–487. IEEE Press, Piscataway (1999)
Schnecke, V., Vornberger, O.: An adaptive parallel genetic algorithm for VLSI-layout optimization. In: Proceedings of the 4th International Conference on Parallel Problem Solving from Nature, pp. 859–868. Springer, Berlin (1996)
Shi, Y., Eberhart, R.: Parameter selection in particle swarm optimization. In: Proceedings of the Seventh Annual Conference on Evolutionary Programming. LNCS, vol. 1447, pp. 591–600. Springer, Berlin (1998)
Shi, Y., Eberhart, R.C.: Fuzzy adaptive particle swarm optimization. In: Proceedings of 2001 Congress on Evolutionary Computation, pp. 101–106. IEEE Press, Piscataway (2001)
Suganthan, P.N.: Particle swarm optimisation with a neighbourhood operator. In: Proceedings of 1999 Congress on Evolutionary Computation, pp. 1958–1962. IEEE Press, Piscataway (1999)
Trelea, I.C.: The particle swarm optimization algorithm: convergence analysis and parameter selection. Inf. Process. Lett. 85, 317–325 (2003)
Van den Bergh, F.: An analysis of particle swarm optimizers. PhD thesis, Department of Computer Science, University of Pretoria, Pretoria, South Africa (2002)
Yasuda, K., Iwasaki, N.: Adaptive particle swarm optimization using velocity information of swarm. In: Proceedings of the IEEE Conference on Systems, Man and Cybernetics, pp. 3475–3481. IEEE Press, Piscataway (2004)
Ye, X.F., Zhang, W.J., Yang, Z.L.: Adaptive particle swarm optimization on individual level. In: Proceedings of the International Conference on Signal Processing (ICSP), pp. 1215–1218. IEEE Press, Piscataway (2002)
Zhang, W., Liu, Y., Clerc, M.: An adaptive PSO algorithm for real power optimization. In: Proceedings of the APSCOM (Advances in Power System Control Operation and Management) Conference, S6: Application of Artificial Intelligence Technique (Part I), pp. 302–307. IEEE Press, Piscataway (2003)
Zheng, Y., Ma, L., Zhang, L., Qian, J.: On the convergence analysis and parameter selection in particle swarm optimization. In: Proceedings of International Conference on Machine Learning and Cybernetics, 2003, pp. 1802–1807. IEEE Press, Piscataway (2003)
Zitzler, E., Deb, K., Thiele, L.: Comparison of multiobjective evolutionary algorithms: empirical results. Evol. Comput. 8(2), 173–195 (2000)
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Cooren, Y., Clerc, M. & Siarry, P. MO-TRIBES, an adaptive multiobjective particle swarm optimization algorithm. Comput Optim Appl 49, 379–400 (2011). https://doi.org/10.1007/s10589-009-9284-z
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10589-009-9284-z