Skip to main content
Log in

A multiagent, dynamic rank-driven multi-deme architecture for real-valued multiobjective optimization

  • Published:
Artificial Intelligence Review Aims and scope Submit manuscript

Abstract

Multiobjective real parameter optimization is a challenging problem in majority of engineering applications. This paper presents a creative multiagent and dynamic multi-deme architecture based on a novel collaboration mechanism for the solution of multiobjective real-parameter optimization problems. The proposed architecture comprises a number of multiobjective metaheuristic agents that act on subsets of a population based on a cyclic assignment order. The proposed multiagent architecture works iteratively in sessions including two consecutive phases: in the first phase, a population of solutions is divided into subpopulations based on dominance ranks of its elements. In the second phase, each multiobjective metaheuristic is assigned to work on a subpopulation based on a cyclic or round-robin order. Hence, each metaheuristic operates on a different-rank subpopulation in subsequent sessions, where a session starts with a new assignment of metaheuristics and ends when termination criteria for the session are satisfied. Individual agents have their local archives of non-dominated solutions extracted in a session, while there is a global archive keeping all non-dominated solutions found so far. At the end of each session, all subpopulations are combined into one global population to be used for the initialization of the next session. Similarly, all local archives are merged with the global archive to get the set of all non-dominated solutions found by all metaheuristics through working on subsets of different rank-levels. This way, the metaheuristics cooperate with each other by sharing their search experiences through collecting them in a common population and a common global archive. The proposed multiagent system is experimentally evaluated using the well-known CEC2009 multiobjective optimization benchmark problems set. Analysis of the experimental results demonstrated that the proposed architecture achieves better performance compared to majority of its state-of-the-art competitors in almost all problem instances.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

References

  • Abraham A, Lakhmi J, Goldberg R (2005) Evolutionary multiobjective optimization. Springer, London

    Book  MATH  Google Scholar 

  • Aydemir FB, Gunay A, Oztoprak F, Birbil SE, Yolum P (2013) Multiagent cooperation for solving global optimization problems: an extendible framework with example cooperation strategies. J Glob Optim 57(2):499–519

    Article  MathSciNet  MATH  Google Scholar 

  • Aydin ME (2013) Coordinating metaheuristic agents with swarm intelligence. J Intell Manuf 23:991–999

    Article  Google Scholar 

  • Bandyopadhyay S, Saha S, Maulik U, Deb K (2008) A simulated annealing based multiobjective optimization algorithm: AMOSA. IEEE Trans Evolut Comput 12(3):269–283

    Article  Google Scholar 

  • Bosman PAN (2014) On gradients and hybrid evolutionary algorithms for real-valued multiobjective optimization. IEEE Trans Evolut Comput 16(1):51–69

    Article  Google Scholar 

  • Cadenas JM, Garrido MC, Munoz E (2008) Construction of a cooperative metaheuristic system based on data mining and soft-computing: methodological issues. In: Proceedings of information processing and management of uncertainty—IPMU’08, pp 1246–1253

  • Cardon A, Galinho T, Vacher J (2000) Genetic algorithms using multiobjectives in a multiagent system. Robot Auton Syst 33:179–190

    Article  Google Scholar 

  • Coello CA, Lechuga MS (2002) MOPSO: a proposal for multiple objective optimization. In: Proceedings of IEEE congress on evolutionary computation (CEC’2002), US, pp 1051–1056

  • Deb K, Agrawal S, Pratap A, Meyarivan T (2002) A fast and elitist multiobjective genetic algorithm: NSGA-II. IEEE Trans Evolut Comput 6(2):182–197

    Article  Google Scholar 

  • Derrac J, Garcia S, Molina D, Herrera F (2011) A practical tutorial on the use of nonparametric statistical tests as a methodology for comparing evolutionary and swarm intelligence algorithms. Swarm Evolut Comput 1:3–18

    Article  Google Scholar 

  • Drezewski R, Siwik L (2006a) Co-Evolutionary multiagent system with sexual selection mechanism for multiobjective optimization. In: IEEE congress on evolutionary computation, pp 769–776

  • Drezewski R, Siwik L (2006b) Multiobjective optimization using co-evolutionary multiagent system with host-parasite mechanism. In: 6th international conference on computational science, Lecture notes in computer science, pp 871–878

  • Fonseca CM, Fleming PJ (1993) Genetic algorithm for multiobjective optimization, formulation, discussion and generalization. In: Proceedings of the Fifth international conference on genetic algorithms, pp 416–423

  • Goncalves RA, Kuk JN, Almeida CP, Venske SM (2015) Decomposition based multiobjective hyperheuristic with differential evolution. In: International conference on computational collective intelligence—ICCCI2015, pp 129–138

  • Jiang S, Zhang J, Ong YS (2012) A multiagent evolutionary framework based on trust for multiobjective optimization. In: Proceedings of the 11th international conference on autonomous agents and multiagent systems, pp 299–306

  • Khan W, Zhang Q (2010) MOEA/D-DRA with two crossover operators. In: UK workshop on computational intelligence—UKCI2010, pp 1–6

  • Kisiel-Dorohinicki M, Socha K (2001) Crowding factor in evolutionary multiagent system for multiobjective optimization. In: Proceedings of the international conference on artificial intelligence—IC-AI 2001, vol 1

  • Kukkonen S, Lampinen J (2009) Performance assessment of generalized differential evolution 3 with a given set of constrained multiobjective test problems. In: Proceedings of the IEEE eleventh conference on evolutionary computation, CEC 2009, pp 2913–2918

  • Li W, Wang L, Jiang Q, Hei X, Wang B (2015) Multiobjective cloud particle optimization algorithm based on decomposition. Algorithms 8(2):157–176

    Article  MathSciNet  Google Scholar 

  • Liu H, Li X (2009) The multiobjective evolutionary algorithm based on determined weight and sub-regional search. In: Proceedings of the IEEE eleventh conference on evolutionary computation, CEC 2009, pp 1928–1934

  • Liu M, Zou X, Chen Y, Wu Z (2009) Performance assessment of DMOEA-DD with CEC 2009 MOEA competition test instances. In: Proceedings of the IEEE eleventh conference on evolutionary computation, CEC 2009, pp 1951–1958

  • Mashwani W, Salhi A (2014) Multiobjective memetic algorithm based on decomposition. Appl Soft Comput 21:221–243

    Article  Google Scholar 

  • Meignan D, Creput JC, Koukam A (2008) An organizational view of metaheuristics. In: Proceedings of first international workshop on optimisation in multi-agent systems, pp 77–85

  • Milano M, Roli A (2004) MAGMA: a multiagent architecture for metaheuristics. IEEE Trans Syst Man Cybern 33:925–941

    Article  Google Scholar 

  • Panait L, Luke S (2005) Cooperative multiagent learning: the state of the art. Auton Agents Multiagent Syst 11:387–434

    Article  Google Scholar 

  • Siwik L, Natanek S (2008) Solving constrained multi-criteria optimization tasks using elitist evolutionary multiagent system. In: World congress on computational intelligence, IEEE CEC, pp 3358–3365

  • Stone P, Veloso M (2000) Multiagent systems: a survey from a machine learning perspective. Auton Robot 8:345–383

    Article  Google Scholar 

  • Stuart R, Norvig P (2003) Artificial Intelligence: a modern approach, chap. 2, 2nd edn. Prentice Hall, Upper Saddle River. ISBN 0-13-790395-2

  • Sycara KP (1998) Multiagent systems. AI Mag 19(2):79–92

    Google Scholar 

  • Taillard ED, Gambardella LM, Gendrau M, Potvin JY (2001) Adaptive memory programming: a unified view of metaheuristics. Eur J Oper Res 135:1–16

    Article  MathSciNet  MATH  Google Scholar 

  • Teixeira F, Castro AJM, Rocha AP, Oliveira E (2013) Multiagent learning in both cooperative and competitive environments. In; Proceedings of the XVI Portuguese Conference on AI-EPAI 2013, pp 370–381

  • Tseng LY, Chen C (2009) Multiple trajectory search for unconstrained/constrained multiobjective optimization. In: Proceedings of the IEEE eleventh conference on evolutionary computation, CEC 2009, pp 1951–1958

  • Xiang Y, Zhou Y, Liu H (2015) An elitism based multi-objective artificial bee colony algorithm. Eur J Oper Res 245:168–193

    Article  Google Scholar 

  • Xue F, Sanderson AC, Graves RJ (2003) Pareto-based multiobjective differential evolution. In: IEEE congress on evolutionary computation (CEC’2003), Australia, pp 862–869

  • Zhang Q, Liu W, Li H (2009) The performance of a new version of MOEA/D on CEC09 unconstrained MOP test instances. In: Proceedings of the IEEE eleventh conference on evolutionary computation, CEC 2009, Norway, pp 203–208

  • Zhang Q, Liu W, Li H (2009) The performance of a new version of MOEA/D on CEC2009 unconstrained MOP test instances. In: IEEE congress on evolutionary computation—CEC2009, pp 203–208

  • Zhang Q, Suganthan PN (2008) Final report on CEC’09 MOEA competition, Working Report, CES-887. School of Computer Science and Electrical Engineering, University of Essex

  • Zhang Q, Zhou A, Zhao S, Suganthan P, Liu W, Tiwari S (2009) Special session and competition, Technical Report CES-487. The School of Computer Science and Electronic Engineering, University of Essex

  • Zhao SZ, Suganthan PN, Zhang Q (2012) Decomposition-based multiobjective evolutionary algorithm with an ensemble of neighborhood size. IEEE Trans Evolut Comput 16(3):442–446

    Article  Google Scholar 

  • Zhou A, Qu B-Y, Li H, Zhao S-Z, Suganthan PN (2011) Multiobjective evolutionary algorithms: a survey of the state-of-the-art. Swarm Evolut Comput 1:32–49

    Article  Google Scholar 

  • Zitzler E, Laumanns M, Thiele L (2001) SPEA2: Improving the strength Pareto evolutionary algorithm for multiobjective optimization. In: Evolutionary methods for design optimization and control with applications to industrial problems, pp 95–100

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Adnan Acan.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Acan, A., Lotfi, N. A multiagent, dynamic rank-driven multi-deme architecture for real-valued multiobjective optimization. Artif Intell Rev 48, 1–29 (2017). https://doi.org/10.1007/s10462-016-9493-7

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10462-016-9493-7

Keywords

Navigation