An adaptive multiobjective estimation of distribution algorithm with a novel Gaussian sampling strategy
- 297 Downloads
- 1 Citations
Abstract
In most of existing multiobjective estimation of distribution algorithms (MEDAs), there exist drawbacks: incorrect treatment of population outliers; the loss of population diversity; and too much computational effort being spent on finding an optimal population model. To ease the drawbacks, this paper designs a novel clustering-based multivariate Gaussian sampling strategy and proposes an adaptive MEDA called AMEDA. A clustering analysis approach is utilized in AMEDA to discover the distribution structure of the population. Based on the distribution information, with a certain probability, a local or a global multivariate Gaussian model (MGM) is built for each solution to sample a new solution. A covariance sharing strategy is designed in AMEDA to reduce the complexity of building MGMs, and an adaptive update strategy of the probability that controls the contributions of the two types of MGMs is developed to dynamically balance exploration and exploitation. AMEDA is compared with four representative MOEAs on a number of test instances with complex Pareto fronts and variable linkages. Experimental results suggest that AMEDA outperforms the comparison algorithms on dealing with the test instances. The effectiveness of the clustering-based multivariate Gaussian sampling strategy and the adaptive probability update strategy is also experimentally verified.
Keywords
Estimation of distribution Adaptive multiobjective optimization Clustering analysis Multivariate Gaussian samplingNotes
Acknowledgments
The authors would like to thank Dr. Jianyong Sun and Aimin Zhou for their helpful comments and suggestions on the original manuscripts. This study was funded by National Basic Research Program of China (Grant Number: 2012CB821205), Foundation for Creative Research Groups of the National Natural Science Foundation of China (Grant Number: 61021002), National Natural Science Foundation of China (Grant Number: 61174037) and Innovation Funds of China Academy of Space Technology (Grant Number: CAST20120602).
Compliance with ethical standards
Conflict of interest
Tao Lin, Hu Zhang, Ke Zhang, Zhenbiao Tu and Naigang Cui all declare that they have no conflict of interest.
Ethical approval
This article does not contain any studies with human participants performed by any of the authors.
References
- Bader J, Zitzler E (2011) HypE: an algorithm for fast hypervolume-based many-objective optimization. Evolut Comput 19(1):45–76CrossRefGoogle Scholar
- Beume N, Naujoks B, Emmerich M (2007) SMS-EMOA: multiobjective selection based on dominated hypervolume. Eur J Oper Res 181(3):1653–1669CrossRefzbMATHGoogle Scholar
- Bosman PA, Thierens D (2002) Multi-objective optimization with diversity preserving mixture-based iterated density estimation evolutionary algorithms. Int J Approx Reason 31(3):259–289MathSciNetCrossRefzbMATHGoogle Scholar
- Bosman PA, Thierens D (2007) Adaptive variance scaling in continuous multi-objective estimation-of-distribution algorithms. In: Proceedings of the 9th annual conference on genetic and evolutionary computation, ACM, pp 500–507Google Scholar
- Cheng R, Jin Y, Narukawa K, Sendhoff B (2015) A multiobjective evolutionary algorithm using Gaussian process-based inverse modeling. IEEE Trans Evolut Comput 19(6):838–856CrossRefGoogle Scholar
- Cherkassky V, Mulier FM (2007) Learning from data: concepts, theory, and methods. Wiley, HokobenCrossRefzbMATHGoogle Scholar
- Corne DW, Knowles JD, Oates MJ (2000) The pareto envelope-based selection algorithm for multiobjective optimization. In: Proceedings of the 6th workshop on parallel problem solving from nature (PPSN VI). Springer, pp 839–848Google Scholar
- Corne DW, Jerram NR, Knowles JD, Oates MJ, Martin J (2001) PESA-II: region-based selection in evolutionary multiobjective optimization. In: Proceedings of the genetic and evolutionary computation conference (GECCO 2001). Morgan Kaufmann Publishers, pp 283–290Google Scholar
- Costa M, Minisci E (2003) MOPED: a multi-objective parzen-based estimation of distribution algorithm for continuous problems. In: Proceedings of the 2nd international conference on evolutionary multi-criterion optimization. Springer, pp 282–294Google Scholar
- Deb K (2001) Multi-objective optimization using evolutionary algorithms. Wiley, ChichesterzbMATHGoogle Scholar
- Deb K, Jain H (2014) An evolutionary many-objective optimization algorithm using reference-point-based nondominated sorting approach, part i: solving problems with box constraints. IEEE Trans Evolut Comput 18(4):577–601CrossRefGoogle Scholar
- Deb K, Pratap A, Agarwal S, Meyarivan T (2002) A fast and elitist multiobjective genetic algorithm: NSGA-II. IEEE Trans Evolut Comput 6(2):182–197CrossRefGoogle Scholar
- Fonseca CM, Fleming PJ (1993) Genetic algorithms for multiobjective optimization: formulation, discussion and generalization. In: Proceedings of the 5th conference on genetic algorithms, vol 93, pp 416–423Google Scholar
- Gu F, Liu HL, Tan KC (2012) A multiobjective evolutionary algorithm using dynamic weight design method. Int J Innov Comput Inf Control 8(5B):3677–3688Google Scholar
- Hastie T, Tibshirani R, Friedman J, Franklin J (2005) The elements of statistical learning: data mining, inference and prediction. Math Intell 27(2):83–85Google Scholar
- Hillermeier C (2001) Nonlinear multiobjective optimization-a generalized homotopy approach. Birkhäuser Verlag, BaselCrossRefzbMATHGoogle Scholar
- Horn J, Nafpliotis N, Goldberg DE (1994) A niched pareto genetic algorithm for multiobjective optimization. In: Proceedings of the 1st IEEE conference on evolutionary computation. IEEE, pp 82–87Google Scholar
- Ishibuchi H, Murata T (1998) A multi-objective genetic local search algorithm and its application to flowshop scheduling. IEEE Trans Syst Man Cybern Part C Appl Rev 28(3):392–403CrossRefGoogle Scholar
- Jiang S, Yang S (2015) An improved multi-objective optimization evolutionary algorithm based on decomposition for complex pareto fronts. IEEE Trans Cybern 46(2):421–437CrossRefGoogle Scholar
- Jourdan L, Corne D, Savic D, Walters G (2005) Preliminary investigation of the learnable evolution model for faster/better multiobjective water systems design. In: Proceedings of the 3rd international conference on evolutionary multi-criterion optimization. Springer, pp 841–855Google Scholar
- Karshenas H, Santana R, Bielza C, Larranaga P (2014) Multiobjective estimation of distribution algorithm based on joint modeling of objectives and variables. IEEE Trans Evolut Comput 18(4):519–542CrossRefGoogle Scholar
- Larrañaga P, Lozano JA (2002) Estimation of distribution algorithms: a new tool for evolutionary computation, vol 2. Springer Science & Business Media, New YorkzbMATHGoogle Scholar
- Larrañaga P, Karshenas H, Bielza C, Santana R (2012) A review on probabilistic graphical models in evolutionary computation. J Heuristics 18(5):795–819CrossRefzbMATHGoogle Scholar
- Laumanns M, Ocenasek J (2002) Bayesian optimization algorithms for multi-objective optimization. In: Proceedings of the 7th international conference parallel problem solving from nature (PPSN VII). Springer, pp 298–307Google Scholar
- Li H, Zhang Q (2009) Multiobjective optimization problems with complicated Pareto sets, MOEA/D and NSGA-II. IEEE Trans Evolut Comput 13(2):284–302CrossRefGoogle Scholar
- Li H, Zhang Q, Tsang E, Ford JA (2004) Hybrid estimation of distribution algorithm for multiobjective knapsack problem. In: Proceedings of the 4th European conference on evolutionary computation in combinatorial optimization (EvoCOP 2004). Springer, pp 145–154Google Scholar
- Li K, Kwong S (2014) A general framework for evolutionary multiobjective optimization via manifold learning. Neurocomputing 146:65–74CrossRefGoogle Scholar
- Li Y, Xu X, Li P, Jiao L (2013) Improved RM-MEDA with local learning. Soft Comput 18(7):1–15Google Scholar
- Liu HL, Gu F, Cheung Y (2010) T-MOEA/D: MOEA/D with objective transform in multi-objective problems. In: Proceedings of the 2010 international conference of information science and management engineering (ISME 2010), vol 2. IEEE, pp 282–285Google Scholar
- Liu HL, Gu F, Zhang Q (2014) Decomposition of a multiobjective optimization problem into a number of simple multiobjective subproblems. IEEE Trans Evolut Comput 18(3):450–455CrossRefGoogle Scholar
- Martí L, García J, Berlanga A, Molina JM (2009) Solving complex high-dimensional problems with the multi-objective neural estimation of distribution algorithm. In: Proceedings of the 11th annual conference on genetic and evolutionary computation. ACM, pp 619–626Google Scholar
- Martí L, García J, Berlanga A, Coello CAC, Molina JM (2011) MB-GNG: addressing drawbacks in multi-objective optimization estimation of distribution algorithms. Oper Res Lett 39(2):150–154MathSciNetCrossRefzbMATHGoogle Scholar
- Marti L, Grimme C, Kerschke P, Trautmann H, Rudolph G (2015) Averaged hausdorff approximations of pareto fronts based on multiobjective estimation of distribution algorithms. arXiv preprint arXiv:1503.07845 [math]
- Menchaca-Mendez A, Coello CAC (2015) GD-MOEA: a new multi-objective evolutionary algorithm based on the generational distance indicator. In: Proceedings of the 8th international conference on evolutionary multi-criterion optimization (EMO 2015). Springer, pp 156–170Google Scholar
- Michalski RS (2000) Learnable evolution model: evolutionary processes guided by machine learning. Mach Learn 38(1–2):9–40Google Scholar
- Miettinen K (1999) Nonlinear multiobjective optimization. Kluwer, BostonzbMATHGoogle Scholar
- Murata T, Ishibuchi H, Gen M (2001) Specification of genetic search directions in cellular multi-objective genetic algorithms. In: Proceedings of the 1st international conference on evolutionary multi-criterion optimization (EMO 2001). Springer, pp 82–95Google Scholar
- Okabe T, Jin Y, Sendoff B, Olhofer M (2004) Voronoi-based estimation of distribution algorithm for multi-objective optimization. In: Proceedings of 2004 IEEE congress on evolutionary computation (CEC 2004), vol 2. IEEE, pp 1594–1601Google Scholar
- Pelikan M, Sastry K, Goldberg DE (2005) Multiobjective hBOA, clustering, and scalability. In: Proceedings of the 7th annual conference on genetic and evolutionary computation. ACM, pp 663–670Google Scholar
- Pelikan M, Sastry K, Goldberg DE (2006) Multiobjective estimation of distribution algorithms. In: Scalable optimization via probabilistic modeling. Springer, pp 223–248Google Scholar
- Phan DH, Suzuki J (2013) R2-IBEA: R2 indicator based evolutionary algorithm for multiobjective optimization. In: Proceedings of 2013 IEEE congress on evolutionary computation (CEC 2013). IEEE, pp 1836–1845Google Scholar
- Rodríguez Villalobos CA, Coello Coello CA (2012) A new multi-objective evolutionary algorithm based on a performance assessment indicator. In: Proceedings of the 14th annual conference on genetic and evolutionary computation. ACM, pp 505–512Google Scholar
- Sastry K, Goldberg DE, Pelikan M (2005) Limits of scalability of multiobjective estimation of distribution algorithms. In: Proceedings of 2005 IEEE congress on evolutionary computation (CEC 2005), vol 3. IEEE, pp 2217–2224Google Scholar
- Schaffer JD (1985) Multiple objective optimization with vector evaluated genetic algorithms. In: Proceedings of the 1st international conference on genetic algorithms and their applications. Lawrence Erlbaum Associates, pp 93–100Google Scholar
- Shim VA, Tan KC (2012) Probabilistic graphical approaches for learning, modeling, and sampling in evolutionary multi-objective optimization. In: Advances in computational intelligence. Springer, pp 122–144Google Scholar
- Shim VA, Tan K, Cheong C (2012) A hybrid estimation of distribution algorithm with decomposition for solving the multiobjective multiple traveling salesman problem. IEEE Trans Syst Man Cybern Part C Appl Rev 42(5):682–691CrossRefGoogle Scholar
- Shim VA, Tan KC, Chia JY, Al Mamun A (2013) Multi-objective optimization with estimation of distribution algorithm in a noisy environment. Evolut Comput 21(1):149–177CrossRefGoogle Scholar
- Soh H, Kirley M (2006) mopga: Towards a new generation of multi-objective genetic algorithms. In: Proceedings of IEEE congress on evolutionary computation (CEC 2006). IEEE, pp 1702–1709Google Scholar
- Wang H, Zhang Q, Jiao L, Yao X (2015) Regularity model for noisy multiobjective optimization. IEEE Trans CybernGoogle Scholar
- Wang Y, Xiang J, Cai Z (2012) A regularity model-based multiobjective estimation of distribution algorithm with reducing redundant cluster operator. Appl Soft Comput 12(11):3526–3538CrossRefGoogle Scholar
- Xu R, Wunsch D (2008) Clustering. Wiley, HokobenCrossRefGoogle Scholar
- Yu X, Gen M (2010) Introduction to evolutionary algorithms. Springer, LondonCrossRefzbMATHGoogle Scholar
- Zhang Q, Li H (2007) MOEA/D: a multiobjective evolutionary algorithm based on decomposition. IEEE Trans Evolut Comput 11(6):712–731CrossRefGoogle Scholar
- Zhang Q, Zhou A, Jin Y (2008) RM-MEDA: a regularity model based multiobjective estimation of distribution algorithm. IEEE Trans Evolut Comput 12(1):41–63Google Scholar
- Zhang H, Zhang X, Gao XZ, Song S (2015) Self-organizing multiobjective optimization based on decomposition with neighborhood ensemble. Neurocomputing 173(P3):1868–1884Google Scholar
- Zhong X, Li W (2007) A decision-tree-based multi-objective estimation of distribution algorithm. In: Proceedings of 2007 international conference on computational intelligence and security. IEEE, pp 114–11Google Scholar
- Zhou A, Zhang Q, Jin Y, Tsang E, Okabe T (2005) A model-based evolutionary algorithm for bi-objective optimization. In: Proceedings of 2005 IEEE congress on evolutionary computation (CEC 2005), vol 3, pp 2568–2575Google Scholar
- Zhou A, Zhang Q, Jin Y (2009) Approximating the set of pareto-optimal solutions in both the decision and objective spaces by an estimation of distribution algorithm. IEEE Trans Evolut Comput 13(5):1167–1189CrossRefGoogle Scholar
- Zhou A, Qu BY, Li H, Zhao SZ, Suganthan PN, Zhang Q (2011) Multiobjective evolutionary algorithms: a survey of the state of the art. Swarm Evolut Comput 1(1):32–49CrossRefGoogle Scholar
- Zhou A, Zhang Q, Zhang G (2012) A multiobjective evolutionary algorithm based on decomposition and probability model. In: Proceedings of 2012 IEEE congress on evolutionary computation (CEC 2012), pp 1–8Google Scholar
- Zhou A, Zhang Q, Zhang G (2013) Approximation model guided selection for evolutionary multiobjective optimization. In: Proceedings of the 7th international conference on evolutionary multi-criterion optimization (EMO 2013). Springer, pp 398–412Google Scholar
- Zhou A, Zhang Q, Zhang G (2014) Multiobjective evolutionary algorithm based on mixture gaussian models. J Softw 25(5):913–928MathSciNetzbMATHGoogle Scholar
- Zhou A, Zhang Y, Zhang G, Gong W (2015) On neighborhood exploration and subproblem exploitation in decomposition based multiobjective evolutionary algorithms. In: Proceedings of 2015 IEEE congress on evolutionary computation (CEC 2015). IEEE, pp 1704–1711Google Scholar
- Zitzler E, Künzli S (2004) Indicator-based selection in multiobjective search. In: Proceedings of the 8th international conference on parallel problem solving from nature (PPSN VIII), vol 3242. Springer, pp 832–842Google Scholar
- Zitzler E, Thiele L (1999) Multiobjective evolutionary algorithms: a comparative case study and the strength pareto approach. IEEE Trans Evolut Comput 3(4):257–271CrossRefGoogle Scholar
- Zitzler E, Laumanns M, Thiele L (2002) SPEA2: improving the strength pareto evolutionary algorithm for multiobjective optimization. In: Proceedings of evolutionary methods for design, optimisation, and control conference. CIMNE, Barcelona, Spain, pp 95–100Google Scholar