Advertisement

Soft Computing

, Volume 21, Issue 20, pp 6043–6061 | Cite as

An adaptive multiobjective estimation of distribution algorithm with a novel Gaussian sampling strategy

  • Tao Lin
  • Hu Zhang
  • Ke Zhang
  • Zhenbiao Tu
  • Naigang CuiEmail author
Foundations
First Online:

Abstract

In most of existing multiobjective estimation of distribution algorithms (MEDAs), there exist drawbacks: incorrect treatment of population outliers; the loss of population diversity; and too much computational effort being spent on finding an optimal population model. To ease the drawbacks, this paper designs a novel clustering-based multivariate Gaussian sampling strategy and proposes an adaptive MEDA called AMEDA. A clustering analysis approach is utilized in AMEDA to discover the distribution structure of the population. Based on the distribution information, with a certain probability, a local or a global multivariate Gaussian model (MGM) is built for each solution to sample a new solution. A covariance sharing strategy is designed in AMEDA to reduce the complexity of building MGMs, and an adaptive update strategy of the probability that controls the contributions of the two types of MGMs is developed to dynamically balance exploration and exploitation. AMEDA is compared with four representative MOEAs on a number of test instances with complex Pareto fronts and variable linkages. Experimental results suggest that AMEDA outperforms the comparison algorithms on dealing with the test instances. The effectiveness of the clustering-based multivariate Gaussian sampling strategy and the adaptive probability update strategy is also experimentally verified.

Keywords

Estimation of distribution Adaptive multiobjective optimization Clustering analysis Multivariate Gaussian sampling 
This is a preview of subscription content, log in to check access.

Notes

Acknowledgments

The authors would like to thank Dr. Jianyong Sun and Aimin Zhou for their helpful comments and suggestions on the original manuscripts. This study was funded by National Basic Research Program of China (Grant Number: 2012CB821205), Foundation for Creative Research Groups of the National Natural Science Foundation of China (Grant Number: 61021002), National Natural Science Foundation of China (Grant Number: 61174037) and Innovation Funds of China Academy of Space Technology (Grant Number: CAST20120602).

Compliance with ethical standards

Conflict of interest

Tao Lin, Hu Zhang, Ke Zhang, Zhenbiao Tu and Naigang Cui all declare that they have no conflict of interest.

Ethical approval

This article does not contain any studies with human participants performed by any of the authors.

References

  1. Bader J, Zitzler E (2011) HypE: an algorithm for fast hypervolume-based many-objective optimization. Evolut Comput 19(1):45–76CrossRefGoogle Scholar
  2. Beume N, Naujoks B, Emmerich M (2007) SMS-EMOA: multiobjective selection based on dominated hypervolume. Eur J Oper Res 181(3):1653–1669CrossRefzbMATHGoogle Scholar
  3. Bosman PA, Thierens D (2002) Multi-objective optimization with diversity preserving mixture-based iterated density estimation evolutionary algorithms. Int J Approx Reason 31(3):259–289MathSciNetCrossRefzbMATHGoogle Scholar
  4. Bosman PA, Thierens D (2007) Adaptive variance scaling in continuous multi-objective estimation-of-distribution algorithms. In: Proceedings of the 9th annual conference on genetic and evolutionary computation, ACM, pp 500–507Google Scholar
  5. Cheng R, Jin Y, Narukawa K, Sendhoff B (2015) A multiobjective evolutionary algorithm using Gaussian process-based inverse modeling. IEEE Trans Evolut Comput 19(6):838–856CrossRefGoogle Scholar
  6. Cherkassky V, Mulier FM (2007) Learning from data: concepts, theory, and methods. Wiley, HokobenCrossRefzbMATHGoogle Scholar
  7. Corne DW, Knowles JD, Oates MJ (2000) The pareto envelope-based selection algorithm for multiobjective optimization. In: Proceedings of the 6th workshop on parallel problem solving from nature (PPSN VI). Springer, pp 839–848Google Scholar
  8. Corne DW, Jerram NR, Knowles JD, Oates MJ, Martin J (2001) PESA-II: region-based selection in evolutionary multiobjective optimization. In: Proceedings of the genetic and evolutionary computation conference (GECCO 2001). Morgan Kaufmann Publishers, pp 283–290Google Scholar
  9. Costa M, Minisci E (2003) MOPED: a multi-objective parzen-based estimation of distribution algorithm for continuous problems. In: Proceedings of the 2nd international conference on evolutionary multi-criterion optimization. Springer, pp 282–294Google Scholar
  10. Deb K (2001) Multi-objective optimization using evolutionary algorithms. Wiley, ChichesterzbMATHGoogle Scholar
  11. Deb K, Jain H (2014) An evolutionary many-objective optimization algorithm using reference-point-based nondominated sorting approach, part i: solving problems with box constraints. IEEE Trans Evolut Comput 18(4):577–601CrossRefGoogle Scholar
  12. Deb K, Pratap A, Agarwal S, Meyarivan T (2002) A fast and elitist multiobjective genetic algorithm: NSGA-II. IEEE Trans Evolut Comput 6(2):182–197CrossRefGoogle Scholar
  13. Fonseca CM, Fleming PJ (1993) Genetic algorithms for multiobjective optimization: formulation, discussion and generalization. In: Proceedings of the 5th conference on genetic algorithms, vol 93, pp 416–423Google Scholar
  14. Gu F, Liu HL, Tan KC (2012) A multiobjective evolutionary algorithm using dynamic weight design method. Int J Innov Comput Inf Control 8(5B):3677–3688Google Scholar
  15. Hastie T, Tibshirani R, Friedman J, Franklin J (2005) The elements of statistical learning: data mining, inference and prediction. Math Intell 27(2):83–85Google Scholar
  16. Hillermeier C (2001) Nonlinear multiobjective optimization-a generalized homotopy approach. Birkhäuser Verlag, BaselCrossRefzbMATHGoogle Scholar
  17. Horn J, Nafpliotis N, Goldberg DE (1994) A niched pareto genetic algorithm for multiobjective optimization. In: Proceedings of the 1st IEEE conference on evolutionary computation. IEEE, pp 82–87Google Scholar
  18. Ishibuchi H, Murata T (1998) A multi-objective genetic local search algorithm and its application to flowshop scheduling. IEEE Trans Syst Man Cybern Part C Appl Rev 28(3):392–403CrossRefGoogle Scholar
  19. Jiang S, Yang S (2015) An improved multi-objective optimization evolutionary algorithm based on decomposition for complex pareto fronts. IEEE Trans Cybern 46(2):421–437CrossRefGoogle Scholar
  20. Jourdan L, Corne D, Savic D, Walters G (2005) Preliminary investigation of the learnable evolution model for faster/better multiobjective water systems design. In: Proceedings of the 3rd international conference on evolutionary multi-criterion optimization. Springer, pp 841–855Google Scholar
  21. Karshenas H, Santana R, Bielza C, Larranaga P (2014) Multiobjective estimation of distribution algorithm based on joint modeling of objectives and variables. IEEE Trans Evolut Comput 18(4):519–542CrossRefGoogle Scholar
  22. Larrañaga P, Lozano JA (2002) Estimation of distribution algorithms: a new tool for evolutionary computation, vol 2. Springer Science & Business Media, New YorkzbMATHGoogle Scholar
  23. Larrañaga P, Karshenas H, Bielza C, Santana R (2012) A review on probabilistic graphical models in evolutionary computation. J Heuristics 18(5):795–819CrossRefzbMATHGoogle Scholar
  24. Laumanns M, Ocenasek J (2002) Bayesian optimization algorithms for multi-objective optimization. In: Proceedings of the 7th international conference parallel problem solving from nature (PPSN VII). Springer, pp 298–307Google Scholar
  25. Li H, Zhang Q (2009) Multiobjective optimization problems with complicated Pareto sets, MOEA/D and NSGA-II. IEEE Trans Evolut Comput 13(2):284–302CrossRefGoogle Scholar
  26. Li H, Zhang Q, Tsang E, Ford JA (2004) Hybrid estimation of distribution algorithm for multiobjective knapsack problem. In: Proceedings of the 4th European conference on evolutionary computation in combinatorial optimization (EvoCOP 2004). Springer, pp 145–154Google Scholar
  27. Li K, Kwong S (2014) A general framework for evolutionary multiobjective optimization via manifold learning. Neurocomputing 146:65–74CrossRefGoogle Scholar
  28. Li Y, Xu X, Li P, Jiao L (2013) Improved RM-MEDA with local learning. Soft Comput 18(7):1–15Google Scholar
  29. Liu HL, Gu F, Cheung Y (2010) T-MOEA/D: MOEA/D with objective transform in multi-objective problems. In: Proceedings of the 2010 international conference of information science and management engineering (ISME 2010), vol 2. IEEE, pp 282–285Google Scholar
  30. Liu HL, Gu F, Zhang Q (2014) Decomposition of a multiobjective optimization problem into a number of simple multiobjective subproblems. IEEE Trans Evolut Comput 18(3):450–455CrossRefGoogle Scholar
  31. Martí L, García J, Berlanga A, Molina JM (2009) Solving complex high-dimensional problems with the multi-objective neural estimation of distribution algorithm. In: Proceedings of the 11th annual conference on genetic and evolutionary computation. ACM, pp 619–626Google Scholar
  32. Martí L, García J, Berlanga A, Coello CAC, Molina JM (2011) MB-GNG: addressing drawbacks in multi-objective optimization estimation of distribution algorithms. Oper Res Lett 39(2):150–154MathSciNetCrossRefzbMATHGoogle Scholar
  33. Marti L, Grimme C, Kerschke P, Trautmann H, Rudolph G (2015) Averaged hausdorff approximations of pareto fronts based on multiobjective estimation of distribution algorithms. arXiv preprint arXiv:1503.07845 [math]
  34. Menchaca-Mendez A, Coello CAC (2015) GD-MOEA: a new multi-objective evolutionary algorithm based on the generational distance indicator. In: Proceedings of the 8th international conference on evolutionary multi-criterion optimization (EMO 2015). Springer, pp 156–170Google Scholar
  35. Michalski RS (2000) Learnable evolution model: evolutionary processes guided by machine learning. Mach Learn 38(1–2):9–40Google Scholar
  36. Miettinen K (1999) Nonlinear multiobjective optimization. Kluwer, BostonzbMATHGoogle Scholar
  37. Murata T, Ishibuchi H, Gen M (2001) Specification of genetic search directions in cellular multi-objective genetic algorithms. In: Proceedings of the 1st international conference on evolutionary multi-criterion optimization (EMO 2001). Springer, pp 82–95Google Scholar
  38. Okabe T, Jin Y, Sendoff B, Olhofer M (2004) Voronoi-based estimation of distribution algorithm for multi-objective optimization. In: Proceedings of 2004 IEEE congress on evolutionary computation (CEC 2004), vol 2. IEEE, pp 1594–1601Google Scholar
  39. Pelikan M, Sastry K, Goldberg DE (2005) Multiobjective hBOA, clustering, and scalability. In: Proceedings of the 7th annual conference on genetic and evolutionary computation. ACM, pp 663–670Google Scholar
  40. Pelikan M, Sastry K, Goldberg DE (2006) Multiobjective estimation of distribution algorithms. In: Scalable optimization via probabilistic modeling. Springer, pp 223–248Google Scholar
  41. Phan DH, Suzuki J (2013) R2-IBEA: R2 indicator based evolutionary algorithm for multiobjective optimization. In: Proceedings of 2013 IEEE congress on evolutionary computation (CEC 2013). IEEE, pp 1836–1845Google Scholar
  42. Rodríguez Villalobos CA, Coello Coello CA (2012) A new multi-objective evolutionary algorithm based on a performance assessment indicator. In: Proceedings of the 14th annual conference on genetic and evolutionary computation. ACM, pp 505–512Google Scholar
  43. Sastry K, Goldberg DE, Pelikan M (2005) Limits of scalability of multiobjective estimation of distribution algorithms. In: Proceedings of 2005 IEEE congress on evolutionary computation (CEC 2005), vol 3. IEEE, pp 2217–2224Google Scholar
  44. Schaffer JD (1985) Multiple objective optimization with vector evaluated genetic algorithms. In: Proceedings of the 1st international conference on genetic algorithms and their applications. Lawrence Erlbaum Associates, pp 93–100Google Scholar
  45. Shim VA, Tan KC (2012) Probabilistic graphical approaches for learning, modeling, and sampling in evolutionary multi-objective optimization. In: Advances in computational intelligence. Springer, pp 122–144Google Scholar
  46. Shim VA, Tan K, Cheong C (2012) A hybrid estimation of distribution algorithm with decomposition for solving the multiobjective multiple traveling salesman problem. IEEE Trans Syst Man Cybern Part C Appl Rev 42(5):682–691CrossRefGoogle Scholar
  47. Shim VA, Tan KC, Chia JY, Al Mamun A (2013) Multi-objective optimization with estimation of distribution algorithm in a noisy environment. Evolut Comput 21(1):149–177CrossRefGoogle Scholar
  48. Soh H, Kirley M (2006) mopga: Towards a new generation of multi-objective genetic algorithms. In: Proceedings of IEEE congress on evolutionary computation (CEC 2006). IEEE, pp 1702–1709Google Scholar
  49. Wang H, Zhang Q, Jiao L, Yao X (2015) Regularity model for noisy multiobjective optimization. IEEE Trans CybernGoogle Scholar
  50. Wang Y, Xiang J, Cai Z (2012) A regularity model-based multiobjective estimation of distribution algorithm with reducing redundant cluster operator. Appl Soft Comput 12(11):3526–3538CrossRefGoogle Scholar
  51. Xu R, Wunsch D (2008) Clustering. Wiley, HokobenCrossRefGoogle Scholar
  52. Yu X, Gen M (2010) Introduction to evolutionary algorithms. Springer, LondonCrossRefzbMATHGoogle Scholar
  53. Zhang Q, Li H (2007) MOEA/D: a multiobjective evolutionary algorithm based on decomposition. IEEE Trans Evolut Comput 11(6):712–731CrossRefGoogle Scholar
  54. Zhang Q, Zhou A, Jin Y (2008) RM-MEDA: a regularity model based multiobjective estimation of distribution algorithm. IEEE Trans Evolut Comput 12(1):41–63Google Scholar
  55. Zhang H, Zhang X, Gao XZ, Song S (2015) Self-organizing multiobjective optimization based on decomposition with neighborhood ensemble. Neurocomputing 173(P3):1868–1884Google Scholar
  56. Zhong X, Li W (2007) A decision-tree-based multi-objective estimation of distribution algorithm. In: Proceedings of 2007 international conference on computational intelligence and security. IEEE, pp 114–11Google Scholar
  57. Zhou A, Zhang Q, Jin Y, Tsang E, Okabe T (2005) A model-based evolutionary algorithm for bi-objective optimization. In: Proceedings of 2005 IEEE congress on evolutionary computation (CEC 2005), vol 3, pp 2568–2575Google Scholar
  58. Zhou A, Zhang Q, Jin Y (2009) Approximating the set of pareto-optimal solutions in both the decision and objective spaces by an estimation of distribution algorithm. IEEE Trans Evolut Comput 13(5):1167–1189CrossRefGoogle Scholar
  59. Zhou A, Qu BY, Li H, Zhao SZ, Suganthan PN, Zhang Q (2011) Multiobjective evolutionary algorithms: a survey of the state of the art. Swarm Evolut Comput 1(1):32–49CrossRefGoogle Scholar
  60. Zhou A, Zhang Q, Zhang G (2012) A multiobjective evolutionary algorithm based on decomposition and probability model. In: Proceedings of 2012 IEEE congress on evolutionary computation (CEC 2012), pp 1–8Google Scholar
  61. Zhou A, Zhang Q, Zhang G (2013) Approximation model guided selection for evolutionary multiobjective optimization. In: Proceedings of the 7th international conference on evolutionary multi-criterion optimization (EMO 2013). Springer, pp 398–412Google Scholar
  62. Zhou A, Zhang Q, Zhang G (2014) Multiobjective evolutionary algorithm based on mixture gaussian models. J Softw 25(5):913–928MathSciNetzbMATHGoogle Scholar
  63. Zhou A, Zhang Y, Zhang G, Gong W (2015) On neighborhood exploration and subproblem exploitation in decomposition based multiobjective evolutionary algorithms. In: Proceedings of 2015 IEEE congress on evolutionary computation (CEC 2015). IEEE, pp 1704–1711Google Scholar
  64. Zitzler E, Künzli S (2004) Indicator-based selection in multiobjective search. In: Proceedings of the 8th international conference on parallel problem solving from nature (PPSN VIII), vol 3242. Springer, pp 832–842Google Scholar
  65. Zitzler E, Thiele L (1999) Multiobjective evolutionary algorithms: a comparative case study and the strength pareto approach. IEEE Trans Evolut Comput 3(4):257–271CrossRefGoogle Scholar
  66. Zitzler E, Laumanns M, Thiele L (2002) SPEA2: improving the strength pareto evolutionary algorithm for multiobjective optimization. In: Proceedings of evolutionary methods for design, optimisation, and control conference. CIMNE, Barcelona, Spain, pp 95–100Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2016

Authors and Affiliations

  1. 1.School of AstronauticsHarbin Institute of TechnologyHarbinChina
  2. 2.Center for Control Theory and Guidance TechnologyHarbin Institute of TechnologyHarbinChina
  3. 3.Beijing Electro-mechanical Engineering InstituteBeijingChina

Personalised recommendations

Cite article

Buy options