The Gradient Free Directed Search Method as Local Search within Multi-Objective Evolutionary Algorithms

  • Adriana Lara
  • Sergio Alvarado
  • Shaul Salomon
  • Gideon Avigad
  • Carlos A. Coello Coello
  • Oliver Schütze
Part of the Advances in Intelligent Systems and Computing book series (AISC, volume 175)

Abstract

Recently, the Directed Search Method has been proposed as a point-wise iterative search procedure that allows to steer the search, in any direction given in objective space, of a multi-objective optimization problem. While the original version requires the objectives’ gradients, we consider here a possible modification that allows to realize the method without gradient information. This makes the novel algorithm in particular interesting for hybridization with set oriented search procedures, such as multi-objective evolutionary algorithms.

In this paper, we propose the DDS, a gradient free Directed Search method, and make a first attempt to demonstrate its benefit, as a local search procedure within a memetic strategy, by integrating the DDS into the well-known algorithmMOEA/D. Numerical results on some benchmark models indicate the advantage of the resulting hybrid.

Keywords

Local Search Pareto Front Evolutionary Computation Multiobjective Optimization Objective Space 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Avigad, G., Eisenstadt, E.: Robustness of Multi-objective Optimal Solutions to Physical Deterioration through Active Control. In: Deb, K., Bhattacharya, A., Chakraborti, N., Chakroborty, P., Das, S., Dutta, J., Gupta, S.K., Jain, A., Aggarwal, V., Branke, J., Louis, S.J., Tan, K.C. (eds.) SEAL 2010. LNCS, vol. 6457, pp. 394–403. Springer, Heidelberg (2010)CrossRefGoogle Scholar
  2. 2.
    Avigad, G., Eisenstadt, E., Schütze, O.: Handling changes of performance-requirements in multi objective problems. Journal of Engineering Design (to appear, 2012)Google Scholar
  3. 3.
    Bosman, P.A.N., de Jong, E.D.: Exploiting gradient information in numerical multi-objective evolutionary optimization. In: Beyer, H.-G., et al. (eds.) 2005 Genetic and Evolutionary Computation Conference (GECCO 2005), vol. 1, pp. 755–762. ACM Press, New York (2005)CrossRefGoogle Scholar
  4. 4.
    Brown, M., Smith, R.E.: Directed multi-objective optimisation. International Journal of Computers, Systems and Signals 6(1), 3–17 (2005)Google Scholar
  5. 5.
    Coello Coello, C.A., Cruz Cortés, N.: Solving Multiobjective Optimization Problems using an Artificial Immune System. Genetic Programming and Evolvable Machines 6(2), 163–190 (2005)CrossRefGoogle Scholar
  6. 6.
    Coello Coello, C.A., Lamont, G.B., Van Veldhuizen, D.A.: Evolutionary Algorithms for Solving Multi-Objective Problems, 2nd edn. Springer, New York (2007)MATHGoogle Scholar
  7. 7.
    Deb, K.: Multi-Objective Optimization using Evolutionary Algorithms. John Wiley & Sons, Chichester (2001) ISBN 0-471-87339-XMATHGoogle Scholar
  8. 8.
    Ishibuchi, T.Y.H., Murata, T.: Balance between Genetic Search and Local Search in Hybrid Evolutionary Multi-Criterion Optimization Algorithms. In: Proceedings of the Genetic and Evolutionary Computation Conference (GECCO 2002), pp. 1301–1308. Morgan Kaufmann Publishers, San Francisco (2002)Google Scholar
  9. 9.
    Ishibuchi, H., Murata, T.: Multi-objective genetic local search algorithm. In: Proc. of 3rd IEEE Int. Conf. on Evolutionary Computation, Nagoya, Japan, pp. 119–124 (1996)Google Scholar
  10. 10.
    Jaszkiewicz, A.: Do multiple-objective metaheuristics deliver on their promises? a computational experiment on the set-covering problem. IEEE Transactions on Evolutionary Computation 7(2), 133–143 (2003)MathSciNetCrossRefGoogle Scholar
  11. 11.
    J.: D Knowles and D.W Corne. M-PAES: a memetic algorithm for multiobjective optimization. In: Proceedings of the IEEE Congress on Evolutionary Computation, Piscataway, New Jersey, pp. 325–332 (2000)Google Scholar
  12. 12.
    Köppen, M., Yoshida, K.: Many-Objective Particle Swarm Optimization by Gradual Leader Selection. In: Beliczynski, B., Dzielinski, A., Iwanowski, M., Ribeiro, B. (eds.) ICANNGA 2007. LNCS, vol. 4431, pp. 323–331. Springer, Heidelberg (2007)CrossRefGoogle Scholar
  13. 13.
    Lara, A., Coello Coello, C.A., Schütze, O.: A painless gradient-assisted multi-objective memetic mechanism for solving continuous bi-objective optimization problems. In: 2010 IEEE Congress on Evolutionary Computation (CEC), pp. 1–8. IEEE, IEEE Press (2010)Google Scholar
  14. 14.
    Lara, A., Sanchez, G., Coello Coello, C.A., Schütze, O.: HCS: A new local search strategy for memetic multiobjective evolutionary algorithms. IEEE Transactions on Evolutionary Computation 14(1), 112–132 (2010)CrossRefGoogle Scholar
  15. 15.
    Mejia, E., Schütze, O.: A predictor corrector method for the computation of boundary points of a multi-objective optimization problem. In: International Conference on Electrical Engineering, Computing Science and Automati Control (CCE 2010), pp. 1–6 (2007)Google Scholar
  16. 16.
    Miettinen, K.M.: Nonlinear Multiobjective Optimization. Springer (1999)Google Scholar
  17. 17.
    Nocedal, J., Wright, S.: Numerical Optimization. Springer Series in Operations Research and Financial Engineering. Springer (2006)Google Scholar
  18. 18.
    Schäffler, S., Schultz, R., Weinzierl, K.: A stochastic method for the solution of unconstrained vector optimization problems. Journal of Optimization Theory and Applications 114(1), 209–222 (2002)MathSciNetMATHCrossRefGoogle Scholar
  19. 19.
    Schuetze, O., Equivel, X., Lara, A., Coello Coello, C.A.: Some comments on GD and IGD and relations to the Hausdorff distance. In: GECCO 2010: Proceedings of the 12th Annual Conference Comp. on Genetic and Evolutionary Computation, pp. 1971–1974. ACM, New York (2010)CrossRefGoogle Scholar
  20. 20.
    Schütze, O., Esquivel, X., Lara, A., Coello Coello, C.A.: Using the averaged Hausdorff distance as a performance measure in evolutionary multi-objective optimization. IEEE Transactions on Evolutionary Computation (2012), doi:10.1109/TEVC.2011.2161872Google Scholar
  21. 21.
    Schütze, O., Lara, A., Coello Coello, C.A.: The directed search method for unconstrained multi-objective optimization problems. In: Proceedings of the EVOLVE – A Bridge Between Probability, Set Oriented Numerics, and Evolutionary Computation (2011)Google Scholar
  22. 22.
    Vasile, M.: A behavior-based meta-heuristic for robust global trajectory optimization. In: IEEE Congress on Evolutionary Computing, vol. 2, pp. 494–497 (2007)Google Scholar
  23. 23.
    Van Veldhuizen, D.A.: Multiobjective Evolutionary Algorithms: Classifications, Analyses, and New Innovations. PhD thesis, Department of Electrical and Computer Engineering. Graduate School of Engineering. Air Force Institute of Technology, Wright-Patterson AFB, Ohio (May 1999)Google Scholar
  24. 24.
    Zhang, Q., Li, H.: MOEA/D: A multi-objective evolutionary algorithm based on decomposition. multi-objective evolutionary algorithm based on decomposition 11(6), 712–731 (2007)Google Scholar
  25. 25.
    Zhang, Q., Liu, W., Li, H.: The performance of a new version of moea/d on cec09 unconstrained mop test instances. In: IEEE Congress on Evolutionary Computation, CEC 2009, pp. 203–208. IEEE (2009)Google Scholar
  26. 26.
    Zhang, Q., Suganthan, P.N.: Final report on CEC09 MOEA competition. In: Congress on Evolutionary Computation, CEC 2009 (2009)Google Scholar
  27. 27.
    Zhang, Q., Zhou, A., Zhao, S., Suganthan, P.N., Liu, W., Tiwari, S.: Multiobjective optimization test instances for the cec 2009 special session and competition. University of Essex, Technical Report (2008)Google Scholar
  28. 28.
    Zitzler, E., Thiele, L.: Multiobjective evolutionary algorithms: a comparative case study and the strength Pareto approach. IEEE Transactions on Evolutionary Computation 3(4), 257–271 (1999)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2013

Authors and Affiliations

  • Adriana Lara
    • 1
  • Sergio Alvarado
    • 2
  • Shaul Salomon
    • 3
  • Gideon Avigad
    • 3
  • Carlos A. Coello Coello
    • 2
  • Oliver Schütze
    • 2
  1. 1.Mathematics DepartmentESFM-IPN, Edif. 9 UPALMMexico CityMexico
  2. 2.Computer Science DepartmentCINVESTAV-IPNMexico CityMexico
  3. 3.School of EngineeringORT BraudeKarmielIsrael

Personalised recommendations